2023-12-16T19:53:37.269 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T19:53:37.269 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733 --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/orig.config.yaml 2023-12-16T19:53:37.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:53:37.410 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733 branch: wip-yuri8-testing-2023-12-15-0911 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7494733' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri8-testing-2023-12-15-0911 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2023-12-15-0911 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2960 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2023-12-15-0911 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8v1Jgn/nZVH/N5Qz9KuKdh34aRS5qOo9LGdTBj0EwZ6eJgxWCJwIRWEFKEh2W+FDyukpTHxc0eSn8X7QZa1Sw= smithi141.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLiKQTDHBYEzKcxypmORXCjwT2fuHh1L/8O+SG5MMQZC5GJMddrFWo9/G2oTfLKMMzTXxOurIl/wZ+ABfXw5nS0= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_15:45:14 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-16T19:53:37.410 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa; will attempt to use it 2023-12-16T19:53:37.411 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks 2023-12-16T19:53:37.411 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T19:53:37.412 INFO:teuthology.task.internal:Checking packages... 2023-12-16T19:53:37.438 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c7586e95519b7be76f3b6e3a4b333888baf46bc9' 2023-12-16T19:53:37.438 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T19:53:37.438 INFO:teuthology.packaging:ref: None 2023-12-16T19:53:37.438 INFO:teuthology.packaging:tag: None 2023-12-16T19:53:37.438 INFO:teuthology.packaging:branch: wip-yuri8-testing-2023-12-15-0911 2023-12-16T19:53:37.438 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T19:53:37.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri8-testing-2023-12-15-0911 2023-12-16T19:53:37.660 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-202.gc7586e95 2023-12-16T19:53:37.661 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T19:53:37.667 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T19:53:37.668 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T19:53:37.681 INFO:teuthology.task.internal:Saving configuration 2023-12-16T19:53:37.700 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T19:53:37.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T19:53:37.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:48:44.654635', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8v1Jgn/nZVH/N5Qz9KuKdh34aRS5qOo9LGdTBj0EwZ6eJgxWCJwIRWEFKEh2W+FDyukpTHxc0eSn8X7QZa1Sw='} 2023-12-16T19:53:37.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:48:44.652601', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLiKQTDHBYEzKcxypmORXCjwT2fuHh1L/8O+SG5MMQZC5GJMddrFWo9/G2oTfLKMMzTXxOurIl/wZ+ABfXw5nS0='} 2023-12-16T19:53:37.757 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T19:53:37.763 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-16T19:53:37.764 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-16T19:53:37.764 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T19:53:37.839 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff02eda5f70>, signals=[15]) 2023-12-16T19:53:37.839 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T19:53:37.846 INFO:teuthology.task.internal:Opening connections... 2023-12-16T19:53:37.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T19:53:37.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:53:37.950 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi141.front.sepia.ceph.com 2023-12-16T19:53:37.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:53:38.036 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T19:53:38.042 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-12-16T19:53:38.059 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-12-16T19:53:38.060 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:53:38.117 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:53:38.118 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:53:38.118 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:53:38.118 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:53:38.118 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-16T19:53:38.144 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-12-16T19:53:38.162 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-12-16T19:53:38.162 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-16T19:53:38.218 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-12-16T19:53:38.218 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-12-16T19:53:38.218 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-12-16T19:53:38.218 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:53:38.218 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:53:38.219 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:53:38.219 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-16T19:53:38.245 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T19:53:38.254 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T19:53:38.262 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T19:53:38.262 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2023-12-16T19:53:38.265 DEBUG:teuthology.orchestra.run.smithi141:> test '!' -e /home/ubuntu/cephtest 2023-12-16T19:53:38.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T19:53:38.285 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T19:53:38.285 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2023-12-16T19:53:38.321 DEBUG:teuthology.orchestra.run.smithi141:> test -z $(ls -A /var/lib/ceph) 2023-12-16T19:53:38.345 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T19:53:38.402 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T19:53:38.416 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T19:53:38.416 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T19:53:38.417 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T19:53:38.417 DEBUG:teuthology.orchestra.run.smithi141:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T19:53:38.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T19:53:38.432 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-12-16T19:53:38.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T19:53:38.433 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-12-16T19:53:38.487 INFO:teuthology.orchestra.run.smithi141.stdout:5.14.0-361.el9.x86_64 2023-12-16T19:53:38.487 INFO:teuthology.task.kernel:Running kernel on smithi141: 5.14.0-361.el9.x86_64 2023-12-16T19:53:38.487 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum install -y kernel 2023-12-16T19:53:38.492 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-361.el9.x86_64 2023-12-16T19:53:38.492 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-361.el9.x86_64 2023-12-16T19:53:38.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2023-12-16T19:53:40.542 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-16T19:53:40.618 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-16T19:53:41.892 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-12-16T19:53:42.002 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-12-16T19:53:43.687 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-12-16T19:53:45.357 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 7.9 MB 00:03 2023-12-16T19:53:45.477 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 26 MB/s | 18 MB 00:00 2023-12-16T19:53:48.791 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 18 MB 00:02 2023-12-16T19:53:50.406 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.8 MB 00:01 2023-12-16T19:53:51.962 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-12-16T19:53:53.555 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-16T19:53:55.033 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 5.8 MB 00:02 2023-12-16T19:53:56.509 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2023-12-16T19:53:58.177 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-16T19:53:58.447 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-16T19:54:00.653 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T19:54:00.654 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T19:54:00.738 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T19:54:00.743 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2023-12-16T19:54:00.744 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:00.745 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 96 M 2023-12-16T19:54:00.745 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 121 M 2023-12-16T19:54:00.745 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T19:54:01.065 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 20 MB/s | 5.6 MB 00:00 2023-12-16T19:54:01.407 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-12-16T19:54:01.799 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 44 MB/s | 32 MB 00:00 2023-12-16T19:54:02.216 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 27 MB/s | 38 MB 00:01 2023-12-16T19:54:02.216 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T19:54:02.216 INFO:teuthology.orchestra.run.smithi038.stdout:Total 65 MB/s | 96 MB 00:01 2023-12-16T19:54:02.876 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2023-12-16T19:54:03.112 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T19:54:03.558 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T19:54:03.558 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T19:54:04.929 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T19:54:04.929 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T19:54:04.975 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T19:54:04.975 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T19:54:05.062 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T19:54:05.073 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: Package Architecture Version Repository Size 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T19:54:05.074 INFO:teuthology.orchestra.run.smithi141.stdout:Install 4 Packages 2023-12-16T19:54:05.075 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:05.075 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 96 M 2023-12-16T19:54:05.075 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 121 M 2023-12-16T19:54:05.075 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T19:54:05.953 INFO:teuthology.orchestra.run.smithi141.stdout:(1/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 45 MB/s | 38 MB 00:00 2023-12-16T19:54:06.061 INFO:teuthology.orchestra.run.smithi141.stdout:(2/4): kernel-5.14.0-391.el9.x86_64.rpm 5.9 MB/s | 5.6 MB 00:00 2023-12-16T19:54:06.553 INFO:teuthology.orchestra.run.smithi141.stdout:(3/4): kernel-core-5.14.0-391.el9.x86_64.rpm 14 MB/s | 20 MB 00:01 2023-12-16T19:54:07.562 INFO:teuthology.orchestra.run.smithi141.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 20 MB/s | 32 MB 00:01 2023-12-16T19:54:07.562 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T19:54:07.562 INFO:teuthology.orchestra.run.smithi141.stdout:Total 39 MB/s | 96 MB 00:02 2023-12-16T19:54:07.741 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T19:54:08.413 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T19:54:08.421 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T19:54:08.543 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:08.795 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T19:54:08.795 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T19:54:10.106 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T19:54:10.106 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T19:54:11.435 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:11.632 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:13.034 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T19:54:13.697 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T19:54:13.828 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:16.568 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:16.750 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:16.764 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:21.351 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:21.471 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:21.761 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:26.090 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:52.465 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:52.511 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T19:54:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:53.388 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:53.389 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T19:54:53.861 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T19:54:54.005 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:54.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T19:54:54.006 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T19:54:54.006 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T19:54:54.006 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T19:54:54.006 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-16T19:54:54.006 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T19:54:54.006 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T19:54:54.130 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:54.131 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T19:54:54.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 68.el9 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2023-12-16T19:54:54.169 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8264254 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T19:54:54.170 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2023-12-16T19:54:54.171 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T19:54:54.171 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T19:54:54.172 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T19:54:54.172 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-391.el9.x86_64 2023-12-16T19:54:54.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T19:54:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2023-12-16T19:54:54.940 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:54.983 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:55.411 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:55.412 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T19:54:55.412 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T19:54:55.412 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:55.830 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T19:54:56.263 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T19:54:56.281 INFO:teuthology.orchestra.run.smithi038.stderr:done 2023-12-16T19:54:56.282 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-12-16T19:54:56.298 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.wDR4ZMAoBo 2023-12-16T19:54:56.298 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wDR4ZMAoBo 2023-12-16T19:54:56.304 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T19:54:56.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.wDR4ZMAoBo 2023-12-16T19:54:56.447 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:56.447 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T19:54:56.447 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T19:54:56.448 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T19:54:56.448 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T19:54:56.448 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-16T19:54:56.448 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi141.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T19:54:56.448 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T19:54:56.513 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.wDR4ZMAoBo is 6KB 2023-12-16T19:54:56.561 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.wDR4ZMAoBo 2023-12-16T19:54:56.565 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T19:54:56.565 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T19:54:56.566 DEBUG:teuthology.orchestra.run.smithi141:> sudo rpm -qi grub2-tools 2023-12-16T19:54:56.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T19:54:56.604 INFO:teuthology.orchestra.run.smithi141.stdout:Name : grub2-tools 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Epoch : 1 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Version : 2.06 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Release : 68.el9 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Architecture: x86_64 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Group : Unspecified 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Size : 8264254 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:License : GPLv3+ 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Packager : builder@centos.org 2023-12-16T19:54:56.605 INFO:teuthology.orchestra.run.smithi141.stdout:Vendor : CentOS 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:Summary : Support tools for GRUB. 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:Description : 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:hardware devices. 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T19:54:56.606 INFO:teuthology.orchestra.run.smithi141.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T19:54:56.607 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T19:54:56.607 INFO:teuthology.task.kernel:Updating grub on smithi141 to boot 5.14.0-391.el9.x86_64 2023-12-16T19:54:56.607 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T19:54:56.648 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T19:54:56.649 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T19:54:56.649 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T19:54:56.649 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T19:54:56.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T19:54:56.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2023-12-16T19:54:57.274 INFO:teuthology.orchestra.run.smithi141.stderr:Generating grub configuration file ... 2023-12-16T19:54:58.654 INFO:teuthology.orchestra.run.smithi141.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T19:54:58.684 INFO:teuthology.orchestra.run.smithi141.stderr:done 2023-12-16T19:54:58.687 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-12-16T19:54:58.702 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.CfT6ROJpws 2023-12-16T19:54:58.702 DEBUG:teuthology.orchestra.run.smithi141:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CfT6ROJpws 2023-12-16T19:54:58.771 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.CfT6ROJpws 2023-12-16T19:54:58.911 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.CfT6ROJpws is 6KB 2023-12-16T19:54:58.958 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.CfT6ROJpws 2023-12-16T19:54:58.972 DEBUG:teuthology.orchestra.run.smithi141:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T19:54:59.038 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T19:54:59.038 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T19:54:59.038 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T19:54:59.038 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T19:54:59.039 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T19:54:59.210 DEBUG:teuthology.orchestra.run.smithi141:> sudo shutdown -r now 2023-12-16T19:55:26.837 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-16T19:55:26.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T19:55:26.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:55:29.213 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-16T19:55:29.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T19:55:29.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:56:26.898 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T19:56:29.217 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T19:56:35.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T19:56:35.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:56:38.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T19:56:38.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:56:38.494 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-12-16T19:56:38.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T19:56:38.912 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-391.el9.x86_64"... 2023-12-16T19:56:38.913 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-12-16T19:56:38.926 INFO:teuthology.orchestra.run.smithi141.stdout:5.14.0-391.el9.x86_64 2023-12-16T19:56:38.926 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T19:56:38.926 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T19:56:38.927 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T19:56:39.323 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-16T19:56:39.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T19:56:39.804 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-391.el9.x86_64"... 2023-12-16T19:56:39.804 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-12-16T19:56:39.819 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-391.el9.x86_64 2023-12-16T19:56:39.819 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T19:56:39.819 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T19:56:39.819 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T19:56:39.927 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-16T19:56:39.927 DEBUG:teuthology.orchestra.run.smithi141:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T19:56:39.988 INFO:teuthology.orchestra.run.smithi141.stdout:ttyS1 2023-12-16T19:56:40.032 DEBUG:teuthology.parallel:result is None 2023-12-16T19:56:40.820 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-16T19:56:40.821 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T19:56:40.912 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2023-12-16T19:56:40.956 DEBUG:teuthology.parallel:result is None 2023-12-16T19:56:40.957 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T19:56:40.973 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T19:56:40.973 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T19:56:40.976 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T19:56:40.990 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T19:56:40.997 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T19:56:41.007 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T19:56:41.007 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T19:56:41.033 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T19:56:41.060 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T19:56:41.071 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T19:56:41.071 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T19:56:41.090 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T19:56:41.121 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T19:56:41.121 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T19:56:41.134 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T19:56:41.137 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T19:56:41.139 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T19:56:41.165 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T19:56:41.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T19:56:41.181 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T19:56:41.210 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T19:56:41.219 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T19:56:41.219 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T19:56:41.253 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T19:56:41.267 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T19:56:41.348 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T19:56:41.419 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T19:56:41.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T19:56:41.507 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T19:56:41.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T19:56:41.579 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T19:56:41.618 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T19:56:41.670 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T19:56:41.748 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T19:56:41.793 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T19:56:41.793 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T19:56:41.859 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2023-12-16T19:56:41.861 DEBUG:teuthology.orchestra.run.smithi141:> sudo service rsyslog restart 2023-12-16T19:56:41.911 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T19:56:41.976 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T19:56:42.181 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T19:56:42.189 INFO:teuthology.task.internal:Starting timer... 2023-12-16T19:56:42.189 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T19:56:42.202 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T19:56:42.213 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-16T19:56:42.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2023-12-16T19:56:42.270 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2023-12-16T19:56:42.272 DEBUG:teuthology.orchestra.run.smithi141:> sudo service auditd rotate 2023-12-16T19:56:42.371 INFO:teuthology.orchestra.run.smithi141.stdout:Rotating logs: 2023-12-16T19:56:42.377 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T19:56:42.378 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2023-12-16T19:56:42.393 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2023-12-16T19:56:42.393 DEBUG:teuthology.orchestra.run.smithi141:> /usr/sbin/getenforce 2023-12-16T19:56:42.434 INFO:teuthology.orchestra.run.smithi141.stdout:Permissive 2023-12-16T19:56:42.434 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi141.front.sepia.ceph.com': 'permissive'} 2023-12-16T19:56:42.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T19:56:42.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T19:56:42.467 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T19:56:42.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T19:56:42.520 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T19:56:42.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2023-12-16T19:56:42.556 DEBUG:teuthology.orchestra.run.smithi141:> sudo /usr/sbin/setenforce permissive 2023-12-16T19:56:42.778 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T19:56:42.788 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-16T19:56:42.788 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T19:56:42.805 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T19:56:42.806 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi141.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T20:02:25.190 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi141.front.sepia.ceph.com')] 2023-12-16T20:02:25.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T20:02:25.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:02:25.291 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-16T20:02:25.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T20:02:25.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T20:02:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:02:25.444 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-12-16T20:02:25.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T20:02:25.517 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T20:02:25.527 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T20:02:25.527 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T20:02:25.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:02:25.530 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T20:02:25.530 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:02:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T20:02:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T20:02:25.587 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T20:02:25.603 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T20:02:25.622 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2023-12-16T20:02:25.632 INFO:teuthology.orchestra.run.smithi141.stderr:sudo: ntpd: command not found 2023-12-16T20:02:25.639 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2023-12-16T20:02:25.645 INFO:teuthology.orchestra.run.smithi141.stdout:506 Cannot talk to daemon 2023-12-16T20:02:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T20:02:25.662 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T20:02:25.678 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T20:02:25.679 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T20:02:25.720 INFO:teuthology.orchestra.run.smithi141.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.723 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.726 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.730 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:02:25.731 INFO:teuthology.run_tasks:Running task install... 2023-12-16T20:02:25.739 DEBUG:teuthology.task.install:project ceph 2023-12-16T20:02:25.739 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}} 2023-12-16T20:02:25.739 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'} 2023-12-16T20:02:25.739 INFO:teuthology.task.install:Using flavor: default 2023-12-16T20:02:25.745 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T20:02:25.745 INFO:teuthology.task.install:extra packages: [] 2023-12-16T20:02:25.746 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'tag': None, 'wait_for_package': False} 2023-12-16T20:02:25.746 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:02:25.746 INFO:teuthology.packaging:ref: None 2023-12-16T20:02:25.746 INFO:teuthology.packaging:tag: None 2023-12-16T20:02:25.746 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:02:25.746 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:02:25.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2023-12-16T20:02:25.749 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'tag': None, 'wait_for_package': False} 2023-12-16T20:02:25.749 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:02:25.749 INFO:teuthology.packaging:ref: None 2023-12-16T20:02:25.749 INFO:teuthology.packaging:tag: None 2023-12-16T20:02:25.749 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:02:25.749 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:02:25.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2023-12-16T20:02:26.057 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/ 2023-12-16T20:02:26.057 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T20:02:26.071 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/ 2023-12-16T20:02:26.071 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T20:02:26.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T20:02:26.182 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:02:26.182 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T20:02:26.211 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T20:02:26.211 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:02:26.212 INFO:teuthology.packaging:ref: None 2023-12-16T20:02:26.212 INFO:teuthology.packaging:tag: None 2023-12-16T20:02:26.212 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:02:26.212 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:02:26.212 DEBUG:teuthology.orchestra.run.smithi141:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T20:02:26.230 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T20:02:26.231 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:02:26.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T20:02:26.264 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T20:02:26.264 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:02:26.264 INFO:teuthology.packaging:ref: None 2023-12-16T20:02:26.264 INFO:teuthology.packaging:tag: None 2023-12-16T20:02:26.265 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:02:26.265 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:02:26.265 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T20:02:26.280 DEBUG:teuthology.orchestra.run.smithi141:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T20:02:26.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T20:02:26.360 DEBUG:teuthology.orchestra.run.smithi141:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T20:02:26.426 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T20:02:26.427 INFO:teuthology.orchestra.run.smithi141.stdout:check_obsoletes = 1 2023-12-16T20:02:26.428 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum clean all 2023-12-16T20:02:26.457 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2023-12-16T20:02:26.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2023-12-16T20:02:26.679 INFO:teuthology.orchestra.run.smithi141.stdout:73 files removed 2023-12-16T20:02:26.705 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-radosgw 2023-12-16T20:02:26.715 INFO:teuthology.orchestra.run.smithi038.stdout:73 files removed 2023-12-16T20:02:26.743 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw 2023-12-16T20:02:27.697 INFO:teuthology.orchestra.run.smithi141.stdout:ceph packages for x86_64 115 kB/s | 77 kB 00:00 2023-12-16T20:02:27.891 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 95 kB/s | 77 kB 00:00 2023-12-16T20:02:28.264 INFO:teuthology.orchestra.run.smithi141.stdout:ceph noarch packages 18 kB/s | 9.1 kB 00:00 2023-12-16T20:02:28.408 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 20 kB/s | 9.1 kB 00:00 2023-12-16T20:02:28.715 INFO:teuthology.orchestra.run.smithi141.stdout:ceph source packages 4.4 kB/s | 1.8 kB 00:00 2023-12-16T20:02:28.825 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 4.7 kB/s | 1.8 kB 00:00 2023-12-16T20:02:29.100 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-16T20:02:29.214 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-16T20:02:30.570 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-12-16T20:02:30.576 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-12-16T20:02:32.519 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 7.9 MB 00:01 2023-12-16T20:02:33.950 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 7.9 MB 00:03 2023-12-16T20:02:36.684 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-16T20:02:39.103 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 18 MB 00:05 2023-12-16T20:02:40.509 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-16T20:02:41.861 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2023-12-16T20:02:43.078 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-16T20:02:44.081 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 20 MB 00:02 2023-12-16T20:02:44.446 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 15 kB 00:00 2023-12-16T20:02:46.192 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-16T20:02:48.828 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 10 kB/s | 1.7 kB 00:00 2023-12-16T20:02:51.056 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-16T20:02:51.295 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:02:51.304 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 14 M 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrading: 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 3.1 M 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.9 M 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 5.0 M 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 23 M 2023-12-16T20:02:51.305 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 24 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 636 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 458 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 4.9 M 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 45 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 116 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 156 k 2023-12-16T20:02:51.306 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 320 k 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 292 k 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 99 k 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout:Install 22 Packages 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrade 2 Packages 2023-12-16T20:02:51.307 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:02:51.308 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 58 M 2023-12-16T20:02:51.308 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:02:52.554 INFO:teuthology.orchestra.run.smithi141.stdout:(1/24): ceph-radosgw-17.2.7-125.g1f2f5510.el9.x 13 MB/s | 14 MB 00:01 2023-12-16T20:02:52.604 INFO:teuthology.orchestra.run.smithi141.stdout:(2/24): ceph-selinux-17.2.7-125.g1f2f5510.el9.x 485 kB/s | 24 kB 00:00 2023-12-16T20:02:52.688 INFO:teuthology.orchestra.run.smithi141.stdout:(3/24): libcephfs2-17.2.7-125.g1f2f5510.el9.x86 7.5 MB/s | 636 kB 00:00 2023-12-16T20:02:52.755 INFO:teuthology.orchestra.run.smithi141.stdout:(4/24): libradosstriper1-17.2.7-125.g1f2f5510.e 6.7 MB/s | 458 kB 00:00 2023-12-16T20:02:53.088 INFO:teuthology.orchestra.run.smithi141.stdout:(5/24): librgw2-17.2.7-125.g1f2f5510.el9.x86_64 15 MB/s | 4.9 MB 00:00 2023-12-16T20:02:53.130 INFO:teuthology.orchestra.run.smithi141.stdout:(6/24): python3-ceph-argparse-17.2.7-125.g1f2f5 1.1 MB/s | 45 kB 00:00 2023-12-16T20:02:53.181 INFO:teuthology.orchestra.run.smithi141.stdout:(7/24): python3-ceph-common-17.2.7-125.g1f2f551 2.3 MB/s | 116 kB 00:00 2023-12-16T20:02:53.256 INFO:teuthology.orchestra.run.smithi141.stdout:(8/24): ceph-base-17.2.7-125.g1f2f5510.el9.x86_ 2.8 MB/s | 5.0 MB 00:01 2023-12-16T20:02:53.281 INFO:teuthology.orchestra.run.smithi141.stdout:(9/24): python3-cephfs-17.2.7-125.g1f2f5510.el9 1.5 MB/s | 156 kB 00:00 2023-12-16T20:02:53.323 INFO:teuthology.orchestra.run.smithi141.stdout:(10/24): python3-rados-17.2.7-125.g1f2f5510.el9 4.7 MB/s | 320 kB 00:00 2023-12-16T20:02:53.349 INFO:teuthology.orchestra.run.smithi141.stdout:(11/24): python3-rbd-17.2.7-125.g1f2f5510.el9.x 4.3 MB/s | 292 kB 00:00 2023-12-16T20:02:53.390 INFO:teuthology.orchestra.run.smithi141.stdout:(12/24): python3-rgw-17.2.7-125.g1f2f5510.el9.x 1.4 MB/s | 99 kB 00:00 2023-12-16T20:02:53.507 INFO:teuthology.orchestra.run.smithi141.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 379 kB/s | 44 kB 00:00 2023-12-16T20:02:53.532 INFO:teuthology.orchestra.run.smithi141.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 867 kB/s | 159 kB 00:00 2023-12-16T20:02:53.583 INFO:teuthology.orchestra.run.smithi141.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-12-16T20:02:53.600 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:02:53.608 INFO:teuthology.orchestra.run.smithi141.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 14 M 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 3.1 M 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.9 M 2023-12-16T20:02:53.614 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 5.0 M 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 23 M 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 24 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 636 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 458 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 4.9 M 2023-12-16T20:02:53.615 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 45 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 116 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 156 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 320 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 292 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 99 k 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout:Install 22 Packages 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2023-12-16T20:02:53.616 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:02:53.617 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 58 M 2023-12-16T20:02:53.617 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:02:53.633 INFO:teuthology.orchestra.run.smithi141.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2023-12-16T20:02:53.792 INFO:teuthology.orchestra.run.smithi141.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 306 kB/s | 49 kB 00:00 2023-12-16T20:02:53.851 INFO:teuthology.orchestra.run.smithi141.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-12-16T20:02:53.884 INFO:teuthology.orchestra.run.smithi141.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2023-12-16T20:02:54.102 INFO:teuthology.orchestra.run.smithi141.stdout:(21/24): ceph-common-17.2.7-125.g1f2f5510.el9.x 8.6 MB/s | 23 MB 00:02 2023-12-16T20:02:54.360 INFO:teuthology.orchestra.run.smithi141.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2023-12-16T20:02:54.802 INFO:teuthology.orchestra.run.smithi141.stdout:(23/24): librbd1-17.2.7-125.g1f2f5510.el9.x86_6 4.2 MB/s | 2.9 MB 00:00 2023-12-16T20:02:55.052 INFO:teuthology.orchestra.run.smithi141.stdout:(24/24): librados2-17.2.7-125.g1f2f5510.el9.x86 2.6 MB/s | 3.1 MB 00:01 2023-12-16T20:02:55.058 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:02:55.059 INFO:teuthology.orchestra.run.smithi141.stdout:Total 15 MB/s | 58 MB 00:03 2023-12-16T20:02:55.059 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:02:55.082 INFO:teuthology.orchestra.run.smithi038.stdout:(1/24): ceph-base-17.2.7-125.g1f2f5510.el9.x86_ 3.6 MB/s | 5.0 MB 00:01 2023-12-16T20:02:55.091 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:02:55.092 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:02:55.133 INFO:teuthology.orchestra.run.smithi038.stdout:(2/24): ceph-selinux-17.2.7-125.g1f2f5510.el9.x 482 kB/s | 24 kB 00:00 2023-12-16T20:02:55.358 INFO:teuthology.orchestra.run.smithi038.stdout:(3/24): ceph-common-17.2.7-125.g1f2f5510.el9.x8 13 MB/s | 23 MB 00:01 2023-12-16T20:02:55.392 INFO:teuthology.orchestra.run.smithi038.stdout:(4/24): libcephfs2-17.2.7-125.g1f2f5510.el9.x86 2.4 MB/s | 636 kB 00:00 2023-12-16T20:02:55.425 INFO:teuthology.orchestra.run.smithi038.stdout:(5/24): libradosstriper1-17.2.7-125.g1f2f5510.e 6.7 MB/s | 458 kB 00:00 2023-12-16T20:02:55.467 INFO:teuthology.orchestra.run.smithi038.stdout:(6/24): python3-ceph-argparse-17.2.7-125.g1f2f5 1.1 MB/s | 45 kB 00:00 2023-12-16T20:02:55.517 INFO:teuthology.orchestra.run.smithi038.stdout:(7/24): python3-ceph-common-17.2.7-125.g1f2f551 2.3 MB/s | 116 kB 00:00 2023-12-16T20:02:55.553 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:02:55.553 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:02:55.568 INFO:teuthology.orchestra.run.smithi038.stdout:(8/24): python3-cephfs-17.2.7-125.g1f2f5510.el9 3.0 MB/s | 156 kB 00:00 2023-12-16T20:02:55.626 INFO:teuthology.orchestra.run.smithi038.stdout:(9/24): python3-rados-17.2.7-125.g1f2f5510.el9. 5.4 MB/s | 320 kB 00:00 2023-12-16T20:02:55.677 INFO:teuthology.orchestra.run.smithi038.stdout:(10/24): python3-rbd-17.2.7-125.g1f2f5510.el9.x 5.7 MB/s | 292 kB 00:00 2023-12-16T20:02:55.727 INFO:teuthology.orchestra.run.smithi038.stdout:(11/24): python3-rgw-17.2.7-125.g1f2f5510.el9.x 2.0 MB/s | 99 kB 00:00 2023-12-16T20:02:55.827 INFO:teuthology.orchestra.run.smithi038.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2023-12-16T20:02:55.852 INFO:teuthology.orchestra.run.smithi038.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-16T20:02:55.911 INFO:teuthology.orchestra.run.smithi038.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-16T20:02:55.944 INFO:teuthology.orchestra.run.smithi038.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-12-16T20:02:56.012 INFO:teuthology.orchestra.run.smithi038.stdout:(16/24): librgw2-17.2.7-125.g1f2f5510.el9.x86_6 7.9 MB/s | 4.9 MB 00:00 2023-12-16T20:02:56.028 INFO:teuthology.orchestra.run.smithi038.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 491 kB/s | 41 kB 00:00 2023-12-16T20:02:56.487 INFO:teuthology.orchestra.run.smithi038.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 106 kB/s | 49 kB 00:00 2023-12-16T20:02:56.662 INFO:teuthology.orchestra.run.smithi038.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 475 kB/s | 309 kB 00:00 2023-12-16T20:02:56.679 INFO:teuthology.orchestra.run.smithi038.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2023-12-16T20:02:56.788 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:02:56.971 INFO:teuthology.orchestra.run.smithi038.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2023-12-16T20:02:57.072 INFO:teuthology.orchestra.run.smithi038.stdout:(22/24): librados2-17.2.7-125.g1f2f5510.el9.x86 7.8 MB/s | 3.1 MB 00:00 2023-12-16T20:02:57.127 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2023-12-16T20:02:57.185 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:02:57.259 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:02:57.263 INFO:teuthology.orchestra.run.smithi038.stdout:(23/24): librbd1-17.2.7-125.g1f2f5510.el9.x86_6 10 MB/s | 2.9 MB 00:00 2023-12-16T20:02:57.347 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 3/26 2023-12-16T20:02:57.378 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:02:57.450 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:02:57.498 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2023-12-16T20:02:57.524 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2023-12-16T20:02:57.722 INFO:teuthology.orchestra.run.smithi038.stdout:(24/24): ceph-radosgw-17.2.7-125.g1f2f5510.el9. 3.5 MB/s | 14 MB 00:04 2023-12-16T20:02:57.728 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:02:57.728 INFO:teuthology.orchestra.run.smithi038.stdout:Total 14 MB/s | 58 MB 00:04 2023-12-16T20:02:57.728 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:02:57.766 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:02:57.766 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:02:57.967 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2023-12-16T20:02:58.001 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 8/26 2023-12-16T20:02:58.060 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 8/26 2023-12-16T20:02:58.089 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2023-12-16T20:02:58.136 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x 10/26 2023-12-16T20:02:58.177 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 11/26 2023-12-16T20:02:58.239 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 12/26 2023-12-16T20:02:58.243 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:02:58.243 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:02:58.267 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:02:58.315 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:02:58.356 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2023-12-16T20:02:58.392 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2023-12-16T20:02:58.424 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2023-12-16T20:02:58.719 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2023-12-16T20:02:58.754 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 18/26 2023-12-16T20:02:58.844 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 18/26 2023-12-16T20:02:58.917 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 19/26 2023-12-16T20:02:58.940 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86 20/26 2023-12-16T20:02:59.521 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:02:59.877 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2023-12-16T20:02:59.933 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:03:00.026 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:03:00.107 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 3/26 2023-12-16T20:03:00.134 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:03:00.224 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:03:00.273 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2023-12-16T20:03:00.328 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2023-12-16T20:03:00.797 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2023-12-16T20:03:00.821 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 8/26 2023-12-16T20:03:00.892 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 8/26 2023-12-16T20:03:00.920 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2023-12-16T20:03:00.970 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x 10/26 2023-12-16T20:03:01.001 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 11/26 2023-12-16T20:03:01.065 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 12/26 2023-12-16T20:03:01.099 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:03:01.164 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:03:01.205 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2023-12-16T20:03:01.240 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2023-12-16T20:03:01.273 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2023-12-16T20:03:01.293 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:01.332 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:01.582 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2023-12-16T20:03:01.611 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 18/26 2023-12-16T20:03:01.702 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 18/26 2023-12-16T20:03:01.777 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 19/26 2023-12-16T20:03:01.807 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86 20/26 2023-12-16T20:03:01.862 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:01.894 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 22/26 2023-12-16T20:03:01.979 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 22/26 2023-12-16T20:03:01.980 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T20:03:01.980 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T20:03:01.980 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:02.011 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:04.333 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 21/26 2023-12-16T20:03:04.959 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 22/26 2023-12-16T20:03:05.046 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 22/26 2023-12-16T20:03:05.047 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T20:03:05.047 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T20:03:05.047 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:05.085 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /sys 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /proc 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /mnt 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /var/tmp 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /home 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /root 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /tmp 2023-12-16T20:03:11.580 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:12.854 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 24/26 2023-12-16T20:03:12.915 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 24/26 2023-12-16T20:03:12.915 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:12.915 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T20:03:12.916 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:03:12.916 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:03:12.916 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:12.917 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2023-12-16T20:03:13.007 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2023-12-16T20:03:13.008 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:14.180 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 1/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 3/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 5/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 6/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 7/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x 8/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86 9/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 10/26 2023-12-16T20:03:14.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 11/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 12/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2023-12-16T20:03:14.182 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 25/26 2023-12-16T20:03:15.119 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:15.119 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout:Upgraded: 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T20:03:15.120 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:15.121 INFO:teuthology.orchestra.run.smithi141.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T20:03:15.122 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:15.122 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2023-12-16T20:03:15.272 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2023-12-16T20:03:15.273 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2023-12-16T20:03:15.273 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:15.456 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-test 2023-12-16T20:03:16.013 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:28 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:16.165 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 48 M 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 159 k 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T20:03:16.166 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout:Install 6 Packages 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 49 M 2023-12-16T20:03:16.167 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 195 M 2023-12-16T20:03:16.168 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:16.311 INFO:teuthology.orchestra.run.smithi141.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 186 kB 00:00 2023-12-16T20:03:16.353 INFO:teuthology.orchestra.run.smithi141.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-16T20:03:16.411 INFO:teuthology.orchestra.run.smithi141.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2023-12-16T20:03:16.454 INFO:teuthology.orchestra.run.smithi141.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-16T20:03:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 24/26 2023-12-16T20:03:16.604 INFO:teuthology.orchestra.run.smithi141.stdout:(5/6): libcephsqlite-17.2.7-125.g1f2f5510.el9.x 364 kB/s | 159 kB 00:00 2023-12-16T20:03:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 24/26 2023-12-16T20:03:16.648 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:16.648 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T20:03:16.648 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:03:16.649 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:03:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2023-12-16T20:03:16.747 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2023-12-16T20:03:16.748 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 1/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 3/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 4/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 5/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 6/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 7/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x 8/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86 9/26 2023-12-16T20:03:17.970 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 10/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 11/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 12/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 13/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 23/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2023-12-16T20:03:17.971 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 25/26 2023-12-16T20:03:18.787 INFO:teuthology.orchestra.run.smithi141.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el9.x86_6 18 MB/s | 48 MB 00:02 2023-12-16T20:03:18.790 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:18.790 INFO:teuthology.orchestra.run.smithi141.stdout:Total 19 MB/s | 49 MB 00:02 2023-12-16T20:03:18.791 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:18.810 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:18.810 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:18.951 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.952 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:18.954 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T20:03:18.954 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:18.954 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:19.197 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:19.197 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:19.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test 2023-12-16T20:03:19.768 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:19.843 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-16T20:03:19.865 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:28 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:19.886 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-16T20:03:19.920 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-16T20:03:19.962 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-16T20:03:19.990 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 5/6 2023-12-16T20:03:20.016 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 48 M 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 159 k 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T20:03:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 49 M 2023-12-16T20:03:20.018 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 195 M 2023-12-16T20:03:20.019 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:20.166 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2023-12-16T20:03:20.208 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-16T20:03:20.242 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 8.7 MB/s | 300 kB 00:00 2023-12-16T20:03:20.276 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-16T20:03:20.460 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): libcephsqlite-17.2.7-125.g1f2f5510.el9.x 360 kB/s | 159 kB 00:00 2023-12-16T20:03:22.343 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el9.x86_6 21 MB/s | 48 MB 00:02 2023-12-16T20:03:22.346 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:22.346 INFO:teuthology.orchestra.run.smithi038.stdout:Total 21 MB/s | 49 MB 00:02 2023-12-16T20:03:22.346 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:22.368 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:22.369 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:22.777 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:22.778 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:23.425 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:23.503 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-16T20:03:23.545 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-16T20:03:23.576 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-16T20:03:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-16T20:03:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 5/6 2023-12-16T20:03:24.436 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 5/6 2023-12-16T20:03:24.505 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 6/6 2023-12-16T20:03:26.749 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 6/6 2023-12-16T20:03:26.749 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 1/6 2023-12-16T20:03:26.749 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 2/6 2023-12-16T20:03:26.749 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-16T20:03:26.749 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-16T20:03:26.750 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-16T20:03:27.143 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-16T20:03:27.143 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:27.143 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:27.143 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: jq-1.6-16.el9.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T20:03:27.144 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:27.145 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:27.461 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph 2023-12-16T20:03:28.014 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:40 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:28.166 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:28.168 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================== 2023-12-16T20:03:28.168 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:28.168 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================== 2023-12-16T20:03:28.168 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 6.5 k 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.1 M 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 1.4 M 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 238 k 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 3.7 M 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 15 M 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T20:03:28.169 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T20:03:28.170 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T20:03:28.171 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T20:03:28.172 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:28.173 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:28.173 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================== 2023-12-16T20:03:28.173 INFO:teuthology.orchestra.run.smithi141.stdout:Install 33 Packages 2023-12-16T20:03:28.173 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:28.174 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 27 M 2023-12-16T20:03:28.174 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 99 M 2023-12-16T20:03:28.174 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:28.297 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 5/6 2023-12-16T20:03:28.372 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 6/6 2023-12-16T20:03:28.773 INFO:teuthology.orchestra.run.smithi141.stdout:(1/33): ceph-17.2.7-125.g1f2f5510.el9.x86_64.rp 28 kB/s | 6.5 kB 00:00 2023-12-16T20:03:28.915 INFO:teuthology.orchestra.run.smithi141.stdout:(2/33): ceph-mds-17.2.7-125.g1f2f5510.el9.x86_6 5.5 MB/s | 2.1 MB 00:00 2023-12-16T20:03:28.949 INFO:teuthology.orchestra.run.smithi141.stdout:(3/33): ceph-mgr-17.2.7-125.g1f2f5510.el9.x86_6 3.4 MB/s | 1.4 MB 00:00 2023-12-16T20:03:29.049 INFO:teuthology.orchestra.run.smithi141.stdout:(4/33): ceph-mgr-modules-core-17.2.7-125.g1f2f5 2.3 MB/s | 238 kB 00:00 2023-12-16T20:03:29.149 INFO:teuthology.orchestra.run.smithi141.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-12-16T20:03:29.175 INFO:teuthology.orchestra.run.smithi141.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-12-16T20:03:29.200 INFO:teuthology.orchestra.run.smithi141.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-12-16T20:03:29.225 INFO:teuthology.orchestra.run.smithi141.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-12-16T20:03:29.267 INFO:teuthology.orchestra.run.smithi141.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-16T20:03:29.325 INFO:teuthology.orchestra.run.smithi141.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-16T20:03:29.359 INFO:teuthology.orchestra.run.smithi141.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-16T20:03:29.393 INFO:teuthology.orchestra.run.smithi141.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-16T20:03:29.426 INFO:teuthology.orchestra.run.smithi141.stdout:(13/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-12-16T20:03:29.460 INFO:teuthology.orchestra.run.smithi141.stdout:(14/33): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-12-16T20:03:29.635 INFO:teuthology.orchestra.run.smithi141.stdout:(15/33): ceph-osd-17.2.7-125.g1f2f5510.el9.x86_ 21 MB/s | 15 MB 00:00 2023-12-16T20:03:29.869 INFO:teuthology.orchestra.run.smithi141.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 106 kB/s | 43 kB 00:00 2023-12-16T20:03:30.003 INFO:teuthology.orchestra.run.smithi141.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 500 kB/s | 172 kB 00:00 2023-12-16T20:03:30.028 INFO:teuthology.orchestra.run.smithi141.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2023-12-16T20:03:30.070 INFO:teuthology.orchestra.run.smithi141.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 161 kB/s | 11 kB 00:00 2023-12-16T20:03:30.095 INFO:teuthology.orchestra.run.smithi141.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2023-12-16T20:03:30.145 INFO:teuthology.orchestra.run.smithi141.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2023-12-16T20:03:30.170 INFO:teuthology.orchestra.run.smithi141.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2023-12-16T20:03:30.213 INFO:teuthology.orchestra.run.smithi141.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2023-12-16T20:03:30.238 INFO:teuthology.orchestra.run.smithi141.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 690 kB/s | 46 kB 00:00 2023-12-16T20:03:30.280 INFO:teuthology.orchestra.run.smithi141.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2023-12-16T20:03:30.305 INFO:teuthology.orchestra.run.smithi141.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2023-12-16T20:03:30.339 INFO:teuthology.orchestra.run.smithi141.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2023-12-16T20:03:30.372 INFO:teuthology.orchestra.run.smithi141.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2023-12-16T20:03:30.398 INFO:teuthology.orchestra.run.smithi141.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2023-12-16T20:03:30.440 INFO:teuthology.orchestra.run.smithi141.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2023-12-16T20:03:30.465 INFO:teuthology.orchestra.run.smithi141.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2023-12-16T20:03:30.498 INFO:teuthology.orchestra.run.smithi141.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 343 kB/s | 20 kB 00:00 2023-12-16T20:03:30.557 INFO:teuthology.orchestra.run.smithi141.stdout:(33/33): ceph-mon-17.2.7-125.g1f2f5510.el9.x86_ 2.1 MB/s | 3.7 MB 00:01 2023-12-16T20:03:30.562 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:30.562 INFO:teuthology.orchestra.run.smithi141.stdout:Total 11 MB/s | 27 MB 00:02 2023-12-16T20:03:30.562 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:30.596 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:30.596 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:30.787 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 6/6 2023-12-16T20:03:30.787 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 1/6 2023-12-16T20:03:30.787 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 2/6 2023-12-16T20:03:30.787 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-16T20:03:30.787 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-16T20:03:30.788 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-16T20:03:30.942 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:30.942 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:31.154 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-16T20:03:31.154 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:31.154 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.6-16.el9.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:31.155 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:31.438 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph 2023-12-16T20:03:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:41 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:32.159 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:32.173 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 6.5 k 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.1 M 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 1.4 M 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 238 k 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 3.7 M 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 15 M 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T20:03:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T20:03:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2023-12-16T20:03:32.178 INFO:teuthology.orchestra.run.smithi038.stdout:Install 33 Packages 2023-12-16T20:03:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:32.179 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 27 M 2023-12-16T20:03:32.179 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 99 M 2023-12-16T20:03:32.179 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:32.218 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-12-16T20:03:32.250 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-12-16T20:03:32.283 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-12-16T20:03:32.374 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-12-16T20:03:32.473 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-12-16T20:03:32.523 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-12-16T20:03:32.594 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-12-16T20:03:32.648 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/33 2023-12-16T20:03:32.687 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/33 2023-12-16T20:03:32.694 INFO:teuthology.orchestra.run.smithi038.stdout:(1/33): ceph-17.2.7-125.g1f2f5510.el9.x86_64.rp 39 kB/s | 6.5 kB 00:00 2023-12-16T20:03:32.736 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2023-12-16T20:03:32.800 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2023-12-16T20:03:32.994 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2023-12-16T20:03:33.041 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2023-12-16T20:03:33.062 INFO:teuthology.orchestra.run.smithi038.stdout:(2/33): ceph-mds-17.2.7-125.g1f2f5510.el9.x86_6 3.9 MB/s | 2.1 MB 00:00 2023-12-16T20:03:33.071 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2023-12-16T20:03:33.106 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2023-12-16T20:03:33.136 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2023-12-16T20:03:33.213 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2023-12-16T20:03:33.245 INFO:teuthology.orchestra.run.smithi038.stdout:(3/33): ceph-mgr-17.2.7-125.g1f2f5510.el9.x86_6 2.0 MB/s | 1.4 MB 00:00 2023-12-16T20:03:33.246 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-12-16T20:03:33.280 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2023-12-16T20:03:33.304 INFO:teuthology.orchestra.run.smithi038.stdout:(4/33): ceph-mon-17.2.7-125.g1f2f5510.el9.x86_6 6.1 MB/s | 3.7 MB 00:00 2023-12-16T20:03:33.320 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2023-12-16T20:03:33.355 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2023-12-16T20:03:33.379 INFO:teuthology.orchestra.run.smithi038.stdout:(5/33): ceph-mgr-modules-core-17.2.7-125.g1f2f5 1.7 MB/s | 238 kB 00:00 2023-12-16T20:03:33.390 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-12-16T20:03:33.437 INFO:teuthology.orchestra.run.smithi038.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2023-12-16T20:03:33.463 INFO:teuthology.orchestra.run.smithi038.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 384 kB/s | 32 kB 00:00 2023-12-16T20:03:33.479 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-12-16T20:03:33.488 INFO:teuthology.orchestra.run.smithi038.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 941 kB/s | 47 kB 00:00 2023-12-16T20:03:33.513 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-12-16T20:03:33.513 INFO:teuthology.orchestra.run.smithi038.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 772 kB/s | 39 kB 00:00 2023-12-16T20:03:33.538 INFO:teuthology.orchestra.run.smithi038.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-16T20:03:33.584 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-12-16T20:03:33.589 INFO:teuthology.orchestra.run.smithi038.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2023-12-16T20:03:33.614 INFO:teuthology.orchestra.run.smithi038.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-16T20:03:33.640 INFO:teuthology.orchestra.run.smithi038.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-12-16T20:03:33.664 INFO:teuthology.orchestra.run.smithi038.stdout:(14/33): python3-requests-2.25.1-7.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2023-12-16T20:03:33.690 INFO:teuthology.orchestra.run.smithi038.stdout:(15/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2023-12-16T20:03:33.720 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-12-16T20:03:33.837 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-12-16T20:03:34.002 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.n 28/33 2023-12-16T20:03:34.034 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 29/33 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 29/33 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:03:34.059 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:34.190 INFO:teuthology.orchestra.run.smithi038.stdout:(16/33): ceph-osd-17.2.7-125.g1f2f5510.el9.x86_ 14 MB/s | 15 MB 00:01 2023-12-16T20:03:34.207 INFO:teuthology.orchestra.run.smithi038.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 80 kB/s | 43 kB 00:00 2023-12-16T20:03:34.315 INFO:teuthology.orchestra.run.smithi038.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2023-12-16T20:03:34.382 INFO:teuthology.orchestra.run.smithi038.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 248 kB/s | 172 kB 00:00 2023-12-16T20:03:34.433 INFO:teuthology.orchestra.run.smithi038.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2023-12-16T20:03:34.500 INFO:teuthology.orchestra.run.smithi038.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 199 kB/s | 23 kB 00:00 2023-12-16T20:03:34.559 INFO:teuthology.orchestra.run.smithi038.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 155 kB/s | 19 kB 00:00 2023-12-16T20:03:34.609 INFO:teuthology.orchestra.run.smithi038.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 181 kB/s | 20 kB 00:00 2023-12-16T20:03:34.717 INFO:teuthology.orchestra.run.smithi038.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 292 kB/s | 46 kB 00:00 2023-12-16T20:03:34.743 INFO:teuthology.orchestra.run.smithi038.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 591 kB/s | 79 kB 00:00 2023-12-16T20:03:34.851 INFO:teuthology.orchestra.run.smithi038.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2023-12-16T20:03:34.885 INFO:teuthology.orchestra.run.smithi038.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 516 kB/s | 358 kB 00:00 2023-12-16T20:03:34.993 INFO:teuthology.orchestra.run.smithi038.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 634 kB/s | 90 kB 00:00 2023-12-16T20:03:35.019 INFO:teuthology.orchestra.run.smithi038.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 267 kB/s | 36 kB 00:00 2023-12-16T20:03:35.044 INFO:teuthology.orchestra.run.smithi038.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 834 kB/s | 272 kB 00:00 2023-12-16T20:03:35.153 INFO:teuthology.orchestra.run.smithi038.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2023-12-16T20:03:35.195 INFO:teuthology.orchestra.run.smithi038.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-12-16T20:03:35.219 INFO:teuthology.orchestra.run.smithi038.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.1 MB/s | 427 kB 00:00 2023-12-16T20:03:35.226 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:35.226 INFO:teuthology.orchestra.run.smithi038.stdout:Total 8.8 MB/s | 27 MB 00:03 2023-12-16T20:03:35.226 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:35.269 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:35.269 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:35.444 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 30/33 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 30/33 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:03:35.473 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:35.628 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:35.628 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:35.845 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 31/33 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 31/33 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:03:35.868 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:36.079 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 32/33 2023-12-16T20:03:36.101 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 32/33 2023-12-16T20:03:36.102 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:36.102 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T20:03:36.102 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:03:36.102 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:03:36.102 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:36.167 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 33/33 2023-12-16T20:03:36.882 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:36.939 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-12-16T20:03:36.972 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-12-16T20:03:37.013 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-12-16T20:03:37.109 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-12-16T20:03:37.186 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-12-16T20:03:37.233 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-12-16T20:03:37.306 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-12-16T20:03:37.359 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/33 2023-12-16T20:03:37.397 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/33 2023-12-16T20:03:37.455 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2023-12-16T20:03:37.517 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2023-12-16T20:03:37.723 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2023-12-16T20:03:37.777 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2023-12-16T20:03:37.815 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2023-12-16T20:03:37.850 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2023-12-16T20:03:37.879 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2023-12-16T20:03:37.937 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 33/33 2023-12-16T20:03:37.937 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 1/33 2023-12-16T20:03:37.937 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 2/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 3/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 4/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 5/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.n 6/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 15/33 2023-12-16T20:03:37.938 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 16/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-12-16T20:03:37.939 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-12-16T20:03:37.940 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-12-16T20:03:37.940 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-12-16T20:03:37.940 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-12-16T20:03:37.958 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2023-12-16T20:03:37.998 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-12-16T20:03:38.031 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2023-12-16T20:03:38.072 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2023-12-16T20:03:38.116 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2023-12-16T20:03:38.150 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-12-16T20:03:38.243 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-12-16T20:03:38.281 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-12-16T20:03:38.357 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-12-16T20:03:38.529 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-12-16T20:03:38.660 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-12-16T20:03:38.819 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.n 28/33 2023-12-16T20:03:38.852 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 29/33 2023-12-16T20:03:38.879 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 29/33 2023-12-16T20:03:38.879 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:38.879 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T20:03:38.880 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:03:38.880 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:03:38.880 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:39.005 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-12-16T20:03:39.005 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:39.005 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:39.005 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T20:03:39.006 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T20:03:39.007 INFO:teuthology.orchestra.run.smithi141.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T20:03:39.008 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T20:03:39.008 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T20:03:39.008 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T20:03:39.008 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:39.008 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:39.375 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-base 2023-12-16T20:03:39.951 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:51 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:40.045 INFO:teuthology.orchestra.run.smithi141.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:03:40.094 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:40.095 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:03:40.095 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:40.169 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install cephadm 2023-12-16T20:03:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 30/33 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 30/33 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:03:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:40.720 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 31/33 2023-12-16T20:03:40.726 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:52 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:40.744 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 31/33 2023-12-16T20:03:40.745 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:40.745 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T20:03:40.745 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:03:40.745 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:03:40.745 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:40.869 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 80 k 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:40.870 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:03:40.871 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:40.871 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 80 k 2023-12-16T20:03:40.871 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 364 k 2023-12-16T20:03:40.871 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:40.946 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 32/33 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 32/33 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:03:40.970 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:41.038 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 33/33 2023-12-16T20:03:41.195 INFO:teuthology.orchestra.run.smithi141.stdout:cephadm-17.2.7-125.g1f2f5510.el9.noarch.rpm 248 kB/s | 80 kB 00:00 2023-12-16T20:03:41.196 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:41.197 INFO:teuthology.orchestra.run.smithi141.stdout:Total 247 kB/s | 80 kB 00:00 2023-12-16T20:03:41.197 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:41.202 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:41.202 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:41.204 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:41.204 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:41.275 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:41.686 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:41.777 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:42.137 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:42.441 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:42.667 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T20:03:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 33/33 2023-12-16T20:03:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 1/33 2023-12-16T20:03:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 2/33 2023-12-16T20:03:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 3/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 4/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 5/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.n 6/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 15/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 16/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-12-16T20:03:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-12-16T20:03:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-12-16T20:03:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-12-16T20:03:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-12-16T20:03:43.223 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:55 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:43.371 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:43.371 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repo Size 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 137 k 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 137 k 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 379 k 2023-12-16T20:03:43.372 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:43.466 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T20:03:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:43.468 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:43.593 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 622 kB/s | 137 kB 00:00 2023-12-16T20:03:43.594 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:43.594 INFO:teuthology.orchestra.run.smithi141.stdout:Total 617 kB/s | 137 kB 00:00 2023-12-16T20:03:43.594 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:43.601 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:43.602 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:43.654 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:43.655 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:43.801 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:43.813 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base 2023-12-16T20:03:43.861 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:43.885 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:43.885 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:43.886 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T20:03:43.886 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:44.391 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:53 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:44.488 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:03:44.540 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:44.541 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:03:44.541 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:44.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install cephadm 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:44.889 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:45.113 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr 2023-12-16T20:03:45.171 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:54 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:45.319 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 80 k 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:45.320 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 80 k 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 364 k 2023-12-16T20:03:45.321 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:45.536 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm-17.2.7-125.g1f2f5510.el9.noarch.rpm 374 kB/s | 80 kB 00:00 2023-12-16T20:03:45.537 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:45.537 INFO:teuthology.orchestra.run.smithi038.stdout:Total 372 kB/s | 80 kB 00:00 2023-12-16T20:03:45.537 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:45.543 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:45.543 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:45.544 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:45.545 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:45.615 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:45.694 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:57 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:45.791 INFO:teuthology.orchestra.run.smithi141.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:03:45.842 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:45.843 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:03:45.843 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:45.915 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T20:03:46.035 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:46.119 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:46.469 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:58 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:46.510 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:46.612 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:46.613 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:46.613 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:46.613 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:46.613 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 1.7 M 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 23 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 15 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout:Installing weak dependencies: 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:46.614 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:03:46.615 INFO:teuthology.orchestra.run.smithi141.stdout:Install 7 Packages 2023-12-16T20:03:46.615 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:46.615 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 2.0 M 2023-12-16T20:03:46.615 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 8.1 M 2023-12-16T20:03:46.615 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:46.844 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/1 2023-12-16T20:03:46.844 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:46.844 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:46.845 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:46.845 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:46.845 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:47.014 INFO:teuthology.orchestra.run.smithi141.stdout:(1/7): ceph-prometheus-alerts-17.2.7-125.g1f2f5 59 kB/s | 15 kB 00:00 2023-12-16T20:03:47.039 INFO:teuthology.orchestra.run.smithi141.stdout:(2/7): ceph-grafana-dashboards-17.2.7-125.g1f2f 85 kB/s | 23 kB 00:00 2023-12-16T20:03:47.060 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T20:03:47.148 INFO:teuthology.orchestra.run.smithi141.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 68 kB/s | 9.0 kB 00:00 2023-12-16T20:03:47.199 INFO:teuthology.orchestra.run.smithi141.stdout:(4/7): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.9 MB/s | 1.7 MB 00:00 2023-12-16T20:03:47.224 INFO:teuthology.orchestra.run.smithi141.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 222 kB/s | 41 kB 00:00 2023-12-16T20:03:47.249 INFO:teuthology.orchestra.run.smithi141.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 309 kB/s | 31 kB 00:00 2023-12-16T20:03:47.282 INFO:teuthology.orchestra.run.smithi141.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2023-12-16T20:03:47.286 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:47.286 INFO:teuthology.orchestra.run.smithi141.stdout:Total 3.0 MB/s | 2.0 MB 00:00 2023-12-16T20:03:47.286 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:47.294 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:47.294 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:47.355 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:47.355 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:47.643 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:56 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:47.655 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:47.717 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-16T20:03:47.751 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-16T20:03:47.794 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 137 k 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:47.795 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 137 k 2023-12-16T20:03:47.796 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 379 k 2023-12-16T20:03:47.796 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:47.831 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-16T20:03:47.862 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-16T20:03:47.891 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.no 5/7 2023-12-16T20:03:48.009 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 644 kB/s | 137 kB 00:00 2023-12-16T20:03:48.009 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:48.010 INFO:teuthology.orchestra.run.smithi038.stdout:Total 640 kB/s | 137 kB 00:00 2023-12-16T20:03:48.010 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:48.018 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:48.018 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:48.073 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:48.073 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:48.123 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.n 6/7 2023-12-16T20:03:48.153 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 7/7 2023-12-16T20:03:48.217 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:48.285 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:48.311 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:03:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T20:03:48.312 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:48.696 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 7/7 2023-12-16T20:03:48.696 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.n 1/7 2023-12-16T20:03:48.696 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 2/7 2023-12-16T20:03:48.696 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.no 3/7 2023-12-16T20:03:48.696 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-16T20:03:48.697 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-16T20:03:48.697 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T20:03:48.997 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T20:03:48.998 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:48.998 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:49.250 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:49.328 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:49.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr 2023-12-16T20:03:49.815 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:01 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:49.959 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout:=========================================================================================== 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout:=========================================================================================== 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 7.4 M 2023-12-16T20:03:49.960 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:49.961 INFO:teuthology.orchestra.run.smithi141.stdout:=========================================================================================== 2023-12-16T20:03:49.962 INFO:teuthology.orchestra.run.smithi141.stdout:Install 12 Packages 2023-12-16T20:03:49.962 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:49.962 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 37 M 2023-12-16T20:03:49.962 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 209 M 2023-12-16T20:03:49.962 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:03:50.095 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:59 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:50.191 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:03:50.206 INFO:teuthology.orchestra.run.smithi141.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 266 kB/s | 32 kB 00:00 2023-12-16T20:03:50.239 INFO:teuthology.orchestra.run.smithi141.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 535 kB/s | 17 kB 00:00 2023-12-16T20:03:50.243 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:50.244 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:03:50.244 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:50.298 INFO:teuthology.orchestra.run.smithi141.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2023-12-16T20:03:50.307 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T20:03:50.323 INFO:teuthology.orchestra.run.smithi141.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 419 kB/s | 34 kB 00:00 2023-12-16T20:03:50.440 INFO:teuthology.orchestra.run.smithi141.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-12-16T20:03:50.508 INFO:teuthology.orchestra.run.smithi141.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-16T20:03:50.533 INFO:teuthology.orchestra.run.smithi141.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2023-12-16T20:03:50.591 INFO:teuthology.orchestra.run.smithi141.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-16T20:03:50.750 INFO:teuthology.orchestra.run.smithi141.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-16T20:03:50.775 INFO:teuthology.orchestra.run.smithi141.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-16T20:03:50.885 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:59 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:50.909 INFO:teuthology.orchestra.run.smithi141.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-1 9.0 MB/s | 7.4 MB 00:00 2023-12-16T20:03:51.034 INFO:teuthology.orchestra.run.smithi141.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 867 kB/s | 245 kB 00:00 2023-12-16T20:03:51.035 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:51.036 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:51.036 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 1.7 M 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 23 k 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 15 k 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T20:03:51.037 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout:Install 7 Packages 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:51.038 INFO:teuthology.orchestra.run.smithi141.stdout:Total 34 MB/s | 37 MB 00:01 2023-12-16T20:03:51.039 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.0 M 2023-12-16T20:03:51.039 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 8.1 M 2023-12-16T20:03:51.039 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:51.049 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:03:51.072 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:03:51.073 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:03:51.479 INFO:teuthology.orchestra.run.smithi038.stdout:(1/7): ceph-prometheus-alerts-17.2.7-125.g1f2f5 58 kB/s | 15 kB 00:00 2023-12-16T20:03:51.504 INFO:teuthology.orchestra.run.smithi038.stdout:(2/7): ceph-grafana-dashboards-17.2.7-125.g1f2f 83 kB/s | 23 kB 00:00 2023-12-16T20:03:51.519 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:03:51.519 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:03:51.605 INFO:teuthology.orchestra.run.smithi038.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 72 kB/s | 9.0 kB 00:00 2023-12-16T20:03:51.647 INFO:teuthology.orchestra.run.smithi038.stdout:(4/7): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 4.0 MB/s | 1.7 MB 00:00 2023-12-16T20:03:51.672 INFO:teuthology.orchestra.run.smithi038.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 244 kB/s | 41 kB 00:00 2023-12-16T20:03:51.689 INFO:teuthology.orchestra.run.smithi038.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 371 kB/s | 31 kB 00:00 2023-12-16T20:03:51.747 INFO:teuthology.orchestra.run.smithi038.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2023-12-16T20:03:51.750 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:51.751 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2023-12-16T20:03:51.751 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:51.759 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:51.759 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:51.832 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:51.832 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:52.139 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:52.182 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-16T20:03:52.216 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-16T20:03:52.227 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:03:52.264 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-16T20:03:52.300 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-16T20:03:52.311 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-16T20:03:52.329 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-16T20:03:52.340 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.no 5/7 2023-12-16T20:03:52.421 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-16T20:03:52.475 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-16T20:03:52.581 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.n 6/7 2023-12-16T20:03:52.618 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 7/7 2023-12-16T20:03:52.656 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T20:03:52.690 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T20:03:52.775 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-16T20:03:53.160 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 7/7 2023-12-16T20:03:53.160 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.n 1/7 2023-12-16T20:03:53.160 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 2/7 2023-12-16T20:03:53.160 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.no 3/7 2023-12-16T20:03:53.160 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-16T20:03:53.161 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-16T20:03:53.161 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-16T20:03:53.409 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-16T20:03:53.478 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-16T20:03:53.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:53.478 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:03:53.478 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:53.479 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:03:53.520 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-16T20:03:53.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T20:03:54.287 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:03 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:03:54.438 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout:=========================================================================================== 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout:=========================================================================================== 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 7.4 M 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T20:03:54.439 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout:=========================================================================================== 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2023-12-16T20:03:54.440 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:03:54.441 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 37 M 2023-12-16T20:03:54.441 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 209 M 2023-12-16T20:03:54.441 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:03:54.663 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 212 kB/s | 32 kB 00:00 2023-12-16T20:03:54.696 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 538 kB/s | 17 kB 00:00 2023-12-16T20:03:54.757 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-16T20:03:54.763 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-12-16T20:03:54.788 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 381 kB/s | 34 kB 00:00 2023-12-16T20:03:54.905 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-12-16T20:03:54.981 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-12-16T20:03:55.006 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-12-16T20:03:55.073 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-16T20:03:55.240 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2023-12-16T20:03:55.265 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2023-12-16T20:03:55.415 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-1 8.2 MB/s | 7.4 MB 00:00 2023-12-16T20:03:55.779 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-16T20:03:55.807 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 12/12 2023-12-16T20:03:55.890 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 378 kB/s | 245 kB 00:00 2023-12-16T20:03:55.893 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:55.894 INFO:teuthology.orchestra.run.smithi038.stdout:Total 26 MB/s | 37 MB 00:01 2023-12-16T20:03:55.909 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:03:55.937 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:03:55.937 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:03:56.394 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:03:56.394 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:03:57.239 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:03:57.309 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-16T20:03:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-16T20:03:57.435 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-16T20:03:57.474 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-16T20:03:57.662 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T20:03:57.705 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T20:03:57.787 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 12/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 1/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-16T20:03:58.399 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-16T20:03:58.400 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-16T20:03:58.400 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-16T20:03:58.400 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-16T20:03:58.598 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-16T20:03:58.712 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-16T20:03:58.913 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T20:03:58.914 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T20:03:58.915 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:58.915 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:03:59.247 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-rook 2023-12-16T20:03:59.815 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:11 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:03:59.961 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:03:59.962 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 47 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T20:03:59.963 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout:Install 13 Packages 2023-12-16T20:03:59.964 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:03:59.965 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 2.0 M 2023-12-16T20:03:59.965 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 26 M 2023-12-16T20:03:59.965 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:00.022 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-16T20:04:00.151 INFO:teuthology.orchestra.run.smithi141.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 198 kB/s | 24 kB 00:00 2023-12-16T20:04:00.177 INFO:teuthology.orchestra.run.smithi141.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 122 kB/s | 18 kB 00:00 2023-12-16T20:04:00.219 INFO:teuthology.orchestra.run.smithi141.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-16T20:04:00.244 INFO:teuthology.orchestra.run.smithi141.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-16T20:04:00.269 INFO:teuthology.orchestra.run.smithi141.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-16T20:04:00.294 INFO:teuthology.orchestra.run.smithi141.stdout:(6/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el9. 178 kB/s | 47 kB 00:00 2023-12-16T20:04:00.320 INFO:teuthology.orchestra.run.smithi141.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 570 kB/s | 43 kB 00:00 2023-12-16T20:04:00.653 INFO:teuthology.orchestra.run.smithi141.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2023-12-16T20:04:00.787 INFO:teuthology.orchestra.run.smithi141.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 62 kB/s | 32 kB 00:00 2023-12-16T20:04:00.966 INFO:teuthology.orchestra.run.smithi141.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 308 kB/s | 197 kB 00:00 2023-12-16T20:04:00.996 INFO:teuthology.orchestra.run.smithi141.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 283 kB/s | 59 kB 00:00 2023-12-16T20:04:01.097 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-16T20:04:01.104 INFO:teuthology.orchestra.run.smithi141.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 633 kB/s | 90 kB 00:00 2023-12-16T20:04:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 12/12 2023-12-16T20:04:01.230 INFO:teuthology.orchestra.run.smithi141.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2023-12-16T20:04:01.234 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:01.234 INFO:teuthology.orchestra.run.smithi141.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2023-12-16T20:04:01.234 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:01.247 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:01.247 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:01.345 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:01.346 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:01.869 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:02.029 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-16T20:04:02.081 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-16T20:04:02.136 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-16T20:04:02.174 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-16T20:04:02.215 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-16T20:04:02.308 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-16T20:04:02.425 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-16T20:04:02.475 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-16T20:04:03.200 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-16T20:04:03.247 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-16T20:04:03.281 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-16T20:04:03.327 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-16T20:04:03.350 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 13/13 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 12/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f55 1/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-16T20:04:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T20:04:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:04.078 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:04.204 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 13/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 1/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-16T20:04:04.205 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-16T20:04:04.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-rook 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T20:04:04.564 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:04.565 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:04.797 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T20:04:05.026 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:14 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:05.180 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 47 k 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:04:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:05.182 INFO:teuthology.orchestra.run.smithi038.stdout:Install 13 Packages 2023-12-16T20:04:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:05.183 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.0 M 2023-12-16T20:04:05.183 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 26 M 2023-12-16T20:04:05.183 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:05.359 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:17 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:05.473 INFO:teuthology.orchestra.run.smithi038.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 194 kB/s | 24 kB 00:00 2023-12-16T20:04:05.499 INFO:teuthology.orchestra.run.smithi038.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 120 kB/s | 18 kB 00:00 2023-12-16T20:04:05.512 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 121 k 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T20:04:05.513 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout:======================================================================================= 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout:Install 6 Packages 2023-12-16T20:04:05.514 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:05.515 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 6.8 M 2023-12-16T20:04:05.515 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 33 M 2023-12-16T20:04:05.515 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:05.540 INFO:teuthology.orchestra.run.smithi038.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-16T20:04:05.565 INFO:teuthology.orchestra.run.smithi038.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-16T20:04:05.590 INFO:teuthology.orchestra.run.smithi038.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-16T20:04:05.616 INFO:teuthology.orchestra.run.smithi038.stdout:(6/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el9. 177 kB/s | 47 kB 00:00 2023-12-16T20:04:05.641 INFO:teuthology.orchestra.run.smithi038.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 569 kB/s | 43 kB 00:00 2023-12-16T20:04:05.757 INFO:teuthology.orchestra.run.smithi141.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-12-16T20:04:05.874 INFO:teuthology.orchestra.run.smithi141.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-12-16T20:04:05.966 INFO:teuthology.orchestra.run.smithi141.stdout:(3/6): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 332 kB/s | 121 kB 00:00 2023-12-16T20:04:06.108 INFO:teuthology.orchestra.run.smithi038.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 62 kB/s | 32 kB 00:00 2023-12-16T20:04:06.133 INFO:teuthology.orchestra.run.smithi038.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 30 kB/s | 15 kB 00:00 2023-12-16T20:04:06.317 INFO:teuthology.orchestra.run.smithi038.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2023-12-16T20:04:06.324 INFO:teuthology.orchestra.run.smithi141.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 135 kB/s | 58 kB 00:00 2023-12-16T20:04:06.383 INFO:teuthology.orchestra.run.smithi141.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 122 kB/s | 51 kB 00:00 2023-12-16T20:04:06.383 INFO:teuthology.orchestra.run.smithi038.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 266 kB/s | 197 kB 00:00 2023-12-16T20:04:06.500 INFO:teuthology.orchestra.run.smithi141.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 739 kB/s | 548 kB 00:00 2023-12-16T20:04:06.510 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:06.510 INFO:teuthology.orchestra.run.smithi141.stdout:Total 6.8 MB/s | 6.8 MB 00:00 2023-12-16T20:04:06.510 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:06.511 INFO:teuthology.orchestra.run.smithi038.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 467 kB/s | 90 kB 00:00 2023-12-16T20:04:06.513 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:06.514 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:06.542 INFO:teuthology.orchestra.run.smithi038.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.4 MB/s | 1.0 MB 00:00 2023-12-16T20:04:06.547 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:06.547 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2023-12-16T20:04:06.547 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:06.562 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:06.562 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:06.602 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:06.603 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:06.670 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:06.670 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:06.912 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:07.090 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-16T20:04:07.143 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-16T20:04:07.195 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:07.371 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-16T20:04:07.420 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-16T20:04:07.484 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-16T20:04:07.520 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-16T20:04:07.562 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-16T20:04:07.654 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-16T20:04:07.657 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-16T20:04:07.729 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-16T20:04:07.775 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-16T20:04:07.784 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-16T20:04:07.814 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 6/6 2023-12-16T20:04:07.829 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-16T20:04:08.587 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-16T20:04:08.639 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 6/6 2023-12-16T20:04:08.639 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/6 2023-12-16T20:04:08.639 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-16T20:04:08.639 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-16T20:04:08.640 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-16T20:04:08.640 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-16T20:04:08.643 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-16T20:04:08.677 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-16T20:04:08.723 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-16T20:04:08.746 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 13/13 2023-12-16T20:04:08.945 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:08.946 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:09.214 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-fuse 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 13/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 1/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-16T20:04:09.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-16T20:04:09.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-16T20:04:09.774 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:21 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:09.918 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 810 k 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:09.919 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:09.920 INFO:teuthology.orchestra.run.smithi141.stdout:Install 2 Packages 2023-12-16T20:04:09.920 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:09.920 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 889 k 2023-12-16T20:04:09.920 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 2.6 M 2023-12-16T20:04:09.920 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T20:04:09.952 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:09.953 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:10.035 INFO:teuthology.orchestra.run.smithi141.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 685 kB/s | 79 kB 00:00 2023-12-16T20:04:10.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T20:04:10.360 INFO:teuthology.orchestra.run.smithi141.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el9.x86_6 1.8 MB/s | 810 kB 00:00 2023-12-16T20:04:10.361 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:10.362 INFO:teuthology.orchestra.run.smithi141.stdout:Total 2.0 MB/s | 889 kB 00:00 2023-12-16T20:04:10.362 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:10.382 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:10.383 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:10.457 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:10.457 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:10.641 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:10.750 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:19 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:10.772 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-16T20:04:10.852 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2/2 2023-12-16T20:04:10.914 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:10.914 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:10.914 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:04:10.914 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:10.914 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el9 ceph-noarch 121 k 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 6.8 M 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 33 M 2023-12-16T20:04:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:11.419 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-12-16T20:04:11.536 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-12-16T20:04:11.546 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2/2 2023-12-16T20:04:11.546 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/2 2023-12-16T20:04:11.670 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 306 kB/s | 121 kB 00:00 2023-12-16T20:04:11.796 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 246 kB/s | 58 kB 00:00 2023-12-16T20:04:11.837 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.3 MB/s | 548 kB 00:00 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:11.858 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:11.879 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 246 kB/s | 51 kB 00:00 2023-12-16T20:04:11.883 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:11.883 INFO:teuthology.orchestra.run.smithi038.stdout:Total 6.9 MB/s | 6.8 MB 00:00 2023-12-16T20:04:11.883 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:11.893 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:11.893 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:11.987 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:11.988 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:12.109 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install librados-devel 2023-12-16T20:04:12.295 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:12.475 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-16T20:04:12.523 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-16T20:04:12.671 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:24 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:12.819 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:12.820 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:12.820 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repo Size 2023-12-16T20:04:12.820 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:12.820 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 126 k 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 126 k 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 448 k 2023-12-16T20:04:12.821 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:13.049 INFO:teuthology.orchestra.run.smithi141.stdout:librados-devel-17.2.7-125.g1f2f5510.el9.x86_64. 556 kB/s | 126 kB 00:00 2023-12-16T20:04:13.049 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:13.049 INFO:teuthology.orchestra.run.smithi141.stdout:Total 552 kB/s | 126 kB 00:00 2023-12-16T20:04:13.050 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:13.055 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:13.055 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:13.075 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-16T20:04:13.110 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:13.110 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:13.160 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-16T20:04:13.214 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-16T20:04:13.242 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 6/6 2023-12-16T20:04:13.251 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:13.365 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:13.806 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:14.059 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 6/6 2023-12-16T20:04:14.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 1/6 2023-12-16T20:04:14.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-16T20:04:14.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-16T20:04:14.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-16T20:04:14.060 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:14.078 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:14.299 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install libcephfs2 2023-12-16T20:04:14.384 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-16T20:04:14.384 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:14.384 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:14.384 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el9.noarch 2023-12-16T20:04:14.384 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:14.385 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:14.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse 2023-12-16T20:04:14.862 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:26 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:14.959 INFO:teuthology.orchestra.run.smithi141.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:15.011 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:15.012 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:15.013 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:15.104 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install libcephfs-devel 2023-12-16T20:04:15.229 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:24 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:15.380 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:15.380 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-16T20:04:15.380 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:15.380 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 810 k 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2023-12-16T20:04:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:15.382 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 889 k 2023-12-16T20:04:15.382 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.6 M 2023-12-16T20:04:15.382 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:15.497 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 684 kB/s | 79 kB 00:00 2023-12-16T20:04:15.657 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:27 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:15.697 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el9.x86_6 2.5 MB/s | 810 kB 00:00 2023-12-16T20:04:15.699 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:15.699 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.7 MB/s | 889 kB 00:00 2023-12-16T20:04:15.699 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:15.722 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:15.722 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:15.802 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:15.802 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repo Size 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 25 k 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:15.803 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:04:15.804 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:15.804 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 25 k 2023-12-16T20:04:15.804 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 110 k 2023-12-16T20:04:15.804 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:15.969 INFO:teuthology.orchestra.run.smithi141.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el9.x86_64 151 kB/s | 25 kB 00:00 2023-12-16T20:04:15.970 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:15.970 INFO:teuthology.orchestra.run.smithi141.stdout:Total 149 kB/s | 25 kB 00:00 2023-12-16T20:04:15.970 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:15.974 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:15.974 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:15.975 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:15.976 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:16.062 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-16T20:04:16.175 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:16.199 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2/2 2023-12-16T20:04:16.558 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:16.826 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:16.826 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:16.826 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:16.827 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:16.827 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:16.827 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:16.959 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2/2 2023-12-16T20:04:16.959 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/2 2023-12-16T20:04:17.035 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install librados2 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:17.253 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:17.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados-devel 2023-12-16T20:04:17.592 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:29 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:17.686 INFO:teuthology.orchestra.run.smithi141.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:17.737 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:17.738 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:17.738 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:17.817 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install librbd1 2023-12-16T20:04:18.122 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:27 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:18.273 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:18.273 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 126 k 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 126 k 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 448 k 2023-12-16T20:04:18.274 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:18.373 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:30 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:18.468 INFO:teuthology.orchestra.run.smithi141.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:18.518 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:18.519 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:18.519 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:18.603 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install python3-rados 2023-12-16T20:04:18.626 INFO:teuthology.orchestra.run.smithi038.stdout:librados-devel-17.2.7-125.g1f2f5510.el9.x86_64. 359 kB/s | 126 kB 00:00 2023-12-16T20:04:18.626 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:18.627 INFO:teuthology.orchestra.run.smithi038.stdout:Total 357 kB/s | 126 kB 00:00 2023-12-16T20:04:18.627 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:18.633 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:18.633 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:18.845 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:18.943 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:19.153 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:31 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:19.247 INFO:teuthology.orchestra.run.smithi141.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:19.297 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:19.298 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:19.298 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:19.341 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:19.368 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install python3-rgw 2023-12-16T20:04:19.657 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:19.658 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:19.658 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:19.658 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:19.658 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:19.658 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:19.920 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:31 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:19.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2 2023-12-16T20:04:20.013 INFO:teuthology.orchestra.run.smithi141.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:20.064 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:20.065 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:20.065 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:20.141 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install python3-cephfs 2023-12-16T20:04:20.514 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:29 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:20.613 INFO:teuthology.orchestra.run.smithi038.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:20.667 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:20.668 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:20.668 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:20.690 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:32 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:20.736 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs-devel 2023-12-16T20:04:20.785 INFO:teuthology.orchestra.run.smithi141.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:20.837 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:20.838 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:20.838 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:20.916 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install python3-rbd 2023-12-16T20:04:21.317 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:30 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:21.467 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:21.467 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:21.467 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2023-12-16T20:04:21.467 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:21.467 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 25 k 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:21.468 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:33 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:21.469 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 25 k 2023-12-16T20:04:21.469 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 110 k 2023-12-16T20:04:21.469 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:21.561 INFO:teuthology.orchestra.run.smithi141.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:21.612 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:21.613 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-12-16T20:04:21.613 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:21.629 INFO:teuthology.orchestra.run.smithi038.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el9.x86_64 155 kB/s | 25 kB 00:00 2023-12-16T20:04:21.630 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:21.630 INFO:teuthology.orchestra.run.smithi038.stdout:Total 154 kB/s | 25 kB 00:00 2023-12-16T20:04:21.630 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:21.634 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:21.634 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:21.635 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:21.635 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:21.694 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install rbd-fuse 2023-12-16T20:04:21.720 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:21.847 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:22.224 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:22.253 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:34 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:22.397 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:22.397 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:22.397 INFO:teuthology.orchestra.run.smithi141.stdout: Package Architecture Version Repository Size 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 81 k 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 81 k 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 222 k 2023-12-16T20:04:22.398 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:22.498 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:22.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2 2023-12-16T20:04:22.723 INFO:teuthology.orchestra.run.smithi141.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el9.x86_64.rpm 251 kB/s | 81 kB 00:00 2023-12-16T20:04:22.724 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:22.724 INFO:teuthology.orchestra.run.smithi141.stdout:Total 250 kB/s | 81 kB 00:00 2023-12-16T20:04:22.724 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:22.731 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:22.731 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:22.787 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:22.787 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:22.928 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:23.030 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:23.291 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:32 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:23.388 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:23.440 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:23.441 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:23.442 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:23.474 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:23.526 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:23.774 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:23.997 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install rbd-mirror 2023-12-16T20:04:24.114 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:33 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:24.212 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:24.267 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:24.268 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:24.268 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:24.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rados 2023-12-16T20:04:24.557 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:36 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:24.703 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repo Size 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.9 M 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 2.9 M 2023-12-16T20:04:24.704 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 12 M 2023-12-16T20:04:24.705 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:24.915 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:33 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:25.013 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:25.066 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:25.067 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:25.067 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:25.076 INFO:teuthology.orchestra.run.smithi141.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el9.x86_64.rpm 7.9 MB/s | 2.9 MB 00:00 2023-12-16T20:04:25.076 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:25.077 INFO:teuthology.orchestra.run.smithi141.stdout:Total 7.9 MB/s | 2.9 MB 00:00 2023-12-16T20:04:25.077 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:25.086 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:25.086 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:25.156 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:25.157 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:25.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rgw 2023-12-16T20:04:25.560 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:25.618 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:25.641 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:25.642 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:04:25.642 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T20:04:25.642 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:04:25.642 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:04:25.642 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:25.807 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:34 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:25.905 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:25.959 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:25.960 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:25.960 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:26.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-cephfs 2023-12-16T20:04:26.613 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:35 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:26.711 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:26.764 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:26.766 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:26.766 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:26.775 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:26.836 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rbd 2023-12-16T20:04:27.013 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install rbd-nbd 2023-12-16T20:04:27.419 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:36 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:27.524 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el9.x86_64 is already installed. 2023-12-16T20:04:27.577 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:27.578 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-12-16T20:04:27.579 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:27.581 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:39 ago on Sat 16 Dec 2023 08:02:48 PM UTC. 2023-12-16T20:04:27.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse 2023-12-16T20:04:27.725 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout: Package Architecture Version Repository Size 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 162 k 2023-12-16T20:04:27.726 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 162 k 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 465 k 2023-12-16T20:04:27.727 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-12-16T20:04:27.955 INFO:teuthology.orchestra.run.smithi141.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el9.x86_64.rpm 712 kB/s | 162 kB 00:00 2023-12-16T20:04:27.956 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:27.956 INFO:teuthology.orchestra.run.smithi141.stdout:Total 707 kB/s | 162 kB 00:00 2023-12-16T20:04:27.956 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-12-16T20:04:27.964 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-12-16T20:04:27.964 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-12-16T20:04:28.018 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-12-16T20:04:28.019 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-12-16T20:04:28.177 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-12-16T20:04:28.238 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:37 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:28.286 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:28.390 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:28.390 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 81 k 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 81 k 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 222 k 2023-12-16T20:04:28.391 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:28.711 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:28.724 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el9.x86_64.rpm 245 kB/s | 81 kB 00:00 2023-12-16T20:04:28.725 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:28.725 INFO:teuthology.orchestra.run.smithi038.stdout:Total 244 kB/s | 81 kB 00:00 2023-12-16T20:04:28.725 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:28.732 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:28.733 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:29.029 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:29.029 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:29.030 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-12-16T20:04:29.030 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:29.030 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:04:29.030 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-12-16T20:04:29.050 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:29.302 DEBUG:teuthology.parallel:result is None 2023-12-16T20:04:29.417 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:29.723 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:29.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:29.723 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:29.724 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:29.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:29.724 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:29.961 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-mirror 2023-12-16T20:04:30.544 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:39 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:30.695 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 2.9 M 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.9 M 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 12 M 2023-12-16T20:04:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:31.069 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el9.x86_64.rpm 7.9 MB/s | 2.9 MB 00:00 2023-12-16T20:04:31.069 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:31.070 INFO:teuthology.orchestra.run.smithi038.stdout:Total 7.9 MB/s | 2.9 MB 00:00 2023-12-16T20:04:31.070 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:31.080 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:31.080 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:31.155 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:31.155 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:31.587 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:31.653 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:31.678 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:04:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T20:04:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:04:31.679 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:04:31.679 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:32.905 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:33.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-nbd 2023-12-16T20:04:33.775 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:42 ago on Sat 16 Dec 2023 08:02:51 PM UTC. 2023-12-16T20:04:33.926 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el9 ceph 162 k 2023-12-16T20:04:33.927 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 162 k 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 465 k 2023-12-16T20:04:33.928 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-16T20:04:34.272 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el9.x86_64.rpm 472 kB/s | 162 kB 00:00 2023-12-16T20:04:34.273 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:04:34.273 INFO:teuthology.orchestra.run.smithi038.stdout:Total 470 kB/s | 162 kB 00:00 2023-12-16T20:04:34.273 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-16T20:04:34.282 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-16T20:04:34.282 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-16T20:04:34.341 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-16T20:04:34.341 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-16T20:04:34.497 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-16T20:04:34.733 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:35.183 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 1/1 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el9.x86_64 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:04:35.499 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-16T20:04:35.738 DEBUG:teuthology.parallel:result is None 2023-12-16T20:04:35.738 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:04:35.738 INFO:teuthology.packaging:ref: None 2023-12-16T20:04:35.738 INFO:teuthology.packaging:tag: None 2023-12-16T20:04:35.738 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:04:35.738 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:04:35.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2023-12-16T20:04:35.962 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T20:04:35.983 INFO:teuthology.orchestra.run.smithi038.stdout:17.2.7-125.g1f2f5510.el9 2023-12-16T20:04:35.983 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el9 2023-12-16T20:04:35.984 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T20:04:35.985 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:04:35.985 INFO:teuthology.packaging:ref: None 2023-12-16T20:04:35.986 INFO:teuthology.packaging:tag: None 2023-12-16T20:04:35.986 INFO:teuthology.packaging:branch: quincy 2023-12-16T20:04:35.986 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:04:35.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2023-12-16T20:04:36.299 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T20:04:36.324 INFO:teuthology.orchestra.run.smithi141.stdout:17.2.7-125.g1f2f5510.el9 2023-12-16T20:04:36.324 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el9 2023-12-16T20:04:36.324 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T20:04:36.326 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T20:04:36.326 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:04:36.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T20:04:36.358 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:04:36.359 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T20:04:36.394 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T20:04:36.394 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:04:36.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T20:04:36.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T20:04:36.499 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:04:36.499 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T20:04:36.529 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T20:04:36.598 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T20:04:36.599 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:04:36.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T20:04:36.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T20:04:36.700 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:04:36.700 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T20:04:36.727 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T20:04:36.794 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T20:04:36.794 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:04:36.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T20:04:36.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T20:04:36.896 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:04:36.896 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T20:04:36.925 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T20:04:36.994 INFO:teuthology.run_tasks:Running task print... 2023-12-16T20:04:37.003 INFO:teuthology.task.print:**** done install task... 2023-12-16T20:04:37.003 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-16T20:04:37.093 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'} 2023-12-16T20:04:37.093 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-16T20:04:37.093 INFO:tasks.cephadm:Cluster fsid is 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:04:37.094 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-16T20:04:37.094 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-16T20:04:37.094 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi038': '172.21.15.38', 'mon.smithi141': '172.21.15.141'} 2023-12-16T20:04:37.094 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-16T20:04:37.094 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname $(hostname -s) 2023-12-16T20:04:37.126 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname $(hostname -s) 2023-12-16T20:04:37.153 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-16T20:04:37.154 DEBUG:teuthology.orchestra.run.smithi038:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.414 INFO:teuthology.orchestra.run.smithi038.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Dec 16 20:04 /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.414 DEBUG:teuthology.orchestra.run.smithi141:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.657 INFO:teuthology.orchestra.run.smithi141.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Dec 16 20:04 /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.657 DEBUG:teuthology.orchestra.run.smithi038:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.675 DEBUG:teuthology.orchestra.run.smithi141:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T20:04:37.701 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-16T20:04:37.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T20:04:37.718 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T20:04:38.484 INFO:teuthology.orchestra.run.smithi141.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T20:04:38.623 INFO:teuthology.orchestra.run.smithi038.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T20:05:03.924 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "repo_digests": [ 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-16T20:05:03.925 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:05:05.317 INFO:teuthology.orchestra.run.smithi141.stdout:{ 2023-12-16T20:05:05.317 INFO:teuthology.orchestra.run.smithi141.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T20:05:05.317 INFO:teuthology.orchestra.run.smithi141.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T20:05:05.317 INFO:teuthology.orchestra.run.smithi141.stdout: "repo_digests": [ 2023-12-16T20:05:05.317 INFO:teuthology.orchestra.run.smithi141.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T20:05:05.318 INFO:teuthology.orchestra.run.smithi141.stdout: ] 2023-12-16T20:05:05.318 INFO:teuthology.orchestra.run.smithi141.stdout:} 2023-12-16T20:05:05.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph 2023-12-16T20:05:05.375 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /etc/ceph 2023-12-16T20:05:05.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /etc/ceph 2023-12-16T20:05:05.449 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 777 /etc/ceph 2023-12-16T20:05:05.477 INFO:tasks.cephadm:Writing seed config... 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-16T20:05:05.478 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-16T20:05:05.479 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-16T20:05:05.480 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-16T20:05:05.481 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:05:05.482 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-16T20:05:05.506 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 56b1cbe2-9c4e-11ee-95a5-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-16T20:05:05.506 DEBUG:teuthology.orchestra.run.smithi038:mon.smithi038> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service 2023-12-16T20:05:05.549 INFO:tasks.cephadm:Bootstrapping... 2023-12-16T20:05:05.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.38 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:05:05.768 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:05:05.768 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '56b1cbe2-9c4e-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.38', '--skip-admin-label'] 2023-12-16T20:05:05.794 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 4.7.2 2023-12-16T20:05:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-16T20:05:05.795 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying podman|docker is present... 2023-12-16T20:05:05.818 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 4.7.2 2023-12-16T20:05:05.818 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying lvm2 is present... 2023-12-16T20:05:05.818 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying time synchronization is in place... 2023-12-16T20:05:05.826 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T20:05:05.826 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T20:05:05.832 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T20:05:05.833 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:05.840 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2023-12-16T20:05:05.846 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2023-12-16T20:05:05.846 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2023-12-16T20:05:05.846 INFO:teuthology.orchestra.run.smithi038.stdout:Repeating the final host check... 2023-12-16T20:05:05.870 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 4.7.2 2023-12-16T20:05:05.870 INFO:teuthology.orchestra.run.smithi038.stdout:podman (/bin/podman) version 4.7.2 is present 2023-12-16T20:05:05.870 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl is present 2023-12-16T20:05:05.870 INFO:teuthology.orchestra.run.smithi038.stdout:lvcreate is present 2023-12-16T20:05:05.877 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T20:05:05.877 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T20:05:05.883 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T20:05:05.884 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:05.891 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:Host looks OK 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:Cluster fsid: 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:Acquiring lock 140308626358336 on /run/cephadm/56b1cbe2-9c4e-11ee-95a5-87774f69a715.lock 2023-12-16T20:05:05.897 INFO:teuthology.orchestra.run.smithi038.stdout:Lock 140308626358336 acquired on /run/cephadm/56b1cbe2-9c4e-11ee-95a5-87774f69a715.lock 2023-12-16T20:05:05.898 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 3300 ... 2023-12-16T20:05:05.898 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 6789 ... 2023-12-16T20:05:05.898 INFO:teuthology.orchestra.run.smithi038.stdout:Base mon IP(s) is [172.21.15.38:3300, 172.21.15.38:6789], mon addrv is [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2023-12-16T20:05:05.901 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.38 metric 100 2023-12-16T20:05:05.902 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.38 metric 100 2023-12-16T20:05:05.904 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-16T20:05:05.904 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2023-12-16T20:05:05.905 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2023-12-16T20:05:05.907 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-16T20:05:05.907 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-16T20:05:05.907 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T20:05:05.907 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-16T20:05:05.908 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-16T20:05:05.908 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T20:05:05.908 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2023-12-16T20:05:05.908 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2023-12-16T20:05:05.908 INFO:teuthology.orchestra.run.smithi038.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-16T20:05:05.909 INFO:teuthology.orchestra.run.smithi038.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-16T20:05:05.911 INFO:teuthology.orchestra.run.smithi038.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Getting image source signatures 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:3c21fa6304a567e69d15522c48775b11468df75d53cc353263c55c753e1a9b4e 2023-12-16T20:05:06.370 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying config sha256:60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T20:05:06.371 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-16T20:05:06.779 INFO:teuthology.orchestra.run.smithi038.stdout:ceph: stdout ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T20:05:06.780 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph version: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T20:05:06.780 INFO:teuthology.orchestra.run.smithi038.stdout:Extracting ceph user uid/gid from container image... 2023-12-16T20:05:07.087 INFO:teuthology.orchestra.run.smithi038.stdout:stat: stdout 167 167 2023-12-16T20:05:07.087 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial keys... 2023-12-16T20:05:07.436 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQDzAn5ln6jPDRAAQIvfXQ2bAd4znwZF+gyVag== 2023-12-16T20:05:07.778 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQDzAn5l/34oIhAA/TDbBy/qmAmjZCTp6UROVQ== 2023-12-16T20:05:08.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQDzAn5lQRSJNhAAHkrbkpN92moJPXiiQgtpnA== 2023-12-16T20:05:08.112 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial monmap... 2023-12-16T20:05:08.478 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T20:05:08.478 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-16T20:05:08.478 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:08.478 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool for smithi038 [v2:172.21.15.38:3300,v1:172.21.15.38:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = octopus 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: set fsid to 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:05:08.479 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mon... 2023-12-16T20:05:08.870 INFO:teuthology.orchestra.run.smithi038.stdout:create mon.smithi038 on 2023-12-16T20:05:09.045 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2023-12-16T20:05:09.190 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-16T20:05:09.340 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target. 2023-12-16T20:05:09.340 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target. 2023-12-16T20:05:09.510 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038 2023-12-16T20:05:09.511 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service: Unit ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service not loaded. 2023-12-16T20:05:09.658 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target.wants/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service → /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@.service. 2023-12-16T20:05:09.929 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T20:05:09.930 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2023-12-16T20:05:09.937 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T20:05:09.937 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:09.937 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2023-12-16T20:05:09.937 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T20:05:09.938 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon to start... 2023-12-16T20:05:09.938 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon... 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout cluster: 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout id: 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout services: 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi038 (age 0.337729s) 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout data: 2023-12-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pgs: 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.223+0000 7f77bd014700 1 Processor -- start 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.223+0000 7f77bd014700 1 -- start start 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.223+0000 7f77bd014700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.223+0000 7f77bd014700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8104310 con 0x7f77b81039c0 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54404/0 (socket says 172.21.15.38:54404) 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b6d9d700 1 -- 172.21.15.38:0/2714929923 learned_addr learned my addr 172.21.15.38:0/2714929923 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b6d9d700 1 -- 172.21.15.38:0/2714929923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8101fb0 con 0x7f77b81039c0 2023-12-16T20:05:10.542 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b6d9d700 1 --2- 172.21.15.38:0/2714929923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f77a80098e0 tx=0x7f77a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80d192667add67 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.224+0000 7f77b5d9b700 1 -- 172.21.15.38:0/2714929923 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a800b860 con 0x7f77b81039c0 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77b5d9b700 1 -- 172.21.15.38:0/2714929923 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800b9c0 con 0x7f77b81039c0 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77b5d9b700 1 -- 172.21.15.38:0/2714929923 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a800bc90 con 0x7f77b81039c0 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 -- 172.21.15.38:0/2714929923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 msgr2=0x7f77b8103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 --2- 172.21.15.38:0/2714929923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f77a80098e0 tx=0x7f77a8009250 comp rx=0 tx=0).stop 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 -- 172.21.15.38:0/2714929923 shutdown_connections 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 --2- 172.21.15.38:0/2714929923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8103dd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 -- 172.21.15.38:0/2714929923 >> 172.21.15.38:0/2714929923 conn(0x7f77b80fda40 msgr2=0x7f77b80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 -- 172.21.15.38:0/2714929923 shutdown_connections 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.225+0000 7f77bd014700 1 -- 172.21.15.38:0/2714929923 wait complete. 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77bd014700 1 Processor -- start 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77bd014700 1 -- start start 2023-12-16T20:05:10.543 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77bd014700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77bd014700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8110ed0 con 0x7f77b81039c0 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54416/0 (socket says 172.21.15.38:54416) 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77b6d9d700 1 -- 172.21.15.38:0/3493692279 learned_addr learned my addr 172.21.15.38:0/3493692279 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.226+0000 7f77b6d9d700 1 -- 172.21.15.38:0/3493692279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80094f0 con 0x7f77b81039c0 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f77b6d9d700 1 --2- 172.21.15.38:0/3493692279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f77a8003080 tx=0x7f77a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a801c5c0 con 0x7f77b81039c0 2023-12-16T20:05:10.544 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a801c720 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b81110d0 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a801ca30 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b81114e0 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f77a801a450 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.227+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f77a802e440 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.228+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b81022c0 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.230+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f77a801a700 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.304+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f77b8109d30 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.304+0000 7f779f7fe700 1 -- 172.21.15.38:0/3493692279 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f77a802e6a0 con 0x7f77b81039c0 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.304+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 msgr2=0x7f77b8110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 --2- 172.21.15.38:0/3493692279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f77a8003080 tx=0x7f77a8016000 comp rx=0 tx=0).stop 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 shutdown_connections 2023-12-16T20:05:10.545 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 --2- 172.21.15.38:0/3493692279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77b81039c0 0x7f77b8110990 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:10.546 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 >> 172.21.15.38:0/3493692279 conn(0x7f77b80fda40 msgr2=0x7f77b8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:10.546 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 shutdown_connections 2023-12-16T20:05:10.546 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.305+0000 7f77bd014700 1 -- 172.21.15.38:0/3493692279 wait complete. 2023-12-16T20:05:10.546 INFO:teuthology.orchestra.run.smithi038.stdout:mon is available 2023-12-16T20:05:10.546 INFO:teuthology.orchestra.run.smithi038.stdout:Assimilating anything we can from ceph.conf... 2023-12-16T20:05:11.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:11.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T20:05:11.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T20:05:11.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa0629a6700 1 Processor -- start 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa0629a6700 1 -- start start 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa0629a6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa0629a6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c101b10 con 0x7fa05c1011c0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39998/0 (socket says 172.21.15.38:39998) 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa05bfff700 1 -- 172.21.15.38:0/4052451979 learned_addr learned my addr 172.21.15.38:0/4052451979 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.823+0000 7fa05bfff700 1 -- 172.21.15.38:0/4052451979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c101c50 con 0x7fa05c1011c0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa05bfff700 1 --2- 172.21.15.38:0/4052451979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00bb80 tx=0x7fa04c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa949f54fc8260bd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa05affd700 1 -- 172.21.15.38:0/4052451979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa04c00dd00 con 0x7fa05c1011c0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa05affd700 1 -- 172.21.15.38:0/4052451979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c00de60 con 0x7fa05c1011c0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa05affd700 1 -- 172.21.15.38:0/4052451979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa04c0105f0 con 0x7fa05c1011c0 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa0629a6700 1 -- 172.21.15.38:0/4052451979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 msgr2=0x7fa05c1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:11.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa0629a6700 1 --2- 172.21.15.38:0/4052451979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00bb80 tx=0x7fa04c00b4f0 comp rx=0 tx=0).stop 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa0629a6700 1 -- 172.21.15.38:0/4052451979 shutdown_connections 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa0629a6700 1 --2- 172.21.15.38:0/4052451979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c1015d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.824+0000 7fa0629a6700 1 -- 172.21.15.38:0/4052451979 >> 172.21.15.38:0/4052451979 conn(0x7fa05c0fc980 msgr2=0x7fa05c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 -- 172.21.15.38:0/4052451979 shutdown_connections 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 -- 172.21.15.38:0/4052451979 wait complete. 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 Processor -- start 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 -- start start 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.825+0000 7fa0629a6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c10ecc0 con 0x7fa05c1011c0 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40008/0 (socket says 172.21.15.38:40008) 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa05bfff700 1 -- 172.21.15.38:0/2110885747 learned_addr learned my addr 172.21.15.38:0/2110885747 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa05bfff700 1 -- 172.21.15.38:0/2110885747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c00b790 con 0x7fa05c1011c0 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa05bfff700 1 --2- 172.21.15.38:0/2110885747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00b530 tx=0x7fa04c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:11.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa04c0189b0 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c01d070 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa04c018cb0 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c10eec0 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c10f2d0 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa04c02e460 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.826+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa04c014070 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.827+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c04bb80 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.830+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa04c01f050 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.900+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa05c102530 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.904+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa04c018e60 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.904+0000 7fa058ff9700 1 -- 172.21.15.38:0/2110885747 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fa04c038b50 con 0x7fa05c1011c0 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 msgr2=0x7fa05c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:11.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 --2- 172.21.15.38:0/2110885747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00b530 tx=0x7fa04c01a000 comp rx=0 tx=0).stop 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 shutdown_connections 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 --2- 172.21.15.38:0/2110885747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c1011c0 0x7fa05c10e780 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 >> 172.21.15.38:0/2110885747 conn(0x7fa05c0fc980 msgr2=0x7fa05c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 shutdown_connections 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:10.905+0000 7fa0629a6700 1 -- 172.21.15.38:0/2110885747 wait complete. 2023-12-16T20:05:11.138 INFO:teuthology.orchestra.run.smithi038.stdout:Generating new minimal ceph.conf... 2023-12-16T20:05:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398f6e5700 1 Processor -- start 2023-12-16T20:05:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398f6e5700 1 -- start start 2023-12-16T20:05:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398f6e5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398f6e5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988101060 con 0x7f3988100710 2023-12-16T20:05:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398d481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398d481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40018/0 (socket says 172.21.15.38:40018) 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.372+0000 7f398d481700 1 -- 172.21.15.38:0/504618705 learned_addr learned my addr 172.21.15.38:0/504618705 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398d481700 1 -- 172.21.15.38:0/504618705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39881011a0 con 0x7f3988100710 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398d481700 1 --2- 172.21.15.38:0/504618705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39840098e0 tx=0x7f3984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa049ff423342cc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f397ffff700 1 -- 172.21.15.38:0/504618705 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f398400b860 con 0x7f3988100710 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f397ffff700 1 -- 172.21.15.38:0/504618705 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f398400be30 con 0x7f3988100710 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f397ffff700 1 -- 172.21.15.38:0/504618705 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3984010380 con 0x7f3988100710 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398f6e5700 1 -- 172.21.15.38:0/504618705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 msgr2=0x7f3988100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398f6e5700 1 --2- 172.21.15.38:0/504618705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39840098e0 tx=0x7f3984009250 comp rx=0 tx=0).stop 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398f6e5700 1 -- 172.21.15.38:0/504618705 shutdown_connections 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398f6e5700 1 --2- 172.21.15.38:0/504618705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988100b20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.373+0000 7f398f6e5700 1 -- 172.21.15.38:0/504618705 >> 172.21.15.38:0/504618705 conn(0x7f39880fc0b0 msgr2=0x7f39880fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 -- 172.21.15.38:0/504618705 shutdown_connections 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 -- 172.21.15.38:0/504618705 wait complete. 2023-12-16T20:05:11.659 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 Processor -- start 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 -- start start 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398f6e5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881016f0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.374+0000 7f398d481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398d481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40030/0 (socket says 172.21.15.38:40030) 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398d481700 1 -- 172.21.15.38:0/2908329024 learned_addr learned my addr 172.21.15.38:0/2908329024 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398d481700 1 -- 172.21.15.38:0/2908329024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840094f0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398d481700 1 --2- 172.21.15.38:0/2908329024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3984006b00 tx=0x7f3984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39840109b0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3984024440 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39881018f0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f398401a5f0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.375+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3988101d00 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.376+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f398401aae0 con 0x7f3988100710 2023-12-16T20:05:11.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.376+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f398402dcc0 con 0x7f3988100710 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.377+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398804bb80 con 0x7f3988100710 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.379+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3984006d70 con 0x7f3988100710 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.450+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f398810ac40 con 0x7f3988100710 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.450+0000 7f397dffb700 1 -- 172.21.15.38:0/2908329024 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f398402d3f0 con 0x7f3988100710 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 msgr2=0x7f3988103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 --2- 172.21.15.38:0/2908329024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3984006b00 tx=0x7f3984009250 comp rx=0 tx=0).stop 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 shutdown_connections 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 --2- 172.21.15.38:0/2908329024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3988100710 0x7f3988103270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 >> 172.21.15.38:0/2908329024 conn(0x7f39880fc0b0 msgr2=0x7f39880fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 shutdown_connections 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:11.451+0000 7f398f6e5700 1 -- 172.21.15.38:0/2908329024 wait complete. 2023-12-16T20:05:11.661 INFO:teuthology.orchestra.run.smithi038.stdout:Restarting the monitor... 2023-12-16T20:05:12.076 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:11 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[80282]: 2023-12-16T20:05:11.852+0000 7f3d58141700 -1 mon.smithi038@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T20:05:12.376 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80531]: 2023-12-16 20:05:12.077291453 +0000 UTC m=+0.267648774 container died 2ef23fa2942bc854db0f93d38e27cf65ae7eededbaf232c18d2b71434e2fd580 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-1f2f551, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20231212, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2023-12-16T20:05:12.376 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80531]: 2023-12-16 20:05:12.166702415 +0000 UTC m=+0.357059736 container cleanup 2ef23fa2942bc854db0f93d38e27cf65ae7eededbaf232c18d2b71434e2fd580 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, RELEASE=quincy-1f2f551, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_CLEAN=True) 2023-12-16T20:05:12.376 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 bash[80531]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038 2023-12-16T20:05:12.376 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80545]: 2023-12-16 20:05:12.258064921 +0000 UTC m=+0.182057867 container remove 2ef23fa2942bc854db0f93d38e27cf65ae7eededbaf232c18d2b71434e2fd580 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, ceph=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212) 2023-12-16T20:05:12.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service: Deactivated successfully. 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 systemd[1]: Stopped Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 systemd[1]: Starting Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80639]: 2023-12-16 20:05:12.524742088 +0000 UTC m=+0.046170749 container create 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80639]: 2023-12-16 20:05:12.496374757 +0000 UTC m=+0.017803425 image pull 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 quay.ceph.io/ceph-ci/ceph:quincy 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80639]: 2023-12-16 20:05:12.600301561 +0000 UTC m=+0.121730222 container init 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=quincy-1f2f551, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 podman[80639]: 2023-12-16 20:05:12.623411362 +0000 UTC m=+0.144840021 container start 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=quincy-1f2f551, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0) 2023-12-16T20:05:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T20:05:12.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 2 2023-12-16T20:05:12.653 INFO:teuthology.orchestra.run.smithi038.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-16T20:05:12.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: pidfile_write: ignore empty --pid-file 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: load: jerasure load: lrc 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: RocksDB version: 6.15.5 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Compile date Dec 13 2023 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: DB SUMMARY 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: DB Session ID: Z1YML0MFHDFTKXQ2IHVH 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: CURRENT file: CURRENT 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi038/store.db dir, Total Num: 1, files: 000008.sst 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi038/store.db: 000010.log size: 95072 ; 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.error_if_exists: 0 2023-12-16T20:05:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.create_if_missing: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 bash[80639]: 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.paranoid_checks: 1 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.env: 0x5649ac63ca80 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.fs: Posix File System 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.info_log: 0x5649adfa9000 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.statistics: (nil) 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.use_fsync: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_log_file_size: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T20:05:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_fallocate: 1 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.use_direct_reads: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.db_log_dir: 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi038/store.db 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T20:05:12.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.write_buffer_manager: 0x5649aed1e9f0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T20:05:12.898 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.unordered_write: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.row_cache: None 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.wal_filter: None 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.preserve_deletes: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.two_write_queues: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.atomic_flush: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T20:05:12.899 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.log_readahead_size: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_background_jobs: 2 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_background_compactions: -1 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_subcompactions: 1 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T20:05:12.900 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_open_files: -1 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_background_flushes: -1 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Compression algorithms supported: 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kZSTD supported: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kXpressCompression supported: 0 2023-12-16T20:05:12.901 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kZlibCompression supported: 1 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kSnappyCompression supported: 1 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kLZ4Compression supported: 1 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: kBZip2Compression supported: 0 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000009 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.merge_operator: 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_filter: None 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T20:05:12.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5649adffef90) 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks: 1 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_top_level_index_and_filter: 1 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_type: 0 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_index_type: 0 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_shortening: 1 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: hash_index_allow_collision: 1 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: checksum: 1 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: no_block_cache: 0 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache: 0x5649ae031090 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_name: BinnedLRUCache 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_options: 2023-12-16T20:05:12.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: capacity : 536870912 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_shard_bits : 4 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: strict_capacity_limit : 0 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: high_pri_pool_ratio: 0.000 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_compressed: (nil) 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: persistent_cache: (nil) 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size: 4096 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size_deviation: 10 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_restart_interval: 16 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_block_restart_interval: 1 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_block_size: 4096 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: partition_filters: 0 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: use_delta_encoding: 1 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: whole_key_filtering: 1 2023-12-16T20:05:12.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: verify_compression: 0 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: read_amp_bytes_per_bit: 0 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: format_version: 4 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_index_compression: 1 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_align: 0 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression: NoCompression 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.num_levels: 7 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T20:05:12.905 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T20:05:12.906 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T20:05:12.907 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T20:05:12.908 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.table_properties_collectors: 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.inplace_update_support: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.bloom_locality: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.max_successive_merges: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T20:05:12.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.ttl: 2592000 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.enable_blob_files: false 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.min_blob_size: 0 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757112651169, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T20:05:12.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757112653070, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90708, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88821, "index_size": 247, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13140, "raw_average_key_size": 50, "raw_value_size": 81644, "raw_average_value_size": 311, "num_data_blocks": 10, "num_entries": 262, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702757112, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "7ad71174-7a83-4a7d-bfea-4e79799359de", "db_session_id": "Z1YML0MFHDFTKXQ2IHVH"}} 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 systemd[1]: Started Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757112654042, "job": 1, "event": "recovery_finished"} 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi038/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5649adfc5180 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: DB pointer 0x5649ae09a000 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** DB Stats ** 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T20:05:12.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L0 2/0 90.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Sum 2/0 90.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:05:12.912 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative compaction: 0.00 GB write, 12.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval compaction: 0.00 GB write, 12.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:05:12.913 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L0 2/0 90.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Sum 2/0 90.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 53.3 0.00 0.00 1 0.002 0 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative compaction: 0.00 GB write, 12.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:05:12.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: starting mon.smithi038 rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi038 fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???) e1 preinit fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).mds e1 new map 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).mds e1 print_map 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: e1 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: legacy client fscid: -1 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: No filesystems configured 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T20:05:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mon.smithi038 is new leader, mons smithi038 in quorum (ranks 0) 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: monmap e1: 1 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: fsmap 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T20:05:12.916 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:12 smithi038 ceph-mon[80659]: mgrmap e1: no daemons active 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5df7ca700 1 Processor -- start 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5df7ca700 1 -- start start 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5df7ca700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5df7ca700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8104310 con 0x7fe5d81039c0 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5dd566700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5dd566700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40036/0 (socket says 172.21.15.38:40036) 2023-12-16T20:05:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.887+0000 7fe5dd566700 1 -- 172.21.15.38:0/1930321408 learned_addr learned my addr 172.21.15.38:0/1930321408 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.888+0000 7fe5dd566700 1 -- 172.21.15.38:0/1930321408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8101fb0 con 0x7fe5d81039c0 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.888+0000 7fe5dd566700 1 --2- 172.21.15.38:0/1930321408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40098e0 tx=0x7fe5d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4661380e17f6c86 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.888+0000 7fe5cffff700 1 -- 172.21.15.38:0/1930321408 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5d400b860 con 0x7fe5d81039c0 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.888+0000 7fe5cffff700 1 -- 172.21.15.38:0/1930321408 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe5d400be30 con 0x7fe5d81039c0 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.888+0000 7fe5cffff700 1 -- 172.21.15.38:0/1930321408 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5d4010380 con 0x7fe5d81039c0 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- 172.21.15.38:0/1930321408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 msgr2=0x7fe5d8103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 --2- 172.21.15.38:0/1930321408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40098e0 tx=0x7fe5d4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- 172.21.15.38:0/1930321408 shutdown_connections 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 --2- 172.21.15.38:0/1930321408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d8103dd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- 172.21.15.38:0/1930321408 >> 172.21.15.38:0/1930321408 conn(0x7fe5d80fda40 msgr2=0x7fe5d80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- 172.21.15.38:0/1930321408 shutdown_connections 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- 172.21.15.38:0/1930321408 wait complete. 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 Processor -- start 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.889+0000 7fe5df7ca700 1 -- start start 2023-12-16T20:05:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5df7ca700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5df7ca700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8111630 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5dd566700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5dd566700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40050/0 (socket says 172.21.15.38:40050) 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5dd566700 1 -- 172.21.15.38:0/3004302667 learned_addr learned my addr 172.21.15.38:0/3004302667 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5dd566700 1 -- 172.21.15.38:0/3004302667 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094f0 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5dd566700 1 --2- 172.21.15.38:0/3004302667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006b00 tx=0x7fe5d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5d40109b0 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe5d401a430 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d8111830 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.890+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5d40245b0 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.891+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d8111c40 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.891+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe5d4024a60 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.891+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe5d402eb80 con 0x7fe5d81039c0 2023-12-16T20:05:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.891+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d8102d60 con 0x7fe5d81039c0 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.894+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe5d402ed40 con 0x7fe5d81039c0 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.972+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe5d804bb80 con 0x7fe5d81039c0 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.974+0000 7fe5cdffb700 1 -- 172.21.15.38:0/3004302667 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe5d401a9c0 con 0x7fe5d81039c0 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 msgr2=0x7fe5d81110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 --2- 172.21.15.38:0/3004302667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006b00 tx=0x7fe5d4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 shutdown_connections 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 --2- 172.21.15.38:0/3004302667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5d81039c0 0x7fe5d81110f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 >> 172.21.15.38:0/3004302667 conn(0x7fe5d80fda40 msgr2=0x7fe5d80ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 shutdown_connections 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:12.975+0000 7fe5df7ca700 1 -- 172.21.15.38:0/3004302667 wait complete. 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mgr... 2023-12-16T20:05:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 9283 ... 2023-12-16T20:05:13.358 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mgr.smithi038.gdlrfj 2023-12-16T20:05:13.358 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mgr.smithi038.gdlrfj.service: Unit ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mgr.smithi038.gdlrfj.service not loaded. 2023-12-16T20:05:13.513 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715.target.wants/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mgr.smithi038.gdlrfj.service → /etc/systemd/system/ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@.service. 2023-12-16T20:05:13.813 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T20:05:13.813 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2023-12-16T20:05:13.823 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T20:05:13.823 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:13.823 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2023-12-16T20:05:13.823 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T20:05:13.832 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T20:05:13.832 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr to start... 2023-12-16T20:05:13.840 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr... 2023-12-16T20:05:14.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:13 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3004302667' entity='client.admin' 2023-12-16T20:05:14.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "56b1cbe2-9c4e-11ee-95a5-87774f69a715", 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T20:05:14.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T20:05:14.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T20:05:14.400 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T20:05:14.401 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T20:05:09.981595+0000", 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T20:05:14.402 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.083+0000 7f41783d4700 1 Processor -- start 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.083+0000 7f41783d4700 1 -- start start 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.083+0000 7f41783d4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.083+0000 7f41783d4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170102d10 con 0x7f4170070f80 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.083+0000 7f4176170700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f4176170700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40074/0 (socket says 172.21.15.38:40074) 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f4176170700 1 -- 172.21.15.38:0/3812523452 learned_addr learned my addr 172.21.15.38:0/3812523452 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f4176170700 1 -- 172.21.15.38:0/3812523452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170107860 con 0x7f4170070f80 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f4176170700 1 --2- 172.21.15.38:0/3812523452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67451973b601280f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f417516e700 1 -- 172.21.15.38:0/3812523452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f416c00b860 con 0x7f4170070f80 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f417516e700 1 -- 172.21.15.38:0/3812523452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f416c00be30 con 0x7f4170070f80 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.084+0000 7f417516e700 1 -- 172.21.15.38:0/3812523452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f416c010380 con 0x7f4170070f80 2023-12-16T20:05:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 -- 172.21.15.38:0/3812523452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 msgr2=0x7f4170107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 --2- 172.21.15.38:0/3812523452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 -- 172.21.15.38:0/3812523452 shutdown_connections 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 --2- 172.21.15.38:0/3812523452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170107320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 -- 172.21.15.38:0/3812523452 >> 172.21.15.38:0/3812523452 conn(0x7f41700fc970 msgr2=0x7f41700fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 -- 172.21.15.38:0/3812523452 shutdown_connections 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.085+0000 7f41783d4700 1 -- 172.21.15.38:0/3812523452 wait complete. 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f41783d4700 1 Processor -- start 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f41783d4700 1 -- start start 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f41783d4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f41783d4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41701138c0 con 0x7f4170070f80 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f4176170700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:14.404 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f4176170700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40088/0 (socket says 172.21.15.38:40088) 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.086+0000 7f4176170700 1 -- 172.21.15.38:0/2271531615 learned_addr learned my addr 172.21.15.38:0/2271531615 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f4176170700 1 -- 172.21.15.38:0/2271531615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094f0 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f4176170700 1 --2- 172.21.15.38:0/2271531615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f416c006b00 tx=0x7f416c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f416c010a80 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f416c01a430 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4170113ac0 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f416c0245b0 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.087+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4170113ed0 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.088+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f416c024830 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.088+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f416c02e790 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.088+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417004bb80 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.091+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f416c02e9f0 con 0x7f4170070f80 2023-12-16T20:05:14.405 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.176+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f41701084f0 con 0x7f4170070f80 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.176+0000 7f4166ffd700 1 -- 172.21.15.38:0/2271531615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f416c02eb90 con 0x7f4170070f80 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 msgr2=0x7f4170113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 --2- 172.21.15.38:0/2271531615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f416c006b00 tx=0x7f416c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 shutdown_connections 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 --2- 172.21.15.38:0/2271531615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4170070f80 0x7f4170113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 >> 172.21.15.38:0/2271531615 conn(0x7f41700fc970 msgr2=0x7f41700fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 shutdown_connections 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:14.177+0000 7f41783d4700 1 -- 172.21.15.38:0/2271531615 wait complete. 2023-12-16T20:05:14.406 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (1/15)... 2023-12-16T20:05:15.107 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:14 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2271531615' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T20:05:16.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:16 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3886349117' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "56b1cbe2-9c4e-11ee-95a5-87774f69a715", 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T20:05:09.981595+0000", 2023-12-16T20:05:16.998 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.637+0000 7f080dce9700 1 Processor -- start 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.637+0000 7f080dce9700 1 -- start start 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.637+0000 7f080dce9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.637+0000 7f080dce9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080806fa20 con 0x7f080806f610 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.651+0000 7f08077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.651+0000 7f08077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40092/0 (socket says 172.21.15.38:40092) 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.651+0000 7f08077fe700 1 -- 172.21.15.38:0/29651475 learned_addr learned my addr 172.21.15.38:0/29651475 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.675+0000 7f08077fe700 1 -- 172.21.15.38:0/29651475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080806fb60 con 0x7f080806f610 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.688+0000 7f08077fe700 1 --2- 172.21.15.38:0/29651475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07f80088e0 tx=0x7f07f80082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc05bdef49f102c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:16.999 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.688+0000 7f08067fc700 1 -- 172.21.15.38:0/29651475 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07f800da80 con 0x7f080806f610 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.688+0000 7f08067fc700 1 -- 172.21.15.38:0/29651475 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f07f800dbe0 con 0x7f080806f610 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.688+0000 7f08067fc700 1 -- 172.21.15.38:0/29651475 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07f8015560 con 0x7f080806f610 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.689+0000 7f080dce9700 1 -- 172.21.15.38:0/29651475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 msgr2=0x7f080806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.689+0000 7f080dce9700 1 --2- 172.21.15.38:0/29651475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07f80088e0 tx=0x7f07f80082d0 comp rx=0 tx=0).stop 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.689+0000 7f080dce9700 1 -- 172.21.15.38:0/29651475 shutdown_connections 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.689+0000 7f080dce9700 1 --2- 172.21.15.38:0/29651475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f080806db20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.689+0000 7f080dce9700 1 -- 172.21.15.38:0/29651475 >> 172.21.15.38:0/29651475 conn(0x7f0808069180 msgr2=0x7f080806b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.693+0000 7f080dce9700 1 -- 172.21.15.38:0/29651475 shutdown_connections 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.693+0000 7f080dce9700 1 -- 172.21.15.38:0/29651475 wait complete. 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.693+0000 7f080dce9700 1 Processor -- start 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.694+0000 7f080dce9700 1 -- start start 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.694+0000 7f080dce9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.694+0000 7f080dce9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808117c60 con 0x7f080806f610 2023-12-16T20:05:17.000 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.700+0000 7f08077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.700+0000 7f08077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40108/0 (socket says 172.21.15.38:40108) 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.700+0000 7f08077fe700 1 -- 172.21.15.38:0/3886349117 learned_addr learned my addr 172.21.15.38:0/3886349117 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f08077fe700 1 -- 172.21.15.38:0/3886349117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8008570 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f08077fe700 1 --2- 172.21.15.38:0/3886349117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f07f8016d00 tx=0x7f07f80082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07f8015a30 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0808117e60 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f07f8021440 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0808118270 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.704+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07f801f5b0 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.705+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f07f801d040 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.705+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f07f802a7e0 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.706+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40052e0 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.708+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f07f8025020 con 0x7f080806f610 2023-12-16T20:05:17.001 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.781+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f07f4005860 con 0x7f080806f610 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.782+0000 7f07effff700 1 -- 172.21.15.38:0/3886349117 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f07f801b070 con 0x7f080806f610 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 msgr2=0x7f0808117720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 --2- 172.21.15.38:0/3886349117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f07f8016d00 tx=0x7f07f80082d0 comp rx=0 tx=0).stop 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 shutdown_connections 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 --2- 172.21.15.38:0/3886349117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f080806f610 0x7f0808117720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 >> 172.21.15.38:0/3886349117 conn(0x7f0808069180 msgr2=0x7f080806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 shutdown_connections 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:16.783+0000 7f080dce9700 1 -- 172.21.15.38:0/3886349117 wait complete. 2023-12-16T20:05:17.002 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (2/15)... 2023-12-16T20:05:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:05:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: mgrmap e2: smithi038.gdlrfj(active, starting, since 0.0048373s) 2023-12-16T20:05:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:05:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:05:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:20 smithi038 ceph-mon[80659]: from='mgr.14100 172.21.15.38:0/4105501586' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:22.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:21 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1267283568' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T20:05:22.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:21 smithi038 ceph-mon[80659]: mgrmap e3: smithi038.gdlrfj(active, since 1.01062s) 2023-12-16T20:05:22.114 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "56b1cbe2-9c4e-11ee-95a5-87774f69a715", 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T20:05:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:22.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T20:05:22.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T20:05:22.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T20:05:22.129 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T20:05:22.130 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T20:05:22.131 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T20:05:09.981595+0000", 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f203a476700 1 Processor -- start 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f203a476700 1 -- start start 2023-12-16T20:05:22.132 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f203a476700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f203a476700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2034105420 con 0x7f2034070fc0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f2033fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f2033fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41904/0 (socket says 172.21.15.38:41904) 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f2033fff700 1 -- 172.21.15.38:0/2219969792 learned_addr learned my addr 172.21.15.38:0/2219969792 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.698+0000 7f2033fff700 1 -- 172.21.15.38:0/2219969792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034105560 con 0x7f2034070fc0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.699+0000 7f2033fff700 1 --2- 172.21.15.38:0/2219969792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f202c009e50 tx=0x7f202c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c053258e2443dad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.699+0000 7f2032ffd700 1 -- 172.21.15.38:0/2219969792 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f202c0092e0 con 0x7f2034070fc0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.699+0000 7f2032ffd700 1 -- 172.21.15.38:0/2219969792 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f202c00be90 con 0x7f2034070fc0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.699+0000 7f2032ffd700 1 -- 172.21.15.38:0/2219969792 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f202c007400 con 0x7f2034070fc0 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 -- 172.21.15.38:0/2219969792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 msgr2=0x7f2034104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 --2- 172.21.15.38:0/2219969792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f202c009e50 tx=0x7f202c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:22.133 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 -- 172.21.15.38:0/2219969792 shutdown_connections 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 --2- 172.21.15.38:0/2219969792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f2034104ee0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 -- 172.21.15.38:0/2219969792 >> 172.21.15.38:0/2219969792 conn(0x7f20340fc970 msgr2=0x7f20340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 -- 172.21.15.38:0/2219969792 shutdown_connections 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.700+0000 7f203a476700 1 -- 172.21.15.38:0/2219969792 wait complete. 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f203a476700 1 Processor -- start 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f203a476700 1 -- start start 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f203a476700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f203a476700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341116f0 con 0x7f2034070fc0 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f2033fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f2033fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41906/0 (socket says 172.21.15.38:41906) 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.701+0000 7f2033fff700 1 -- 172.21.15.38:0/1267283568 learned_addr learned my addr 172.21.15.38:0/1267283568 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.702+0000 7f2033fff700 1 -- 172.21.15.38:0/1267283568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009ae0 con 0x7f2034070fc0 2023-12-16T20:05:22.134 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.702+0000 7f2033fff700 1 --2- 172.21.15.38:0/1267283568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f202c009fd0 tx=0x7f202c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:22.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.703+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f202c007670 con 0x7f2034070fc0 2023-12-16T20:05:22.135 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.703+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20341118f0 con 0x7f2034070fc0 2023-12-16T20:05:22.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.703+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034112590 con 0x7f2034070fc0 2023-12-16T20:05:22.136 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.703+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f202c007c40 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.703+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f202c01c7f0 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.704+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 2) v1 ==== 43037+0+0 (secure 0 0 0) 0x7f202c019070 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.704+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20200052e0 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.704+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f202c04a930 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.706+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f202c019910 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.780+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2020005590 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.780+0000 7f2030ff9700 1 -- 172.21.15.38:0/1267283568 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f202c017020 con 0x7f2034070fc0 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 msgr2=0x7f20341111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 --2- 172.21.15.38:0/1267283568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f202c009fd0 tx=0x7f202c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 shutdown_connections 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 --2- 172.21.15.38:0/1267283568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2034070fc0 0x7f20341111b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:22.137 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 >> 172.21.15.38:0/1267283568 conn(0x7f20340fc970 msgr2=0x7f20340fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:22.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 shutdown_connections 2023-12-16T20:05:22.138 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:20.781+0000 7f203a476700 1 -- 172.21.15.38:0/1267283568 wait complete. 2023-12-16T20:05:22.138 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (3/15)... 2023-12-16T20:05:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:23 smithi038 ceph-mon[80659]: mgrmap e4: smithi038.gdlrfj(active, since 2s) 2023-12-16T20:05:25.177 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "56b1cbe2-9c4e-11ee-95a5-87774f69a715", 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:25.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T20:05:25.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T20:05:25.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T20:05:25.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T20:05:25.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T20:05:25.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T20:05:25.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T20:05:25.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T20:05:25.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T20:05:25.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T20:05:09.981595+0000", 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:25.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf8461c700 1 Processor -- start 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf8461c700 1 -- start start 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf8461c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf8461c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c103100 con 0x7fdf7c1027b0 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf823b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf823b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41922/0 (socket says 172.21.15.38:41922) 2023-12-16T20:05:25.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf823b8700 1 -- 172.21.15.38:0/489262193 learned_addr learned my addr 172.21.15.38:0/489262193 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:25.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.678+0000 7fdf823b8700 1 -- 172.21.15.38:0/489262193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c103240 con 0x7fdf7c1027b0 2023-12-16T20:05:25.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf823b8700 1 --2- 172.21.15.38:0/489262193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009e50 tx=0x7fdf6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c194e73729e9a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf813b6700 1 -- 172.21.15.38:0/489262193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c0092e0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf813b6700 1 -- 172.21.15.38:0/489262193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdf6c00be90 con 0x7fdf7c1027b0 2023-12-16T20:05:25.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf813b6700 1 -- 172.21.15.38:0/489262193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c007400 con 0x7fdf7c1027b0 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf8461c700 1 -- 172.21.15.38:0/489262193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 msgr2=0x7fdf7c102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.679+0000 7fdf8461c700 1 --2- 172.21.15.38:0/489262193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009e50 tx=0x7fdf6c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- 172.21.15.38:0/489262193 shutdown_connections 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 --2- 172.21.15.38:0/489262193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c102bc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- 172.21.15.38:0/489262193 >> 172.21.15.38:0/489262193 conn(0x7fdf7c0fc0b0 msgr2=0x7fdf7c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:25.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- 172.21.15.38:0/489262193 shutdown_connections 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- 172.21.15.38:0/489262193 wait complete. 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 Processor -- start 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- start start 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.680+0000 7fdf8461c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c1116d0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf823b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf823b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41934/0 (socket says 172.21.15.38:41934) 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf823b8700 1 -- 172.21.15.38:0/957738188 learned_addr learned my addr 172.21.15.38:0/957738188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf823b8700 1 -- 172.21.15.38:0/957738188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009ae0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf823b8700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c01c620 con 0x7fdf7c1027b0 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdf6c01cbf0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c1118d0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c007bd0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.681+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c112570 con 0x7fdf7c1027b0 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.682+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fdf6c019070 con 0x7fdf7c1027b0 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.682+0000 7fdf7affd700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 0x7fdf64038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.682+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdf6c049ed0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.682+0000 7fdf81bb7700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 0x7fdf64038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.682+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c05f270 con 0x7fdf7c1027b0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.683+0000 7fdf81bb7700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 0x7fdf64038aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009990 tx=0x7fdf70006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.687+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf6c017020 con 0x7fdf7c1027b0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.965+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdf7c1127b0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.966+0000 7fdf7affd700 1 -- 172.21.15.38:0/957738188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fdf6c0243b0 con 0x7fdf7c1027b0 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 msgr2=0x7fdf64038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 0x7fdf64038aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009990 tx=0x7fdf70006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 msgr2=0x7fdf7c111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 shutdown_connections 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fdf640365f0 0x7fdf64038aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 --2- 172.21.15.38:0/957738188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf7c1027b0 0x7fdf7c111190 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.209 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 >> 172.21.15.38:0/957738188 conn(0x7fdf7c0fc0b0 msgr2=0x7fdf7c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:25.212 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 shutdown_connections 2023-12-16T20:05:25.213 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:24.968+0000 7fdf8461c700 1 -- 172.21.15.38:0/957738188 wait complete. 2023-12-16T20:05:25.213 INFO:teuthology.orchestra.run.smithi038.stdout:mgr is available 2023-12-16T20:05:25.239 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:25 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/957738188' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T20:05:25.815 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa48ba4a700 1 Processor -- start 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa48ba4a700 1 -- start start 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa48ba4a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa48ba4a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841050f0 con 0x7fa4841047a0 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa4897e6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa4897e6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41946/0 (socket says 172.21.15.38:41946) 2023-12-16T20:05:25.816 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa4897e6700 1 -- 172.21.15.38:0/3435598833 learned_addr learned my addr 172.21.15.38:0/3435598833 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.394+0000 7fa4897e6700 1 -- 172.21.15.38:0/3435598833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484105230 con 0x7fa4841047a0 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa4897e6700 1 --2- 172.21.15.38:0/3435598833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e50 tx=0x7fa480009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953fe352d5ce58a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa47bfff700 1 -- 172.21.15.38:0/3435598833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4800092e0 con 0x7fa4841047a0 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa47bfff700 1 -- 172.21.15.38:0/3435598833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa480012430 con 0x7fa4841047a0 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa47bfff700 1 -- 172.21.15.38:0/3435598833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4800075c0 con 0x7fa4841047a0 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa48ba4a700 1 -- 172.21.15.38:0/3435598833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 msgr2=0x7fa484104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/3435598833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e50 tx=0x7fa480009840 comp rx=0 tx=0).stop 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa48ba4a700 1 -- 172.21.15.38:0/3435598833 shutdown_connections 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/3435598833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484104bb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.395+0000 7fa48ba4a700 1 -- 172.21.15.38:0/3435598833 >> 172.21.15.38:0/3435598833 conn(0x7fa484077a80 msgr2=0x7fa484077e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 -- 172.21.15.38:0/3435598833 shutdown_connections 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 -- 172.21.15.38:0/3435598833 wait complete. 2023-12-16T20:05:25.817 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 Processor -- start 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 -- start start 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa48ba4a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841138d0 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa4897e6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.396+0000 7fa4897e6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41960/0 (socket says 172.21.15.38:41960) 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa4897e6700 1 -- 172.21.15.38:0/1257978608 learned_addr learned my addr 172.21.15.38:0/1257978608 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa4897e6700 1 -- 172.21.15.38:0/1257978608 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009ae0 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa4897e6700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa480009ab0 tx=0x7fa480009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4800092e0 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa480007cf0 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484113ad0 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa48001c880 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.397+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa484114770 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.398+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fa480019070 con 0x7fa4841047a0 2023-12-16T20:05:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.398+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484113f40 con 0x7fa4841047a0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.398+0000 7fa479ffb700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 0x7fa470038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.398+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa480049c40 con 0x7fa4841047a0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.398+0000 7fa488fe5700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 0x7fa470038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.399+0000 7fa488fe5700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 0x7fa470038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa474009990 tx=0x7fa474006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.403+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa480019910 con 0x7fa4841047a0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.598+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa48410d360 con 0x7fa4841047a0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.599+0000 7fa479ffb700 1 -- 172.21.15.38:0/1257978608 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa480020070 con 0x7fa4841047a0 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 msgr2=0x7fa470038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 0x7fa470038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa474009990 tx=0x7fa474006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 msgr2=0x7fa484113390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa480009ab0 tx=0x7fa480009840 comp rx=0 tx=0).stop 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 shutdown_connections 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fa4700365a0 0x7fa470038a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 --2- 172.21.15.38:0/1257978608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4841047a0 0x7fa484113390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:25.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 >> 172.21.15.38:0/1257978608 conn(0x7fa484077a80 msgr2=0x7fa484103150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:25.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 shutdown_connections 2023-12-16T20:05:25.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:25.601+0000 7fa48ba4a700 1 -- 172.21.15.38:0/1257978608 wait complete. 2023-12-16T20:05:25.820 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling cephadm module... 2023-12-16T20:05:26.056 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:26 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1257978608' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.046+0000 7fcb6e330700 1 Processor -- start 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.046+0000 7fcb6e330700 1 -- start start 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb6e330700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb6e330700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68102c20 con 0x7fcb681022d0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb67fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb67fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41964/0 (socket says 172.21.15.38:41964) 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb67fff700 1 -- 172.21.15.38:0/1779881018 learned_addr learned my addr 172.21.15.38:0/1779881018 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb67fff700 1 -- 172.21.15.38:0/1779881018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68102d60 con 0x7fcb681022d0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb67fff700 1 --2- 172.21.15.38:0/1779881018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098e0 tx=0x7fcb58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd663d48b0ef828 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb66ffd700 1 -- 172.21.15.38:0/1779881018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb5800b860 con 0x7fcb681022d0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb66ffd700 1 -- 172.21.15.38:0/1779881018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcb5800be30 con 0x7fcb681022d0 2023-12-16T20:05:27.247 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.047+0000 7fcb66ffd700 1 -- 172.21.15.38:0/1779881018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb58010380 con 0x7fcb681022d0 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 -- 172.21.15.38:0/1779881018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 msgr2=0x7fcb681026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1779881018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098e0 tx=0x7fcb58009250 comp rx=0 tx=0).stop 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 -- 172.21.15.38:0/1779881018 shutdown_connections 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1779881018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb681026e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 -- 172.21.15.38:0/1779881018 >> 172.21.15.38:0/1779881018 conn(0x7fcb680fda50 msgr2=0x7fcb680ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 -- 172.21.15.38:0/1779881018 shutdown_connections 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.048+0000 7fcb6e330700 1 -- 172.21.15.38:0/1779881018 wait complete. 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb6e330700 1 Processor -- start 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb6e330700 1 -- start start 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb6e330700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb6e330700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68111670 con 0x7fcb681022d0 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb67fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb67fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41976/0 (socket says 172.21.15.38:41976) 2023-12-16T20:05:27.248 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb67fff700 1 -- 172.21.15.38:0/1210113678 learned_addr learned my addr 172.21.15.38:0/1210113678 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.049+0000 7fcb67fff700 1 -- 172.21.15.38:0/1210113678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580094f0 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb67fff700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000c00 tx=0x7fcb58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb58010a80 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcb5801a430 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb68111870 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb580245b0 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.050+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb68111c80 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fcb5801a5a0 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb64ff9700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 0x7fcb50038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6804bb80 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcb5804aaa0 con 0x7fcb681022d0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb677fe700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 0x7fcb50038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:27.249 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.051+0000 7fcb677fe700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 0x7fcb50038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009990 tx=0x7fcb5c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.056+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb58023df0 con 0x7fcb681022d0 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:26.306+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fcb6810af50 con 0x7fcb681022d0 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.024+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fcb5800fd90 con 0x7fcb681022d0 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.025+0000 7fcb64ff9700 1 -- 172.21.15.38:0/1210113678 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fcb5800f2e0 con 0x7fcb681022d0 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 msgr2=0x7fcb50038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 0x7fcb50038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009990 tx=0x7fcb5c006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 msgr2=0x7fcb68111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000c00 tx=0x7fcb58009250 comp rx=0 tx=0).stop 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 shutdown_connections 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7fcb500365f0 0x7fcb50038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 --2- 172.21.15.38:0/1210113678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb681022d0 0x7fcb68111130 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 >> 172.21.15.38:0/1210113678 conn(0x7fcb680fda50 msgr2=0x7fcb680ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 shutdown_connections 2023-12-16T20:05:27.250 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.028+0000 7fcb6e330700 1 -- 172.21.15.38:0/1210113678 wait complete. 2023-12-16T20:05:27.296 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:27 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1210113678' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-16T20:05:27.939 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:27.939 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-16T20:05:27.939 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "smithi038.gdlrfj", 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46ecbb0700 1 Processor -- start 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46ecbb0700 1 -- start start 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46ecbb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46ecbb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8077710 con 0x7f46e8078dc0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46e659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46e659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41992/0 (socket says 172.21.15.38:41992) 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.463+0000 7f46e659c700 1 -- 172.21.15.38:0/3200686702 learned_addr learned my addr 172.21.15.38:0/3200686702 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.464+0000 7f46e659c700 1 -- 172.21.15.38:0/3200686702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8077850 con 0x7f46e8078dc0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.464+0000 7f46e659c700 1 --2- 172.21.15.38:0/3200686702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46d80098e0 tx=0x7f46d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b62736d4b87ca7d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.464+0000 7f46e559a700 1 -- 172.21.15.38:0/3200686702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46d800b860 con 0x7f46e8078dc0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.464+0000 7f46e559a700 1 -- 172.21.15.38:0/3200686702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f46d800be30 con 0x7f46e8078dc0 2023-12-16T20:05:27.940 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.464+0000 7f46e559a700 1 -- 172.21.15.38:0/3200686702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46d8010380 con 0x7f46e8078dc0 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3200686702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 msgr2=0x7f46e80771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3200686702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46d80098e0 tx=0x7f46d8009250 comp rx=0 tx=0).stop 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3200686702 shutdown_connections 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3200686702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e80771d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3200686702 >> 172.21.15.38:0/3200686702 conn(0x7f46e80fda40 msgr2=0x7f46e80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3200686702 shutdown_connections 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3200686702 wait complete. 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 Processor -- start 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.465+0000 7f46ecbb0700 1 -- start start 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46ecbb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46ecbb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8113870 con 0x7f46e8078dc0 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46e659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46e659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42006/0 (socket says 172.21.15.38:42006) 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46e659c700 1 -- 172.21.15.38:0/3099360788 learned_addr learned my addr 172.21.15.38:0/3099360788 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46e659c700 1 -- 172.21.15.38:0/3099360788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d80094f0 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46e659c700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46d80090b0 tx=0x7f46d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46d8010a80 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f46d801a430 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8113a70 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46d80245b0 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.466+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8113e80 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.467+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f46d802d3f0 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.467+0000 7f46d6ffd700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 0x7f46d0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.467+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f46d804a110 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.467+0000 7f46e5d9b700 1 -- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 msgr2=0x7f46d0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.467+0000 7f46e5d9b700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 0x7f46d0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.468+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e805f270 con 0x7f46e8078dc0 2023-12-16T20:05:27.942 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.472+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f46d802b8e0 con 0x7f46e8078dc0 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.668+0000 7f46e5d9b700 1 -- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 msgr2=0x7f46d0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.668+0000 7f46e5d9b700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 0x7f46d0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.723+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f46e804bb80 con 0x7f46e8078dc0 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.723+0000 7f46d6ffd700 1 -- 172.21.15.38:0/3099360788 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f46d802b2f0 con 0x7f46e8078dc0 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 msgr2=0x7f46d0038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 0x7f46d0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 msgr2=0x7f46e8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46d80090b0 tx=0x7f46d8009250 comp rx=0 tx=0).stop 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 shutdown_connections 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f46d0036640 0x7f46d0038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 --2- 172.21.15.38:0/3099360788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46e8078dc0 0x7f46e8113330 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 >> 172.21.15.38:0/3099360788 conn(0x7f46e80fda40 msgr2=0x7f46e80ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 shutdown_connections 2023-12-16T20:05:27.943 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:27.725+0000 7f46ecbb0700 1 -- 172.21.15.38:0/3099360788 wait complete. 2023-12-16T20:05:27.944 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2023-12-16T20:05:27.944 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 5... 2023-12-16T20:05:28.096 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:28 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1210113678' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-16T20:05:28.096 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:28 smithi038 ceph-mon[80659]: mgrmap e5: smithi038.gdlrfj(active, since 6s) 2023-12-16T20:05:28.096 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:28 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3099360788' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T20:05:34.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:05:34.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:05:34.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: osdmap e2: 0 total, 0 up, 0 in 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: mgrmap e6: smithi038.gdlrfj(active, starting, since 0.0048995s) 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:33 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:35.081 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.171+0000 7f9e24425700 1 Processor -- start 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.171+0000 7f9e24425700 1 -- start start 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e24425700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e24425700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c105420 con 0x7f9e1c070fc0 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e221c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e221c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42022/0 (socket says 172.21.15.38:42022) 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e221c1700 1 -- 172.21.15.38:0/2264138954 learned_addr learned my addr 172.21.15.38:0/2264138954 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e221c1700 1 -- 172.21.15.38:0/2264138954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c105560 con 0x7f9e1c070fc0 2023-12-16T20:05:35.082 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.172+0000 7f9e221c1700 1 --2- 172.21.15.38:0/2264138954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e180098e0 tx=0x7f9e18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f66656e39b77c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e211bf700 1 -- 172.21.15.38:0/2264138954 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e1800b860 con 0x7f9e1c070fc0 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e211bf700 1 -- 172.21.15.38:0/2264138954 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9e1800be30 con 0x7f9e1c070fc0 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e211bf700 1 -- 172.21.15.38:0/2264138954 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e18010380 con 0x7f9e1c070fc0 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 -- 172.21.15.38:0/2264138954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 msgr2=0x7f9e1c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 --2- 172.21.15.38:0/2264138954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e180098e0 tx=0x7f9e18009250 comp rx=0 tx=0).stop 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 -- 172.21.15.38:0/2264138954 shutdown_connections 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 --2- 172.21.15.38:0/2264138954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c104ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 -- 172.21.15.38:0/2264138954 >> 172.21.15.38:0/2264138954 conn(0x7f9e1c0fc970 msgr2=0x7f9e1c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.173+0000 7f9e24425700 1 -- 172.21.15.38:0/2264138954 shutdown_connections 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e24425700 1 -- 172.21.15.38:0/2264138954 wait complete. 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e24425700 1 Processor -- start 2023-12-16T20:05:35.083 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e24425700 1 -- start start 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e24425700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e24425700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c1116c0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e221c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e221c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42024/0 (socket says 172.21.15.38:42024) 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.174+0000 7f9e221c1700 1 -- 172.21.15.38:0/2835290181 learned_addr learned my addr 172.21.15.38:0/2835290181 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e221c1700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180094f0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e221c1700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e18006b00 tx=0x7f9e18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e18010a80 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9e1801a430 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c1118c0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e180245b0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.175+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c111cd0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9e180247e0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.084 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e0effd700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e1c04bb80 con 0x7f9e08036640 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9e1804aac0 con 0x7f9e1c070fc0 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e219c0700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.176+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.377+0000 7f9e219c0700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.377+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.778+0000 7f9e219c0700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:28.778+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:29.579+0000 7f9e219c0700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:29.579+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:31.180+0000 7f9e219c0700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2626729029 2023-12-16T20:05:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:31.180+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:33.871+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f9e1802e960 con 0x7f9e1c070fc0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:33.872+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 msgr2=0x7f9e08038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:33.872+0000 7f9e0effd700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.871+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f9e18020d00 con 0x7f9e1c070fc0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.871+0000 7f9e0effd700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 0x7f9e0803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.871+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e1c04bb80 con 0x7f9e08039db0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.871+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 0x7f9e0803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.872+0000 7f9e219c0700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 0x7f9e0803c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e100039d0 tx=0x7f9e10009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.873+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f9e1c04bb80 con 0x7f9e08039db0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9e1c106310 con 0x7f9e08039db0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e0effd700 1 -- 172.21.15.38:0/2835290181 <== mgr.14120 v2:172.21.15.38:6800/4128185288 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9e1c106310 con 0x7f9e08039db0 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 msgr2=0x7f9e0803c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e24425700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 0x7f9e0803c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e100039d0 tx=0x7f9e10009350 comp rx=0 tx=0).stop 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 msgr2=0x7f9e1c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.879+0000 7f9e24425700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e18006b00 tx=0x7f9e18009250 comp rx=0 tx=0).stop 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 shutdown_connections 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e1c070fc0 0x7f9e1c111180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f9e08039db0 0x7f9e0803c190 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 --2- 172.21.15.38:0/2835290181 >> [v2:172.21.15.38:6800/2626729029,v1:172.21.15.38:6801/2626729029] conn(0x7f9e08036640 0x7f9e08038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 >> 172.21.15.38:0/2835290181 conn(0x7f9e1c0fc970 msgr2=0x7f9e1c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 shutdown_connections 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:34.880+0000 7f9e24425700 1 -- 172.21.15.38:0/2835290181 wait complete. 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 5 is available 2023-12-16T20:05:35.087 INFO:teuthology.orchestra.run.smithi038.stdout:Setting orchestrator backend to cephadm... 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: Found migration_current of "None". Setting to last migration. 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:35.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: mgrmap e7: smithi038.gdlrfj(active, since 1.00555s) 2023-12-16T20:05:35.138 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:34 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8ddd2a700 1 Processor -- start 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8ddd2a700 1 -- start start 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8ddd2a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8ddd2a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8077730 con 0x7fd8d8078de0 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40496/0 (socket says 172.21.15.38:40496) 2023-12-16T20:05:35.745 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.304+0000 7fd8d77fe700 1 -- 172.21.15.38:0/2384185281 learned_addr learned my addr 172.21.15.38:0/2384185281 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.305+0000 7fd8d77fe700 1 -- 172.21.15.38:0/2384185281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8077870 con 0x7fd8d8078de0 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.305+0000 7fd8d77fe700 1 --2- 172.21.15.38:0/2384185281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098e0 tx=0x7fd8d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafe2331d97c3393 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.305+0000 7fd8d67fc700 1 -- 172.21.15.38:0/2384185281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d000b860 con 0x7fd8d8078de0 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.305+0000 7fd8d67fc700 1 -- 172.21.15.38:0/2384185281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd8d000be30 con 0x7fd8d8078de0 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.305+0000 7fd8d67fc700 1 -- 172.21.15.38:0/2384185281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d0010380 con 0x7fd8d8078de0 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/2384185281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 msgr2=0x7fd8d80771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/2384185281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098e0 tx=0x7fd8d0009250 comp rx=0 tx=0).stop 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/2384185281 shutdown_connections 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/2384185281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d80771f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/2384185281 >> 172.21.15.38:0/2384185281 conn(0x7fd8d80fda40 msgr2=0x7fd8d80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/2384185281 shutdown_connections 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/2384185281 wait complete. 2023-12-16T20:05:35.746 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 Processor -- start 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.306+0000 7fd8ddd2a700 1 -- start start 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8ddd2a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8ddd2a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8113890 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40504/0 (socket says 172.21.15.38:40504) 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8d77fe700 1 -- 172.21.15.38:0/4104808035 learned_addr learned my addr 172.21.15.38:0/4104808035 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8d77fe700 1 -- 172.21.15.38:0/4104808035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00094f0 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8d77fe700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00090b0 tx=0x7fd8d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d0010a80 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd8d001a430 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d8113a90 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d00245b0 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.307+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8113ea0 con 0x7fd8d8078de0 2023-12-16T20:05:35.747 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.308+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fd8d002d3f0 con 0x7fd8d8078de0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.308+0000 7fd8cffff700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 0x7fd8c40389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.308+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd8d001a960 con 0x7fd8d8078de0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.308+0000 7fd8d6ffd700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 0x7fd8c40389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.308+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d805f270 con 0x7fd8d8078de0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.309+0000 7fd8d6ffd700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 0x7fd8c40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009990 tx=0x7fd8c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.313+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd8d002b8e0 con 0x7fd8d8078de0 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.523+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d810cee0 con 0x7fd8c4036510 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.535+0000 7fd8cffff700 1 -- 172.21.15.38:0/4104808035 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd8d810cee0 con 0x7fd8c4036510 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 msgr2=0x7fd8c40389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 0x7fd8c40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009990 tx=0x7fd8c0006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 msgr2=0x7fd8d8113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00090b0 tx=0x7fd8d0009250 comp rx=0 tx=0).stop 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 shutdown_connections 2023-12-16T20:05:35.748 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd8c4036510 0x7fd8c40389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.749 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 --2- 172.21.15.38:0/4104808035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8078de0 0x7fd8d8113350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:35.749 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 >> 172.21.15.38:0/4104808035 conn(0x7fd8d80fda40 msgr2=0x7fd8d80ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:35.749 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 shutdown_connections 2023-12-16T20:05:35.749 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.537+0000 7fd8ddd2a700 1 -- 172.21.15.38:0/4104808035 wait complete. 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:34] ENGINE Bus STARTING 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:34] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:34] ENGINE Bus STARTED 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:35 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:36.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-16T20:05:36.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.970+0000 7fa7e6c14700 1 Processor -- start 2023-12-16T20:05:36.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.970+0000 7fa7e6c14700 1 -- start start 2023-12-16T20:05:36.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e6c14700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:36.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e6c14700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0104310 con 0x7fa7e01039c0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e49b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e49b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40518/0 (socket says 172.21.15.38:40518) 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e49b0700 1 -- 172.21.15.38:0/2684481066 learned_addr learned my addr 172.21.15.38:0/2684481066 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e49b0700 1 -- 172.21.15.38:0/2684481066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0101fb0 con 0x7fa7e01039c0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7e49b0700 1 --2- 172.21.15.38:0/2684481066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434458676aff8e5e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.971+0000 7fa7df7fe700 1 -- 172.21.15.38:0/2684481066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7d80092e0 con 0x7fa7e01039c0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7df7fe700 1 -- 172.21.15.38:0/2684481066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa7d800be90 con 0x7fa7e01039c0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7df7fe700 1 -- 172.21.15.38:0/2684481066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7d8007400 con 0x7fa7e01039c0 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 -- 172.21.15.38:0/2684481066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 msgr2=0x7fa7e0103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/2684481066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d8009840 comp rx=0 tx=0).stop 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 -- 172.21.15.38:0/2684481066 shutdown_connections 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/2684481066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0103dd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 -- 172.21.15.38:0/2684481066 >> 172.21.15.38:0/2684481066 conn(0x7fa7e00fda40 msgr2=0x7fa7e00ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:36.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 -- 172.21.15.38:0/2684481066 shutdown_connections 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.972+0000 7fa7e6c14700 1 -- 172.21.15.38:0/2684481066 wait complete. 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e6c14700 1 Processor -- start 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e6c14700 1 -- start start 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e6c14700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e6c14700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0111640 con 0x7fa7e01039c0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e49b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e49b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40532/0 (socket says 172.21.15.38:40532) 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.973+0000 7fa7e49b0700 1 -- 172.21.15.38:0/3295486091 learned_addr learned my addr 172.21.15.38:0/3295486091 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7e49b0700 1 -- 172.21.15.38:0/3295486091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009ae0 con 0x7fa7e01039c0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7e49b0700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800bc50 tx=0x7fa7d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7d8007670 con 0x7fa7e01039c0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e0111840 con 0x7fa7e01039c0 2023-12-16T20:05:36.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa7d8007c40 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7d801cc00 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.974+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01124e0 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.975+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fa7d8019070 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.975+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0111cb0 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.975+0000 7fa7dd7fa700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 0x7fa7c8038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.975+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa7d8049dd0 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.975+0000 7fa7dffff700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 0x7fa7c8038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.976+0000 7fa7dffff700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 0x7fa7c8038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009990 tx=0x7fa7d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:35.980+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa7d8019910 con 0x7fa7e01039c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.181+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7e0113020 con 0x7fa7c80364c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.181+0000 7fa7dd7fa700 1 -- 172.21.15.38:0/3295486091 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fa7e0113020 con 0x7fa7c80364c0 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.183+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 msgr2=0x7fa7c8038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:36.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.183+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 0x7fa7c8038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009990 tx=0x7fa7d4006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.183+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 msgr2=0x7fa7e0111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.183+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800bc50 tx=0x7fa7d8009840 comp rx=0 tx=0).stop 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 shutdown_connections 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa7c80364c0 0x7fa7c8038970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 --2- 172.21.15.38:0/3295486091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7e01039c0 0x7fa7e0111100 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 >> 172.21.15.38:0/3295486091 conn(0x7fa7e00fda40 msgr2=0x7fa7e00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 shutdown_connections 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.184+0000 7fa7e6c14700 1 -- 172.21.15.38:0/3295486091 wait complete. 2023-12-16T20:05:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:Generating ssh key... 2023-12-16T20:05:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:36 smithi038 ceph-mon[80659]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:36 smithi038 ceph-mon[80659]: mgrmap e8: smithi038.gdlrfj(active, since 2s) 2023-12-16T20:05:37.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.641+0000 7fd29ff05700 1 Processor -- start 2023-12-16T20:05:37.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.641+0000 7fd29ff05700 1 -- start start 2023-12-16T20:05:37.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29ff05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29ff05700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298101b20 con 0x7fd2981011d0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29dca1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29dca1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40542/0 (socket says 172.21.15.38:40542) 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29dca1700 1 -- 172.21.15.38:0/3823524429 learned_addr learned my addr 172.21.15.38:0/3823524429 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29dca1700 1 -- 172.21.15.38:0/3823524429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298101c60 con 0x7fd2981011d0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.642+0000 7fd29dca1700 1 --2- 172.21.15.38:0/3823524429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2900098e0 tx=0x7fd290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d8ca12ca13e4a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29cc9f700 1 -- 172.21.15.38:0/3823524429 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd29000b860 con 0x7fd2981011d0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29cc9f700 1 -- 172.21.15.38:0/3823524429 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd29000be30 con 0x7fd2981011d0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29cc9f700 1 -- 172.21.15.38:0/3823524429 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd290010380 con 0x7fd2981011d0 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29ff05700 1 -- 172.21.15.38:0/3823524429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 msgr2=0x7fd2981015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29ff05700 1 --2- 172.21.15.38:0/3823524429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2900098e0 tx=0x7fd290009250 comp rx=0 tx=0).stop 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29ff05700 1 -- 172.21.15.38:0/3823524429 shutdown_connections 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29ff05700 1 --2- 172.21.15.38:0/3823524429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd2981015e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.643+0000 7fd29ff05700 1 -- 172.21.15.38:0/3823524429 >> 172.21.15.38:0/3823524429 conn(0x7fd2980fc950 msgr2=0x7fd2980fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:37.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 -- 172.21.15.38:0/3823524429 shutdown_connections 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 -- 172.21.15.38:0/3823524429 wait complete. 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 Processor -- start 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 -- start start 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29ff05700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298110580 con 0x7fd2981011d0 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.644+0000 7fd29dca1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29dca1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40556/0 (socket says 172.21.15.38:40556) 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29dca1700 1 -- 172.21.15.38:0/2330455284 learned_addr learned my addr 172.21.15.38:0/2330455284 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29dca1700 1 -- 172.21.15.38:0/2330455284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900094f0 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29dca1700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd290000c00 tx=0x7fd290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd290010a80 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd29001a430 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd298110780 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298110b90 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.645+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2900245b0 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.646+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29804bb80 con 0x7fd2981011d0 2023-12-16T20:05:37.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.646+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd29001a5a0 con 0x7fd2981011d0 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.647+0000 7fd2967fc700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 0x7fd280038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.647+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd29004aa20 con 0x7fd2981011d0 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.647+0000 7fd29d4a0700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 0x7fd280038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.647+0000 7fd29d4a0700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 0x7fd280038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009990 tx=0x7fd28c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.651+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd2900239e0 con 0x7fd2981011d0 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:36.850+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd298109ec0 con 0x7fd280036640 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.274+0000 7fd2967fc700 1 -- 172.21.15.38:0/2330455284 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd298109ec0 con 0x7fd280036640 2023-12-16T20:05:37.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 msgr2=0x7fd280038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 0x7fd280038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009990 tx=0x7fd28c006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 msgr2=0x7fd298110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd290000c00 tx=0x7fd290009250 comp rx=0 tx=0).stop 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 shutdown_connections 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fd280036640 0x7fd280038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 --2- 172.21.15.38:0/2330455284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2981011d0 0x7fd298110040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.276+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 >> 172.21.15.38:0/2330455284 conn(0x7fd2980fc950 msgr2=0x7fd2980fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:37.503 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.277+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 shutdown_connections 2023-12-16T20:05:37.504 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.277+0000 7fd29ff05700 1 -- 172.21.15.38:0/2330455284 wait complete. 2023-12-16T20:05:38.161 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDux3obQz8/OxrzUKOg+dww2OQ32fbG3NjVowQbosAELCQTQ+ew3NUhaV1ikw2r46qB/WjU8SG/H28ajV3wzkk/jWOfwdcn55ZW3JYa6ValOAMzKCcEASacmpioLCOQoIturazkyBLsBATdhzTdehs25lgYrst1oQ2rQwMlvcaCs1fvZZ2lpW6tw9eDjWOaSw1auUrjlmECIAdwJ6n8HR/fFWMOdaF0bX5wxwmfq+7NVajBY4L6+5GCVLgQqj2PNqT9IDj9o4B1eube04gC9B0soAjKbwH9DSBIpYg9CsIELTQGAcbVK+m5k5ZbQUP/U90AH0GKse4P0S/Ji3nqUIn59nXarDOJeIRImScpzkx7vrA708yO0JhoA2rUNDJfCE9dq0C7x3xXoszUHw9fYR6lEN+6zB8SyHu4rqamZW99qrUTs2wT63m/DmwSKB4e1wQZecAKrqtEAJ8i52hOTgBHcTwTzWfLll6oI19ImtiXGrjJ6ZbfCcySMi1YxWExiac= ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.735+0000 7f607bf9e700 1 Processor -- start 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.735+0000 7f607bf9e700 1 -- start start 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.735+0000 7f607bf9e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.735+0000 7f607bf9e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074077710 con 0x7f6074078dc0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6079d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6079d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40572/0 (socket says 172.21.15.38:40572) 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6079d3a700 1 -- 172.21.15.38:0/2106945034 learned_addr learned my addr 172.21.15.38:0/2106945034 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6079d3a700 1 -- 172.21.15.38:0/2106945034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074077850 con 0x7f6074078dc0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6079d3a700 1 --2- 172.21.15.38:0/2106945034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f606c0098e0 tx=0x7f606c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac858c3e35610213 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6078d38700 1 -- 172.21.15.38:0/2106945034 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606c00b860 con 0x7f6074078dc0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6078d38700 1 -- 172.21.15.38:0/2106945034 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f606c00be30 con 0x7f6074078dc0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.736+0000 7f6078d38700 1 -- 172.21.15.38:0/2106945034 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606c010380 con 0x7f6074078dc0 2023-12-16T20:05:38.162 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 -- 172.21.15.38:0/2106945034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 msgr2=0x7f60740771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 --2- 172.21.15.38:0/2106945034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f606c0098e0 tx=0x7f606c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 -- 172.21.15.38:0/2106945034 shutdown_connections 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 --2- 172.21.15.38:0/2106945034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f60740771d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 -- 172.21.15.38:0/2106945034 >> 172.21.15.38:0/2106945034 conn(0x7f60740fda40 msgr2=0x7f60740ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 -- 172.21.15.38:0/2106945034 shutdown_connections 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.737+0000 7f607bf9e700 1 -- 172.21.15.38:0/2106945034 wait complete. 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f607bf9e700 1 Processor -- start 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f607bf9e700 1 -- start start 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f607bf9e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f607bf9e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074113870 con 0x7f6074078dc0 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f6079d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f6079d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40574/0 (socket says 172.21.15.38:40574) 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f6079d3a700 1 -- 172.21.15.38:0/3761499276 learned_addr learned my addr 172.21.15.38:0/3761499276 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:38.163 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f6079d3a700 1 -- 172.21.15.38:0/3761499276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0094f0 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.738+0000 7f6079d3a700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f606c0090b0 tx=0x7f606c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606c010a80 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f606c01a430 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606c0245b0 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074113a70 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6074113e80 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.739+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f606c010be0 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.740+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074108620 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.740+0000 7f60727fc700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 0x7f605c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.740+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f606c04a5e0 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.740+0000 7f6079539700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 0x7f605c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.740+0000 7f6079539700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 0x7f605c038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6068009990 tx=0x7f6068006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.745+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f606c02c340 con 0x7f6074078dc0 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.943+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f607410d260 con 0x7f605c036640 2023-12-16T20:05:38.164 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.943+0000 7f60727fc700 1 -- 172.21.15.38:0/3761499276 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f607410d260 con 0x7f605c036640 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 msgr2=0x7f605c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 0x7f605c038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6068009990 tx=0x7f6068006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 msgr2=0x7f6074113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f606c0090b0 tx=0x7f606c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 shutdown_connections 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f605c036640 0x7f605c038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 --2- 172.21.15.38:0/3761499276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074078dc0 0x7f6074113330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 >> 172.21.15.38:0/3761499276 conn(0x7f60740fda40 msgr2=0x7f60740ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 shutdown_connections 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:37.945+0000 7f607bf9e700 1 -- 172.21.15.38:0/3761499276 wait complete. 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:Adding key to root@localhost authorized_keys... 2023-12-16T20:05:38.165 INFO:teuthology.orchestra.run.smithi038.stdout:Adding host smithi038... 2023-12-16T20:05:38.220 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:37 smithi038 ceph-mon[80659]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:38.220 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:37 smithi038 ceph-mon[80659]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:38.220 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:37 smithi038 ceph-mon[80659]: Generating ssh key... 2023-12-16T20:05:38.220 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:37 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:38.220 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:37 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:39.185 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:38 smithi038 ceph-mon[80659]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:40.137 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:39 smithi038 ceph-mon[80659]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Added host 'smithi038' with addr '172.21.15.38' 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a9a72700 1 Processor -- start 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a9a72700 1 -- start start 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a9a72700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a9a72700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4104310 con 0x7fa4a41039c0 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40584/0 (socket says 172.21.15.38:40584) 2023-12-16T20:05:40.887 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a37fe700 1 -- 172.21.15.38:0/2636170782 learned_addr learned my addr 172.21.15.38:0/2636170782 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.388+0000 7fa4a37fe700 1 -- 172.21.15.38:0/2636170782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4101fb0 con 0x7fa4a41039c0 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a37fe700 1 --2- 172.21.15.38:0/2636170782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4940098e0 tx=0x7fa494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdb388b254e2a7d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a27fc700 1 -- 172.21.15.38:0/2636170782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49400b860 con 0x7fa4a41039c0 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a27fc700 1 -- 172.21.15.38:0/2636170782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa49400be30 con 0x7fa4a41039c0 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a27fc700 1 -- 172.21.15.38:0/2636170782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa494010380 con 0x7fa4a41039c0 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 -- 172.21.15.38:0/2636170782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 msgr2=0x7fa4a4103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/2636170782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4940098e0 tx=0x7fa494009250 comp rx=0 tx=0).stop 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 -- 172.21.15.38:0/2636170782 shutdown_connections 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/2636170782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a4103dd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 -- 172.21.15.38:0/2636170782 >> 172.21.15.38:0/2636170782 conn(0x7fa4a40fda40 msgr2=0x7fa4a40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 -- 172.21.15.38:0/2636170782 shutdown_connections 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.389+0000 7fa4a9a72700 1 -- 172.21.15.38:0/2636170782 wait complete. 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a9a72700 1 Processor -- start 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a9a72700 1 -- start start 2023-12-16T20:05:40.888 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a9a72700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a9a72700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4111630 con 0x7fa4a41039c0 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40588/0 (socket says 172.21.15.38:40588) 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a37fe700 1 -- 172.21.15.38:0/1776885379 learned_addr learned my addr 172.21.15.38:0/1776885379 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.390+0000 7fa4a37fe700 1 -- 172.21.15.38:0/1776885379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940094f0 con 0x7fa4a41039c0 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa4a37fe700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa494006b00 tx=0x7fa494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4940109b0 con 0x7fa4a41039c0 2023-12-16T20:05:40.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa49401a430 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a4111830 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4940245b0 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.391+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a4111c40 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa494010b10 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a4102d60 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa48bfff700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 0x7fa48c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa49404abf0 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa4a2ffd700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 0x7fa48c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.392+0000 7fa4a2ffd700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 0x7fa48c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa498009990 tx=0x7fa498006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.397+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa49402cb80 con 0x7fa4a41039c0 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:38.595+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a40ffdb0 con 0x7fa48c036640 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.680+0000 7fa48bfff700 1 -- 172.21.15.38:0/1776885379 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa4a40ffdb0 con 0x7fa48c036640 2023-12-16T20:05:40.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 msgr2=0x7fa48c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 0x7fa48c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa498009990 tx=0x7fa498006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 msgr2=0x7fa4a41110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa494006b00 tx=0x7fa494009250 comp rx=0 tx=0).stop 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 shutdown_connections 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa48c036640 0x7fa48c038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 --2- 172.21.15.38:0/1776885379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a41039c0 0x7fa4a41110f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 >> 172.21.15.38:0/1776885379 conn(0x7fa4a40fda40 msgr2=0x7fa4a40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 shutdown_connections 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:40.683+0000 7fa4a9a72700 1 -- 172.21.15.38:0/1776885379 wait complete. 2023-12-16T20:05:40.891 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying mon service with default placement... 2023-12-16T20:05:41.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:40 smithi038 ceph-mon[80659]: Deploying cephadm binary to smithi038 2023-12-16T20:05:41.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:40 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:41.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:40 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.141+0000 7fac3f3b7700 1 Processor -- start 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3f3b7700 1 -- start start 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3f3b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3f3b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38105460 con 0x7fac38070f80 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3d153700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3d153700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56668/0 (socket says 172.21.15.38:56668) 2023-12-16T20:05:41.795 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3d153700 1 -- 172.21.15.38:0/2991445942 learned_addr learned my addr 172.21.15.38:0/2991445942 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3d153700 1 -- 172.21.15.38:0/2991445942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac381055a0 con 0x7fac38070f80 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.142+0000 7fac3d153700 1 --2- 172.21.15.38:0/2991445942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac340098e0 tx=0x7fac34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7fd763682efbce server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac2bfff700 1 -- 172.21.15.38:0/2991445942 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac3400b860 con 0x7fac38070f80 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac2bfff700 1 -- 172.21.15.38:0/2991445942 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fac3400be30 con 0x7fac38070f80 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac2bfff700 1 -- 172.21.15.38:0/2991445942 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac34010380 con 0x7fac38070f80 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac3f3b7700 1 -- 172.21.15.38:0/2991445942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 msgr2=0x7fac38104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/2991445942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac340098e0 tx=0x7fac34009250 comp rx=0 tx=0).stop 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac3f3b7700 1 -- 172.21.15.38:0/2991445942 shutdown_connections 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/2991445942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac38104f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.143+0000 7fac3f3b7700 1 -- 172.21.15.38:0/2991445942 >> 172.21.15.38:0/2991445942 conn(0x7fac380fc970 msgr2=0x7fac380fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 -- 172.21.15.38:0/2991445942 shutdown_connections 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 -- 172.21.15.38:0/2991445942 wait complete. 2023-12-16T20:05:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 Processor -- start 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 -- start start 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3f3b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38100e20 con 0x7fac38070f80 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3d153700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3d153700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56684/0 (socket says 172.21.15.38:56684) 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.144+0000 7fac3d153700 1 -- 172.21.15.38:0/3745747342 learned_addr learned my addr 172.21.15.38:0/3745747342 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac3d153700 1 -- 172.21.15.38:0/3745747342 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340094f0 con 0x7fac38070f80 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac3d153700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac34006d40 tx=0x7fac34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac340109b0 con 0x7fac38070f80 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac38101020 con 0x7fac38070f80 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fac34024440 con 0x7fac38070f80 2023-12-16T20:05:41.797 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac3401a5f0 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.145+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38101430 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.146+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fac3401a870 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.146+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3804bb80 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.146+0000 7fac29ffb700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 0x7fac24038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.146+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fac3404a5a0 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.147+0000 7fac3c952700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 0x7fac24038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.147+0000 7fac3c952700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 0x7fac24038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009990 tx=0x7fac2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.151+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fac34018350 con 0x7fac38070f80 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.361+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fac3810adb0 con 0x7fac240365f0 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.367+0000 7fac29ffb700 1 -- 172.21.15.38:0/3745747342 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fac3810adb0 con 0x7fac240365f0 2023-12-16T20:05:41.798 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 msgr2=0x7fac24038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 0x7fac24038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009990 tx=0x7fac2c006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 msgr2=0x7fac381029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac34006d40 tx=0x7fac34009250 comp rx=0 tx=0).stop 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 shutdown_connections 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fac240365f0 0x7fac24038aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 --2- 172.21.15.38:0/3745747342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac38070f80 0x7fac381029a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 >> 172.21.15.38:0/3745747342 conn(0x7fac380fc970 msgr2=0x7fac380fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 shutdown_connections 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:41.369+0000 7fac3f3b7700 1 -- 172.21.15.38:0/3745747342 wait complete. 2023-12-16T20:05:41.799 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying mgr service with default placement... 2023-12-16T20:05:42.006 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:41 smithi038 ceph-mon[80659]: Added host smithi038 2023-12-16T20:05:42.006 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:41 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:42.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4577cb0700 1 Processor -- start 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4577cb0700 1 -- start start 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4577cb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4577cb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4570104240 con 0x7f45701038f0 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4575a4c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4575a4c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56694/0 (socket says 172.21.15.38:56694) 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.006+0000 7f4575a4c700 1 -- 172.21.15.38:0/1050596551 learned_addr learned my addr 172.21.15.38:0/1050596551 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.007+0000 7f4575a4c700 1 -- 172.21.15.38:0/1050596551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570104380 con 0x7f45701038f0 2023-12-16T20:05:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.007+0000 7f4575a4c700 1 --2- 172.21.15.38:0/1050596551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f456c0098e0 tx=0x7f456c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ea1080541ee4b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.007+0000 7f4574a4a700 1 -- 172.21.15.38:0/1050596551 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456c00b860 con 0x7f45701038f0 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.007+0000 7f4574a4a700 1 -- 172.21.15.38:0/1050596551 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f456c00be30 con 0x7f45701038f0 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.007+0000 7f4574a4a700 1 -- 172.21.15.38:0/1050596551 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456c010380 con 0x7f45701038f0 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- 172.21.15.38:0/1050596551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 msgr2=0x7f4570103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1050596551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f456c0098e0 tx=0x7f456c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- 172.21.15.38:0/1050596551 shutdown_connections 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1050596551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570103d00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- 172.21.15.38:0/1050596551 >> 172.21.15.38:0/1050596551 conn(0x7f45700fc0b0 msgr2=0x7f45700fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- 172.21.15.38:0/1050596551 shutdown_connections 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- 172.21.15.38:0/1050596551 wait complete. 2023-12-16T20:05:42.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 Processor -- start 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.008+0000 7f4577cb0700 1 -- start start 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4577cb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4577cb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4570111650 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4575a4c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4575a4c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56704/0 (socket says 172.21.15.38:56704) 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4575a4c700 1 -- 172.21.15.38:0/1272333543 learned_addr learned my addr 172.21.15.38:0/1272333543 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4575a4c700 1 -- 172.21.15.38:0/1272333543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0094f0 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4575a4c700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f456c000c00 tx=0x7f456c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456c010a80 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f456c01a430 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570111850 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456c0245b0 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.009+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4570111c60 con 0x7f45701038f0 2023-12-16T20:05:42.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.010+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f456c0247a0 con 0x7f45701038f0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.010+0000 7f45667fc700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 0x7f455c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.010+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f456c04ab30 con 0x7f45701038f0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.010+0000 7f457524b700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 0x7f455c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.010+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457004bb80 con 0x7f45701038f0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.011+0000 7f457524b700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 0x7f455c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4560009990 tx=0x7f4560006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.015+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f456c018350 con 0x7f45701038f0 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.228+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f457010acf0 con 0x7f455c036640 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.233+0000 7f45667fc700 1 -- 172.21.15.38:0/1272333543 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f457010acf0 con 0x7f455c036640 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 msgr2=0x7f455c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 0x7f455c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4560009990 tx=0x7f4560006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 msgr2=0x7f4570111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f456c000c00 tx=0x7f456c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 shutdown_connections 2023-12-16T20:05:42.582 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f455c036640 0x7f455c038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:42.583 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 --2- 172.21.15.38:0/1272333543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45701038f0 0x7f4570111110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:42.583 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 >> 172.21.15.38:0/1272333543 conn(0x7f45700fc0b0 msgr2=0x7f45700fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:42.583 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.236+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 shutdown_connections 2023-12-16T20:05:42.583 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.237+0000 7f4577cb0700 1 -- 172.21.15.38:0/1272333543 wait complete. 2023-12-16T20:05:42.583 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying crash service with default placement... 2023-12-16T20:05:43.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:42 smithi038 ceph-mon[80659]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:43.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:42 smithi038 ceph-mon[80659]: Saving service mon spec with placement count:5 2023-12-16T20:05:43.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:42 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:43.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:42 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:43.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:42 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f53a11a4700 1 Processor -- start 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f53a11a4700 1 -- start start 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f53a11a4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f53a11a4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c104310 con 0x7f539c1039c0 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56718/0 (socket says 172.21.15.38:56718) 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f539ad9d700 1 -- 172.21.15.38:0/3975392582 learned_addr learned my addr 172.21.15.38:0/3975392582 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f539ad9d700 1 -- 172.21.15.38:0/3975392582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c101fb0 con 0x7f539c1039c0 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.821+0000 7f539ad9d700 1 --2- 172.21.15.38:0/3975392582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f538c009e50 tx=0x7f538c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9afbab6f95b5fbd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:43.262 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f5399d9b700 1 -- 172.21.15.38:0/3975392582 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c0092e0 con 0x7f539c1039c0 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f5399d9b700 1 -- 172.21.15.38:0/3975392582 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f538c012430 con 0x7f539c1039c0 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f5399d9b700 1 -- 172.21.15.38:0/3975392582 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c0075c0 con 0x7f539c1039c0 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 -- 172.21.15.38:0/3975392582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 msgr2=0x7f539c103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3975392582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f538c009e50 tx=0x7f538c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 -- 172.21.15.38:0/3975392582 shutdown_connections 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3975392582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c103dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 -- 172.21.15.38:0/3975392582 >> 172.21.15.38:0/3975392582 conn(0x7f539c0fda40 msgr2=0x7f539c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 -- 172.21.15.38:0/3975392582 shutdown_connections 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.822+0000 7f53a11a4700 1 -- 172.21.15.38:0/3975392582 wait complete. 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f53a11a4700 1 Processor -- start 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f53a11a4700 1 -- start start 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f53a11a4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f53a11a4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c111680 con 0x7f539c1039c0 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:43.263 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56726/0 (socket says 172.21.15.38:56726) 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.823+0000 7f539ad9d700 1 -- 172.21.15.38:0/3140043093 learned_addr learned my addr 172.21.15.38:0/3140043093 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f539ad9d700 1 -- 172.21.15.38:0/3140043093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009ae0 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f539ad9d700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f538c00bc80 tx=0x7f538c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c0092e0 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f538c012900 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c111880 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f538c025970 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.824+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c111c90 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.825+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f538c019050 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.825+0000 7f53837fe700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 0x7f5384038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.825+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f538c049fa0 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.825+0000 7f539a59c700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 0x7f5384038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.825+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c05f270 con 0x7f539c1039c0 2023-12-16T20:05:43.264 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.826+0000 7f539a59c700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 0x7f5384038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5390009990 tx=0x7f5390006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:42.830+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f538c017080 con 0x7f539c1039c0 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.045+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f539c10acf0 con 0x7f5384036640 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.051+0000 7f53837fe700 1 -- 172.21.15.38:0/3140043093 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f539c10acf0 con 0x7f5384036640 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 msgr2=0x7f5384038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 0x7f5384038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5390009990 tx=0x7f5390006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 msgr2=0x7f539c111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f538c00bc80 tx=0x7f538c009840 comp rx=0 tx=0).stop 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 shutdown_connections 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f5384036640 0x7f5384038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 --2- 172.21.15.38:0/3140043093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f539c1039c0 0x7f539c111140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.053+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 >> 172.21.15.38:0/3140043093 conn(0x7f539c0fda40 msgr2=0x7f539c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.054+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 shutdown_connections 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.054+0000 7f53a11a4700 1 -- 172.21.15.38:0/3140043093 wait complete. 2023-12-16T20:05:43.265 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying prometheus service with default placement... 2023-12-16T20:05:44.046 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-16T20:05:44.046 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcf836700 1 Processor -- start 2023-12-16T20:05:44.046 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcf836700 1 -- start start 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcf836700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcf836700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81054c0 con 0x7f1fc8076b80 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcd5d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcd5d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56738/0 (socket says 172.21.15.38:56738) 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.473+0000 7f1fcd5d2700 1 -- 172.21.15.38:0/2529750573 learned_addr learned my addr 172.21.15.38:0/2529750573 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.474+0000 7f1fcd5d2700 1 -- 172.21.15.38:0/2529750573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8105600 con 0x7f1fc8076b80 2023-12-16T20:05:44.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.474+0000 7f1fcd5d2700 1 --2- 172.21.15.38:0/2529750573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098e0 tx=0x7f1fc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28ba0acaf980f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.474+0000 7f1fbffff700 1 -- 172.21.15.38:0/2529750573 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fc400b860 con 0x7f1fc8076b80 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.474+0000 7f1fbffff700 1 -- 172.21.15.38:0/2529750573 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fc400be70 con 0x7f1fc8076b80 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.474+0000 7f1fbffff700 1 -- 172.21.15.38:0/2529750573 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fc4010380 con 0x7f1fc8076b80 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 -- 172.21.15.38:0/2529750573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 msgr2=0x7f1fc8104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 --2- 172.21.15.38:0/2529750573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098e0 tx=0x7f1fc4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 -- 172.21.15.38:0/2529750573 shutdown_connections 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 --2- 172.21.15.38:0/2529750573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc8104f80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 -- 172.21.15.38:0/2529750573 >> 172.21.15.38:0/2529750573 conn(0x7f1fc80fc950 msgr2=0x7f1fc80fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 -- 172.21.15.38:0/2529750573 shutdown_connections 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.475+0000 7f1fcf836700 1 -- 172.21.15.38:0/2529750573 wait complete. 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcf836700 1 Processor -- start 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcf836700 1 -- start start 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcf836700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcf836700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8111730 con 0x7f1fc8076b80 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcd5d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcd5d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56746/0 (socket says 172.21.15.38:56746) 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.476+0000 7f1fcd5d2700 1 -- 172.21.15.38:0/3211556790 learned_addr learned my addr 172.21.15.38:0/3211556790 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fcd5d2700 1 -- 172.21.15.38:0/3211556790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40094f0 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fcd5d2700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40094c0 tx=0x7f1fc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fc4010850 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fc4010e60 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fc40243f0 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8111930 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.477+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8111d40 con 0x7f1fc8076b80 2023-12-16T20:05:44.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.478+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1fc40245a0 con 0x7f1fc8076b80 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.478+0000 7f1fbdffb700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 0x7f1fb4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.478+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1fc404a460 con 0x7f1fc8076b80 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.478+0000 7f1fccdd1700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 0x7f1fb4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.479+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc804bb80 con 0x7f1fc8076b80 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.479+0000 7f1fccdd1700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 0x7f1fb4038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009990 tx=0x7f1fb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.484+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1fc4018940 con 0x7f1fc8076b80 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.707+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fc810ac70 con 0x7f1fb4036640 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.711+0000 7f1fbdffb700 1 -- 172.21.15.38:0/3211556790 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f1fc810ac70 con 0x7f1fb4036640 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 msgr2=0x7f1fb4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 0x7f1fb4038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009990 tx=0x7f1fb8006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 msgr2=0x7f1fc81111f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40094c0 tx=0x7f1fc4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 shutdown_connections 2023-12-16T20:05:44.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1fb4036640 0x7f1fb4038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 --2- 172.21.15.38:0/3211556790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1fc8076b80 0x7f1fc81111f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.713+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 >> 172.21.15.38:0/3211556790 conn(0x7f1fc80fc950 msgr2=0x7f1fc80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:44.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.714+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 shutdown_connections 2023-12-16T20:05:44.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:43.714+0000 7f1fcf836700 1 -- 172.21.15.38:0/3211556790 wait complete. 2023-12-16T20:05:44.052 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying grafana service with default placement... 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: Saving service mgr spec with placement count:2 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: Saving service crash spec with placement * 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:44.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:44.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:44 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.259+0000 7fc71b991700 1 Processor -- start 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.259+0000 7fc71b991700 1 -- start start 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71b991700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71b991700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714101b20 con 0x7fc7141011d0 2023-12-16T20:05:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71972d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71972d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56750/0 (socket says 172.21.15.38:56750) 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71972d700 1 -- 172.21.15.38:0/2139839716 learned_addr learned my addr 172.21.15.38:0/2139839716 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71972d700 1 -- 172.21.15.38:0/2139839716 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714101c60 con 0x7fc7141011d0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc71972d700 1 --2- 172.21.15.38:0/2139839716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7040098e0 tx=0x7fc704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04467caf4e6aa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.260+0000 7fc70bfff700 1 -- 172.21.15.38:0/2139839716 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc70400b860 con 0x7fc7141011d0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc70bfff700 1 -- 172.21.15.38:0/2139839716 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc70400be70 con 0x7fc7141011d0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc70bfff700 1 -- 172.21.15.38:0/2139839716 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc704010380 con 0x7fc7141011d0 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 -- 172.21.15.38:0/2139839716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 msgr2=0x7fc7141015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 --2- 172.21.15.38:0/2139839716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7040098e0 tx=0x7fc704009250 comp rx=0 tx=0).stop 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 -- 172.21.15.38:0/2139839716 shutdown_connections 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 --2- 172.21.15.38:0/2139839716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc7141015e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 -- 172.21.15.38:0/2139839716 >> 172.21.15.38:0/2139839716 conn(0x7fc7140fc970 msgr2=0x7fc7140fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 -- 172.21.15.38:0/2139839716 shutdown_connections 2023-12-16T20:05:44.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.261+0000 7fc71b991700 1 -- 172.21.15.38:0/2139839716 wait complete. 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71b991700 1 Processor -- start 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71b991700 1 -- start start 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71b991700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71b991700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141105b0 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71972d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71972d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56764/0 (socket says 172.21.15.38:56764) 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71972d700 1 -- 172.21.15.38:0/3168470150 learned_addr learned my addr 172.21.15.38:0/3168470150 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.262+0000 7fc71972d700 1 -- 172.21.15.38:0/3168470150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040094f0 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc71972d700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c010 tx=0x7fc704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc704010960 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc70401a430 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7141107b0 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc704019580 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.263+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc714110bc0 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.264+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc704019800 con 0x7fc7141011d0 2023-12-16T20:05:44.691 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.264+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71404bb80 con 0x7fc7141011d0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.264+0000 7fc709ffb700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 0x7fc700038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.264+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc70404a520 con 0x7fc7141011d0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.264+0000 7fc718f2c700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 0x7fc700038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.265+0000 7fc718f2c700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 0x7fc700038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc710009990 tx=0x7fc710006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.269+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc70402b900 con 0x7fc7141011d0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.473+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fc714109f00 con 0x7fc7000365f0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.479+0000 7fc709ffb700 1 -- 172.21.15.38:0/3168470150 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc714109f00 con 0x7fc7000365f0 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 msgr2=0x7fc700038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 0x7fc700038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc710009990 tx=0x7fc710006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 msgr2=0x7fc714110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c010 tx=0x7fc704009250 comp rx=0 tx=0).stop 2023-12-16T20:05:44.692 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 shutdown_connections 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fc7000365f0 0x7fc700038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 --2- 172.21.15.38:0/3168470150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7141011d0 0x7fc714110070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 >> 172.21.15.38:0/3168470150 conn(0x7fc7140fc970 msgr2=0x7fc7140fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 shutdown_connections 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.481+0000 7fc71b991700 1 -- 172.21.15.38:0/3168470150 wait complete. 2023-12-16T20:05:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying node-exporter service with default placement... 2023-12-16T20:05:45.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:45 smithi038 ceph-mon[80659]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:45.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:45 smithi038 ceph-mon[80659]: Saving service prometheus spec with placement count:1 2023-12-16T20:05:45.361 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:45 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b81313700 1 Processor -- start 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b81313700 1 -- start start 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b81313700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b81313700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c101b20 con 0x7f1b7c1011d0 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b7affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b7affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56776/0 (socket says 172.21.15.38:56776) 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b7affd700 1 -- 172.21.15.38:0/1844864786 learned_addr learned my addr 172.21.15.38:0/1844864786 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:45.370 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.943+0000 7f1b7affd700 1 -- 172.21.15.38:0/1844864786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c101c60 con 0x7f1b7c1011d0 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b7affd700 1 --2- 172.21.15.38:0/1844864786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098e0 tx=0x7f1b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eba119418c87399 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b79ffb700 1 -- 172.21.15.38:0/1844864786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b6c00b860 con 0x7f1b7c1011d0 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b79ffb700 1 -- 172.21.15.38:0/1844864786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b6c00be70 con 0x7f1b7c1011d0 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b79ffb700 1 -- 172.21.15.38:0/1844864786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b6c010380 con 0x7f1b7c1011d0 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b81313700 1 -- 172.21.15.38:0/1844864786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 msgr2=0x7f1b7c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b81313700 1 --2- 172.21.15.38:0/1844864786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098e0 tx=0x7f1b6c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b81313700 1 -- 172.21.15.38:0/1844864786 shutdown_connections 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b81313700 1 --2- 172.21.15.38:0/1844864786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c1015e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.944+0000 7f1b81313700 1 -- 172.21.15.38:0/1844864786 >> 172.21.15.38:0/1844864786 conn(0x7f1b7c0fc970 msgr2=0x7f1b7c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.945+0000 7f1b81313700 1 -- 172.21.15.38:0/1844864786 shutdown_connections 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.945+0000 7f1b81313700 1 -- 172.21.15.38:0/1844864786 wait complete. 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.945+0000 7f1b81313700 1 Processor -- start 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.945+0000 7f1b81313700 1 -- start start 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.945+0000 7f1b81313700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b81313700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c1116d0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b7affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b7affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56792/0 (socket says 172.21.15.38:56792) 2023-12-16T20:05:45.372 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b7affd700 1 -- 172.21.15.38:0/3790276552 learned_addr learned my addr 172.21.15.38:0/3790276552 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b7affd700 1 -- 172.21.15.38:0/3790276552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0094f0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b7affd700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c011b60 tx=0x7f1b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b6c010850 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b6c010e60 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c1118d0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b6c01ae20 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.946+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c111ce0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.947+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1b6c02d3f0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.374 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.948+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c04bb80 con 0x7f1b7c1011d0 2023-12-16T20:05:45.374 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.948+0000 7f1b637fe700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 0x7f1b64038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:45.374 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.948+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1b6c04a330 con 0x7f1b7c1011d0 2023-12-16T20:05:45.374 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.948+0000 7f1b7a7fc700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 0x7f1b64038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.948+0000 7f1b7a7fc700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 0x7f1b64038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009990 tx=0x7f1b70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:44.952+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1b6c02b2f0 con 0x7f1b7c1011d0 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.164+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b7c0febe0 con 0x7f1b64036640 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.169+0000 7f1b637fe700 1 -- 172.21.15.38:0/3790276552 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1b7c0febe0 con 0x7f1b64036640 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 msgr2=0x7f1b64038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 0x7f1b64038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009990 tx=0x7f1b70006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 msgr2=0x7f1b7c111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c011b60 tx=0x7f1b6c009250 comp rx=0 tx=0).stop 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 shutdown_connections 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f1b64036640 0x7f1b64038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 --2- 172.21.15.38:0/3790276552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b7c1011d0 0x7f1b7c111190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 >> 172.21.15.38:0/3790276552 conn(0x7f1b7c0fc970 msgr2=0x7f1b7c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 shutdown_connections 2023-12-16T20:05:45.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.171+0000 7f1b81313700 1 -- 172.21.15.38:0/3790276552 wait complete. 2023-12-16T20:05:45.376 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying alertmanager service with default placement... 2023-12-16T20:05:46.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:46 smithi038 ceph-mon[80659]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:46.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:46 smithi038 ceph-mon[80659]: Saving service grafana spec with placement count:1 2023-12-16T20:05:46.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:46 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:46.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:46 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:46.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:46 smithi038 ceph-mon[80659]: from='mgr.14120 172.21.15.38:0/313313543' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e5a88c700 1 Processor -- start 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e5a88c700 1 -- start start 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e5a88c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e5a88c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54103120 con 0x7f8e541027d0 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e53fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.194 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e53fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56796/0 (socket says 172.21.15.38:56796) 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e53fff700 1 -- 172.21.15.38:0/147826930 learned_addr learned my addr 172.21.15.38:0/147826930 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.625+0000 7f8e53fff700 1 -- 172.21.15.38:0/147826930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54103260 con 0x7f8e541027d0 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.626+0000 7f8e53fff700 1 --2- 172.21.15.38:0/147826930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400bb80 tx=0x7f8e4400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb21c5d64026971 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.626+0000 7f8e52ffd700 1 -- 172.21.15.38:0/147826930 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e4400dd00 con 0x7f8e541027d0 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.626+0000 7f8e52ffd700 1 -- 172.21.15.38:0/147826930 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e4400de60 con 0x7f8e541027d0 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.626+0000 7f8e52ffd700 1 -- 172.21.15.38:0/147826930 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e440188d0 con 0x7f8e541027d0 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 -- 172.21.15.38:0/147826930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 msgr2=0x7f8e54102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/147826930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400bb80 tx=0x7f8e4400b4f0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 -- 172.21.15.38:0/147826930 shutdown_connections 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/147826930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e54102be0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 -- 172.21.15.38:0/147826930 >> 172.21.15.38:0/147826930 conn(0x7f8e540fc0b0 msgr2=0x7f8e540fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 -- 172.21.15.38:0/147826930 shutdown_connections 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.627+0000 7f8e5a88c700 1 -- 172.21.15.38:0/147826930 wait complete. 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.628+0000 7f8e5a88c700 1 Processor -- start 2023-12-16T20:05:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.628+0000 7f8e5a88c700 1 -- start start 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.628+0000 7f8e5a88c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.628+0000 7f8e5a88c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5410f450 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.628+0000 7f8e53fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e53fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56804/0 (socket says 172.21.15.38:56804) 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e53fff700 1 -- 172.21.15.38:0/1203754747 learned_addr learned my addr 172.21.15.38:0/1203754747 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e53fff700 1 -- 172.21.15.38:0/1203754747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4400b790 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e53fff700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e440184f0 tx=0x7f8e4400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e44010b90 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5410f650 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e4401d050 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e44022590 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.629+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5410fa60 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.630+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5404bb80 con 0x7f8e541027d0 2023-12-16T20:05:46.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.631+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f8e44010cf0 con 0x7f8e541027d0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.631+0000 7f8e50ff9700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 0x7f8e3c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.631+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8e44014070 con 0x7f8e541027d0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.631+0000 7f8e537fe700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 0x7f8e3c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.631+0000 7f8e537fe700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 0x7f8e3c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009990 tx=0x7f8e48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.636+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e44022bd0 con 0x7f8e541027d0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.867+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e540008d0 con 0x7f8e3c0365f0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.872+0000 7f8e50ff9700 1 -- 172.21.15.38:0/1203754747 <== mgr.14120 v2:172.21.15.38:6800/4128185288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f8e540008d0 con 0x7f8e3c0365f0 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 msgr2=0x7f8e3c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 0x7f8e3c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009990 tx=0x7f8e48006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 msgr2=0x7f8e5410ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e440184f0 tx=0x7f8e4400b4f0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 shutdown_connections 2023-12-16T20:05:46.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f8e3c0365f0 0x7f8e3c038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.874+0000 7f8e5a88c700 1 --2- 172.21.15.38:0/1203754747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e541027d0 0x7f8e5410ef10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.875+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 >> 172.21.15.38:0/1203754747 conn(0x7f8e540fc0b0 msgr2=0x7f8e540fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:46.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.875+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 shutdown_connections 2023-12-16T20:05:46.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:45.875+0000 7f8e5a88c700 1 -- 172.21.15.38:0/1203754747 wait complete. 2023-12-16T20:05:46.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb3030b700 1 Processor -- start 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb3030b700 1 -- start start 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb3030b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb3030b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28104240 con 0x7fbb281038f0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb2e0a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb2e0a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56810/0 (socket says 172.21.15.38:56810) 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb2e0a7700 1 -- 172.21.15.38:0/77473585 learned_addr learned my addr 172.21.15.38:0/77473585 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.405+0000 7fbb2e0a7700 1 -- 172.21.15.38:0/77473585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28104380 con 0x7fbb281038f0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb2e0a7700 1 --2- 172.21.15.38:0/77473585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009e50 tx=0x7fbb20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ff2ad818b2470c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb2d0a5700 1 -- 172.21.15.38:0/77473585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb200092e0 con 0x7fbb281038f0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb2d0a5700 1 -- 172.21.15.38:0/77473585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb20012430 con 0x7fbb281038f0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb2d0a5700 1 -- 172.21.15.38:0/77473585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb200075c0 con 0x7fbb281038f0 2023-12-16T20:05:46.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 -- 172.21.15.38:0/77473585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 msgr2=0x7fbb28103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 --2- 172.21.15.38:0/77473585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009e50 tx=0x7fbb20009840 comp rx=0 tx=0).stop 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 -- 172.21.15.38:0/77473585 shutdown_connections 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 --2- 172.21.15.38:0/77473585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28103d00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 -- 172.21.15.38:0/77473585 >> 172.21.15.38:0/77473585 conn(0x7fbb280fc0b0 msgr2=0x7fbb280fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 -- 172.21.15.38:0/77473585 shutdown_connections 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.406+0000 7fbb3030b700 1 -- 172.21.15.38:0/77473585 wait complete. 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb3030b700 1 Processor -- start 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb3030b700 1 -- start start 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb3030b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb3030b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281116c0 con 0x7fbb281038f0 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb2e0a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb2e0a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56826/0 (socket says 172.21.15.38:56826) 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.407+0000 7fbb2e0a7700 1 -- 172.21.15.38:0/3531147413 learned_addr learned my addr 172.21.15.38:0/3531147413 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:46.823 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb2e0a7700 1 -- 172.21.15.38:0/3531147413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009ae0 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb2e0a7700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009fd0 tx=0x7fbb20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb200092e0 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb20012920 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb281118c0 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb200258e0 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.408+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb28111cd0 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.409+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fbb20019050 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.409+0000 7fbb26ffd700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 0x7fbb10038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.409+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2804bb80 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.409+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbb2004a100 con 0x7fbb281038f0 2023-12-16T20:05:46.824 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.409+0000 7fbb2d8a6700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 0x7fbb10038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.410+0000 7fbb2d8a6700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 0x7fbb10038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009990 tx=0x7fbb1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.414+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb20020070 con 0x7fbb281038f0 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.608+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fbb28100da0 con 0x7fbb281038f0 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.611+0000 7fbb26ffd700 1 -- 172.21.15.38:0/3531147413 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fbb20020030 con 0x7fbb281038f0 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 msgr2=0x7fbb10038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 0x7fbb10038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009990 tx=0x7fbb1c006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 msgr2=0x7fbb28111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009fd0 tx=0x7fbb20009840 comp rx=0 tx=0).stop 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 shutdown_connections 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fbb10036640 0x7fbb10038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.613+0000 7fbb3030b700 1 --2- 172.21.15.38:0/3531147413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb281038f0 0x7fbb28111180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:46.825 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.614+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 >> 172.21.15.38:0/3531147413 conn(0x7fbb280fc0b0 msgr2=0x7fbb280fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:46.826 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.614+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 shutdown_connections 2023-12-16T20:05:46.826 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:46.614+0000 7fbb3030b700 1 -- 172.21.15.38:0/3531147413 wait complete. 2023-12-16T20:05:47.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:47 smithi038 ceph-mon[80659]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:47.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:47 smithi038 ceph-mon[80659]: Saving service node-exporter spec with placement * 2023-12-16T20:05:47.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:47 smithi038 ceph-mon[80659]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:47.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:47 smithi038 ceph-mon[80659]: Saving service alertmanager spec with placement count:1 2023-12-16T20:05:47.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:47 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3531147413' entity='client.admin' 2023-12-16T20:05:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.037+0000 7f137547a700 1 Processor -- start 2023-12-16T20:05:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.037+0000 7f137547a700 1 -- start start 2023-12-16T20:05:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f137547a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f137547a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370101b20 con 0x7f13701011d0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56830/0 (socket says 172.21.15.38:56830) 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136effd700 1 -- 172.21.15.38:0/2978452786 learned_addr learned my addr 172.21.15.38:0/2978452786 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136effd700 1 -- 172.21.15.38:0/2978452786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370101c60 con 0x7f13701011d0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136effd700 1 --2- 172.21.15.38:0/2978452786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13600098e0 tx=0x7f1360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7db9211e13a2893 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136dffb700 1 -- 172.21.15.38:0/2978452786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f136000b860 con 0x7f13701011d0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136dffb700 1 -- 172.21.15.38:0/2978452786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f136000be70 con 0x7f13701011d0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.038+0000 7f136dffb700 1 -- 172.21.15.38:0/2978452786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1360010380 con 0x7f13701011d0 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 -- 172.21.15.38:0/2978452786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 msgr2=0x7f13701015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 --2- 172.21.15.38:0/2978452786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13600098e0 tx=0x7f1360009250 comp rx=0 tx=0).stop 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 -- 172.21.15.38:0/2978452786 shutdown_connections 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 --2- 172.21.15.38:0/2978452786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f13701015e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 -- 172.21.15.38:0/2978452786 >> 172.21.15.38:0/2978452786 conn(0x7f13700fc950 msgr2=0x7f13700fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 -- 172.21.15.38:0/2978452786 shutdown_connections 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.039+0000 7f137547a700 1 -- 172.21.15.38:0/2978452786 wait complete. 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f137547a700 1 Processor -- start 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f137547a700 1 -- start start 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f137547a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f137547a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370076bf0 con 0x7f13701011d0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f136effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f136effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56842/0 (socket says 172.21.15.38:56842) 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f136effd700 1 -- 172.21.15.38:0/4212283032 learned_addr learned my addr 172.21.15.38:0/4212283032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f136effd700 1 -- 172.21.15.38:0/4212283032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094f0 con 0x7f13701011d0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.040+0000 7f136effd700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1360011b60 tx=0x7f1360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.041+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1360010850 con 0x7f13701011d0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.041+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1360010e60 con 0x7f13701011d0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.041+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1370076df0 con 0x7f13701011d0 2023-12-16T20:05:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.041+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13600243f0 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.041+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1370114590 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f136002e440 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137010a090 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f13577fe700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 0x7f1358038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f136004a6e0 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f136e7fc700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 0x7f1358038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.042+0000 7f136e7fc700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 0x7f1358038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1364009990 tx=0x7f1364006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.047+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f13600189a0 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.240+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f137004bb80 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.248+0000 7f13577fe700 1 -- 172.21.15.38:0/4212283032 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1360018350 con 0x7f13701011d0 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 msgr2=0x7f1358038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 0x7f1358038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1364009990 tx=0x7f1364006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 msgr2=0x7f1370113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1360011b60 tx=0x7f1360009250 comp rx=0 tx=0).stop 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 shutdown_connections 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f13580365f0 0x7f1358038aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 --2- 172.21.15.38:0/4212283032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13701011d0 0x7f1370113e90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 >> 172.21.15.38:0/4212283032 conn(0x7f13700fc950 msgr2=0x7f13700fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 shutdown_connections 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.250+0000 7f137547a700 1 -- 172.21.15.38:0/4212283032 wait complete. 2023-12-16T20:05:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling the dashboard module... 2023-12-16T20:05:48.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4212283032' entity='client.admin' 2023-12-16T20:05:48.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2035077464' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-16T20:05:48.961 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.669+0000 7fddc0c0e700 1 Processor -- start 2023-12-16T20:05:48.961 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.669+0000 7fddc0c0e700 1 -- start start 2023-12-16T20:05:48.961 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddc0c0e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:48.961 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddc0c0e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc103100 con 0x7fddbc1027b0 2023-12-16T20:05:48.961 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddba59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddba59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56858/0 (socket says 172.21.15.38:56858) 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddba59c700 1 -- 172.21.15.38:0/443532136 learned_addr learned my addr 172.21.15.38:0/443532136 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddba59c700 1 -- 172.21.15.38:0/443532136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc103240 con 0x7fddbc1027b0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddba59c700 1 --2- 172.21.15.38:0/443532136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddac00d0d0 tx=0x7fddac00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a3ec301b4188de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.670+0000 7fddb959a700 1 -- 172.21.15.38:0/443532136 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddac00ddf0 con 0x7fddbc1027b0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddb959a700 1 -- 172.21.15.38:0/443532136 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddac009610 con 0x7fddbc1027b0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddb959a700 1 -- 172.21.15.38:0/443532136 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddac0145f0 con 0x7fddbc1027b0 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 -- 172.21.15.38:0/443532136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 msgr2=0x7fddbc102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/443532136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddac00d0d0 tx=0x7fddac00ba50 comp rx=0 tx=0).stop 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 -- 172.21.15.38:0/443532136 shutdown_connections 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/443532136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc102bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 -- 172.21.15.38:0/443532136 >> 172.21.15.38:0/443532136 conn(0x7fddbc0fc0b0 msgr2=0x7fddbc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 -- 172.21.15.38:0/443532136 shutdown_connections 2023-12-16T20:05:48.962 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.671+0000 7fddc0c0e700 1 -- 172.21.15.38:0/443532136 wait complete. 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddc0c0e700 1 Processor -- start 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddc0c0e700 1 -- start start 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddc0c0e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddc0c0e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc10f520 con 0x7fddbc1027b0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddba59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddba59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56870/0 (socket says 172.21.15.38:56870) 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddba59c700 1 -- 172.21.15.38:0/2035077464 learned_addr learned my addr 172.21.15.38:0/2035077464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.672+0000 7fddba59c700 1 -- 172.21.15.38:0/2035077464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac00bcf0 con 0x7fddbc1027b0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddba59c700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fddac009e40 tx=0x7fddac00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddac009990 con 0x7fddbc1027b0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddac009af0 con 0x7fddbc1027b0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc10f720 con 0x7fddbc1027b0 2023-12-16T20:05:48.963 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddac01eb20 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.673+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc10fb30 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fddac01ed10 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc04bb80 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddb2ffd700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 0x7fdda8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fddac04bfe0 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddb9d9b700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 0x7fdda8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.674+0000 7fddb9d9b700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 0x7fdda8038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009990 tx=0x7fdda4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.679+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fddac026d00 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:47.931+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fddbc108c60 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.674+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fddac0148b0 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.675+0000 7fddb2ffd700 1 -- 172.21.15.38:0/2035077464 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fddac01dd60 con 0x7fddbc1027b0 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 msgr2=0x7fdda8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 0x7fdda8038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009990 tx=0x7fdda4006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:48.964 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 msgr2=0x7fddbc10efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fddac009e40 tx=0x7fddac00ba50 comp rx=0 tx=0).stop 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 shutdown_connections 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fdda8036640 0x7fdda8038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 --2- 172.21.15.38:0/2035077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddbc1027b0 0x7fddbc10efe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 >> 172.21.15.38:0/2035077464 conn(0x7fddbc0fc0b0 msgr2=0x7fddbc105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 shutdown_connections 2023-12-16T20:05:48.965 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:48.678+0000 7fddc0c0e700 1 -- 172.21.15.38:0/2035077464 wait complete. 2023-12-16T20:05:49.644 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:49.644 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-16T20:05:49.644 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "smithi038.gdlrfj", 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8eaf9e700 1 Processor -- start 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8eaf9e700 1 -- start start 2023-12-16T20:05:49.645 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8eaf9e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8eaf9e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4101b20 con 0x7fa8e41011d0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8e8d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8e8d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56904/0 (socket says 172.21.15.38:56904) 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.176+0000 7fa8e8d3a700 1 -- 172.21.15.38:0/1404027819 learned_addr learned my addr 172.21.15.38:0/1404027819 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.177+0000 7fa8e8d3a700 1 -- 172.21.15.38:0/1404027819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4101c60 con 0x7fa8e41011d0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.177+0000 7fa8e8d3a700 1 --2- 172.21.15.38:0/1404027819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098e0 tx=0x7fa8d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b6ed8d4c71c51 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.177+0000 7fa8e37fe700 1 -- 172.21.15.38:0/1404027819 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d800b860 con 0x7fa8e41011d0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.177+0000 7fa8e37fe700 1 -- 172.21.15.38:0/1404027819 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8d800be70 con 0x7fa8e41011d0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.177+0000 7fa8e37fe700 1 -- 172.21.15.38:0/1404027819 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d8010380 con 0x7fa8e41011d0 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/1404027819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 msgr2=0x7fa8e41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/1404027819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80098e0 tx=0x7fa8d8009250 comp rx=0 tx=0).stop 2023-12-16T20:05:49.646 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/1404027819 shutdown_connections 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/1404027819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e41015e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/1404027819 >> 172.21.15.38:0/1404027819 conn(0x7fa8e40fc970 msgr2=0x7fa8e40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/1404027819 shutdown_connections 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/1404027819 wait complete. 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 Processor -- start 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.178+0000 7fa8eaf9e700 1 -- start start 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8eaf9e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8eaf9e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e410f4c0 con 0x7fa8e41011d0 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e8d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e8d3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56920/0 (socket says 172.21.15.38:56920) 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e8d3a700 1 -- 172.21.15.38:0/552005388 learned_addr learned my addr 172.21.15.38:0/552005388 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:49.647 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e8d3a700 1 -- 172.21.15.38:0/552005388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80094f0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e8d3a700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8011b60 tx=0x7fa8d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d8010850 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e410f6c0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8d8010e60 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8d801ae20 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.179+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e410fad0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.180+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fa8d802d3f0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.180+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e404bb80 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.180+0000 7fa8e17fa700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 0x7fa8d403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.181+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa8d801a6a0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.181+0000 7fa8e3fff700 1 -- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 msgr2=0x7fa8d403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.181+0000 7fa8e3fff700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 0x7fa8d403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.185+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa8d802b8e0 con 0x7fa8e41011d0 2023-12-16T20:05:49.648 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.382+0000 7fa8e3fff700 1 -- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 msgr2=0x7fa8d403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.382+0000 7fa8e3fff700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 0x7fa8d403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.435+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa8e4108bc0 con 0x7fa8e41011d0 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.436+0000 7fa8e17fa700 1 -- 172.21.15.38:0/552005388 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa8d802b2f0 con 0x7fa8e41011d0 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 msgr2=0x7fa8d403ad20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 0x7fa8d403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 msgr2=0x7fa8e410ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8011b60 tx=0x7fa8d8009250 comp rx=0 tx=0).stop 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 shutdown_connections 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7fa8d4038870 0x7fa8d403ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 --2- 172.21.15.38:0/552005388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8e41011d0 0x7fa8e410ef80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 >> 172.21.15.38:0/552005388 conn(0x7fa8e40fc970 msgr2=0x7fa8e4105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 shutdown_connections 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.438+0000 7fa8eaf9e700 1 -- 172.21.15.38:0/552005388 wait complete. 2023-12-16T20:05:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2023-12-16T20:05:49.650 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 9... 2023-12-16T20:05:49.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:49 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2035077464' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-16T20:05:49.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:49 smithi038 ceph-mon[80659]: mgrmap e9: smithi038.gdlrfj(active, since 14s) 2023-12-16T20:05:49.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:49 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/552005388' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T20:05:55.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:05:55.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: osdmap e3: 0 total, 0 up, 0 in 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: mgrmap e10: smithi038.gdlrfj(active, starting, since 0.0036822s) 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:55.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:55 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:05:56.776 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.873+0000 7f79e1431700 1 Processor -- start 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.873+0000 7f79e1431700 1 -- start start 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.873+0000 7f79e1431700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:56.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.873+0000 7f79e1431700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc105440 con 0x7f79dc070fa0 2023-12-16T20:05:56.778 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79daffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:56.778 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79daffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56924/0 (socket says 172.21.15.38:56924) 2023-12-16T20:05:56.778 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79daffd700 1 -- 172.21.15.38:0/57614946 learned_addr learned my addr 172.21.15.38:0/57614946 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:56.778 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79daffd700 1 -- 172.21.15.38:0/57614946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc105580 con 0x7f79dc070fa0 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79daffd700 1 --2- 172.21.15.38:0/57614946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0098e0 tx=0x7f79cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f73e99ca80ea95d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79d9ffb700 1 -- 172.21.15.38:0/57614946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79cc00b860 con 0x7f79dc070fa0 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79d9ffb700 1 -- 172.21.15.38:0/57614946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79cc00be70 con 0x7f79dc070fa0 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.874+0000 7f79d9ffb700 1 -- 172.21.15.38:0/57614946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79cc010380 con 0x7f79dc070fa0 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 -- 172.21.15.38:0/57614946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 msgr2=0x7f79dc104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 --2- 172.21.15.38:0/57614946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0098e0 tx=0x7f79cc009250 comp rx=0 tx=0).stop 2023-12-16T20:05:56.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 -- 172.21.15.38:0/57614946 shutdown_connections 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 --2- 172.21.15.38:0/57614946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc104f00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 -- 172.21.15.38:0/57614946 >> 172.21.15.38:0/57614946 conn(0x7f79dc0fc970 msgr2=0x7f79dc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 -- 172.21.15.38:0/57614946 shutdown_connections 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.875+0000 7f79e1431700 1 -- 172.21.15.38:0/57614946 wait complete. 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79e1431700 1 Processor -- start 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79e1431700 1 -- start start 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79e1431700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:56.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79e1431700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc100e00 con 0x7f79dc070fa0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79daffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79daffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56934/0 (socket says 172.21.15.38:56934) 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.876+0000 7f79daffd700 1 -- 172.21.15.38:0/2699612291 learned_addr learned my addr 172.21.15.38:0/2699612291 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79daffd700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0094f0 con 0x7f79dc070fa0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79daffd700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79cc006d40 tx=0x7f79cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79cc010960 con 0x7f79dc070fa0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79cc01a430 con 0x7f79dc070fa0 2023-12-16T20:05:56.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc101000 con 0x7f79dc070fa0 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79cc0245b0 con 0x7f79dc070fa0 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.877+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc101410 con 0x7f79dc070fa0 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f79cc02d3f0 con 0x7f79dc070fa0 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79c37fe700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc05f270 con 0x7f79c4036640 2023-12-16T20:05:56.782 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f79cc04b140 con 0x7f79dc070fa0 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79da7fc700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:49.878+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:50.079+0000 7f79da7fc700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:50.079+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:50.480+0000 7f79da7fc700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:56.783 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:50.480+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:51.281+0000 7f79da7fc700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:51.281+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:52.882+0000 7f79da7fc700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/4128185288 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:52.882+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:55.520+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f79cc01a9f0 con 0x7f79dc070fa0 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:55.520+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 msgr2=0x7f79c4038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:05:56.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:55.520+0000 7f79c37fe700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.526+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f79cc02dac0 con 0x7f79dc070fa0 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.527+0000 7f79c37fe700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 0x7f79c403c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.527+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc05f270 con 0x7f79c4039f40 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.527+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 0x7f79c403c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.528+0000 7f79da7fc700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 0x7f79c403c320 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f79d00039d0 tx=0x7f79d00092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.528+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f79dc05f270 con 0x7f79c4039f40 2023-12-16T20:05:56.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.534+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f79dc04bb80 con 0x7f79c4039f40 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79c37fe700 1 -- 172.21.15.38:0/2699612291 <== mgr.14162 v2:172.21.15.38:6800/3045147274 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f79dc04bb80 con 0x7f79c4039f40 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 msgr2=0x7f79c403c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 0x7f79c403c320 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f79d00039d0 tx=0x7f79d00092f0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 msgr2=0x7f79dc102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79cc006d40 tx=0x7f79cc009250 comp rx=0 tx=0).stop 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 shutdown_connections 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f79c4039f40 0x7f79c403c320 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc070fa0 0x7f79dc102980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 --2- 172.21.15.38:0/2699612291 >> [v2:172.21.15.38:6800/4128185288,v1:172.21.15.38:6801/4128185288] conn(0x7f79c4036640 0x7f79c4038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 >> 172.21.15.38:0/2699612291 conn(0x7f79dc0fc970 msgr2=0x7f79dc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 shutdown_connections 2023-12-16T20:05:56.787 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:56.535+0000 7f79e1431700 1 -- 172.21.15.38:0/2699612291 wait complete. 2023-12-16T20:05:56.787 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 9 is available 2023-12-16T20:05:56.787 INFO:teuthology.orchestra.run.smithi038.stdout:Generating a dashboard self-signed certificate... 2023-12-16T20:05:56.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:56 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:05:56.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:56 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:05:56.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:56 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:56.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:56 smithi038 ceph-mon[80659]: mgrmap e11: smithi038.gdlrfj(active, since 1.01039s) 2023-12-16T20:05:57.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-16T20:05:57.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.018+0000 7f129930d700 1 Processor -- start 2023-12-16T20:05:57.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.018+0000 7f129930d700 1 -- start start 2023-12-16T20:05:57.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.018+0000 7f129930d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:57.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.018+0000 7f129930d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294102c00 con 0x7f12941022b0 2023-12-16T20:05:57.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1292ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1292ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45324/0 (socket says 172.21.15.38:45324) 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1292ffd700 1 -- 172.21.15.38:0/1711572889 learned_addr learned my addr 172.21.15.38:0/1711572889 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1292ffd700 1 -- 172.21.15.38:0/1711572889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294102d40 con 0x7f12941022b0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1292ffd700 1 --2- 172.21.15.38:0/1711572889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12840098e0 tx=0x7f1284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669ccb33e54fc8e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1291ffb700 1 -- 172.21.15.38:0/1711572889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f128400b860 con 0x7f12941022b0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1291ffb700 1 -- 172.21.15.38:0/1711572889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f128400be70 con 0x7f12941022b0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.019+0000 7f1291ffb700 1 -- 172.21.15.38:0/1711572889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1284010380 con 0x7f12941022b0 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 -- 172.21.15.38:0/1711572889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 msgr2=0x7f12941026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 --2- 172.21.15.38:0/1711572889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12840098e0 tx=0x7f1284009250 comp rx=0 tx=0).stop 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 -- 172.21.15.38:0/1711572889 shutdown_connections 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 --2- 172.21.15.38:0/1711572889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f12941026c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 -- 172.21.15.38:0/1711572889 >> 172.21.15.38:0/1711572889 conn(0x7f12940fda10 msgr2=0x7f12940ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 -- 172.21.15.38:0/1711572889 shutdown_connections 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.020+0000 7f129930d700 1 -- 172.21.15.38:0/1711572889 wait complete. 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f129930d700 1 Processor -- start 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f129930d700 1 -- start start 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f129930d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f129930d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941116d0 con 0x7f12941022b0 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f1292ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f1292ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45326/0 (socket says 172.21.15.38:45326) 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f1292ffd700 1 -- 172.21.15.38:0/522598817 learned_addr learned my addr 172.21.15.38:0/522598817 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.021+0000 7f1292ffd700 1 -- 172.21.15.38:0/522598817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840094f0 con 0x7f12941022b0 2023-12-16T20:05:57.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f1292ffd700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f128400c010 tx=0x7f1284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1284010960 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f128401a430 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12941118d0 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294111ce0 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.022+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1284019580 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.023+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f12840197b0 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.023+0000 7f127b7fe700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 0x7f127c038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.023+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12800052e0 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.023+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f128404b350 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.023+0000 7f12927fc700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 0x7f127c038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.024+0000 7f12927fc700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 0x7f127c038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1288009990 tx=0x7f1288006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.028+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f128402bb50 con 0x7f12941022b0 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.246+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f1280000bf0 con 0x7f127c036570 2023-12-16T20:05:57.556 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.337+0000 7f127b7fe700 1 -- 172.21.15.38:0/522598817 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f1280000bf0 con 0x7f127c036570 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.339+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 msgr2=0x7f127c038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.339+0000 7f129930d700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 0x7f127c038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1288009990 tx=0x7f1288006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 msgr2=0x7f1294111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f128400c010 tx=0x7f1284009250 comp rx=0 tx=0).stop 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 shutdown_connections 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f127c036570 0x7f127c038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 --2- 172.21.15.38:0/522598817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12941022b0 0x7f1294111190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 >> 172.21.15.38:0/522598817 conn(0x7f12940fda10 msgr2=0x7f12940ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 shutdown_connections 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.340+0000 7f129930d700 1 -- 172.21.15.38:0/522598817 wait complete. 2023-12-16T20:05:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial admin user... 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:57.796 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:57 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:58.467 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$xJ/l6uEVhkW/hOD6RMdCvOtZadTC7MOyyz1EFjRRcSmPKXjYqVd7e", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702757158, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-16T20:05:58.467 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f979697f700 1 Processor -- start 2023-12-16T20:05:58.467 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f979697f700 1 -- start start 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f979697f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f979697f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900790d0 con 0x7f9790078cc0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f978ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f978ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45328/0 (socket says 172.21.15.38:45328) 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.786+0000 7f978ffff700 1 -- 172.21.15.38:0/635265323 learned_addr learned my addr 172.21.15.38:0/635265323 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f978ffff700 1 -- 172.21.15.38:0/635265323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790077710 con 0x7f9790078cc0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f978ffff700 1 --2- 172.21.15.38:0/635265323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97800098e0 tx=0x7f9780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5518f800605b85c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f978effd700 1 -- 172.21.15.38:0/635265323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f978000b860 con 0x7f9790078cc0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f978effd700 1 -- 172.21.15.38:0/635265323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f978000be70 con 0x7f9790078cc0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f978effd700 1 -- 172.21.15.38:0/635265323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9780010380 con 0x7f9790078cc0 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f979697f700 1 -- 172.21.15.38:0/635265323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 msgr2=0x7f97900771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f979697f700 1 --2- 172.21.15.38:0/635265323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97800098e0 tx=0x7f9780009250 comp rx=0 tx=0).stop 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f979697f700 1 -- 172.21.15.38:0/635265323 shutdown_connections 2023-12-16T20:05:58.468 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f979697f700 1 --2- 172.21.15.38:0/635265323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f97900771d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.787+0000 7f979697f700 1 -- 172.21.15.38:0/635265323 >> 172.21.15.38:0/635265323 conn(0x7f97900fda10 msgr2=0x7f97900ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 -- 172.21.15.38:0/635265323 shutdown_connections 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 -- 172.21.15.38:0/635265323 wait complete. 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 Processor -- start 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 -- start start 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.788+0000 7f979697f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9790113890 con 0x7f9790078cc0 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45332/0 (socket says 172.21.15.38:45332) 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978ffff700 1 -- 172.21.15.38:0/1188709963 learned_addr learned my addr 172.21.15.38:0/1188709963 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978ffff700 1 -- 172.21.15.38:0/1188709963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800094f0 con 0x7f9790078cc0 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978ffff700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97800094c0 tx=0x7f9780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:58.469 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9780010850 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9790113a90 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9780010e60 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97800243f0 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.789+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9790113ea0 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.790+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f97800246b0 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.790+0000 7f978cff9700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 0x7f97780389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.790+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f978004a690 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.790+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979004bb80 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.790+0000 7f978f7fe700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 0x7f97780389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.791+0000 7f978f7fe700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 0x7f97780389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9784009990 tx=0x7f9784006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:57.796+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f978002ee00 con 0x7f9790078cc0 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.013+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9790108530 con 0x7f9778036510 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.261+0000 7f978cff9700 1 -- 172.21.15.38:0/1188709963 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9790108530 con 0x7f9778036510 2023-12-16T20:05:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 msgr2=0x7f97780389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 0x7f97780389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9784009990 tx=0x7f9784006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 msgr2=0x7f9790113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97800094c0 tx=0x7f9780009250 comp rx=0 tx=0).stop 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 shutdown_connections 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9778036510 0x7f97780389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 --2- 172.21.15.38:0/1188709963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9790078cc0 0x7f9790113350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 >> 172.21.15.38:0/1188709963 conn(0x7f97900fda10 msgr2=0x7f97900ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 shutdown_connections 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.263+0000 7f979697f700 1 -- 172.21.15.38:0/1188709963 wait complete. 2023-12-16T20:05:58.471 INFO:teuthology.orchestra.run.smithi038.stdout:Fetching dashboard port number... 2023-12-16T20:05:58.921 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:57] ENGINE Bus STARTING 2023-12-16T20:05:58.921 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:58.922 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:57] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:05:58.922 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: [16/Dec/2023:20:05:57] ENGINE Bus STARTED 2023-12-16T20:05:58.922 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:05:58.922 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:58 smithi038 ceph-mon[80659]: mgrmap e12: smithi038.gdlrfj(active, since 2s) 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 8443 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.703+0000 7f74e840b700 1 Processor -- start 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.703+0000 7f74e840b700 1 -- start start 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e840b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e840b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0101b20 con 0x7f74e01011d0 2023-12-16T20:05:59.117 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e61a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e61a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45334/0 (socket says 172.21.15.38:45334) 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e61a7700 1 -- 172.21.15.38:0/48944681 learned_addr learned my addr 172.21.15.38:0/48944681 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e61a7700 1 -- 172.21.15.38:0/48944681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0101c60 con 0x7f74e01011d0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e61a7700 1 --2- 172.21.15.38:0/48944681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bb80 tx=0x7f74dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848478e9182c81d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e51a5700 1 -- 172.21.15.38:0/48944681 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74dc00dd00 con 0x7f74e01011d0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e51a5700 1 -- 172.21.15.38:0/48944681 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74dc00de60 con 0x7f74e01011d0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.704+0000 7f74e51a5700 1 -- 172.21.15.38:0/48944681 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74dc0188d0 con 0x7f74e01011d0 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 -- 172.21.15.38:0/48944681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 msgr2=0x7f74e01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 --2- 172.21.15.38:0/48944681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bb80 tx=0x7f74dc00b4f0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 -- 172.21.15.38:0/48944681 shutdown_connections 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 --2- 172.21.15.38:0/48944681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e01015e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 -- 172.21.15.38:0/48944681 >> 172.21.15.38:0/48944681 conn(0x7f74e00fc970 msgr2=0x7f74e00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 -- 172.21.15.38:0/48944681 shutdown_connections 2023-12-16T20:05:59.118 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.705+0000 7f74e840b700 1 -- 172.21.15.38:0/48944681 wait complete. 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e840b700 1 Processor -- start 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e840b700 1 -- start start 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e840b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e840b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0113880 con 0x7f74e01011d0 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e61a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e61a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45344/0 (socket says 172.21.15.38:45344) 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e61a7700 1 -- 172.21.15.38:0/1457521884 learned_addr learned my addr 172.21.15.38:0/1457521884 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:59.119 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e61a7700 1 -- 172.21.15.38:0/1457521884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc00b790 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74e61a7700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74dc018460 tx=0x7f74dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.706+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74dc010c00 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.707+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74dc010d60 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.707+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e0113a80 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.707+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74dc021550 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.707+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e0113e90 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.707+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f74dc0216b0 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.708+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e004bb80 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.708+0000 7f74d6ffd700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 0x7f74cc038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.708+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f74dc014070 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.708+0000 7f74e59a6700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 0x7f74cc038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.708+0000 7f74e59a6700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 0x7f74cc038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009990 tx=0x7f74d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.713+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f74dc01fd10 con 0x7f74e01011d0 2023-12-16T20:05:59.120 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.908+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f74e0102fb0 con 0x7f74e01011d0 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.909+0000 7f74d6ffd700 1 -- 172.21.15.38:0/1457521884 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f74dc026020 con 0x7f74e01011d0 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 msgr2=0x7f74cc038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 0x7f74cc038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009990 tx=0x7f74d0006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 msgr2=0x7f74e0113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74dc018460 tx=0x7f74dc00b4f0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 shutdown_connections 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f74cc036690 0x7f74cc038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 --2- 172.21.15.38:0/1457521884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74e01011d0 0x7f74e0113340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 >> 172.21.15.38:0/1457521884 conn(0x7f74e00fc970 msgr2=0x7f74e0105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 shutdown_connections 2023-12-16T20:05:59.121 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:58.911+0000 7f74e840b700 1 -- 172.21.15.38:0/1457521884 wait complete. 2023-12-16T20:05:59.124 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T20:05:59.124 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2023-12-16T20:05:59.132 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T20:05:59.132 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2023-12-16T20:05:59.132 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2023-12-16T20:05:59.132 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph Dashboard is now available at: 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout: URL: https://smithi038.front.sepia.ceph.com:8443/ 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout: User: admin 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout: Password: po48tr8wy6 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:05:59.133 INFO:teuthology.orchestra.run.smithi038.stdout:Saving cluster configuration to /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config directory 2023-12-16T20:05:59.134 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling autotune for osd_memory_target 2023-12-16T20:05:59.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf0957d700 1 Processor -- start 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf0957d700 1 -- start start 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf0957d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf0957d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04077730 con 0x7fbf04078de0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45360/0 (socket says 172.21.15.38:45360) 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf02ffd700 1 -- 172.21.15.38:0/2412625798 learned_addr learned my addr 172.21.15.38:0/2412625798 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf02ffd700 1 -- 172.21.15.38:0/2412625798 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04077870 con 0x7fbf04078de0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.354+0000 7fbf02ffd700 1 --2- 172.21.15.38:0/2412625798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbef40098e0 tx=0x7fbef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ba36c5e5dcea4a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf01ffb700 1 -- 172.21.15.38:0/2412625798 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef400b860 con 0x7fbf04078de0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf01ffb700 1 -- 172.21.15.38:0/2412625798 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbef400be70 con 0x7fbf04078de0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf01ffb700 1 -- 172.21.15.38:0/2412625798 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef4010380 con 0x7fbf04078de0 2023-12-16T20:05:59.767 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 -- 172.21.15.38:0/2412625798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 msgr2=0x7fbf040771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 --2- 172.21.15.38:0/2412625798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbef40098e0 tx=0x7fbef4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 -- 172.21.15.38:0/2412625798 shutdown_connections 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 --2- 172.21.15.38:0/2412625798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf040771f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 -- 172.21.15.38:0/2412625798 >> 172.21.15.38:0/2412625798 conn(0x7fbf040fda40 msgr2=0x7fbf040ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 -- 172.21.15.38:0/2412625798 shutdown_connections 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.355+0000 7fbf0957d700 1 -- 172.21.15.38:0/2412625798 wait complete. 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf0957d700 1 Processor -- start 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf0957d700 1 -- start start 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf0957d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf0957d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf041138d0 con 0x7fbf04078de0 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.356+0000 7fbf02ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45366/0 (socket says 172.21.15.38:45366) 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbf02ffd700 1 -- 172.21.15.38:0/358679571 learned_addr learned my addr 172.21.15.38:0/358679571 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbf02ffd700 1 -- 172.21.15.38:0/358679571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40094f0 con 0x7fbf04078de0 2023-12-16T20:05:59.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbf02ffd700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbef40094c0 tx=0x7fbef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef4010850 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbef4010e60 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf04113ad0 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef40243f0 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.357+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf04113ee0 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.358+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fbef40246b0 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.358+0000 7fbeeb7fe700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 0x7fbeec038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.358+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbef404a6e0 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.358+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf04108600 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.358+0000 7fbf027fc700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 0x7fbeec038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.359+0000 7fbf027fc700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 0x7fbeec038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009990 tx=0x7fbef8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.363+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbef402e440 con 0x7fbf04078de0 2023-12-16T20:05:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.560+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fbf0404bb80 con 0x7fbf04078de0 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.561+0000 7fbeeb7fe700 1 -- 172.21.15.38:0/358679571 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fbef4048030 con 0x7fbf04078de0 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 msgr2=0x7fbeec038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 0x7fbeec038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009990 tx=0x7fbef8006e40 comp rx=0 tx=0).stop 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 msgr2=0x7fbf04113390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbef40094c0 tx=0x7fbef4009250 comp rx=0 tx=0).stop 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 shutdown_connections 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fbeec036640 0x7fbeec038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 --2- 172.21.15.38:0/358679571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf04078de0 0x7fbf04113390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 >> 172.21.15.38:0/358679571 conn(0x7fbf040fda40 msgr2=0x7fbf040ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 shutdown_connections 2023-12-16T20:05:59.770 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.563+0000 7fbf0957d700 1 -- 172.21.15.38:0/358679571 wait complete. 2023-12-16T20:05:59.825 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:59 smithi038 ceph-mon[80659]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:05:59.825 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:05:59 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1457521884' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-16T20:06:00.509 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.984+0000 7f7ee443d700 1 Processor -- start 2023-12-16T20:06:00.509 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.984+0000 7f7ee443d700 1 -- start start 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee443d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee443d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1030d0 con 0x7f7edc102780 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee21d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee21d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45380/0 (socket says 172.21.15.38:45380) 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee21d9700 1 -- 172.21.15.38:0/1251376537 learned_addr learned my addr 172.21.15.38:0/1251376537 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee21d9700 1 -- 172.21.15.38:0/1251376537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc103210 con 0x7f7edc102780 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.985+0000 7f7ee21d9700 1 --2- 172.21.15.38:0/1251376537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80098e0 tx=0x7f7ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4f442b14cef5b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee11d7700 1 -- 172.21.15.38:0/1251376537 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ed800b860 con 0x7f7edc102780 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee11d7700 1 -- 172.21.15.38:0/1251376537 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ed800be70 con 0x7f7edc102780 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee11d7700 1 -- 172.21.15.38:0/1251376537 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ed8010380 con 0x7f7edc102780 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 -- 172.21.15.38:0/1251376537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 msgr2=0x7f7edc102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 --2- 172.21.15.38:0/1251376537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80098e0 tx=0x7f7ed8009250 comp rx=0 tx=0).stop 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 -- 172.21.15.38:0/1251376537 shutdown_connections 2023-12-16T20:06:00.510 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 --2- 172.21.15.38:0/1251376537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc102b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 -- 172.21.15.38:0/1251376537 >> 172.21.15.38:0/1251376537 conn(0x7f7edc0fc0b0 msgr2=0x7f7edc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 -- 172.21.15.38:0/1251376537 shutdown_connections 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.986+0000 7f7ee443d700 1 -- 172.21.15.38:0/1251376537 wait complete. 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee443d700 1 Processor -- start 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee443d700 1 -- start start 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee443d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee443d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1116e0 con 0x7f7edc102780 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee21d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee21d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45396/0 (socket says 172.21.15.38:45396) 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.987+0000 7f7ee21d9700 1 -- 172.21.15.38:0/2347436035 learned_addr learned my addr 172.21.15.38:0/2347436035 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7ee21d9700 1 -- 172.21.15.38:0/2347436035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094f0 con 0x7f7edc102780 2023-12-16T20:06:00.511 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7ee21d9700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80094c0 tx=0x7f7ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ed8010850 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc1118e0 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ed8010e60 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ed801a430 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.988+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc111cf0 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f7ed801a6b0 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7eceffd700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 0x7f7ec8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc04bb80 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7ed804a670 con 0x7f7edc102780 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7ee19d8700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 0x7f7ec8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.989+0000 7f7ee19d8700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 0x7f7ec8038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009990 tx=0x7f7ed0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:00.512 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:05:59.994+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7ed80189a0 con 0x7f7edc102780 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.298+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7edc101fd0 con 0x7f7edc102780 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.300+0000 7f7eceffd700 1 -- 172.21.15.38:0/2347436035 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7ed802e260 con 0x7f7edc102780 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 msgr2=0x7f7ec8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 0x7f7ec8038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009990 tx=0x7f7ed0006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 msgr2=0x7f7edc1111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80094c0 tx=0x7f7ed8009250 comp rx=0 tx=0).stop 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 shutdown_connections 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7ec8036640 0x7f7ec8038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 --2- 172.21.15.38:0/2347436035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc102780 0x7f7edc1111a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 >> 172.21.15.38:0/2347436035 conn(0x7f7edc0fc0b0 msgr2=0x7f7edc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:00.513 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 shutdown_connections 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2023-12-16T20:06:00.303+0000 7f7ee443d700 1 -- 172.21.15.38:0/2347436035 wait complete. 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.514 INFO:teuthology.orchestra.run.smithi038.stdout:Or, if you are only running a single cluster on this host: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: ceph telemetry on 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout:For more information see: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-16T20:06:00.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:00.516 INFO:teuthology.orchestra.run.smithi038.stdout:Bootstrap complete. 2023-12-16T20:06:00.550 INFO:tasks.cephadm:Fetching config... 2023-12-16T20:06:00.550 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:06:00.550 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-16T20:06:00.606 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-16T20:06:00.606 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:06:00.606 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-16T20:06:00.662 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-16T20:06:00.662 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:06:00.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/keyring of=/dev/stdout 2023-12-16T20:06:00.741 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-16T20:06:00.742 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:06:00.742 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-16T20:06:00.797 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-16T20:06:00.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDux3obQz8/OxrzUKOg+dww2OQ32fbG3NjVowQbosAELCQTQ+ew3NUhaV1ikw2r46qB/WjU8SG/H28ajV3wzkk/jWOfwdcn55ZW3JYa6ValOAMzKCcEASacmpioLCOQoIturazkyBLsBATdhzTdehs25lgYrst1oQ2rQwMlvcaCs1fvZZ2lpW6tw9eDjWOaSw1auUrjlmECIAdwJ6n8HR/fFWMOdaF0bX5wxwmfq+7NVajBY4L6+5GCVLgQqj2PNqT9IDj9o4B1eube04gC9B0soAjKbwH9DSBIpYg9CsIELTQGAcbVK+m5k5ZbQUP/U90AH0GKse4P0S/Ji3nqUIn59nXarDOJeIRImScpzkx7vrA708yO0JhoA2rUNDJfCE9dq0C7x3xXoszUHw9fYR6lEN+6zB8SyHu4rqamZW99qrUTs2wT63m/DmwSKB4e1wQZecAKrqtEAJ8i52hOTgBHcTwTzWfLll6oI19ImtiXGrjJ6ZbfCcySMi1YxWExiac= ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T20:06:00.883 INFO:teuthology.orchestra.run.smithi038.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDux3obQz8/OxrzUKOg+dww2OQ32fbG3NjVowQbosAELCQTQ+ew3NUhaV1ikw2r46qB/WjU8SG/H28ajV3wzkk/jWOfwdcn55ZW3JYa6ValOAMzKCcEASacmpioLCOQoIturazkyBLsBATdhzTdehs25lgYrst1oQ2rQwMlvcaCs1fvZZ2lpW6tw9eDjWOaSw1auUrjlmECIAdwJ6n8HR/fFWMOdaF0bX5wxwmfq+7NVajBY4L6+5GCVLgQqj2PNqT9IDj9o4B1eube04gC9B0soAjKbwH9DSBIpYg9CsIELTQGAcbVK+m5k5ZbQUP/U90AH0GKse4P0S/Ji3nqUIn59nXarDOJeIRImScpzkx7vrA708yO0JhoA2rUNDJfCE9dq0C7x3xXoszUHw9fYR6lEN+6zB8SyHu4rqamZW99qrUTs2wT63m/DmwSKB4e1wQZecAKrqtEAJ8i52hOTgBHcTwTzWfLll6oI19ImtiXGrjJ6ZbfCcySMi1YxWExiac= ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:06:00.901 DEBUG:teuthology.orchestra.run.smithi141:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDux3obQz8/OxrzUKOg+dww2OQ32fbG3NjVowQbosAELCQTQ+ew3NUhaV1ikw2r46qB/WjU8SG/H28ajV3wzkk/jWOfwdcn55ZW3JYa6ValOAMzKCcEASacmpioLCOQoIturazkyBLsBATdhzTdehs25lgYrst1oQ2rQwMlvcaCs1fvZZ2lpW6tw9eDjWOaSw1auUrjlmECIAdwJ6n8HR/fFWMOdaF0bX5wxwmfq+7NVajBY4L6+5GCVLgQqj2PNqT9IDj9o4B1eube04gC9B0soAjKbwH9DSBIpYg9CsIELTQGAcbVK+m5k5ZbQUP/U90AH0GKse4P0S/Ji3nqUIn59nXarDOJeIRImScpzkx7vrA708yO0JhoA2rUNDJfCE9dq0C7x3xXoszUHw9fYR6lEN+6zB8SyHu4rqamZW99qrUTs2wT63m/DmwSKB4e1wQZecAKrqtEAJ8i52hOTgBHcTwTzWfLll6oI19ImtiXGrjJ6ZbfCcySMi1YxWExiac= ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T20:06:00.947 INFO:teuthology.orchestra.run.smithi141.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDux3obQz8/OxrzUKOg+dww2OQ32fbG3NjVowQbosAELCQTQ+ew3NUhaV1ikw2r46qB/WjU8SG/H28ajV3wzkk/jWOfwdcn55ZW3JYa6ValOAMzKCcEASacmpioLCOQoIturazkyBLsBATdhzTdehs25lgYrst1oQ2rQwMlvcaCs1fvZZ2lpW6tw9eDjWOaSw1auUrjlmECIAdwJ6n8HR/fFWMOdaF0bX5wxwmfq+7NVajBY4L6+5GCVLgQqj2PNqT9IDj9o4B1eube04gC9B0soAjKbwH9DSBIpYg9CsIELTQGAcbVK+m5k5ZbQUP/U90AH0GKse4P0S/Ji3nqUIn59nXarDOJeIRImScpzkx7vrA708yO0JhoA2rUNDJfCE9dq0C7x3xXoszUHw9fYR6lEN+6zB8SyHu4rqamZW99qrUTs2wT63m/DmwSKB4e1wQZecAKrqtEAJ8i52hOTgBHcTwTzWfLll6oI19ImtiXGrjJ6ZbfCcySMi1YxWExiac= ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:06:00.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-16T20:06:01.227 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:06:01.566 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:01 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2347436035' entity='client.admin' 2023-12-16T20:06:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 -- 172.21.15.38:0/407476206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 msgr2=0x7f7c900fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/407476206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c900fcc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009c60 tx=0x7f7c88004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 -- 172.21.15.38:0/407476206 shutdown_connections 2023-12-16T20:06:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/407476206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c900fcc90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 -- 172.21.15.38:0/407476206 >> 172.21.15.38:0/407476206 conn(0x7f7c900f7f20 msgr2=0x7f7c900fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 -- 172.21.15.38:0/407476206 shutdown_connections 2023-12-16T20:06:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.888+0000 7f7c94ee1700 1 -- 172.21.15.38:0/407476206 wait complete. 2023-12-16T20:06:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c94ee1700 1 Processor -- start 2023-12-16T20:06:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c94ee1700 1 -- start start 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c94ee1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c94ee1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9010d120 con 0x7f7c900fc880 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36122/0 (socket says 172.21.15.38:36122) 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c8e59c700 1 -- 172.21.15.38:0/105322777 learned_addr learned my addr 172.21.15.38:0/105322777 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.889+0000 7f7c8e59c700 1 -- 172.21.15.38:0/105322777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009940 con 0x7f7c900fc880 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c8e59c700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000f80 tx=0x7f7c88004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c8800bec0 con 0x7f7c900fc880 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c8801d8f0 con 0x7f7c900fc880 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9010d320 con 0x7f7c900fc880 2023-12-16T20:06:01.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c88012890 con 0x7f7c900fc880 2023-12-16T20:06:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.890+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9010dfc0 con 0x7f7c900fc880 2023-12-16T20:06:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.891+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f7c88019040 con 0x7f7c900fc880 2023-12-16T20:06:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.891+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9005f270 con 0x7f7c900fc880 2023-12-16T20:06:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.891+0000 7f7c86ffd700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 0x7f7c7c038b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.891+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7c88049f20 con 0x7f7c900fc880 2023-12-16T20:06:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.891+0000 7f7c8dd9b700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 0x7f7c7c038b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.892+0000 7f7c8dd9b700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 0x7f7c7c038b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009990 tx=0x7f7c78006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:01.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:01.896+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7c8801d440 con 0x7f7c900fc880 2023-12-16T20:06:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.117+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f7c9004bb80 con 0x7f7c900fc880 2023-12-16T20:06:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.122+0000 7f7c86ffd700 1 -- 172.21.15.38:0/105322777 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7c880210c0 con 0x7f7c900fc880 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 msgr2=0x7f7c7c038b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 0x7f7c7c038b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009990 tx=0x7f7c78006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 msgr2=0x7f7c9010cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000f80 tx=0x7f7c88004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 shutdown_connections 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f7c7c036680 0x7f7c7c038b30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 --2- 172.21.15.38:0/105322777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c900fc880 0x7f7c9010cbe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 >> 172.21.15.38:0/105322777 conn(0x7f7c900f7f20 msgr2=0x7f7c900f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 shutdown_connections 2023-12-16T20:06:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:02.126+0000 7f7c94ee1700 1 -- 172.21.15.38:0/105322777 wait complete. 2023-12-16T20:06:02.424 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-16T20:06:02.424 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-16T20:06:02.707 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: Deploying daemon crash.smithi038 on smithi038 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/105322777' entity='client.admin' 2023-12-16T20:06:03.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:02 smithi038 ceph-mon[80659]: mgrmap e13: smithi038.gdlrfj(active, since 6s) 2023-12-16T20:06:03.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 -- 172.21.15.38:0/401507901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 msgr2=0x7fb1240faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:03.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 --2- 172.21.15.38:0/401507901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240faf40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb1180048c0 tx=0x7fb118009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:03.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 -- 172.21.15.38:0/401507901 shutdown_connections 2023-12-16T20:06:03.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 --2- 172.21.15.38:0/401507901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240faf40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:03.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 -- 172.21.15.38:0/401507901 >> 172.21.15.38:0/401507901 conn(0x7fb1240f65d0 msgr2=0x7fb1240f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:03.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 -- 172.21.15.38:0/401507901 shutdown_connections 2023-12-16T20:06:03.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.473+0000 7fb12af30700 1 -- 172.21.15.38:0/401507901 wait complete. 2023-12-16T20:06:03.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb12af30700 1 Processor -- start 2023-12-16T20:06:03.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb12af30700 1 -- start start 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb12af30700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb12af30700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240fbad0 con 0x7fb1240fab30 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb128ccc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb128ccc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36140/0 (socket says 172.21.15.38:36140) 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.474+0000 7fb128ccc700 1 -- 172.21.15.38:0/2980161541 learned_addr learned my addr 172.21.15.38:0/2980161541 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb128ccc700 1 -- 172.21.15.38:0/2980161541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118005040 con 0x7fb1240fab30 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb128ccc700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb118009040 tx=0x7fb118009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:03.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb118009650 con 0x7fb1240fab30 2023-12-16T20:06:03.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1180097b0 con 0x7fb1240fab30 2023-12-16T20:06:03.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb11801c5b0 con 0x7fb1240fab30 2023-12-16T20:06:03.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1240fbcd0 con 0x7fb1240fab30 2023-12-16T20:06:03.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.475+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1240fc1c0 con 0x7fb1240fab30 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.476+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb11801c870 con 0x7fb1240fab30 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.476+0000 7fb1217fa700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 0x7fb114038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.476+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb11804a850 con 0x7fb1240fab30 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.476+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1241064a0 con 0x7fb1240fab30 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.476+0000 7fb123fff700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 0x7fb114038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:03.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.477+0000 7fb123fff700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 0x7fb114038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb110009990 tx=0x7fb110006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:03.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.481+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb118011db0 con 0x7fb1240fab30 2023-12-16T20:06:03.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.702+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12402b250 con 0x7fb1140366d0 2023-12-16T20:06:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.706+0000 7fb1217fa700 1 -- 172.21.15.38:0/2980161541 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb12402b250 con 0x7fb1140366d0 2023-12-16T20:06:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.707+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 msgr2=0x7fb114038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.707+0000 7fb12af30700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 0x7fb114038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb110009990 tx=0x7fb110006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.707+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 msgr2=0x7fb1240fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.707+0000 7fb12af30700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb118009040 tx=0x7fb118009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 shutdown_connections 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fb1140366d0 0x7fb114038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 --2- 172.21.15.38:0/2980161541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1240fab30 0x7fb1240fd650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 >> 172.21.15.38:0/2980161541 conn(0x7fb1240f65d0 msgr2=0x7fb1240f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 shutdown_connections 2023-12-16T20:06:03.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:03.708+0000 7fb12af30700 1 -- 172.21.15.38:0/2980161541 wait complete. 2023-12-16T20:06:04.232 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi141 2023-12-16T20:06:04.232 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:06:04.232 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/etc/ceph/ceph.conf 2023-12-16T20:06:04.250 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:06:04.250 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:04.307 INFO:tasks.cephadm:Adding host smithi141 to orchestrator... 2023-12-16T20:06:04.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch host add smithi141 2023-12-16T20:06:04.644 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:04.749 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:04 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- 172.21.15.38:0/3376155688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 msgr2=0x7f208c0ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 --2- 172.21.15.38:0/3376155688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0ff430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20800048c0 tx=0x7f2080009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- 172.21.15.38:0/3376155688 shutdown_connections 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 --2- 172.21.15.38:0/3376155688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0ff430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- 172.21.15.38:0/3376155688 >> 172.21.15.38:0/3376155688 conn(0x7f208c0f6e40 msgr2=0x7f208c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- 172.21.15.38:0/3376155688 shutdown_connections 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- 172.21.15.38:0/3376155688 wait complete. 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 Processor -- start 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.457+0000 7f2092d34700 1 -- start start 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2092d34700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2092d34700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0fb330 con 0x7f208c065aa0 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2090ad0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2090ad0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36168/0 (socket says 172.21.15.38:36168) 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2090ad0700 1 -- 172.21.15.38:0/2932056871 learned_addr learned my addr 172.21.15.38:0/2932056871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2090ad0700 1 -- 172.21.15.38:0/2932056871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080005040 con 0x7f208c065aa0 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f2090ad0700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2080009040 tx=0x7f2080009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:05.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.458+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2080009620 con 0x7f208c065aa0 2023-12-16T20:06:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.459+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c0fb530 con 0x7f208c065aa0 2023-12-16T20:06:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.459+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2080009780 con 0x7f208c065aa0 2023-12-16T20:06:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.459+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208001c5b0 con 0x7f208c065aa0 2023-12-16T20:06:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.459+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c0fba20 con 0x7f208c065aa0 2023-12-16T20:06:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.459+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2080013420 con 0x7f208c065aa0 2023-12-16T20:06:05.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.460+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c106500 con 0x7f208c065aa0 2023-12-16T20:06:05.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.460+0000 7f20897fa700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 0x7f207c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:05.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.460+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2080049820 con 0x7f208c065aa0 2023-12-16T20:06:05.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.460+0000 7f208bfff700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 0x7f207c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:05.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.460+0000 7f208bfff700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 0x7f207c038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2078009990 tx=0x7f2078006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.469+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2080011370 con 0x7f208c065aa0 2023-12-16T20:06:05.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:05.685+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi141", "target": ["mon-mgr", ""]}) v1 -- 0x7f208c02b150 con 0x7f207c0366d0 2023-12-16T20:06:06.076 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:05 smithi038 ceph-mon[80659]: Deploying daemon node-exporter.smithi038 on smithi038 2023-12-16T20:06:06.076 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:05 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:06.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:06 smithi038 ceph-mon[80659]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi141", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:06:07.625 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi141' with addr '172.21.15.141' 2023-12-16T20:06:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.625+0000 7f20897fa700 1 -- 172.21.15.38:0/2932056871 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f208c02b150 con 0x7f207c0366d0 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 msgr2=0x7f207c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 0x7f207c038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2078009990 tx=0x7f2078006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 msgr2=0x7f208c0fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2080009040 tx=0x7f2080009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 shutdown_connections 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f207c0366d0 0x7f207c038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 --2- 172.21.15.38:0/2932056871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f208c065aa0 0x7f208c0fceb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 >> 172.21.15.38:0/2932056871 conn(0x7f208c0f6e40 msgr2=0x7f208c0f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 shutdown_connections 2023-12-16T20:06:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:07.627+0000 7f2092d34700 1 -- 172.21.15.38:0/2932056871 wait complete. 2023-12-16T20:06:07.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:07 smithi038 ceph-mon[80659]: Deploying cephadm binary to smithi141 2023-12-16T20:06:07.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:07 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:08.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-16T20:06:08.382 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:06:08.967 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:08 smithi038 ceph-mon[80659]: Added host smithi141 2023-12-16T20:06:08.967 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:08 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:08.967 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:08 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:08.967 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:08 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:08.967 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:08 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 -- 172.21.15.38:0/640551798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 msgr2=0x7f8b180fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 --2- 172.21.15.38:0/640551798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b180fcc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b080048c0 tx=0x7f8b08009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 -- 172.21.15.38:0/640551798 shutdown_connections 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 --2- 172.21.15.38:0/640551798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b180fcc80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 -- 172.21.15.38:0/640551798 >> 172.21.15.38:0/640551798 conn(0x7f8b180f7f50 msgr2=0x7f8b180fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 -- 172.21.15.38:0/640551798 shutdown_connections 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.084+0000 7f8b1e289700 1 -- 172.21.15.38:0/640551798 wait complete. 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.085+0000 7f8b1e289700 1 Processor -- start 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.085+0000 7f8b1e289700 1 -- start start 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.085+0000 7f8b1e289700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.085+0000 7f8b1e289700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1810d020 con 0x7f8b180fc870 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b17fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b17fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36176/0 (socket says 172.21.15.38:36176) 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b17fff700 1 -- 172.21.15.38:0/2527085554 learned_addr learned my addr 172.21.15.38:0/2527085554 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b17fff700 1 -- 172.21.15.38:0/2527085554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08005040 con 0x7f8b180fc870 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b17fff700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800b690 tx=0x7f8b08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b08009650 con 0x7f8b180fc870 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b080097b0 con 0x7f8b180fc870 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1810d220 con 0x7f8b180fc870 2023-12-16T20:06:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b0801c5d0 con 0x7f8b180fc870 2023-12-16T20:06:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.086+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1810dec0 con 0x7f8b180fc870 2023-12-16T20:06:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.087+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8b0801c840 con 0x7f8b180fc870 2023-12-16T20:06:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.087+0000 7f8b14ff9700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 0x7f8b00038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:09.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.087+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8b08049970 con 0x7f8b180fc870 2023-12-16T20:06:09.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.087+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1805f270 con 0x7f8b180fc870 2023-12-16T20:06:09.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.087+0000 7f8b177fe700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 0x7f8b00038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:09.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.088+0000 7f8b177fe700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 0x7f8b00038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009990 tx=0x7f8b0c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:09.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.092+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8b08023950 con 0x7f8b180fc870 2023-12-16T20:06:09.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.297+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b1810e980 con 0x7f8b000366d0 2023-12-16T20:06:09.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.298+0000 7f8b14ff9700 1 -- 172.21.15.38:0/2527085554 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f8b1810e980 con 0x7f8b000366d0 2023-12-16T20:06:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:06:09.298 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.141", "hostname": "smithi141", "labels": [], "status": ""}] 2023-12-16T20:06:09.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 msgr2=0x7f8b00038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:09.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 0x7f8b00038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009990 tx=0x7f8b0c006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 msgr2=0x7f8b1810cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800b690 tx=0x7f8b08009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 shutdown_connections 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8b000366d0 0x7f8b00038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 --2- 172.21.15.38:0/2527085554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b180fc870 0x7f8b1810cae0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 >> 172.21.15.38:0/2527085554 conn(0x7f8b180f7f50 msgr2=0x7f8b180f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 shutdown_connections 2023-12-16T20:06:09.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:09.300+0000 7f8b1e289700 1 -- 172.21.15.38:0/2527085554 wait complete. 2023-12-16T20:06:09.640 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-16T20:06:09.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-16T20:06:09.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:09 smithi038 ceph-mon[80659]: Deploying daemon alertmanager.smithi038 on smithi038 2023-12-16T20:06:09.902 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:06:10.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:10 smithi038 ceph-mon[80659]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T20:06:10.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:10 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.058+0000 7ff5aab6c700 1 -- 172.21.15.38:0/1800198591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 msgr2=0x7ff5a40fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.058+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/1800198591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a40fbb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5980048c0 tx=0x7ff598009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 -- 172.21.15.38:0/1800198591 shutdown_connections 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/1800198591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a40fbb80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 -- 172.21.15.38:0/1800198591 >> 172.21.15.38:0/1800198591 conn(0x7ff5a40f6e50 msgr2=0x7ff5a40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 -- 172.21.15.38:0/1800198591 shutdown_connections 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 -- 172.21.15.38:0/1800198591 wait complete. 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 Processor -- start 2023-12-16T20:06:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.059+0000 7ff5aab6c700 1 -- start start 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5aab6c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5aab6c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a410cf90 con 0x7ff5a40fb770 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a8908700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a8908700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60288/0 (socket says 172.21.15.38:60288) 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a8908700 1 -- 172.21.15.38:0/71983674 learned_addr learned my addr 172.21.15.38:0/71983674 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a8908700 1 -- 172.21.15.38:0/71983674 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598005040 con 0x7ff5a40fb770 2023-12-16T20:06:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a8908700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b690 tx=0x7ff598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff598009650 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5980097b0 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a410d190 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff59801c5d0 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.060+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a410de30 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.061+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff59801c730 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.061+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a405f270 con 0x7ff5a40fb770 2023-12-16T20:06:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.061+0000 7ff5a17fa700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 0x7ff594038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.061+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff5980498c0 con 0x7ff5a40fb770 2023-12-16T20:06:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.061+0000 7ff5a3fff700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 0x7ff594038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.062+0000 7ff5a3fff700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 0x7ff594038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff590009990 tx=0x7ff590006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.066+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff598025400 con 0x7ff5a40fb770 2023-12-16T20:06:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.273+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff5a410e9a0 con 0x7ff5a40fb770 2023-12-16T20:06:11.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.727+0000 7ff5a17fa700 1 -- 172.21.15.38:0/71983674 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff598011b60 con 0x7ff5a40fb770 2023-12-16T20:06:11.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 msgr2=0x7ff594038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:11.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 0x7ff594038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff590009990 tx=0x7ff590006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:11.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 msgr2=0x7ff5a410ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b690 tx=0x7ff598009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 shutdown_connections 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7ff594036720 0x7ff594038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 --2- 172.21.15.38:0/71983674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5a40fb770 0x7ff5a410ca50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 >> 172.21.15.38:0/71983674 conn(0x7ff5a40f6e50 msgr2=0x7ff5a40660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 shutdown_connections 2023-12-16T20:06:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:06:11.730+0000 7ff5aab6c700 1 -- 172.21.15.38:0/71983674 wait complete. 2023-12-16T20:06:11.733 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2023-12-16T20:06:12.102 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:11 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/71983674' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-16T20:06:12.127 INFO:tasks.cephadm:Adding mon.smithi038 on smithi038 2023-12-16T20:06:12.127 INFO:tasks.cephadm:Adding mon.smithi141 on smithi141 2023-12-16T20:06:12.127 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch apply mon '2;smithi038:172.21.15.38=smithi038;smithi141:172.21.15.141=smithi141' 2023-12-16T20:06:12.375 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:12.421 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:13.140 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:12 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/71983674' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-16T20:06:13.140 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:12 smithi038 ceph-mon[80659]: osdmap e4: 0 total, 0 up, 0 in 2023-12-16T20:06:13.631 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 -- 172.21.15.141:0/1348254950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 msgr2=0x7f4a340fb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1348254950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a340fb000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a240048c0 tx=0x7f4a24009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 -- 172.21.15.141:0/1348254950 shutdown_connections 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1348254950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a340fb000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 -- 172.21.15.141:0/1348254950 >> 172.21.15.141:0/1348254950 conn(0x7f4a340f65d0 msgr2=0x7f4a340f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 -- 172.21.15.141:0/1348254950 shutdown_connections 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.631+0000 7f4a3a793700 1 -- 172.21.15.141:0/1348254950 wait complete. 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a3a793700 1 Processor -- start 2023-12-16T20:06:13.632 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a3a793700 1 -- start start 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a3a793700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a3a793700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3410cfb0 con 0x7f4a340fabf0 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a33fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a33fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:55844/0 (socket says 172.21.15.141:55844) 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a33fff700 1 -- 172.21.15.141:0/1254430821 learned_addr learned my addr 172.21.15.141:0/1254430821 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.632+0000 7f4a33fff700 1 -- 172.21.15.141:0/1254430821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24005040 con 0x7f4a340fabf0 2023-12-16T20:06:13.633 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.633+0000 7f4a33fff700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400b690 tx=0x7f4a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:13.634 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.633+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a24009650 con 0x7f4a340fabf0 2023-12-16T20:06:13.634 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.633+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a240097b0 con 0x7f4a340fabf0 2023-12-16T20:06:13.634 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.633+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3410d1b0 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a2401c5b0 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3410de50 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f4a2401c870 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a30ff9700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 0x7f4a1c038810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4a2404e660 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.634+0000 7f4a337fe700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 0x7f4a1c038810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.635+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3405f270 con 0x7f4a340fabf0 2023-12-16T20:06:13.635 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.635+0000 7f4a337fe700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 0x7f4a1c038810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009990 tx=0x7f4a28006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:13.639 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.640+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a2404f060 con 0x7f4a340fabf0 2023-12-16T20:06:13.833 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.832+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 --> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi038:172.21.15.38=smithi038;smithi141:172.21.15.141=smithi141", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a3410ea50 con 0x7f4a1c036360 2023-12-16T20:06:13.840 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.840+0000 7f4a30ff9700 1 -- 172.21.15.141:0/1254430821 <== mgr.14162 v2:172.21.15.38:6800/3045147274 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4a3410ea50 con 0x7f4a1c036360 2023-12-16T20:06:13.840 INFO:teuthology.orchestra.run.smithi141.stdout:Scheduled mon update... 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 msgr2=0x7f4a1c038810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 0x7f4a1c038810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009990 tx=0x7f4a28006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 msgr2=0x7f4a3410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400b690 tx=0x7f4a24009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 shutdown_connections 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f4a1c036360 0x7f4a1c038810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 --2- 172.21.15.141:0/1254430821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a340fabf0 0x7f4a3410ca70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 >> 172.21.15.141:0/1254430821 conn(0x7f4a340f65d0 msgr2=0x7f4a340f73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 shutdown_connections 2023-12-16T20:06:13.842 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:13.842+0000 7f4a3a793700 1 -- 172.21.15.141:0/1254430821 wait complete. 2023-12-16T20:06:14.073 DEBUG:teuthology.orchestra.run.smithi141:mon.smithi141> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi141.service 2023-12-16T20:06:14.077 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:14.077 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:14.354 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:14.400 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:14.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:14 smithi038 ceph-mon[80659]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi038:172.21.15.38=smithi038;smithi141:172.21.15.141=smithi141", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:06:14.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:14 smithi038 ceph-mon[80659]: Saving service mon spec with placement smithi038:172.21.15.38=smithi038;smithi141:172.21.15.141=smithi141;count:2 2023-12-16T20:06:14.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:14 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:15.044 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 -- 172.21.15.141:0/283337178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 msgr2=0x7fd5180fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 --2- 172.21.15.141:0/283337178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd5180fbb80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0048c0 tx=0x7fd50c009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 -- 172.21.15.141:0/283337178 shutdown_connections 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 --2- 172.21.15.141:0/283337178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd5180fbb80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 -- 172.21.15.141:0/283337178 >> 172.21.15.141:0/283337178 conn(0x7fd5180f6e50 msgr2=0x7fd5180f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 -- 172.21.15.141:0/283337178 shutdown_connections 2023-12-16T20:06:15.045 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.044+0000 7fd51f151700 1 -- 172.21.15.141:0/283337178 wait complete. 2023-12-16T20:06:15.046 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51f151700 1 Processor -- start 2023-12-16T20:06:15.046 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51f151700 1 -- start start 2023-12-16T20:06:15.046 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51f151700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:15.046 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51f151700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51810cff0 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51ceed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51ceed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:55850/0 (socket says 172.21.15.141:55850) 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.045+0000 7fd51ceed700 1 -- 172.21.15.141:0/1872763756 learned_addr learned my addr 172.21.15.141:0/1872763756 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd51ceed700 1 -- 172.21.15.141:0/1872763756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c005040 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd51ceed700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009330 tx=0x7fd50c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd50c0096b0 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd50c009810 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51810d1f0 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd50c01c5b0 con 0x7fd5180fb770 2023-12-16T20:06:15.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.046+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51810de90 con 0x7fd5180fb770 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.047+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd50c01c870 con 0x7fd5180fb770 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.047+0000 7fd5157fa700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 0x7fd508038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.047+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd50c049ae0 con 0x7fd5180fb770 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.047+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51805f270 con 0x7fd5180fb770 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.047+0000 7fd517fff700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 0x7fd508038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:15.048 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.048+0000 7fd517fff700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 0x7fd508038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd504009990 tx=0x7fd504006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:15.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.053+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd50c011dd0 con 0x7fd5180fb770 2023-12-16T20:06:15.312 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.312+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd51810e8a0 con 0x7fd5180fb770 2023-12-16T20:06:15.312 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.312+0000 7fd5157fa700 1 -- 172.21.15.141:0/1872763756 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd50c011370 con 0x7fd5180fb770 2023-12-16T20:06:15.312 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:15.313 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 msgr2=0x7fd508038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 0x7fd508038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd504009990 tx=0x7fd504006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 msgr2=0x7fd51810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009330 tx=0x7fd50c009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 shutdown_connections 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd5080366d0 0x7fd508038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 --2- 172.21.15.141:0/1872763756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5180fb770 0x7fd51810cab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 >> 172.21.15.141:0/1872763756 conn(0x7fd5180f6e50 msgr2=0x7fd5180660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 shutdown_connections 2023-12-16T20:06:15.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:15.315+0000 7fd51f151700 1 -- 172.21.15.141:0/1872763756 wait complete. 2023-12-16T20:06:15.316 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: Deploying daemon grafana.smithi038 on smithi038 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1872763756' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:16.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:15 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:16.557 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:16.557 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:16.802 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:16.848 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:17.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- 172.21.15.141:0/4255047469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 msgr2=0x7fd6600fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 --2- 172.21.15.141:0/4255047469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd6600fcc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6540048c0 tx=0x7fd654009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- 172.21.15.141:0/4255047469 shutdown_connections 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 --2- 172.21.15.141:0/4255047469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd6600fcc80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- 172.21.15.141:0/4255047469 >> 172.21.15.141:0/4255047469 conn(0x7fd6600f7f50 msgr2=0x7fd6600fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- 172.21.15.141:0/4255047469 shutdown_connections 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- 172.21.15.141:0/4255047469 wait complete. 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 Processor -- start 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.569+0000 7fd666c49700 1 -- start start 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd666c49700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd666c49700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66010f290 con 0x7fd6600fc870 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd6649e5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd6649e5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:55880/0 (socket says 172.21.15.141:55880) 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd6649e5700 1 -- 172.21.15.141:0/3129414349 learned_addr learned my addr 172.21.15.141:0/3129414349 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:17.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd6649e5700 1 -- 172.21.15.141:0/3129414349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654005040 con 0x7fd6600fc870 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.570+0000 7fd6649e5700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd654009330 tx=0x7fd654009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6540096b0 con 0x7fd6600fc870 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66010f490 con 0x7fd6600fc870 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd654009810 con 0x7fd6600fc870 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd65401c5b0 con 0x7fd6600fc870 2023-12-16T20:06:17.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66010fff0 con 0x7fd6600fc870 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd65401c870 con 0x7fd6600fc870 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.571+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66004bb80 con 0x7fd6600fc870 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.572+0000 7fd65d7fa700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 0x7fd650038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.572+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd654049bb0 con 0x7fd6600fc870 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.572+0000 7fd65ffff700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 0x7fd650038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:17.573 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.572+0000 7fd65ffff700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 0x7fd650038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009990 tx=0x7fd64c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:17.576 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.576+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd654011550 con 0x7fd6600fc870 2023-12-16T20:06:17.838 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.838+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd660110e70 con 0x7fd6600fc870 2023-12-16T20:06:17.838 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.839+0000 7fd65d7fa700 1 -- 172.21.15.141:0/3129414349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd654011370 con 0x7fd6600fc870 2023-12-16T20:06:17.839 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:17.839 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 msgr2=0x7fd650038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 0x7fd650038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009990 tx=0x7fd64c006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 msgr2=0x7fd66010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd654009330 tx=0x7fd654009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 shutdown_connections 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd6500366d0 0x7fd650038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 --2- 172.21.15.141:0/3129414349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6600fc870 0x7fd66010ed50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 >> 172.21.15.141:0/3129414349 conn(0x7fd6600f7f50 msgr2=0x7fd6600f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 shutdown_connections 2023-12-16T20:06:17.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:17.841+0000 7fd666c49700 1 -- 172.21.15.141:0/3129414349 wait complete. 2023-12-16T20:06:17.842 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:19.081 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:19.082 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:19.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:18 smithi038 ceph-mon[80659]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:19.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:18 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3129414349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:19.332 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:19.379 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:19.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 -- 172.21.15.141:0/4210413600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 msgr2=0x7f2af80fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:19.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 --2- 172.21.15.141:0/4210413600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af80fcc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009c60 tx=0x7f2af0004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 -- 172.21.15.141:0/4210413600 shutdown_connections 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 --2- 172.21.15.141:0/4210413600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af80fcc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 -- 172.21.15.141:0/4210413600 >> 172.21.15.141:0/4210413600 conn(0x7f2af80f7f40 msgr2=0x7f2af80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 -- 172.21.15.141:0/4210413600 shutdown_connections 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 -- 172.21.15.141:0/4210413600 wait complete. 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.994+0000 7f2afebde700 1 Processor -- start 2023-12-16T20:06:19.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afebde700 1 -- start start 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afebde700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afebde700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af810d0d0 con 0x7f2af80fc880 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afc97a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afc97a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:48918/0 (socket says 172.21.15.141:48918) 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afc97a700 1 -- 172.21.15.141:0/1530435570 learned_addr learned my addr 172.21.15.141:0/1530435570 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.995+0000 7f2afc97a700 1 -- 172.21.15.141:0/1530435570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0009940 con 0x7f2af80fc880 2023-12-16T20:06:19.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2afc97a700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f80 tx=0x7f2af0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:19.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af000bec0 con 0x7f2af80fc880 2023-12-16T20:06:19.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2af001d8f0 con 0x7f2af80fc880 2023-12-16T20:06:19.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af0012890 con 0x7f2af80fc880 2023-12-16T20:06:19.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af810d2d0 con 0x7f2af80fc880 2023-12-16T20:06:19.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.996+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af810df70 con 0x7f2af80fc880 2023-12-16T20:06:20.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2af0019040 con 0x7f2af80fc880 2023-12-16T20:06:20.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af805f270 con 0x7f2af80fc880 2023-12-16T20:06:20.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2af57fa700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 0x7f2ae4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:20.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2af004a0c0 con 0x7f2af80fc880 2023-12-16T20:06:20.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2af7fff700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 0x7f2ae4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:20.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:19.997+0000 7f2af7fff700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 0x7f2ae4038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009990 tx=0x7f2ae8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:20.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.002+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2af001d440 con 0x7f2af80fc880 2023-12-16T20:06:20.260 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.260+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2af810ea70 con 0x7f2af80fc880 2023-12-16T20:06:20.261 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.261+0000 7f2af57fa700 1 -- 172.21.15.141:0/1530435570 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2af0021020 con 0x7f2af80fc880 2023-12-16T20:06:20.261 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:20.261 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 msgr2=0x7f2ae4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 0x7f2ae4038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009990 tx=0x7f2ae8006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 msgr2=0x7f2af810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f80 tx=0x7f2af0004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 shutdown_connections 2023-12-16T20:06:20.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f2ae40366d0 0x7f2ae4038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:20.264 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 --2- 172.21.15.141:0/1530435570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2af80fc880 0x7f2af810cb90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:20.264 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 >> 172.21.15.141:0/1530435570 conn(0x7f2af80f7f40 msgr2=0x7f2af80f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:20.264 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 shutdown_connections 2023-12-16T20:06:20.264 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:20.263+0000 7f2afebde700 1 -- 172.21.15.141:0/1530435570 wait complete. 2023-12-16T20:06:20.264 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:20 smithi038 ceph-mon[80659]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:20 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1530435570' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:21.489 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:21.489 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:21.737 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:21.782 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:22.477 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 -- 172.21.15.141:0/3982754976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 msgr2=0x7fa0880fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:22.477 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 --2- 172.21.15.141:0/3982754976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa0880fcc90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0780048c0 tx=0x7fa078009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:22.477 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 -- 172.21.15.141:0/3982754976 shutdown_connections 2023-12-16T20:06:22.477 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 --2- 172.21.15.141:0/3982754976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa0880fcc90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:22.477 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 -- 172.21.15.141:0/3982754976 >> 172.21.15.141:0/3982754976 conn(0x7fa0880f7f40 msgr2=0x7fa0880fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 -- 172.21.15.141:0/3982754976 shutdown_connections 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.476+0000 7fa08e62a700 1 -- 172.21.15.141:0/3982754976 wait complete. 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa08e62a700 1 Processor -- start 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa08e62a700 1 -- start start 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa08e62a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa08e62a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08810d000 con 0x7fa0880fc880 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa087fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa087fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:48928/0 (socket says 172.21.15.141:48928) 2023-12-16T20:06:22.478 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.477+0000 7fa087fff700 1 -- 172.21.15.141:0/1663584027 learned_addr learned my addr 172.21.15.141:0/1663584027 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:22.479 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa087fff700 1 -- 172.21.15.141:0/1663584027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078005040 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa087fff700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa07800b690 tx=0x7fa078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa078009650 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0780097b0 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08810d200 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08810dea0 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.478+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa07801c5d0 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.479+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa07801c840 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.479+0000 7fa084ff9700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 0x7fa070038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.479+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08805f270 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.479+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa078049a10 con 0x7fa0880fc880 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.479+0000 7fa0877fe700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 0x7fa070038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:22.480 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.480+0000 7fa0877fe700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 0x7fa070038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009990 tx=0x7fa07c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:22.484 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.484+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa078023300 con 0x7fa0880fc880 2023-12-16T20:06:22.743 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.743+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa08810e9c0 con 0x7fa0880fc880 2023-12-16T20:06:22.744 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.744+0000 7fa084ff9700 1 -- 172.21.15.141:0/1663584027 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa078034090 con 0x7fa0880fc880 2023-12-16T20:06:22.744 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:22.744 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.745+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 msgr2=0x7fa070038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.745+0000 7fa08e62a700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 0x7fa070038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009990 tx=0x7fa07c006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.745+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 msgr2=0x7fa08810cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.745+0000 7fa08e62a700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa07800b690 tx=0x7fa078009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 shutdown_connections 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa0700366d0 0x7fa070038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 --2- 172.21.15.141:0/1663584027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0880fc880 0x7fa08810cac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 >> 172.21.15.141:0/1663584027 conn(0x7fa0880f7f40 msgr2=0x7fa0880f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 shutdown_connections 2023-12-16T20:06:22.746 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:22.746+0000 7fa08e62a700 1 -- 172.21.15.141:0/1663584027 wait complete. 2023-12-16T20:06:22.747 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:23.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:22 smithi038 ceph-mon[80659]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:23.988 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:23.988 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:23 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1663584027' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:24.236 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:24.283 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:24.780 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:24 smithi038 ceph-mon[80659]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:24.960 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 -- 172.21.15.141:0/2796267977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 msgr2=0x7f8a1c0ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 --2- 172.21.15.141:0/2796267977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c0ff490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009c60 tx=0x7f8a14004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 -- 172.21.15.141:0/2796267977 shutdown_connections 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 --2- 172.21.15.141:0/2796267977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c0ff490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 -- 172.21.15.141:0/2796267977 >> 172.21.15.141:0/2796267977 conn(0x7f8a1c0f6e40 msgr2=0x7f8a1c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 -- 172.21.15.141:0/2796267977 shutdown_connections 2023-12-16T20:06:24.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.960+0000 7f8a242b7700 1 -- 172.21.15.141:0/2796267977 wait complete. 2023-12-16T20:06:24.962 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a242b7700 1 Processor -- start 2023-12-16T20:06:24.962 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a242b7700 1 -- start start 2023-12-16T20:06:24.962 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a242b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a242b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c10d050 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a22053700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a22053700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:48950/0 (socket says 172.21.15.141:48950) 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.961+0000 7f8a22053700 1 -- 172.21.15.141:0/271150420 learned_addr learned my addr 172.21.15.141:0/271150420 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a22053700 1 -- 172.21.15.141:0/271150420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009940 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a22053700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a14015040 tx=0x7f8a14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a1401d440 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c10d250 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c10def0 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a1401da50 con 0x7f8a1c065a40 2023-12-16T20:06:24.963 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.962+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a140128e0 con 0x7f8a1c065a40 2023-12-16T20:06:24.964 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.963+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a000052e0 con 0x7f8a1c065a40 2023-12-16T20:06:24.964 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.963+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8a14019040 con 0x7f8a1c065a40 2023-12-16T20:06:24.964 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.963+0000 7f8a12ffd700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 0x7f8a08038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:24.964 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.963+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8a14049af0 con 0x7f8a1c065a40 2023-12-16T20:06:24.965 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.963+0000 7f8a21852700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 0x7f8a08038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:24.965 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.964+0000 7f8a21852700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 0x7f8a08038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009990 tx=0x7f8a0c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:24.968 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:24.968+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8a1401d5a0 con 0x7f8a1c065a40 2023-12-16T20:06:25.228 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.228+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8a00005590 con 0x7f8a1c065a40 2023-12-16T20:06:25.229 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.229+0000 7f8a12ffd700 1 -- 172.21.15.141:0/271150420 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8a14017070 con 0x7f8a1c065a40 2023-12-16T20:06:25.229 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:25.229 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 msgr2=0x7f8a08038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 0x7f8a08038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009990 tx=0x7f8a0c006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 msgr2=0x7f8a1c10cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a14015040 tx=0x7f8a14004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 shutdown_connections 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f8a08036720 0x7f8a08038bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 --2- 172.21.15.141:0/271150420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a1c065a40 0x7f8a1c10cb10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 >> 172.21.15.141:0/271150420 conn(0x7f8a1c0f6e40 msgr2=0x7f8a1c0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 shutdown_connections 2023-12-16T20:06:25.231 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:25.231+0000 7f8a242b7700 1 -- 172.21.15.141:0/271150420 wait complete. 2023-12-16T20:06:25.232 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:26.006 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:25 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/271150420' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:26.512 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:26.513 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:26.756 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:26.803 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:26 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:27.568 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 -- 172.21.15.141:0/2461217980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 msgr2=0x7fd4940fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/2461217980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd4940fd160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4840048c0 tx=0x7fd484009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 -- 172.21.15.141:0/2461217980 shutdown_connections 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/2461217980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd4940fd160 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 -- 172.21.15.141:0/2461217980 >> 172.21.15.141:0/2461217980 conn(0x7fd4940f65d0 msgr2=0x7fd4940f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 -- 172.21.15.141:0/2461217980 shutdown_connections 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.567+0000 7fd49a3fe700 1 -- 172.21.15.141:0/2461217980 wait complete. 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd49a3fe700 1 Processor -- start 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd49a3fe700 1 -- start start 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd49a3fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:27.569 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd49a3fe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940fb630 con 0x7fd4940fcd50 2023-12-16T20:06:27.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd493fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:27.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd493fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:48974/0 (socket says 172.21.15.141:48974) 2023-12-16T20:06:27.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.568+0000 7fd493fff700 1 -- 172.21.15.141:0/3131998176 learned_addr learned my addr 172.21.15.141:0/3131998176 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:27.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd493fff700 1 -- 172.21.15.141:0/3131998176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484005040 con 0x7fd4940fcd50 2023-12-16T20:06:27.570 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd493fff700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd484009040 tx=0x7fd484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd484009650 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4840097b0 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940fb830 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd48401c5b0 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.569+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49410fef0 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.570+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd484013420 con 0x7fd4940fcd50 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.570+0000 7fd490ff9700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 0x7fd47c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:27.571 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.570+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd4840499c0 con 0x7fd4940fcd50 2023-12-16T20:06:27.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.570+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4941053a0 con 0x7fd4940fcd50 2023-12-16T20:06:27.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.570+0000 7fd4937fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 0x7fd47c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:27.572 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.571+0000 7fd4937fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 0x7fd47c038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd488009990 tx=0x7fd488006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:27.576 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.576+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd4840139d0 con 0x7fd4940fcd50 2023-12-16T20:06:27.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.841+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd49402b180 con 0x7fd4940fcd50 2023-12-16T20:06:27.841 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.841+0000 7fd490ff9700 1 -- 172.21.15.141:0/3131998176 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd484034090 con 0x7fd4940fcd50 2023-12-16T20:06:27.841 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:27.842 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:27.843 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 msgr2=0x7fd47c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:27.843 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 0x7fd47c038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd488009990 tx=0x7fd488006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:27.843 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 msgr2=0x7fd49410f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:27.843 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd484009040 tx=0x7fd484009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:27.843 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 shutdown_connections 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fd47c0366d0 0x7fd47c038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 --2- 172.21.15.141:0/3131998176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4940fcd50 0x7fd49410f770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 >> 172.21.15.141:0/3131998176 conn(0x7fd4940f65d0 msgr2=0x7fd4940f73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 shutdown_connections 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:27.843+0000 7fd49a3fe700 1 -- 172.21.15.141:0/3131998176 wait complete. 2023-12-16T20:06:27.844 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:27 smithi038 ceph-mon[80659]: Deploying daemon prometheus.smithi038 on smithi038 2023-12-16T20:06:29.071 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:29.072 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:29.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:28 smithi038 ceph-mon[80659]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:29.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:28 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3131998176' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:29.318 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:29.367 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 -- 172.21.15.141:0/1686934541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 msgr2=0x7f9d800ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/1686934541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d800ff420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d700048c0 tx=0x7f9d70009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 -- 172.21.15.141:0/1686934541 shutdown_connections 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/1686934541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d800ff420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 -- 172.21.15.141:0/1686934541 >> 172.21.15.141:0/1686934541 conn(0x7f9d800f6e50 msgr2=0x7f9d800f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 -- 172.21.15.141:0/1686934541 shutdown_connections 2023-12-16T20:06:30.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 -- 172.21.15.141:0/1686934541 wait complete. 2023-12-16T20:06:30.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.051+0000 7f9d85dc9700 1 Processor -- start 2023-12-16T20:06:30.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d85dc9700 1 -- start start 2023-12-16T20:06:30.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d85dc9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:30.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d85dc9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d801135a0 con 0x7f9d80066550 2023-12-16T20:06:30.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:30.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46168/0 (socket says 172.21.15.141:46168) 2023-12-16T20:06:30.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.052+0000 7f9d7f7fe700 1 -- 172.21.15.141:0/803942825 learned_addr learned my addr 172.21.15.141:0/803942825 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:30.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d7f7fe700 1 -- 172.21.15.141:0/803942825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70005040 con 0x7f9d80066550 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d7f7fe700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000b690 tx=0x7f9d70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d70009650 con 0x7f9d80066550 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d700097b0 con 0x7f9d80066550 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d801137a0 con 0x7f9d80066550 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d7001c5b0 con 0x7f9d80066550 2023-12-16T20:06:30.054 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.053+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80114440 con 0x7f9d80066550 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.054+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8005f270 con 0x7f9d80066550 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.054+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f9d7001c870 con 0x7f9d80066550 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.054+0000 7f9d67fff700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 0x7f9d68038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.054+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9d70049a40 con 0x7f9d80066550 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.055+0000 7f9d7effd700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 0x7f9d68038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:30.055 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.055+0000 7f9d7effd700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 0x7f9d68038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009990 tx=0x7f9d74006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:30.059 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.060+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9d70011550 con 0x7f9d80066550 2023-12-16T20:06:30.319 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.319+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9d80114f90 con 0x7f9d80066550 2023-12-16T20:06:30.319 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.319+0000 7f9d67fff700 1 -- 172.21.15.141:0/803942825 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9d70011370 con 0x7f9d80066550 2023-12-16T20:06:30.319 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:30.319 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:30.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 msgr2=0x7f9d68038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:30.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 0x7f9d68038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009990 tx=0x7f9d74006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 msgr2=0x7f9d80113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000b690 tx=0x7f9d70009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 shutdown_connections 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f9d680366d0 0x7f9d68038b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 --2- 172.21.15.141:0/803942825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d80066550 0x7f9d80113060 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 >> 172.21.15.141:0/803942825 conn(0x7f9d800f6e50 msgr2=0x7f9d800f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 shutdown_connections 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:30.321+0000 7f9d85dc9700 1 -- 172.21.15.141:0/803942825 wait complete. 2023-12-16T20:06:30.322 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:31.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:30 smithi038 ceph-mon[80659]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:31.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:30 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/803942825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:31.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:30 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:31.555 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:31.555 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:31.800 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:31.848 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.594+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/103523282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 msgr2=0x7fcd840fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.594+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/103523282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd840fcc90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd800048c0 tx=0x7fcd80009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.594+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/103523282 shutdown_connections 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.594+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/103523282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd840fcc90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.594+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/103523282 >> 172.21.15.141:0/103523282 conn(0x7fcd840f7f20 msgr2=0x7fcd840fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/103523282 shutdown_connections 2023-12-16T20:06:32.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/103523282 wait complete. 2023-12-16T20:06:32.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 Processor -- start 2023-12-16T20:06:32.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 -- start start 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.595+0000 7fcd8b3cb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8410d010 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd89167700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd89167700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46182/0 (socket says 172.21.15.141:46182) 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd89167700 1 -- 172.21.15.141:0/2254534387 learned_addr learned my addr 172.21.15.141:0/2254534387 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd89167700 1 -- 172.21.15.141:0/2254534387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80005040 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd89167700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009330 tx=0x7fcd80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd800096b0 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd80009810 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8410d210 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.596+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8001c5b0 con 0x7fcd840fc880 2023-12-16T20:06:32.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.597+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8410deb0 con 0x7fcd840fc880 2023-12-16T20:06:32.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.597+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fcd8001c820 con 0x7fcd840fc880 2023-12-16T20:06:32.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.597+0000 7fcd79ffb700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 0x7fcd70038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:32.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.598+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcd8004a890 con 0x7fcd840fc880 2023-12-16T20:06:32.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.598+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8405f270 con 0x7fcd840fc880 2023-12-16T20:06:32.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.598+0000 7fcd88966700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 0x7fcd70038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:32.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.598+0000 7fcd88966700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 0x7fcd70038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009990 tx=0x7fcd74006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:32.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.603+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcd80023300 con 0x7fcd840fc880 2023-12-16T20:06:32.873 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.872+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcd8410e8c0 con 0x7fcd840fc880 2023-12-16T20:06:32.873 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.873+0000 7fcd79ffb700 1 -- 172.21.15.141:0/2254534387 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fcd80034090 con 0x7fcd840fc880 2023-12-16T20:06:32.873 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:32.873 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:32.875 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 msgr2=0x7fcd70038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:32.875 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 0x7fcd70038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009990 tx=0x7fcd74006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:32.875 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 msgr2=0x7fcd8410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:32.875 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009330 tx=0x7fcd80009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 shutdown_connections 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fcd70036720 0x7fcd70038bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 --2- 172.21.15.141:0/2254534387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840fc880 0x7fcd8410cad0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 >> 172.21.15.141:0/2254534387 conn(0x7fcd840f7f20 msgr2=0x7fcd840f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 shutdown_connections 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:32.875+0000 7fcd8b3cb700 1 -- 172.21.15.141:0/2254534387 wait complete. 2023-12-16T20:06:32.876 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:33.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:32 smithi038 ceph-mon[80659]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:34.104 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:33 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/2254534387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:34.104 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:34.104 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:34.352 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:34.400 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:34.754 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:34 smithi038 ceph-mon[80659]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:35.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 -- 172.21.15.141:0/3735812066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 msgr2=0x7fc4b40faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:35.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 --2- 172.21.15.141:0/3735812066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b40faf40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009c60 tx=0x7fc4ac004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:35.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 -- 172.21.15.141:0/3735812066 shutdown_connections 2023-12-16T20:06:35.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 --2- 172.21.15.141:0/3735812066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b40faf40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 -- 172.21.15.141:0/3735812066 >> 172.21.15.141:0/3735812066 conn(0x7fc4b40f65d0 msgr2=0x7fc4b40f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 -- 172.21.15.141:0/3735812066 shutdown_connections 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.090+0000 7fc4bc288700 1 -- 172.21.15.141:0/3735812066 wait complete. 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.091+0000 7fc4bc288700 1 Processor -- start 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.091+0000 7fc4bc288700 1 -- start start 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.091+0000 7fc4bc288700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.091+0000 7fc4bc288700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b410d060 con 0x7fc4b40fab30 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.091+0000 7fc4ba024700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4ba024700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46198/0 (socket says 172.21.15.141:46198) 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4ba024700 1 -- 172.21.15.141:0/1600262217 learned_addr learned my addr 172.21.15.141:0/1600262217 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4ba024700 1 -- 172.21.15.141:0/1600262217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009940 con 0x7fc4b40fab30 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4ba024700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac000f80 tx=0x7fc4ac004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:35.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac01d440 con 0x7fc4b40fab30 2023-12-16T20:06:35.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4ac01da50 con 0x7fc4b40fab30 2023-12-16T20:06:35.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b410d260 con 0x7fc4b40fab30 2023-12-16T20:06:35.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac0129f0 con 0x7fc4b40fab30 2023-12-16T20:06:35.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.092+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b410df00 con 0x7fc4b40fab30 2023-12-16T20:06:35.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.093+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc4ac019040 con 0x7fc4b40fab30 2023-12-16T20:06:35.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.093+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b405f270 con 0x7fc4b40fab30 2023-12-16T20:06:35.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.093+0000 7fc4aaffd700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 0x7fc4a0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:35.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.093+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc4ac04a120 con 0x7fc4b40fab30 2023-12-16T20:06:35.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.093+0000 7fc4b9823700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 0x7fc4a0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:35.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.094+0000 7fc4b9823700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 0x7fc4a0038b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009990 tx=0x7fc4a4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:35.098 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.099+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc4ac07ba00 con 0x7fc4b40fab30 2023-12-16T20:06:35.358 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.358+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc4b410ea50 con 0x7fc4b40fab30 2023-12-16T20:06:35.359 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.359+0000 7fc4aaffd700 1 -- 172.21.15.141:0/1600262217 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc4ac021090 con 0x7fc4b40fab30 2023-12-16T20:06:35.359 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:35.359 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 msgr2=0x7fc4a0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 0x7fc4a0038b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009990 tx=0x7fc4a4006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 msgr2=0x7fc4b410cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac000f80 tx=0x7fc4ac004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 shutdown_connections 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc4a00366d0 0x7fc4a0038b80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 --2- 172.21.15.141:0/1600262217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4b40fab30 0x7fc4b410cb20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 >> 172.21.15.141:0/1600262217 conn(0x7fc4b40f65d0 msgr2=0x7fc4b40f7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:35.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 shutdown_connections 2023-12-16T20:06:35.362 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:35.361+0000 7fc4bc288700 1 -- 172.21.15.141:0/1600262217 wait complete. 2023-12-16T20:06:35.362 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1600262217' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:35 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:36.586 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:36.586 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:36.827 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:36.873 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:37.127 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:36 smithi038 ceph-mon[80659]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T20:06:37.127 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:36 smithi038 ceph-mon[80659]: mgrmap e14: smithi038.gdlrfj(active, since 40s) 2023-12-16T20:06:37.592 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 -- 172.21.15.141:0/1701811178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 msgr2=0x7f39980ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:37.592 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 --2- 172.21.15.141:0/1701811178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980ff420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39940048c0 tx=0x7f3994009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:37.592 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 -- 172.21.15.141:0/1701811178 shutdown_connections 2023-12-16T20:06:37.592 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 --2- 172.21.15.141:0/1701811178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980ff420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 -- 172.21.15.141:0/1701811178 >> 172.21.15.141:0/1701811178 conn(0x7f39980f6e50 msgr2=0x7f39980f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 -- 172.21.15.141:0/1701811178 shutdown_connections 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.591+0000 7f399f8df700 1 -- 172.21.15.141:0/1701811178 wait complete. 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399f8df700 1 Processor -- start 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399f8df700 1 -- start start 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399f8df700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399f8df700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39980fb320 con 0x7f3998066530 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399d67b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399d67b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46210/0 (socket says 172.21.15.141:46210) 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399d67b700 1 -- 172.21.15.141:0/4153592253 learned_addr learned my addr 172.21.15.141:0/4153592253 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:37.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.592+0000 7f399d67b700 1 -- 172.21.15.141:0/4153592253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994005040 con 0x7f3998066530 2023-12-16T20:06:37.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f399d67b700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f399400b690 tx=0x7f3994009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:37.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3994009650 con 0x7f3998066530 2023-12-16T20:06:37.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39980fb520 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39940097b0 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f399401c5b0 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.593+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39980fba10 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f3994013a60 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39981064f0 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f398dffb700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 0x7f3984038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f39940499d0 con 0x7f3998066530 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f399ce7a700 1 -- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 msgr2=0x7f3984038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3045147274 2023-12-16T20:06:37.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.594+0000 7f399ce7a700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 0x7f3984038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:06:37.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.599+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3994011550 con 0x7f3998066530 2023-12-16T20:06:37.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.795+0000 7f399ce7a700 1 -- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 msgr2=0x7f3984038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3045147274 2023-12-16T20:06:37.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.795+0000 7f399ce7a700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 0x7f3984038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:06:37.860 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.859+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f399804bb80 con 0x7f3998066530 2023-12-16T20:06:37.860 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.860+0000 7f398dffb700 1 -- 172.21.15.141:0/4153592253 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3994011370 con 0x7f3998066530 2023-12-16T20:06:37.860 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:37.860 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 msgr2=0x7f3984038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 0x7f3984038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 msgr2=0x7f39980fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f399400b690 tx=0x7f3994009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 shutdown_connections 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7f3984036720 0x7f3984038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 --2- 172.21.15.141:0/4153592253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3998066530 0x7f39980fcea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:37.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 >> 172.21.15.141:0/4153592253 conn(0x7f39980f6e50 msgr2=0x7f39980f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:37.863 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 shutdown_connections 2023-12-16T20:06:37.863 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:37.863+0000 7f399f8df700 1 -- 172.21.15.141:0/4153592253 wait complete. 2023-12-16T20:06:37.863 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:39.086 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:39.087 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:39.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:38 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/4153592253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:39.334 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:39.380 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:40.090 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.089+0000 7fc86b5f2700 1 -- 172.21.15.141:0/1938211767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 msgr2=0x7fc8640fbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:40.090 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.089+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/1938211767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8640fbff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8600048c0 tx=0x7fc860009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.089+0000 7fc86b5f2700 1 -- 172.21.15.141:0/1938211767 shutdown_connections 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.089+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/1938211767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8640fbff0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 -- 172.21.15.141:0/1938211767 >> 172.21.15.141:0/1938211767 conn(0x7fc8640f65d0 msgr2=0x7fc8640f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 -- 172.21.15.141:0/1938211767 shutdown_connections 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 -- 172.21.15.141:0/1938211767 wait complete. 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 Processor -- start 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 -- start start 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86b5f2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641135e0 con 0x7fc8640fbbe0 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86938e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:40.091 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86938e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:42284/0 (socket says 172.21.15.141:42284) 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.090+0000 7fc86938e700 1 -- 172.21.15.141:0/3048189206 learned_addr learned my addr 172.21.15.141:0/3048189206 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc86938e700 1 -- 172.21.15.141:0/3048189206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860005040 con 0x7fc8640fbbe0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc86938e700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b690 tx=0x7fc860009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc860009650 con 0x7fc8640fbbe0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8600097b0 con 0x7fc8640fbbe0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8641137e0 con 0x7fc8640fbbe0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc86001c5b0 con 0x7fc8640fbbe0 2023-12-16T20:06:40.092 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.091+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc864114480 con 0x7fc8640fbbe0 2023-12-16T20:06:40.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.092+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fc86001c870 con 0x7fc8640fbbe0 2023-12-16T20:06:40.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.092+0000 7fc859ffb700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:40.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.092+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc860049a80 con 0x7fc8640fbbe0 2023-12-16T20:06:40.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.092+0000 7fc868b8d700 1 -- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3045147274 2023-12-16T20:06:40.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.092+0000 7fc868b8d700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:06:40.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.093+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86405f270 con 0x7fc8640fbbe0 2023-12-16T20:06:40.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.098+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc8600116f0 con 0x7fc8640fbbe0 2023-12-16T20:06:40.292 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.293+0000 7fc868b8d700 1 -- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3045147274 2023-12-16T20:06:40.293 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.293+0000 7fc868b8d700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:06:40.357 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.358+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc864114e90 con 0x7fc8640fbbe0 2023-12-16T20:06:40.358 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.359+0000 7fc859ffb700 1 -- 172.21.15.141:0/3048189206 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc860034090 con 0x7fc8640fbbe0 2023-12-16T20:06:40.358 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:40.358 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 msgr2=0x7fc8641130a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b690 tx=0x7fc860009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 shutdown_connections 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 --2- 172.21.15.141:0/3048189206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8640fbbe0 0x7fc8641130a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 >> 172.21.15.141:0/3048189206 conn(0x7fc8640f65d0 msgr2=0x7fc8640fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:40.360 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 shutdown_connections 2023-12-16T20:06:40.361 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:40.361+0000 7fc86b5f2700 1 -- 172.21.15.141:0/3048189206 wait complete. 2023-12-16T20:06:40.361 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:40.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:40 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3048189206' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:41.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:41.603 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:41.850 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:41.896 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:42.657 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1204864539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 msgr2=0x7fa0380fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 --2- 172.21.15.141:0/1204864539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa0380fbb90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa030009c60 tx=0x7fa030004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1204864539 shutdown_connections 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 --2- 172.21.15.141:0/1204864539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa0380fbb90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1204864539 >> 172.21.15.141:0/1204864539 conn(0x7fa0380f6e40 msgr2=0x7fa0380f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1204864539 shutdown_connections 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.657+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1204864539 wait complete. 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03f0c6700 1 Processor -- start 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03f0c6700 1 -- start start 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03f0c6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03f0c6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03810bf80 con 0x7fa0380fb780 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03ce62700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03ce62700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:42294/0 (socket says 172.21.15.141:42294) 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.658+0000 7fa03ce62700 1 -- 172.21.15.141:0/1939667202 learned_addr learned my addr 172.21.15.141:0/1939667202 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:42.658 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa03ce62700 1 -- 172.21.15.141:0/1939667202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030009940 con 0x7fa0380fb780 2023-12-16T20:06:42.659 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa03ce62700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa030015040 tx=0x7fa030004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa03000be40 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0300198d0 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03810c180 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0300127b0 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.659+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03810ce20 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fa030019420 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03805f270 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa0357fa700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 0x7fa020038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa03004bab0 con 0x7fa0380fb780 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa037fff700 1 -- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 msgr2=0x7fa020038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3045147274 2023-12-16T20:06:42.660 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.660+0000 7fa037fff700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 0x7fa020038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:06:42.664 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.665+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa0300233f0 con 0x7fa0380fb780 2023-12-16T20:06:42.698 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.698+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 15) v1 ==== 43075+0+0 (secure 0 0 0) 0x7fa03001e250 con 0x7fa0380fb780 2023-12-16T20:06:42.698 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.699+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 msgr2=0x7fa020038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:06:42.698 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.699+0000 7fa0357fa700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 0x7fa020038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:42.932 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.932+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa03804bb80 con 0x7fa0380fb780 2023-12-16T20:06:42.932 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.933+0000 7fa0357fa700 1 -- 172.21.15.141:0/1939667202 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa030017030 con 0x7fa0380fb780 2023-12-16T20:06:42.933 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:42.933 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 msgr2=0x7fa03810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa030015040 tx=0x7fa030004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 shutdown_connections 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:6800/3045147274,v1:172.21.15.38:6801/3045147274] conn(0x7fa020036720 0x7fa020038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 --2- 172.21.15.141:0/1939667202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0380fb780 0x7fa03810ba40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 >> 172.21.15.141:0/1939667202 conn(0x7fa0380f6e40 msgr2=0x7fa0380f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 shutdown_connections 2023-12-16T20:06:42.934 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:42.935+0000 7fa03f0c6700 1 -- 172.21.15.141:0/1939667202 wait complete. 2023-12-16T20:06:42.935 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:43.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:06:43.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: mgrmap e15: smithi038.gdlrfj(active, starting, since 0.00350841s) 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:06:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:06:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:06:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1939667202' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:44.222 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:44.222 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:44.471 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:44.520 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T20:06:44.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:44 smithi038 ceph-mon[80659]: [16/Dec/2023:20:06:43] ENGINE Bus STARTING 2023-12-16T20:06:44.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:44 smithi038 ceph-mon[80659]: [16/Dec/2023:20:06:43] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:06:44.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:44 smithi038 ceph-mon[80659]: [16/Dec/2023:20:06:43] ENGINE Bus STARTED 2023-12-16T20:06:44.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:44 smithi038 ceph-mon[80659]: mgrmap e16: smithi038.gdlrfj(active, since 1.00549s) 2023-12-16T20:06:44.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:44 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:45.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 -- 172.21.15.141:0/2987760707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 msgr2=0x7f0ccc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:45.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 --2- 172.21.15.141:0/2987760707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc0fcc80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0048c0 tx=0x7f0cbc009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:45.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 -- 172.21.15.141:0/2987760707 shutdown_connections 2023-12-16T20:06:45.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 --2- 172.21.15.141:0/2987760707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc0fcc80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:45.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 -- 172.21.15.141:0/2987760707 >> 172.21.15.141:0/2987760707 conn(0x7f0ccc0f7f50 msgr2=0x7f0ccc0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 -- 172.21.15.141:0/2987760707 shutdown_connections 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.485+0000 7f0cd1690700 1 -- 172.21.15.141:0/2987760707 wait complete. 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0cd1690700 1 Processor -- start 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0cd1690700 1 -- start start 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0cd1690700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0cd1690700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc10cfd0 con 0x7f0ccc0fc870 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0ccaffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0ccaffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:42310/0 (socket says 172.21.15.141:42310) 2023-12-16T20:06:45.486 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.486+0000 7f0ccaffd700 1 -- 172.21.15.141:0/3464746796 learned_addr learned my addr 172.21.15.141:0/3464746796 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:45.487 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0ccaffd700 1 -- 172.21.15.141:0/3464746796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc005040 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0ccaffd700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009330 tx=0x7f0cbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cbc0096b0 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc10d1d0 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cbc009810 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cbc01c5b0 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.487+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc10de70 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.488+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f0cbc01c870 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.488+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc05f270 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.488+0000 7f0cb37fe700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 0x7f0cb4038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.488+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0cbc049930 con 0x7f0ccc0fc870 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.488+0000 7f0cca7fc700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 0x7f0cb4038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:45.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.489+0000 7f0cca7fc700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 0x7f0cb4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009990 tx=0x7f0cc0006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:45.492 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.493+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0cbc023300 con 0x7f0ccc0fc870 2023-12-16T20:06:45.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.703+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f0cbc02bd30 con 0x7f0ccc0fc870 2023-12-16T20:06:45.763 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.764+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ccc10e9c0 con 0x7f0ccc0fc870 2023-12-16T20:06:45.764 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.765+0000 7f0cb37fe700 1 -- 172.21.15.141:0/3464746796 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0cbc023300 con 0x7f0ccc0fc870 2023-12-16T20:06:45.764 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:45.764 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:45.766 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 msgr2=0x7f0cb4038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:45.766 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 0x7f0cb4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009990 tx=0x7f0cc0006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:45.766 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 msgr2=0x7f0ccc10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:45.766 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009330 tx=0x7f0cbc009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:45.766 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 shutdown_connections 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0cb4036560 0x7f0cb4038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 --2- 172.21.15.141:0/3464746796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ccc0fc870 0x7f0ccc10ca90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 >> 172.21.15.141:0/3464746796 conn(0x7f0ccc0f7f50 msgr2=0x7f0ccc0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 shutdown_connections 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:45.767+0000 7f0cd1690700 1 -- 172.21.15.141:0/3464746796 wait complete. 2023-12-16T20:06:45.767 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:46.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:46.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:46.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: mgrmap e17: smithi038.gdlrfj(active, since 3s) 2023-12-16T20:06:46.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3464746796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:46.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:46.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:46.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:06:47.017 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:47.017 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:47.264 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:47.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi141", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:06:47.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T20:06:47.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:47.971 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 -- 172.21.15.141:0/1273154622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 msgr2=0x7f2510102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 --2- 172.21.15.141:0/1273154622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510102cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f25040048c0 tx=0x7f2504009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 -- 172.21.15.141:0/1273154622 shutdown_connections 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 --2- 172.21.15.141:0/1273154622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510102cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 -- 172.21.15.141:0/1273154622 >> 172.21.15.141:0/1273154622 conn(0x7f2510071d60 msgr2=0x7f2510072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 -- 172.21.15.141:0/1273154622 shutdown_connections 2023-12-16T20:06:47.972 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.972+0000 7f2515df6700 1 -- 172.21.15.141:0/1273154622 wait complete. 2023-12-16T20:06:47.973 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.973+0000 7f2515df6700 1 Processor -- start 2023-12-16T20:06:47.973 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.973+0000 7f2515df6700 1 -- start start 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.973+0000 7f2515df6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.973+0000 7f2515df6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2510113130 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:42320/0 (socket says 172.21.15.141:42320) 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f250f7fe700 1 -- 172.21.15.141:0/1727333882 learned_addr learned my addr 172.21.15.141:0/1727333882 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f250f7fe700 1 -- 172.21.15.141:0/1727333882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504005040 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f250f7fe700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2504009040 tx=0x7f2504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2504004e60 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2504009650 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2510113330 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f250401c3f0 con 0x7f25101028f0 2023-12-16T20:06:47.974 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.974+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25101137a0 con 0x7f25101028f0 2023-12-16T20:06:47.975 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.975+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2504013420 con 0x7f25101028f0 2023-12-16T20:06:47.975 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.975+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251005f270 con 0x7f25101028f0 2023-12-16T20:06:47.975 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.975+0000 7f24f7fff700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 0x7f24f8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:47.975 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.975+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2504049a50 con 0x7f25101028f0 2023-12-16T20:06:47.976 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.976+0000 7f250effd700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 0x7f24f8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:47.976 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.976+0000 7f250effd700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 0x7f24f8038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2500009990 tx=0x7f2500006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:47.980 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:47.981+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2504011550 con 0x7f25101028f0 2023-12-16T20:06:48.256 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.256+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f251004bc10 con 0x7f25101028f0 2023-12-16T20:06:48.256 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.257+0000 7f24f7fff700 1 -- 172.21.15.141:0/1727333882 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2504011370 con 0x7f25101028f0 2023-12-16T20:06:48.256 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:48.256 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 msgr2=0x7f24f8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 0x7f24f8038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2500009990 tx=0x7f2500006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 msgr2=0x7f2510112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2504009040 tx=0x7f2504009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 shutdown_connections 2023-12-16T20:06:48.258 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f24f80367c0 0x7f24f8038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:48.259 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 --2- 172.21.15.141:0/1727333882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25101028f0 0x7f2510112bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:48.259 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 >> 172.21.15.141:0/1727333882 conn(0x7f2510071d60 msgr2=0x7f2510103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:48.259 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 shutdown_connections 2023-12-16T20:06:48.259 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:48.259+0000 7f2515df6700 1 -- 172.21.15.141:0/1727333882 wait complete. 2023-12-16T20:06:48.259 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: Deploying daemon crash.smithi141 on smithi141 2023-12-16T20:06:49.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1727333882' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:49.570 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:49.570 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:49.838 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- 172.21.15.141:0/2516324586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 msgr2=0x7fb4000fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 --2- 172.21.15.141:0/2516324586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb4000fdc60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009c60 tx=0x7fb3f8004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- 172.21.15.141:0/2516324586 shutdown_connections 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 --2- 172.21.15.141:0/2516324586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb4000fdc60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- 172.21.15.141:0/2516324586 >> 172.21.15.141:0/2516324586 conn(0x7fb4000f7310 msgr2=0x7fb4000f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- 172.21.15.141:0/2516324586 shutdown_connections 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- 172.21.15.141:0/2516324586 wait complete. 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 Processor -- start 2023-12-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- start start 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.779+0000 7fb408048700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001131d0 con 0x7fb4000fd890 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb405de4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb405de4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46368/0 (socket says 172.21.15.141:46368) 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb405de4700 1 -- 172.21.15.141:0/467579711 learned_addr learned my addr 172.21.15.141:0/467579711 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb405de4700 1 -- 172.21.15.141:0/467579711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009940 con 0x7fb4000fd890 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb405de4700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009fd0 tx=0x7fb3f8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3f800be40 con 0x7fb4000fd890 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4001133d0 con 0x7fb4000fd890 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3f801d8f0 con 0x7fb4000fd890 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3f8012800 con 0x7fb4000fd890 2023-12-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.780+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb400113840 con 0x7fb4000fd890 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.781+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fb3f8019040 con 0x7fb4000fd890 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.781+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40005f270 con 0x7fb4000fd890 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.782+0000 7fb3fe7fc700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 0x7fb3e8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.782+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb3f804a200 con 0x7fb4000fd890 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.782+0000 7fb4055e3700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 0x7fb3e8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.782+0000 7fb4055e3700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 0x7fb3e8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009990 tx=0x7fb3f4006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:50.787 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:50.787+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb3f801d440 con 0x7fb4000fd890 2023-12-16T20:06:50.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:50 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:50.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:50 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:50.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:50 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:50.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:50 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:50.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:50 smithi038 ceph-mon[80659]: Deploying daemon node-exporter.smithi141 on smithi141 2023-12-16T20:06:51.050 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.049+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb40010e230 con 0x7fb4000fd890 2023-12-16T20:06:51.050 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.050+0000 7fb3fe7fc700 1 -- 172.21.15.141:0/467579711 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb3f8021020 con 0x7fb4000fd890 2023-12-16T20:06:51.050 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:51.050 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:51.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 msgr2=0x7fb3e8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:51.052 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 0x7fb3e8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009990 tx=0x7fb3f4006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 msgr2=0x7fb400112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009fd0 tx=0x7fb3f8004d10 comp rx=0 tx=0).stop 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 shutdown_connections 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb3e80367c0 0x7fb3e8038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 --2- 172.21.15.141:0/467579711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4000fd890 0x7fb400112c90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 >> 172.21.15.141:0/467579711 conn(0x7fb4000f7310 msgr2=0x7fb4001011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 shutdown_connections 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:51.052+0000 7fb408048700 1 -- 172.21.15.141:0/467579711 wait complete. 2023-12-16T20:06:51.053 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:51.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:51 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/467579711' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:52.300 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:52.300 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:52.953 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:54.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:53 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 -- 172.21.15.141:0/4014359784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 msgr2=0x7fc2980fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 --2- 172.21.15.141:0/4014359784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc2980fdcb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2880048c0 tx=0x7fc288009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 -- 172.21.15.141:0/4014359784 shutdown_connections 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 --2- 172.21.15.141:0/4014359784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc2980fdcb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 -- 172.21.15.141:0/4014359784 >> 172.21.15.141:0/4014359784 conn(0x7fc2980f7310 msgr2=0x7fc2980f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.232+0000 7fc29dc51700 1 -- 172.21.15.141:0/4014359784 shutdown_connections 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.233+0000 7fc29dc51700 1 -- 172.21.15.141:0/4014359784 wait complete. 2023-12-16T20:06:54.233 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.233+0000 7fc29dc51700 1 Processor -- start 2023-12-16T20:06:54.234 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.233+0000 7fc29dc51700 1 -- start start 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.233+0000 7fc29dc51700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.233+0000 7fc29dc51700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298113130 con 0x7fc2980fd8e0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc2977fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc2977fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46388/0 (socket says 172.21.15.141:46388) 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc2977fe700 1 -- 172.21.15.141:0/2042818334 learned_addr learned my addr 172.21.15.141:0/2042818334 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc2977fe700 1 -- 172.21.15.141:0/2042818334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288005040 con 0x7fc2980fd8e0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc2977fe700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc288009300 tx=0x7fc288009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc288004e60 con 0x7fc2980fd8e0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc298113330 con 0x7fc2980fd8e0 2023-12-16T20:06:54.235 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.234+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2981137a0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.236 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.235+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc288013420 con 0x7fc2980fd8e0 2023-12-16T20:06:54.236 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.235+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc28801c5b0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.236 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.236+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2840052e0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.236 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.236+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fc28801c7e0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.236 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.236+0000 7fc27ffff700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 0x7fc280038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:54.237 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.236+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc2880499d0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.237 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.237+0000 7fc296ffd700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 0x7fc280038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:54.237 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.238+0000 7fc296ffd700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 0x7fc280038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009990 tx=0x7fc28c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:54.241 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.241+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc288011dd0 con 0x7fc2980fd8e0 2023-12-16T20:06:54.525 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.525+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc284005590 con 0x7fc2980fd8e0 2023-12-16T20:06:54.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.526+0000 7fc27ffff700 1 -- 172.21.15.141:0/2042818334 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc288011370 con 0x7fc2980fd8e0 2023-12-16T20:06:54.526 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:54.526 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:54.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 msgr2=0x7fc280038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:54.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 0x7fc280038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009990 tx=0x7fc28c006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:54.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 msgr2=0x7fc298112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:54.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc288009300 tx=0x7fc288009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 shutdown_connections 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc280036810 0x7fc280038cc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 --2- 172.21.15.141:0/2042818334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2980fd8e0 0x7fc298112bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 >> 172.21.15.141:0/2042818334 conn(0x7fc2980f7310 msgr2=0x7fc298101100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 shutdown_connections 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:54.528+0000 7fc29dc51700 1 -- 172.21.15.141:0/2042818334 wait complete. 2023-12-16T20:06:54.529 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T20:06:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:06:55.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:55.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:06:55.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:54 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/2042818334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:56.151 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:56.151 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:56.462 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:06:56.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:56.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:06:56 smithi038 ceph-mon[80659]: Deploying daemon mon.smithi141 on smithi141 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- 172.21.15.141:0/486726921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 msgr2=0x7f803c102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 --2- 172.21.15.141:0/486726921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c102ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f802c0048c0 tx=0x7f802c009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- 172.21.15.141:0/486726921 shutdown_connections 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 --2- 172.21.15.141:0/486726921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c102ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- 172.21.15.141:0/486726921 >> 172.21.15.141:0/486726921 conn(0x7f803c0f8410 msgr2=0x7f803c0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:57.738 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- 172.21.15.141:0/486726921 shutdown_connections 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- 172.21.15.141:0/486726921 wait complete. 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 Processor -- start 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.736+0000 7f804089f700 1 -- start start 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f804089f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f804089f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c1130a0 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f803a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f803a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.141:46420/0 (socket says 172.21.15.141:46420) 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f803a59c700 1 -- 172.21.15.141:0/2593293018 learned_addr learned my addr 172.21.15.141:0/2593293018 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.737+0000 7f803a59c700 1 -- 172.21.15.141:0/2593293018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c005040 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f803a59c700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f802c009040 tx=0x7f802c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f802c004e60 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c1132a0 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c10ca20 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f802c009650 con 0x7f803c1028d0 2023-12-16T20:06:57.739 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.738+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f802c01c3f0 con 0x7f803c1028d0 2023-12-16T20:06:57.740 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.739+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f802c01c660 con 0x7f803c1028d0 2023-12-16T20:06:57.740 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.739+0000 7f802affd700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 0x7f8024038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:06:57.741 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.739+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f802c049a30 con 0x7f803c1028d0 2023-12-16T20:06:57.741 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.739+0000 7f8039d9b700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 0x7f8024038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:06:57.741 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.739+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c0052e0 con 0x7f803c1028d0 2023-12-16T20:06:57.741 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.740+0000 7f8039d9b700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 0x7f8024038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8030009990 tx=0x7f8030006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:06:57.744 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:57.745+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f802c025400 con 0x7f803c1028d0 2023-12-16T20:06:57.973 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:57 smithi141 podman[88145]: 2023-12-16 20:06:57.924793595 +0000 UTC m=+0.065941707 container create 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2023-12-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.047+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f801c005590 con 0x7f803c1028d0 2023-12-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.047+0000 7f802affd700 1 -- 172.21.15.141:0/2593293018 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f802c023a00 con 0x7f803c1028d0 2023-12-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":1,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:05:08.236870Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 msgr2=0x7f8024038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 0x7f8024038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8030009990 tx=0x7f8030006e40 comp rx=0 tx=0).stop 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 msgr2=0x7f803c112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f802c009040 tx=0x7f802c009e30 comp rx=0 tx=0).stop 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 shutdown_connections 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8024036810 0x7f8024038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 --2- 172.21.15.141:0/2593293018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f803c1028d0 0x7f803c112b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 >> 172.21.15.141:0/2593293018 conn(0x7f803c0f8410 msgr2=0x7f803c0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 shutdown_connections 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:06:58.050+0000 7f804089f700 1 -- 172.21.15.141:0/2593293018 wait complete. 2023-12-16T20:06:58.051 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 1 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:57 smithi141 podman[88145]: 2023-12-16 20:06:57.886650129 +0000 UTC m=+0.027798254 image pull 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 podman[88145]: 2023-12-16 20:06:58.033844431 +0000 UTC m=+0.174992552 container init 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 podman[88145]: 2023-12-16 20:06:58.036802438 +0000 UTC m=+0.177950562 container start 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, RELEASE=quincy-1f2f551) 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 2 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pidfile_write: ignore empty --pid-file 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 bash[88145]: 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f 2023-12-16T20:06:58.096 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: load: jerasure load: lrc 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: RocksDB version: 6.15.5 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Compile date Dec 13 2023 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: DB SUMMARY 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: DB Session ID: U3YGE0SE5J2SM5J118KF 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: CURRENT file: CURRENT 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi141/store.db dir, Total Num: 0, files: 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi141/store.db: 000004.log size: 511 ; 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.error_if_exists: 0 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.create_if_missing: 0 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.paranoid_checks: 1 2023-12-16T20:06:58.097 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.env: 0x55ece115ca80 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.fs: Posix File System 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.info_log: 0x55ece31e3000 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.statistics: (nil) 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.use_fsync: 0 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_log_file_size: 0 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T20:06:58.098 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_fallocate: 1 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.use_direct_reads: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.db_log_dir: 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi141/store.db 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T20:06:58.099 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.write_buffer_manager: 0x55ece3f589f0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.unordered_write: 0 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T20:06:58.100 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.row_cache: None 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.wal_filter: None 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.preserve_deletes: 0 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.two_write_queues: 0 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T20:06:58.102 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.atomic_flush: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.log_readahead_size: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_background_jobs: 2 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_background_compactions: -1 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_subcompactions: 1 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T20:06:58.103 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_open_files: -1 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_background_flushes: -1 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Compression algorithms supported: 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kZSTD supported: 0 2023-12-16T20:06:58.104 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kXpressCompression supported: 0 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kZlibCompression supported: 1 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kSnappyCompression supported: 1 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kLZ4Compression supported: 1 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: kBZip2Compression supported: 0 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi141/store.db/MANIFEST-000003 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.merge_operator: 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_filter: None 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T20:06:58.105 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ece3238f90) 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: cache_index_and_filter_blocks: 1 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: pin_top_level_index_and_filter: 1 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_type: 0 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: data_block_index_type: 0 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_shortening: 1 2023-12-16T20:06:58.109 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: hash_index_allow_collision: 1 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: checksum: 1 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: no_block_cache: 0 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache: 0x55ece326b090 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_name: BinnedLRUCache 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_options: 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: capacity : 536870912 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: num_shard_bits : 4 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: strict_capacity_limit : 0 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: high_pri_pool_ratio: 0.000 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_compressed: (nil) 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: persistent_cache: (nil) 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_size: 4096 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_size_deviation: 10 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_restart_interval: 16 2023-12-16T20:06:58.110 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_block_restart_interval: 1 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: metadata_block_size: 4096 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: partition_filters: 0 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: use_delta_encoding: 1 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: whole_key_filtering: 1 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: verify_compression: 0 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: read_amp_bytes_per_bit: 0 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: format_version: 4 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: enable_index_compression: 1 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_align: 0 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression: NoCompression 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T20:06:58.111 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.num_levels: 7 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T20:06:58.112 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T20:06:58.113 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T20:06:58.114 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.table_properties_collectors: 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.inplace_update_support: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.bloom_locality: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.max_successive_merges: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T20:06:58.115 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.ttl: 2592000 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.enable_blob_files: false 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.min_blob_size: 0 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 systemd[1]: Started Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi141/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757218069760, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-16T20:06:58.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757218070165, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702757218, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "a2a97017-0360-4f40-99e5-d63807664ec7", "db_session_id": "U3YGE0SE5J2SM5J118KF"}} 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757218070578, "job": 1, "event": "recovery_finished"} 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi141/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ece31ff180 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: DB pointer 0x55ece32d4000 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** DB Stats ** 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:06:58.117 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:06:58.118 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative compaction: 0.00 GB write, 0.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval compaction: 0.00 GB write, 0.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.119 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative compaction: 0.00 GB write, 0.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:06:58.120 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141 does not exist in monmap, will attempt to join an existing cluster 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: using public_addr v2:172.21.15.141:0/0 -> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: starting mon.smithi141 rank -1 at public addrs [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] at bind addrs [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi141 fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(???) e0 preinit fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).mds e1 new map 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).mds e1 print_map 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: e1 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: legacy client fscid: -1 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: No filesystems configured 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-16T20:06:58.121 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T20:06:58.122 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/1663584027' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/271150420' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Deploying daemon prometheus.smithi038 on smithi038 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3131998176' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/803942825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/2254534387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/1600262217' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14162 172.21.15.38:0/1020116469' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mgrmap e14: smithi038.gdlrfj(active, since 40s) 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/4153592253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3048189206' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mgrmap e15: smithi038.gdlrfj(active, starting, since 0.00350841s) 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:06:58.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/1939667202' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: [16/Dec/2023:20:06:43] ENGINE Bus STARTING 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: [16/Dec/2023:20:06:43] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: [16/Dec/2023:20:06:43] ENGINE Bus STARTED 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mgrmap e16: smithi038.gdlrfj(active, since 1.00549s) 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mgrmap e17: smithi038.gdlrfj(active, since 3s) 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3464746796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.249 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi141", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:58.250 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Deploying daemon crash.smithi141 on smithi141 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/1727333882' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Deploying daemon node-exporter.smithi141 on smithi141 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/467579711' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.251 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/2042818334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: Deploying daemon mon.smithi141 on smithi141 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-16T20:06:58.252 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:06:58 smithi141 ceph-mon[88165]: mon.smithi141@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-16T20:06:59.408 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T20:06:59.409 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T20:06:59.667 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 -- 172.21.15.141:0/1220112377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081029d0 msgr2=0x7f54f00055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 --2- 172.21.15.141:0/1220112377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081029d0 0x7f54f00055d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54f8007ea0 tx=0x7f54f800b040 comp rx=0 tx=0).stop 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 -- 172.21.15.141:0/1220112377 shutdown_connections 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 --2- 172.21.15.141:0/1220112377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081029d0 0x7f54f00055d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 -- 172.21.15.141:0/1220112377 >> 172.21.15.141:0/1220112377 conn(0x7f55080f8510 msgr2=0x7f55080fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:03.408 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 -- 172.21.15.141:0/1220112377 shutdown_connections 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.405+0000 7f550e4ec700 1 -- 172.21.15.141:0/1220112377 wait complete. 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.406+0000 7f550e4ec700 1 Processor -- start 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.406+0000 7f550e4ec700 1 -- start start 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.406+0000 7f550e4ec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f550e4ec700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 0x7f550810cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f550e4ec700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55081138b0 con 0x7f55081132a0 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f550e4ec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550810d140 con 0x7f55081029d0 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:38250/0 (socket says 172.21.15.141:38250) 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 -- 172.21.15.141:0/389080299 learned_addr learned my addr 172.21.15.141:0/389080299 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 -- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 msgr2=0x7f5508112d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 -- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 msgr2=0x7f5508112d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T20:07:03.409 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f5507fff700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f55077fe700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 0x7f550810cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f55077fe700 1 -- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 msgr2=0x7f5508112d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f55077fe700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f55077fe700 1 -- 172.21.15.141:0/389080299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8005040 con 0x7f55081132a0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.407+0000 7f55077fe700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 0x7f550810cc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b790 tx=0x7f54fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.408+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc011810 con 0x7f55081132a0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.408+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54fc011e20 con 0x7f55081132a0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.408+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc00f2e0 con 0x7f55081132a0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.408+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550810d420 con 0x7f55081132a0 2023-12-16T20:07:03.410 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.408+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550810d960 con 0x7f55081132a0 2023-12-16T20:07:03.411 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.409+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550805f270 con 0x7f55081132a0 2023-12-16T20:07:03.411 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.410+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f54fc010380 con 0x7f55081132a0 2023-12-16T20:07:03.411 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.410+0000 7f5504ff9700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 0x7f54f406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:03.411 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.410+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f54fc085f20 con 0x7f55081132a0 2023-12-16T20:07:03.411 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.410+0000 7f5507fff700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 0x7f54f406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:03.412 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.411+0000 7f5507fff700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 0x7f54f406b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009090 tx=0x7f54f800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:03.415 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.415+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54fc056ee0 con 0x7f55081132a0 2023-12-16T20:07:03.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:07:03.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: mon.smithi038 calling monitor election 2023-12-16T20:07:03.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: mon.smithi141 calling monitor election 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: fsmap 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: mgrmap e17: smithi038.gdlrfj(active, since 20s) 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:07:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: overall HEALTH_OK 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:07:03.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: mon.smithi038 calling monitor election 2023-12-16T20:07:03.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: mon.smithi141 calling monitor election 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: fsmap 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: mgrmap e17: smithi038.gdlrfj(active, since 20s) 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:07:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: overall HEALTH_OK 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/1981294151' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:03.708 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.706+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f550810e340 con 0x7f55081132a0 2023-12-16T20:07:03.708 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.706+0000 7f5504ff9700 1 -- 172.21.15.141:0/389080299 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f54fc015090 con 0x7f55081132a0 2023-12-16T20:07:03.709 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T20:07:03.709 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":2,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","modified":"2023-12-16T20:06:58.100532Z","created":"2023-12-16T20:05:08.236870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi141","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:3300","nonce":0},{"type":"v1","addr":"172.21.15.141:6789","nonce":0}]},"addr":"172.21.15.141:6789/0","public_addr":"172.21.15.141:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 msgr2=0x7f54f406b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 0x7f54f406b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009090 tx=0x7f54f800b040 comp rx=0 tx=0).stop 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 msgr2=0x7f550810cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 0x7f550810cc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b790 tx=0x7f54fc0091a0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 shutdown_connections 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f54f4069030 0x7f54f406b4e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55081029d0 0x7f5508112d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 --2- 172.21.15.141:0/389080299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55081132a0 0x7f550810cc00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 >> 172.21.15.141:0/389080299 conn(0x7f55080f8510 msgr2=0x7f55080fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:03.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 shutdown_connections 2023-12-16T20:07:03.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:07:03.709+0000 7f550e4ec700 1 -- 172.21.15.141:0/389080299 wait complete. 2023-12-16T20:07:03.711 INFO:teuthology.orchestra.run.smithi141.stderr:dumped monmap epoch 2 2023-12-16T20:07:04.111 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-16T20:07:04.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: mgrmap e18: smithi038.gdlrfj(active, since 20s), standbys: smithi141.cycgjd 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/389080299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:07:04.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:04.389 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: mgrmap e18: smithi038.gdlrfj(active, since 20s), standbys: smithi141.cycgjd 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/389080299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T20:07:04.467 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:07:05.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 -- 172.21.15.38:0/3660134818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca41028f0 msgr2=0x7f4ca4102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:05.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/3660134818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca41028f0 0x7f4ca4102cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c940048c0 tx=0x7f4c94009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:05.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 -- 172.21.15.38:0/3660134818 shutdown_connections 2023-12-16T20:07:05.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/3660134818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca41028f0 0x7f4ca4102cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 -- 172.21.15.38:0/3660134818 >> 172.21.15.38:0/3660134818 conn(0x7f4ca4071d60 msgr2=0x7f4ca4072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 -- 172.21.15.38:0/3660134818 shutdown_connections 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 -- 172.21.15.38:0/3660134818 wait complete. 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.223+0000 7f4ca92dc700 1 Processor -- start 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca92dc700 1 -- start start 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca92dc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca92dc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca92dc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4119080 con 0x7f4ca40fc500 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca92dc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca41191c0 con 0x7f4ca41028f0 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40366/0 (socket says 172.21.15.38:40366) 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 -- 172.21.15.38:0/4028885658 learned_addr learned my addr 172.21.15.38:0/4028885658 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca2ffd700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca2ffd700 1 -- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 msgr2=0x7f4ca40fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-16T20:07:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca2ffd700 1 -- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 msgr2=0x7f4ca40fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca2ffd700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 -- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 msgr2=0x7f4ca40fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca2ffd700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 -- 172.21.15.38:0/4028885658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94005040 con 0x7f4ca40fc500 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.224+0000 7f4ca27fc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b790 tx=0x7f4c98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:05.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.226+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c98010870 con 0x7f4ca40fc500 2023-12-16T20:07:05.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.226+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca4119450 con 0x7f4ca40fc500 2023-12-16T20:07:05.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.226+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca4119990 con 0x7f4ca40fc500 2023-12-16T20:07:05.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.226+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c98010e80 con 0x7f4ca40fc500 2023-12-16T20:07:05.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.226+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9800d3b0 con 0x7f4ca40fc500 2023-12-16T20:07:05.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.227+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900052e0 con 0x7f4ca40fc500 2023-12-16T20:07:05.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.228+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f4c9800d680 con 0x7f4ca40fc500 2023-12-16T20:07:05.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.228+0000 7f4c8b7fe700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 0x7f4c8c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:05.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.228+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4c98086130 con 0x7f4ca40fc500 2023-12-16T20:07:05.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.228+0000 7f4ca2ffd700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 0x7f4c8c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:05.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.229+0000 7f4ca2ffd700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 0x7f4c8c06b4f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400b3b0 tx=0x7f4c94009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:05.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.233+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4c980536e0 con 0x7f4ca40fc500 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.429+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4c90005590 con 0x7f4ca40fc500 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.429+0000 7f4c8b7fe700 1 -- 172.21.15.38:0/4028885658 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4c98056d00 con 0x7f4ca40fc500 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stdout:# minimal ceph.conf for 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:07:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: mon_host = [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] 2023-12-16T20:07:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 msgr2=0x7f4c8c06b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 0x7f4c8c06b4f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400b3b0 tx=0x7f4c94009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 msgr2=0x7f4ca40fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b790 tx=0x7f4c98009250 comp rx=0 tx=0).stop 2023-12-16T20:07:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 shutdown_connections 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4c8c069040 0x7f4c8c06b4f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ca41028f0 0x7f4ca40fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 --2- 172.21.15.38:0/4028885658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca40fc500 0x7f4ca40fc950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 >> 172.21.15.38:0/4028885658 conn(0x7f4ca4071d60 msgr2=0x7f4ca41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 shutdown_connections 2023-12-16T20:07:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:05.431+0000 7f4ca92dc700 1 -- 172.21.15.38:0/4028885658 wait complete. 2023-12-16T20:07:05.658 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-16T20:07:05.658 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:07:05.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:05.689 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:05.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:05 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4028885658' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:05.695 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:07:05.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:07:05.767 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:07:05.767 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T20:07:05.797 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:07:05.797 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:07:05.865 INFO:tasks.cephadm:Deploying OSDs... 2023-12-16T20:07:05.865 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:07:05.866 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T20:07:05.882 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T20:07:05.882 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-16 20:06:34.436556966 +0000 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-16 20:01:57.134880017 +0000 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-16 20:01:57.134880017 +0000 2023-12-16T20:07:05.937 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-16 20:01:57.134880017 +0000 2023-12-16T20:07:05.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T20:07:05.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:05 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4028885658' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:06.008 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-16T20:07:06.008 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-16T20:07:06.008 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000282755 s, 1.8 MB/s 2023-12-16T20:07:06.009 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T20:07:06.066 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-16 20:06:34.437556947 +0000 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-16 20:01:57.663869817 +0000 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-16 20:01:57.663869817 +0000 2023-12-16T20:07:06.123 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-16 20:01:57.663869817 +0000 2023-12-16T20:07:06.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T20:07:06.194 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-16T20:07:06.194 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-16T20:07:06.194 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000445512 s, 1.1 MB/s 2023-12-16T20:07:06.195 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T20:07:06.252 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-16 20:06:34.437556947 +0000 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-16 20:01:58.178859887 +0000 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-16 20:01:58.178859887 +0000 2023-12-16T20:07:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-16 20:01:58.178859887 +0000 2023-12-16T20:07:06.309 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T20:07:06.380 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-16T20:07:06.380 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-16T20:07:06.380 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000329776 s, 1.6 MB/s 2023-12-16T20:07:06.382 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T20:07:06.439 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2023-12-16T20:07:06.497 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T20:07:06.497 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-16 20:06:34.438556928 +0000 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-16 20:01:58.691849996 +0000 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-16 20:01:58.691849996 +0000 2023-12-16T20:07:06.498 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-16 20:01:58.691849996 +0000 2023-12-16T20:07:06.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T20:07:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-16T20:07:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-16T20:07:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000422782 s, 1.2 MB/s 2023-12-16T20:07:06.570 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T20:07:06.629 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:07:06.629 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T20:07:06.648 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T20:07:06.648 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_1 2023-12-16T20:07:06.705 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-12-16 20:06:57.692850891 +0000 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-12-16 20:01:45.952654699 +0000 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-12-16 20:01:45.952654699 +0000 2023-12-16T20:07:06.706 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-12-16 20:01:45.952654699 +0000 2023-12-16T20:07:06.706 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T20:07:06.776 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-12-16T20:07:06.776 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-12-16T20:07:06.776 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000236464 s, 2.2 MB/s 2023-12-16T20:07:06.777 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: Reconfiguring mon.smithi038 (unknown last config time)... 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: Reconfiguring daemon mon.smithi038 on smithi038 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:07:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:06 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:06.836 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_2 2023-12-16T20:07:06.893 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-12-16 20:06:57.692850891 +0000 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-12-16 20:01:46.446644506 +0000 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-12-16 20:01:46.446644506 +0000 2023-12-16T20:07:06.894 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-12-16 20:01:46.446644506 +0000 2023-12-16T20:07:06.894 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T20:07:06.962 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:07:06.962 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: Reconfiguring mon.smithi038 (unknown last config time)... 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: Reconfiguring daemon mon.smithi038 on smithi038 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:07:06.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:06 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:06.964 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-12-16T20:07:06.964 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-12-16T20:07:06.965 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000191929 s, 2.7 MB/s 2023-12-16T20:07:06.966 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T20:07:07.023 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_3 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-12-16 20:06:57.692850891 +0000 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-12-16 20:01:46.928634561 +0000 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-12-16 20:01:46.928634561 +0000 2023-12-16T20:07:07.079 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-12-16 20:01:46.928634561 +0000 2023-12-16T20:07:07.080 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T20:07:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-12-16T20:07:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-12-16T20:07:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000218182 s, 2.3 MB/s 2023-12-16T20:07:07.147 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T20:07:07.205 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_4 2023-12-16T20:07:07.261 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T20:07:07.261 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:07:07.261 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-12-16 20:06:57.693850871 +0000 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-12-16 20:01:47.419624429 +0000 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-12-16 20:01:47.419624429 +0000 2023-12-16T20:07:07.262 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-12-16 20:01:47.419624429 +0000 2023-12-16T20:07:07.262 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T20:07:07.331 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-12-16T20:07:07.331 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-12-16T20:07:07.331 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000208502 s, 2.5 MB/s 2023-12-16T20:07:07.331 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T20:07:07.389 INFO:tasks.cephadm:Deploying osd.0 on smithi038 with /dev/vg_nvme/lv_4... 2023-12-16T20:07:07.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T20:07:07.675 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: Reconfiguring mgr.smithi038.gdlrfj (unknown last config time)... 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: Reconfiguring daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:07:08.133 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:08.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: Reconfiguring mgr.smithi038.gdlrfj (unknown last config time)... 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: Reconfiguring daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:07:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:09.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:08 smithi038 ceph-mon[80659]: Reconfiguring crash.smithi038 (monmap changed)... 2023-12-16T20:07:09.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:08 smithi038 ceph-mon[80659]: Reconfiguring daemon crash.smithi038 on smithi038 2023-12-16T20:07:09.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:08 smithi038 ceph-mon[80659]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2023-12-16T20:07:09.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:08 smithi038 ceph-mon[80659]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2023-12-16T20:07:09.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:08 smithi038 ceph-mon[80659]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:09.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:08 smithi141 ceph-mon[88165]: Reconfiguring crash.smithi038 (monmap changed)... 2023-12-16T20:07:09.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:08 smithi141 ceph-mon[88165]: Reconfiguring daemon crash.smithi038 on smithi038 2023-12-16T20:07:09.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:08 smithi141 ceph-mon[88165]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2023-12-16T20:07:09.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:08 smithi141 ceph-mon[88165]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2023-12-16T20:07:09.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:08 smithi141 ceph-mon[88165]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T20:07:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T20:07:09.450 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2023-12-16T20:07:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2023-12-16T20:07:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118174 s, 887 MB/s 2023-12-16T20:07:09.451 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2023-12-16T20:07:09.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi038:vg_nvme/lv_4 2023-12-16T20:07:10.255 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:11.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:11 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:11.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:11 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:11.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:11 smithi038 ceph-mon[80659]: Reconfiguring grafana.smithi038 (dependencies changed)... 2023-12-16T20:07:11.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:11 smithi038 ceph-mon[80659]: Reconfiguring daemon grafana.smithi038 on smithi038 2023-12-16T20:07:11.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:11 smithi038 ceph-mon[80659]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:11.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:11 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:11.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:11 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:11.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:11 smithi141 ceph-mon[88165]: Reconfiguring grafana.smithi038 (dependencies changed)... 2023-12-16T20:07:11.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:11 smithi141 ceph-mon[88165]: Reconfiguring daemon grafana.smithi038 on smithi038 2023-12-16T20:07:11.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:11 smithi141 ceph-mon[88165]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/2459898347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 msgr2=0x7f6b880ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/2459898347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b880ff7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6b78004940 tx=0x7f6b78009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/2459898347 shutdown_connections 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/2459898347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 0x7f6b881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/2459898347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b880ff7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/2459898347 >> 172.21.15.38:0/2459898347 conn(0x7f6b880f7190 msgr2=0x7f6b880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/2459898347 shutdown_connections 2023-12-16T20:07:11.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.600+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/2459898347 wait complete. 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 Processor -- start 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 -- start start 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 0x7f6b8810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8810df50 con 0x7f6b88066090 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b8e7ce700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8810e790 con 0x7f6b880ffd70 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:11.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51698/0 (socket says 172.21.15.38:51698) 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.601+0000 7f6b87fff700 1 -- 172.21.15.38:0/1686093959 learned_addr learned my addr 172.21.15.38:0/1686093959 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b877fe700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 0x7f6b8810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b87fff700 1 -- 172.21.15.38:0/1686093959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 msgr2=0x7f6b8810d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b87fff700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 0x7f6b8810d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b87fff700 1 -- 172.21.15.38:0/1686093959 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78005040 con 0x7f6b88066090 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b87fff700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009b30 tx=0x7f6b78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7800e040 con 0x7f6b88066090 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b78004290 con 0x7f6b88066090 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8810ea10 con 0x7f6b88066090 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7801c790 con 0x7f6b88066090 2023-12-16T20:07:11.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.602+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8810ef50 con 0x7f6b88066090 2023-12-16T20:07:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.603+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b88107660 con 0x7f6b88066090 2023-12-16T20:07:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.604+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f6b78013bb0 con 0x7f6b88066090 2023-12-16T20:07:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.604+0000 7f6b84ff9700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 0x7f6b7006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.604+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6b78087270 con 0x7f6b88066090 2023-12-16T20:07:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.604+0000 7f6b877fe700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 0x7f6b7006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:11.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.605+0000 7f6b877fe700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 0x7f6b7006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006fd0 tx=0x7f6b7c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.609+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b78058350 con 0x7f6b88066090 2023-12-16T20:07:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:11.825+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b8802b150 con 0x7f6b70068ed0 2023-12-16T20:07:12.352 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:12 smithi038 ceph-mon[80659]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:12.352 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:12.352 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:12.352 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:12.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:12 smithi141 ceph-mon[88165]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:12.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:12.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:12.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:07:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:07:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:13 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2618478161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "823fcdc8-23a7-4401-b145-dfd40acfbe5c"}]: dispatch 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:13 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2618478161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "823fcdc8-23a7-4401-b145-dfd40acfbe5c"}]: dispatch 2023-12-16T20:07:15.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:14 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2618478161' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "823fcdc8-23a7-4401-b145-dfd40acfbe5c"}]': finished 2023-12-16T20:07:15.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:14 smithi038 ceph-mon[80659]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T20:07:15.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:14 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:15.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:14 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3326301876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:15.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:14 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2618478161' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "823fcdc8-23a7-4401-b145-dfd40acfbe5c"}]': finished 2023-12-16T20:07:15.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:14 smithi141 ceph-mon[88165]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T20:07:15.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:14 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:15.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:14 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3326301876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:15 smithi038 ceph-mon[80659]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:16.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:15 smithi141 ceph-mon[88165]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:18.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:17 smithi038 ceph-mon[80659]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:18.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:17 smithi141 ceph-mon[88165]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:19.790 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:19 smithi038 ceph-mon[80659]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:20.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:19 smithi141 ceph-mon[88165]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:21.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:21.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:21.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:21.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: Reconfiguring crash.smithi141 (monmap changed)... 2023-12-16T20:07:21.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: Reconfiguring daemon crash.smithi141 on smithi141 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:07:21.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: Reconfiguring crash.smithi141 (monmap changed)... 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: Reconfiguring daemon crash.smithi141 on smithi141 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:07:22.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:07:22.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: Deploying daemon osd.0 on smithi038 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: Reconfiguring mgr.smithi141.cycgjd (monmap changed)... 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: Reconfiguring daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:07:22.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:22.969 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: Deploying daemon osd.0 on smithi038 2023-12-16T20:07:22.969 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: Reconfiguring mgr.smithi141.cycgjd (monmap changed)... 2023-12-16T20:07:22.969 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: Reconfiguring daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:07:22.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:22.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:07:22.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:07:22.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: Reconfiguring mon.smithi141 (monmap changed)... 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: Reconfiguring daemon mon.smithi141 on smithi141 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:07:23.911 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.912 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: Reconfiguring mon.smithi141 (monmap changed)... 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: Reconfiguring daemon mon.smithi141 on smithi141 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T20:07:23.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:23.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:07:24.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T20:07:24.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:24.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:24 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:24.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:07:24.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:24 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:25.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:25 smithi038 ceph-mon[80659]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:25.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:25 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:25.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:25 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:25 smithi141 ceph-mon[88165]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:25 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:25 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.531+0000 7f6b84ff9700 1 -- 172.21.15.38:0/1686093959 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6b8802b150 con 0x7f6b70068ed0 2023-12-16T20:07:26.531 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 0 on host 'smithi038' 2023-12-16T20:07:26.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 msgr2=0x7f6b7006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:26.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 0x7f6b7006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006fd0 tx=0x7f6b7c008040 comp rx=0 tx=0).stop 2023-12-16T20:07:26.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 msgr2=0x7f6b8810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:26.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009b30 tx=0x7f6b78009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 shutdown_connections 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6b70068ed0 0x7f6b7006b380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b88066090 0x7f6b8810d380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 --2- 172.21.15.38:0/1686093959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b880ffd70 0x7f6b8810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 >> 172.21.15.38:0/1686093959 conn(0x7f6b880f7190 msgr2=0x7f6b880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 shutdown_connections 2023-12-16T20:07:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:26.533+0000 7f6b8e7ce700 1 -- 172.21.15.38:0/1686093959 wait complete. 2023-12-16T20:07:26.864 DEBUG:teuthology.orchestra.run.smithi038:osd.0> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service 2023-12-16T20:07:26.866 INFO:tasks.cephadm:Deploying osd.1 on smithi038 with /dev/vg_nvme/lv_3... 2023-12-16T20:07:26.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T20:07:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:27.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:27.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:27 smithi038 ceph-mon[80659]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:27.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:27 smithi141 ceph-mon[88165]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:28.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:28 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:28.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:28 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:28.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:28 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0101065 s, 1.0 GB/s 2023-12-16T20:07:28.629 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2023-12-16T20:07:28.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:28 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:28.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:28 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:28.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:28 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:28.877 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:07:28 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:07:28.792+0000 7f37baede540 -1 osd.0 0 log_to_monitors true 2023-12-16T20:07:28.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi038:vg_nvme/lv_3 2023-12-16T20:07:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:29.480 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:29 smithi038 ceph-mon[80659]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:29.480 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:29 smithi038 ceph-mon[80659]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T20:07:29.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:29 smithi141 ceph-mon[88165]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:29.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:29 smithi141 ceph-mon[88165]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 -- 172.21.15.38:0/3914761707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 msgr2=0x7f3df80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 --2- 172.21.15.38:0/3914761707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df80fbf00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3de8004940 tx=0x7f3de8009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 -- 172.21.15.38:0/3914761707 shutdown_connections 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 --2- 172.21.15.38:0/3914761707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 0x7f3df80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 --2- 172.21.15.38:0/3914761707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df80fbf00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 -- 172.21.15.38:0/3914761707 >> 172.21.15.38:0/3914761707 conn(0x7f3df80f71d0 msgr2=0x7f3df80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 -- 172.21.15.38:0/3914761707 shutdown_connections 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 -- 172.21.15.38:0/3914761707 wait complete. 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.100+0000 7f3dfd121700 1 Processor -- start 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3dfd121700 1 -- start start 2023-12-16T20:07:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3dfd121700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3dfd121700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 0x7f3df810c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3dfd121700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df810cfa0 con 0x7f3df80fbaf0 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3dfd121700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df810d840 con 0x7f3df80fcd00 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54362/0 (socket says 172.21.15.38:54362) 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 -- 172.21.15.38:0/4009887551 learned_addr learned my addr 172.21.15.38:0/4009887551 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df659c700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 0x7f3df810c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 -- 172.21.15.38:0/4009887551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 msgr2=0x7f3df810c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 0x7f3df810c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:30.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 -- 172.21.15.38:0/4009887551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8005040 con 0x7f3df80fbaf0 2023-12-16T20:07:30.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3df6d9d700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3de8000c00 tx=0x7f3de8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:30.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.101+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de800e040 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.102+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df810dac0 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.102+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3de8009af0 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.102+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de801c630 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.102+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df810e000 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.103+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df804bb80 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.103+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f3de800bcd0 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.103+0000 7f3ddf7fe700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 0x7f3de006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.104+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1572+0+0 (secure 0 0 0) 0x7f3de8087170 con 0x7f3df80fbaf0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.104+0000 7f3df659c700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 0x7f3de006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:30.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.104+0000 7f3df659c700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 0x7f3de006b380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3dec007fd0 tx=0x7f3dec009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:30.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.108+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3de8058190 con 0x7f3df80fbaf0 2023-12-16T20:07:30.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:30.312+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3df810e410 con 0x7f3de0068ed0 2023-12-16T20:07:30.624 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:07:30.322+0000 7f37b16c3700 -1 osd.0 0 waiting for initial osdmap 2023-12-16T20:07:30.624 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:07:30.329+0000 7f37ac4be700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:30.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:30 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:30.645 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T20:07:30.646 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T20:07:30.646 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:30.646 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:07:30.646 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:30.646 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:30 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:31.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:31.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:31.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:31.651 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T20:07:31.652 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] boot 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:32.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: osd.0 [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] boot 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:32.663 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.664 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:32.664 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:32.664 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:32.664 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi038 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi038 to 12869M 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: pgmap v23: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/758703690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c07c7f4-3599-494b-bec2-721ece56613b"}]: dispatch 2023-12-16T20:07:33.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/758703690' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c07c7f4-3599-494b-bec2-721ece56613b"}]': finished 2023-12-16T20:07:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T20:07:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi038 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi038 to 12869M 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: pgmap v23: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/758703690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c07c7f4-3599-494b-bec2-721ece56613b"}]: dispatch 2023-12-16T20:07:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/758703690' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c07c7f4-3599-494b-bec2-721ece56613b"}]': finished 2023-12-16T20:07:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T20:07:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:34.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:34 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1793090958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:34.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:34 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1793090958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:38.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:37 smithi038 ceph-mon[80659]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:38.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:37 smithi141 ceph-mon[88165]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:40.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:39 smithi038 ceph-mon[80659]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:40.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:39 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:07:40.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:39 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:39 smithi141 ceph-mon[88165]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:39 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:07:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:39 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:41.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:40 smithi038 ceph-mon[80659]: Deploying daemon osd.1 on smithi038 2023-12-16T20:07:41.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:40 smithi141 ceph-mon[88165]: Deploying daemon osd.1 on smithi038 2023-12-16T20:07:42.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:41 smithi038 ceph-mon[80659]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:42.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:41 smithi141 ceph-mon[88165]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:43.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:43.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:43.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:43 smithi038 ceph-mon[80659]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:43.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:43 smithi141 ceph-mon[88165]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:44.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.457+0000 7f3ddf7fe700 1 -- 172.21.15.38:0/4009887551 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3df810e410 con 0x7f3de0068ed0 2023-12-16T20:07:44.459 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 1 on host 'smithi038' 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 msgr2=0x7f3de006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 0x7f3de006b380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3dec007fd0 tx=0x7f3dec009040 comp rx=0 tx=0).stop 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 msgr2=0x7f3df810c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3de8000c00 tx=0x7f3de8009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 shutdown_connections 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3de0068ed0 0x7f3de006b380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df80fbaf0 0x7f3df810c460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 --2- 172.21.15.38:0/4009887551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3df80fcd00 0x7f3df810c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 >> 172.21.15.38:0/4009887551 conn(0x7f3df80f71d0 msgr2=0x7f3df80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:44.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 shutdown_connections 2023-12-16T20:07:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:44.459+0000 7f3dfd121700 1 -- 172.21.15.38:0/4009887551 wait complete. 2023-12-16T20:07:44.862 DEBUG:teuthology.orchestra.run.smithi038:osd.1> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.1.service 2023-12-16T20:07:44.864 INFO:tasks.cephadm:Deploying osd.2 on smithi038 with /dev/vg_nvme/lv_2... 2023-12-16T20:07:44.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T20:07:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:45.687 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:45 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:45.688 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:45 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:45.688 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:45 smithi038 ceph-mon[80659]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:45.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:45 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:45.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:45 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:45.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:45 smithi141 ceph-mon[88165]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.016177 s, 648 MB/s 2023-12-16T20:07:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2023-12-16T20:07:46.745 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:46.745 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:46.745 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:46 smithi038 ceph-mon[80659]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T20:07:46.745 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:07:46 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:07:46.612+0000 7f9befce6540 -1 osd.1 0 log_to_monitors true 2023-12-16T20:07:46.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi038:vg_nvme/lv_2 2023-12-16T20:07:46.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:46.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:46.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:46 smithi141 ceph-mon[88165]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T20:07:47.253 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:07:47.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:07:47.710+0000 7f9be7cce700 -1 osd.1 0 waiting for initial osdmap 2023-12-16T20:07:47.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:07:47.715+0000 7f9bdf2c2700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:07:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-mon[80659]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T20:07:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-mon[80659]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T20:07:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-mon[80659]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:07:47.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:47 smithi038 ceph-mon[80659]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:47.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.930+0000 7fc72c918700 1 -- 172.21.15.38:0/1779989168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 msgr2=0x7fc7280fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:47.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.930+0000 7fc72c918700 1 --2- 172.21.15.38:0/1779989168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc7280fd000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc718004940 tx=0x7fc718009e30 comp rx=0 tx=0).stop 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- 172.21.15.38:0/1779989168 shutdown_connections 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 --2- 172.21.15.38:0/1779989168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7280fde00 0x7fc7280fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 --2- 172.21.15.38:0/1779989168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc7280fd000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- 172.21.15.38:0/1779989168 >> 172.21.15.38:0/1779989168 conn(0x7fc7280f82d0 msgr2=0x7fc7280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- 172.21.15.38:0/1779989168 shutdown_connections 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- 172.21.15.38:0/1779989168 wait complete. 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 Processor -- start 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- start start 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:47.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7280fde00 0x7fc72810dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72810e170 con 0x7fc7280fcbf0 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72c918700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72810e9b0 con 0x7fc7280fde00 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58534/0 (socket says 172.21.15.38:58534) 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.931+0000 7fc72659c700 1 -- 172.21.15.38:0/130231687 learned_addr learned my addr 172.21.15.38:0/130231687 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72659c700 1 -- 172.21.15.38:0/130231687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7280fde00 msgr2=0x7fc72810dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72659c700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7280fde00 0x7fc72810dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:07:47.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72659c700 1 -- 172.21.15.38:0/130231687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718005040 con 0x7fc7280fcbf0 2023-12-16T20:07:47.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72659c700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b7d0 tx=0x7fc718009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:47.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71800e040 con 0x7fc7280fcbf0 2023-12-16T20:07:47.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc71800bc50 con 0x7fc7280fcbf0 2023-12-16T20:07:47.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72810ec30 con 0x7fc7280fcbf0 2023-12-16T20:07:47.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71801c630 con 0x7fc7280fcbf0 2023-12-16T20:07:47.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.932+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72810f170 con 0x7fc7280fcbf0 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.933+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72804bb80 con 0x7fc7280fcbf0 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.934+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fc718013420 con 0x7fc7280fcbf0 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.934+0000 7fc716ffd700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 0x7fc71006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.934+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2130+0+0 (secure 0 0 0) 0x7fc7180872c0 con 0x7fc7280fcbf0 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.934+0000 7fc725d9b700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 0x7fc71006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:07:47.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.934+0000 7fc725d9b700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 0x7fc71006b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006fd0 tx=0x7fc71c006db0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:07:47.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:47.939+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc7180580a0 con 0x7fc7280fcbf0 2023-12-16T20:07:47.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:47 smithi141 ceph-mon[88165]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T20:07:47.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:47 smithi141 ceph-mon[88165]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T20:07:47.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:47 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:47.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:47 smithi141 ceph-mon[88165]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:07:47.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:47 smithi141 ceph-mon[88165]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:48.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:07:48.147+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc72810f6d0 con 0x7fc710068ed0 2023-12-16T20:07:48.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:07:48.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:48.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:48.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:48.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:48.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:07:48.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T20:07:48.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:48.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:07:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:49.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi038 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi038 to 6434M 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] boot 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4152184903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ee3a174-4f43-493d-99fc-9e66d34b747e"}]: dispatch 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4152184903' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ee3a174-4f43-493d-99fc-9e66d34b747e"}]': finished 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: osdmap e15: 3 total, 2 up, 3 in 2023-12-16T20:07:49.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:07:49.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:07:49.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:07:49.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi038 2023-12-16T20:07:49.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi038 to 6434M 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: osd.1 [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] boot 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4152184903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ee3a174-4f43-493d-99fc-9e66d34b747e"}]: dispatch 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4152184903' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ee3a174-4f43-493d-99fc-9e66d34b747e"}]': finished 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: osdmap e15: 3 total, 2 up, 3 in 2023-12-16T20:07:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:07:51.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:51 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/13375696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:51.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:51 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/13375696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:07:52.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: pgmap v37: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:52.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:52.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: pgmap v37: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:52.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:52.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:52.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:52.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:07:52.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:07:53.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:53 smithi141 ceph-mon[88165]: pgmap v38: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:54.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:53 smithi038 ceph-mon[80659]: pgmap v38: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:56.114 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:55 smithi038 ceph-mon[80659]: pgmap v39: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:56.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:55 smithi141 ceph-mon[88165]: pgmap v39: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:56.968 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:07:56.968 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:56 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:57.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:56 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:07:57.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:56 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:07:58.112 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:57 smithi038 ceph-mon[80659]: Deploying daemon osd.2 on smithi038 2023-12-16T20:07:58.113 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:57 smithi038 ceph-mon[80659]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:58.113 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:57 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:07:58.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:57 smithi141 ceph-mon[88165]: Deploying daemon osd.2 on smithi038 2023-12-16T20:07:58.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:57 smithi141 ceph-mon[88165]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:07:58.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:57 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:00.026 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:59 smithi038 ceph-mon[80659]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:00.026 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:00.026 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:00.027 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:07:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:00.046 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:59 smithi141 ceph-mon[88165]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:00.046 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:00.046 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:00.046 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:07:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:00.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.957+0000 7fc716ffd700 1 -- 172.21.15.38:0/130231687 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc72810f6d0 con 0x7fc710068ed0 2023-12-16T20:08:00.958 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 2 on host 'smithi038' 2023-12-16T20:08:00.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 msgr2=0x7fc71006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:00.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 0x7fc71006b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006fd0 tx=0x7fc71c006db0 comp rx=0 tx=0).stop 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 msgr2=0x7fc72810d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b7d0 tx=0x7fc718009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 shutdown_connections 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc710068ed0 0x7fc71006b380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7280fcbf0 0x7fc72810d5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 --2- 172.21.15.38:0/130231687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7280fde00 0x7fc72810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.958+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 >> 172.21.15.38:0/130231687 conn(0x7fc7280f82d0 msgr2=0x7fc728101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.959+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 shutdown_connections 2023-12-16T20:08:00.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:00.959+0000 7fc72c918700 1 -- 172.21.15.38:0/130231687 wait complete. 2023-12-16T20:08:01.327 DEBUG:teuthology.orchestra.run.smithi038:osd.2> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.2.service 2023-12-16T20:08:01.329 INFO:tasks.cephadm:Deploying osd.3 on smithi141 with /dev/vg_nvme/lv_4... 2023-12-16T20:08:01.329 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T20:08:01.576 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:01.971 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:01 smithi141 ceph-mon[88165]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:01.971 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:01 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:01.971 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:01 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:02.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:01 smithi038 ceph-mon[80659]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:02.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:01 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:02.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:01 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr: stderr: 10+0 records in 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr:10+0 records out 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115982 s, 904 MB/s 2023-12-16T20:08:02.570 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping successful for: 2023-12-16T20:08:02.846 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi141:vg_nvme/lv_4 2023-12-16T20:08:03.092 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:03.521 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:03 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:08:03.339+0000 7f9f38940540 -1 osd.2 0 log_to_monitors true 2023-12-16T20:08:03.779 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:03.779 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:03 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:03.779 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:03 smithi141 ceph-mon[88165]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:03.779 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:03 smithi141 ceph-mon[88165]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T20:08:03.880 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- 172.21.15.141:0/2042448699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 msgr2=0x7f9af80fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 --2- 172.21.15.141:0/2042448699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af80fb2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009ce0 tx=0x7f9af4004d10 comp rx=0 tx=0).stop 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- 172.21.15.141:0/2042448699 shutdown_connections 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 --2- 172.21.15.141:0/2042448699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af80fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 --2- 172.21.15.141:0/2042448699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af80fb2e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- 172.21.15.141:0/2042448699 >> 172.21.15.141:0/2042448699 conn(0x7f9af80f6950 msgr2=0x7f9af80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- 172.21.15.141:0/2042448699 shutdown_connections 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- 172.21.15.141:0/2042448699 wait complete. 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 Processor -- start 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- start start 2023-12-16T20:08:03.881 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af810dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af810e2b0 con 0x7f9af80fdf60 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.879+0000 7f9b006de700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af810eb50 con 0x7f9af80faed0 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:60490/0 (socket says 172.21.15.141:60490) 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 -- 172.21.15.141:0/2116311175 learned_addr learned my addr 172.21.15.141:0/2116311175 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afdc79700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af810dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 -- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 msgr2=0x7f9af810dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af810dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 -- 172.21.15.141:0/2116311175 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4009940 con 0x7f9af80faed0 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afdc79700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9afe47a700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9af40098b0 tx=0x7f9af4004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:03.882 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af400e040 con 0x7f9af80faed0 2023-12-16T20:08:03.883 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af810edd0 con 0x7f9af80faed0 2023-12-16T20:08:03.883 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af810f310 con 0x7f9af80faed0 2023-12-16T20:08:03.883 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9af40128c0 con 0x7f9af80faed0 2023-12-16T20:08:03.883 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.880+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af401c840 con 0x7f9af80faed0 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.881+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc0052e0 con 0x7f9af80faed0 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.882+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f9af4012410 con 0x7f9af80faed0 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.882+0000 7f9aeeffd700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 0x7f9ae406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.882+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2546+0+0 (secure 0 0 0) 0x7f9af4087de0 con 0x7f9af80faed0 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.882+0000 7f9afdc79700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 0x7f9ae406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:03.884 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.883+0000 7f9afdc79700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 0x7f9ae406b380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009fd0 tx=0x7f9ae8009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:03.887 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:03.887+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9af4058900 con 0x7f9af80faed0 2023-12-16T20:08:03.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:03.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:03 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:03.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:03 smithi038 ceph-mon[80659]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:03.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:03 smithi038 ceph-mon[80659]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T20:08:04.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:04.080+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9adc000bf0 con 0x7f9ae4068ed0 2023-12-16T20:08:04.979 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:04.980 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:04.981 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:04 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.143 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:08:04.719+0000 7f9f2f125700 -1 osd.2 0 waiting for initial osdmap 2023-12-16T20:08:05.143 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:08:04.727+0000 7f9f2af22700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:05.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:04 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:05.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:05.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi038 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi038 to 4289M 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3982363802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]: dispatch 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]: dispatch 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] boot 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]': finished 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: osdmap e18: 4 total, 3 up, 4 in 2023-12-16T20:08:05.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:05.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:05 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:06.047 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi038 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi038 to 4289M 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3982363802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]: dispatch 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]: dispatch 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: osd.2 [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] boot 2023-12-16T20:08:06.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f43cc52b-2a8e-442d-8acb-b61c2d5d4803"}]': finished 2023-12-16T20:08:06.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: osdmap e18: 4 total, 3 up, 4 in 2023-12-16T20:08:06.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:08:06.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:05 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:06.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:06 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:08:06.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:06 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:08:06.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:06 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/554976852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:07.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:06 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:08:07.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:06 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:08:07.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:06 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/554976852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:07.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:07 smithi141 ceph-mon[88165]: pgmap v48: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:07.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:07 smithi141 ceph-mon[88165]: osdmap e19: 4 total, 3 up, 4 in 2023-12-16T20:08:07.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:07.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:07 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T20:08:08.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:07 smithi038 ceph-mon[80659]: pgmap v48: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:07 smithi038 ceph-mon[80659]: osdmap e19: 4 total, 3 up, 4 in 2023-12-16T20:08:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:07 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T20:08:08.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:08 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T20:08:08.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:08 smithi141 ceph-mon[88165]: osdmap e20: 4 total, 3 up, 4 in 2023-12-16T20:08:08.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:08 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:08.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:08 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T20:08:09.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:08 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T20:08:09.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:08 smithi038 ceph-mon[80659]: osdmap e20: 4 total, 3 up, 4 in 2023-12-16T20:08:09.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:08 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:09.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:08 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T20:08:09.643 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119228]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T20:08:09.643 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:09.643 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119228]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:09.643 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119228]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:09.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:09.750+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9af4055240 con 0x7f9af80faed0 2023-12-16T20:08:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:09 smithi141 ceph-mon[88165]: pgmap v51: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:09 smithi141 ceph-mon[88165]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-16T20:08:09.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:09 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T20:08:09.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:09 smithi141 ceph-mon[88165]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T20:08:09.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:09 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:10.143 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119231]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T20:08:10.143 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:10.143 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119231]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:10.143 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:08:09 smithi038 sudo[119231]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:09 smithi038 ceph-mon[80659]: pgmap v51: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:09 smithi038 ceph-mon[80659]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-16T20:08:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:09 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T20:08:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:09 smithi038 ceph-mon[80659]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T20:08:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:09 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:10.643 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119234]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T20:08:10.643 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:10.643 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119234]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:10.643 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119234]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:11.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:10 smithi141 ceph-mon[88165]: mgrmap e19: smithi038.gdlrfj(active, since 87s), standbys: smithi141.cycgjd 2023-12-16T20:08:11.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:10 smithi141 ceph-mon[88165]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T20:08:11.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:10 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:11.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:10 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:11.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:10 smithi038 ceph-mon[80659]: mgrmap e19: smithi038.gdlrfj(active, since 87s), standbys: smithi141.cycgjd 2023-12-16T20:08:11.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:10 smithi038 ceph-mon[80659]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T20:08:11.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:10 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:11.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:10 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:11.143 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119237]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T20:08:11.144 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119237]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:11.144 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119237]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:11.144 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:08:10 smithi038 sudo[119237]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:11.611 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119240]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T20:08:11.611 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119240]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:11.612 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119240]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:11.612 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119240]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:11.893 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119243]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T20:08:11.893 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119243]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:11.893 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119243]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:11.893 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:08:11 smithi038 sudo[119243]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:12.393 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119246]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T20:08:12.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:12.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119246]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:12.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119246]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:12.647 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: pgmap v54: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:12.647 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-16T20:08:12.647 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: Cluster is now healthy 2023-12-16T20:08:12.647 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:08:12.647 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:12.648 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 ceph-mon[88165]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T20:08:12.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119249]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T20:08:12.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119249]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:12.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119249]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 sudo[119249]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: pgmap v54: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: Cluster is now healthy 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:12 smithi038 ceph-mon[80659]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T20:08:12.905 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 sudo[93299]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T20:08:12.905 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 sudo[93299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:12.905 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 sudo[93299]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:12.905 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:12 smithi141 sudo[93299]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:13.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 sudo[93346]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T20:08:13.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 sudo[93346]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T20:08:13.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 sudo[93346]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T20:08:13.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 sudo[93346]: pam_unix(sudo:session): session closed for user root 2023-12-16T20:08:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: Deploying daemon osd.3 on smithi141 2023-12-16T20:08:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T20:08:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:08:13.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: pgmap v55: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T20:08:13.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: Deploying daemon osd.3 on smithi141 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:08:13.927 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:08:13.928 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: pgmap v55: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T20:08:13.928 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:13.928 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T20:08:13.928 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:15.676 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:15 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:15.676 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:15 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:15.677 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:15 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:15.677 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:15 smithi141 ceph-mon[88165]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.4 KiB/s rd, 263 KiB/s wr, 18 op/s 2023-12-16T20:08:15.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:15 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:15.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:15 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:15.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:15 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:15.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:15 smithi038 ceph-mon[80659]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.4 KiB/s rd, 263 KiB/s wr, 18 op/s 2023-12-16T20:08:16.425 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.426+0000 7f9aeeffd700 1 -- 172.21.15.141:0/2116311175 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9adc000bf0 con 0x7f9ae4068ed0 2023-12-16T20:08:16.426 INFO:teuthology.orchestra.run.smithi141.stdout:Created osd(s) 3 on host 'smithi141' 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 msgr2=0x7f9ae406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 0x7f9ae406b380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009fd0 tx=0x7f9ae8009ee0 comp rx=0 tx=0).stop 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 msgr2=0x7f9af810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9af40098b0 tx=0x7f9af4004d10 comp rx=0 tx=0).stop 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 shutdown_connections 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ae4068ed0 0x7f9ae406b380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9af80faed0 0x7f9af810d770 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 --2- 172.21.15.141:0/2116311175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af80fdf60 0x7f9af810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 >> 172.21.15.141:0/2116311175 conn(0x7f9af80f6950 msgr2=0x7f9af80f8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 shutdown_connections 2023-12-16T20:08:16.428 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:16.428+0000 7f9b006de700 1 -- 172.21.15.141:0/2116311175 wait complete. 2023-12-16T20:08:16.793 DEBUG:teuthology.orchestra.run.smithi141:osd.3> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.3.service 2023-12-16T20:08:16.795 INFO:tasks.cephadm:Deploying osd.4 on smithi141 with /dev/vg_nvme/lv_3... 2023-12-16T20:08:16.796 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T20:08:17.122 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:17.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:17 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:17 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:17 smithi141 ceph-mon[88165]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.9 KiB/s rd, 187 KiB/s wr, 12 op/s 2023-12-16T20:08:17.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:17 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:17 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.745 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:17 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:17 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:17 smithi038 ceph-mon[80659]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.9 KiB/s rd, 187 KiB/s wr, 12 op/s 2023-12-16T20:08:17.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:17 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:17.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:17 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:18.596 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T20:08:18.596 INFO:teuthology.orchestra.run.smithi141.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T20:08:18.597 INFO:teuthology.orchestra.run.smithi141.stderr: stderr: 10+0 records in 2023-12-16T20:08:18.597 INFO:teuthology.orchestra.run.smithi141.stderr:10+0 records out 2023-12-16T20:08:18.597 INFO:teuthology.orchestra.run.smithi141.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130176 s, 806 MB/s 2023-12-16T20:08:18.597 INFO:teuthology.orchestra.run.smithi141.stderr: stderr: 2023-12-16T20:08:18.597 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping successful for: 2023-12-16T20:08:18.597 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:08:18 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:08:18.547+0000 7f2ab2d6b540 -1 osd.3 0 log_to_monitors true 2023-12-16T20:08:18.860 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:18 smithi141 ceph-mon[88165]: from='osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:08:18.860 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:18 smithi141 ceph-mon[88165]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:08:18.861 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi141:vg_nvme/lv_3 2023-12-16T20:08:19.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:18 smithi038 ceph-mon[80659]: from='osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:08:19.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:18 smithi038 ceph-mon[80659]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:08:19.322 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:19.993 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:08:19.728+0000 7f2aa9550700 -1 osd.3 0 waiting for initial osdmap 2023-12-16T20:08:19.993 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:08:19.734+0000 7f2aa2347700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:19.993 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:19.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:19 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.068 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.067+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2584779093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440ffdb0 msgr2=0x7ff344102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.067+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2584779093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440ffdb0 0x7ff344102190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff334004940 tx=0x7ff334009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2584779093 shutdown_connections 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2584779093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440ffdb0 0x7ff344102190 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2584779093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff344066860 0x7ff3440ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2584779093 >> 172.21.15.141:0/2584779093 conn(0x7ff3440f7240 msgr2=0x7ff3440f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2584779093 shutdown_connections 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2584779093 wait complete. 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 Processor -- start 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- start start 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3440ffdb0 0x7ff34410da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34410e050 con 0x7ff3440ffdb0 2023-12-16T20:08:20.069 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff34b6e4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34410e8f0 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff349480700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff349480700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:53292/0 (socket says 172.21.15.141:53292) 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff349480700 1 -- 172.21.15.141:0/2223012632 learned_addr learned my addr 172.21.15.141:0/2223012632 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.068+0000 7ff348c7f700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3440ffdb0 0x7ff34410da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff349480700 1 -- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3440ffdb0 msgr2=0x7ff34410da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff349480700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3440ffdb0 0x7ff34410da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff349480700 1 -- 172.21.15.141:0/2223012632 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334005040 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff349480700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff340002a80 tx=0x7ff340004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff340007cc0 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34410ebd0 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff34000f040 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34000d9c0 con 0x7ff344066860 2023-12-16T20:08:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.069+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34410f110 con 0x7ff344066860 2023-12-16T20:08:20.071 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.070+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34404bb80 con 0x7ff344066860 2023-12-16T20:08:20.071 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.071+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff34000db20 con 0x7ff344066860 2023-12-16T20:08:20.071 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.071+0000 7ff339ffb700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 0x7ff33006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:20.071 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.071+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3490+0+0 (secure 0 0 0) 0x7ff340086310 con 0x7ff344066860 2023-12-16T20:08:20.072 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.071+0000 7ff348c7f700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 0x7ff33006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:20.072 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.072+0000 7ff348c7f700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 0x7ff33006b410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b3b0 tx=0x7ff334009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.076+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3400569a0 con 0x7ff344066860 2023-12-16T20:08:20.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-12-16T20:08:20.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:19 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:20.268 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:20.268+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff34410f560 con 0x7ff330068f60 2023-12-16T20:08:20.917 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi141 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi141 to 15936M 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] boot 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T20:08:20.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:20 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi141 2023-12-16T20:08:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi141 to 15936M 2023-12-16T20:08:21.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: osd.3 [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] boot 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T20:08:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:20 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:08:21.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:21 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:08:21.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:21 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:08:21.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:21 smithi141 ceph-mon[88165]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:21.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:21 smithi141 ceph-mon[88165]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-12-16T20:08:21.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:21 smithi141 ceph-mon[88165]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T20:08:22.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:21 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:08:22.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:21 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:08:22.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:21 smithi038 ceph-mon[80659]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:22.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:21 smithi038 ceph-mon[80659]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-12-16T20:08:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:21 smithi038 ceph-mon[80659]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T20:08:23.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/828043987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]: dispatch 2023-12-16T20:08:23.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]: dispatch 2023-12-16T20:08:23.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]': finished 2023-12-16T20:08:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: osdmap e27: 5 total, 4 up, 5 in 2023-12-16T20:08:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/2318811696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T20:08:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:22 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:23.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/828043987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]: dispatch 2023-12-16T20:08:23.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]: dispatch 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f8086c7-2036-4bd7-9922-3c2e84a75a59"}]': finished 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: osdmap e27: 5 total, 4 up, 5 in 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/2318811696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T20:08:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:22 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:23 smithi038 ceph-mon[80659]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:23 smithi038 ceph-mon[80659]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T20:08:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:23 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:24.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:23 smithi141 ceph-mon[88165]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:24.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:23 smithi141 ceph-mon[88165]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T20:08:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:23 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:25.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:25 smithi141 ceph-mon[88165]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T20:08:26.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:25 smithi038 ceph-mon[80659]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T20:08:27.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:27 smithi141 ceph-mon[88165]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-12-16T20:08:27.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:08:27.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:27.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:27 smithi038 ceph-mon[80659]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-12-16T20:08:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:08:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:28.982 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:28 smithi141 ceph-mon[88165]: Deploying daemon osd.4 on smithi141 2023-12-16T20:08:29.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:28 smithi038 ceph-mon[80659]: Deploying daemon osd.4 on smithi141 2023-12-16T20:08:30.116 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:29 smithi141 ceph-mon[88165]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-16T20:08:30.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:29 smithi038 ceph-mon[80659]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-16T20:08:31.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:31.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:31.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:31.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:31 smithi141 ceph-mon[88165]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-16T20:08:31.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:31.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:31.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:31.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:31 smithi038 ceph-mon[80659]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-16T20:08:32.417 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.416+0000 7ff339ffb700 1 -- 172.21.15.141:0/2223012632 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff34410f560 con 0x7ff330068f60 2023-12-16T20:08:32.417 INFO:teuthology.orchestra.run.smithi141.stdout:Created osd(s) 4 on host 'smithi141' 2023-12-16T20:08:32.420 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 msgr2=0x7ff33006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:32.420 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 0x7ff33006b410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b3b0 tx=0x7ff334009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:32.420 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 msgr2=0x7ff34410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:32.420 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff340002a80 tx=0x7ff340004600 comp rx=0 tx=0).stop 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 shutdown_connections 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff330068f60 0x7ff33006b410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344066860 0x7ff34410d510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 --2- 172.21.15.141:0/2223012632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3440ffdb0 0x7ff34410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 >> 172.21.15.141:0/2223012632 conn(0x7ff3440f7240 msgr2=0x7ff3440f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 shutdown_connections 2023-12-16T20:08:32.421 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:32.420+0000 7ff34b6e4700 1 -- 172.21.15.141:0/2223012632 wait complete. 2023-12-16T20:08:32.706 DEBUG:teuthology.orchestra.run.smithi141:osd.4> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.4.service 2023-12-16T20:08:32.708 INFO:tasks.cephadm:Deploying osd.5 on smithi141 with /dev/vg_nvme/lv_2... 2023-12-16T20:08:32.708 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T20:08:33.012 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:33 smithi038 ceph-mon[80659]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T20:08:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:33 smithi141 ceph-mon[88165]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T20:08:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr: stderr: 10+0 records in 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr:10+0 records out 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0143489 s, 731 MB/s 2023-12-16T20:08:34.532 INFO:teuthology.orchestra.run.smithi141.stderr:--> Zapping successful for: 2023-12-16T20:08:34.707 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:08:34 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:08:34.420+0000 7ff3485a4540 -1 osd.4 0 log_to_monitors true 2023-12-16T20:08:34.870 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi141:vg_nvme/lv_2 2023-12-16T20:08:34.964 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:34 smithi141 ceph-mon[88165]: from='osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:08:34.964 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:34 smithi141 ceph-mon[88165]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:08:35.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:34 smithi038 ceph-mon[80659]: from='osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:08:35.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:34 smithi038 ceph-mon[80659]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:08:35.338 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:08:35.882 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:08:35.723+0000 7ff33ed89700 -1 osd.4 0 waiting for initial osdmap 2023-12-16T20:08:35.882 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:08:35.730+0000 7ff33bb88700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:35.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:35.883 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:36.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:36.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:36.079 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- 172.21.15.141:0/3835818576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 msgr2=0x7f124c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 --2- 172.21.15.141:0/3835818576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c0fbf00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f123c004940 tx=0x7f123c009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- 172.21.15.141:0/3835818576 shutdown_connections 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 --2- 172.21.15.141:0/3835818576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 0x7f124c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 --2- 172.21.15.141:0/3835818576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c0fbf00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- 172.21.15.141:0/3835818576 >> 172.21.15.141:0/3835818576 conn(0x7f124c0f7190 msgr2=0x7f124c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- 172.21.15.141:0/3835818576 shutdown_connections 2023-12-16T20:08:36.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- 172.21.15.141:0/3835818576 wait complete. 2023-12-16T20:08:36.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 Processor -- start 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- start start 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 0x7f124c114c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c066000 con 0x7f124c0fcd00 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.079+0000 7f1250cd7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c066140 con 0x7f124c0fbaf0 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:49778/0 (socket says 172.21.15.141:49778) 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 -- 172.21.15.141:0/4199041294 learned_addr learned my addr 172.21.15.141:0/4199041294 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1243fff700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 0x7f124c114c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:36.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 -- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 msgr2=0x7f124c114c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 0x7f124c114c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 -- 172.21.15.141:0/4199041294 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c005040 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f124a59c700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f123c004f90 tx=0x7f123c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123c00e040 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f123c00bcd0 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123c01c630 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c115180 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.080+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c115520 con 0x7f124c0fbaf0 2023-12-16T20:08:36.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.081+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c1064f0 con 0x7f124c0fbaf0 2023-12-16T20:08:36.086 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.082+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f123c013960 con 0x7f124c0fbaf0 2023-12-16T20:08:36.086 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.082+0000 7f1242ffd700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 0x7f123806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:36.086 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.082+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f123c087cd0 con 0x7f124c0fbaf0 2023-12-16T20:08:36.086 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.082+0000 7f1243fff700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 0x7f123806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:36.086 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.083+0000 7f1243fff700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 0x7f123806b410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1234009fd0 tx=0x7f1234009f20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:36.087 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.086+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f123c054700 con 0x7f124c0fbaf0 2023-12-16T20:08:36.282 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:36.281+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f124c02b180 con 0x7f1238068f60 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi141 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi141 to 7968M 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:36.963 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi141 2023-12-16T20:08:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi141 to 7968M 2023-12-16T20:08:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:37.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T20:08:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T20:08:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T20:08:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:37.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:08:37.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:08:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: pgmap v76: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] boot 2023-12-16T20:08:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T20:08:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:37 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:38.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:08:38.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:08:38.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi141:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:08:38.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: pgmap v76: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T20:08:38.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: osd.4 [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] boot 2023-12-16T20:08:38.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T20:08:38.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:37 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:08:39.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T20:08:39.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3773585656' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]: dispatch 2023-12-16T20:08:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]: dispatch 2023-12-16T20:08:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]': finished 2023-12-16T20:08:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T20:08:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:38 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/3807882816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:39.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T20:08:39.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3773585656' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]: dispatch 2023-12-16T20:08:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]: dispatch 2023-12-16T20:08:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71"}]': finished 2023-12-16T20:08:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T20:08:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:38 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/3807882816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T20:08:40.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:39 smithi038 ceph-mon[80659]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:39 smithi141 ceph-mon[88165]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:41.972 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:41 smithi141 ceph-mon[88165]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:42.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:41 smithi038 ceph-mon[80659]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:43 smithi141 ceph-mon[88165]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:08:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:44.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:43 smithi038 ceph-mon[80659]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:44.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:08:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:44.987 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:44 smithi141 ceph-mon[88165]: Deploying daemon osd.5 on smithi141 2023-12-16T20:08:45.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:44 smithi038 ceph-mon[80659]: Deploying daemon osd.5 on smithi141 2023-12-16T20:08:45.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:45 smithi141 ceph-mon[88165]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:46.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:45 smithi038 ceph-mon[80659]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:47.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:47 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:47 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:47 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:47 smithi141 ceph-mon[88165]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:48.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:48.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:48.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:47 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:48.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:47 smithi038 ceph-mon[80659]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:48.886 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.885+0000 7f1242ffd700 1 -- 172.21.15.141:0/4199041294 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f124c02b180 con 0x7f1238068f60 2023-12-16T20:08:48.886 INFO:teuthology.orchestra.run.smithi141.stdout:Created osd(s) 5 on host 'smithi141' 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.887+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 msgr2=0x7f123806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.887+0000 7f1250cd7700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 0x7f123806b410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1234009fd0 tx=0x7f1234009f20 comp rx=0 tx=0).stop 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.887+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 msgr2=0x7f124c1126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.887+0000 7f1250cd7700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f123c004f90 tx=0x7f123c009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 shutdown_connections 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1238068f60 0x7f123806b410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f124c0fbaf0 0x7f124c1126f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 --2- 172.21.15.141:0/4199041294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f124c0fcd00 0x7f124c114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:48.888 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 >> 172.21.15.141:0/4199041294 conn(0x7f124c0f7190 msgr2=0x7f124c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:48.889 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 shutdown_connections 2023-12-16T20:08:48.889 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:08:48.888+0000 7f1250cd7700 1 -- 172.21.15.141:0/4199041294 wait complete. 2023-12-16T20:08:49.144 DEBUG:teuthology.orchestra.run.smithi141:osd.5> sudo journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.5.service 2023-12-16T20:08:49.147 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-16T20:08:49.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T20:08:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:49.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:49 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:49.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:49 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:08:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 -- 172.21.15.38:0/2628580819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fca10 msgr2=0x7f48840fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 --2- 172.21.15.38:0/2628580819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fca10 0x7f48840fce20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4880004940 tx=0x7f4880009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 -- 172.21.15.38:0/2628580819 shutdown_connections 2023-12-16T20:08:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 --2- 172.21.15.38:0/2628580819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fdc20 0x7f48840fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 --2- 172.21.15.38:0/2628580819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fca10 0x7f48840fce20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 -- 172.21.15.38:0/2628580819 >> 172.21.15.38:0/2628580819 conn(0x7f48840f80d0 msgr2=0x7f48840fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:50.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 -- 172.21.15.38:0/2628580819 shutdown_connections 2023-12-16T20:08:50.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 -- 172.21.15.38:0/2628580819 wait complete. 2023-12-16T20:08:50.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.094+0000 7f488b19e700 1 Processor -- start 2023-12-16T20:08:50.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488b19e700 1 -- start start 2023-12-16T20:08:50.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488b19e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fca10 0x7f488410d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:50.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488b19e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488b19e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488410def0 con 0x7f48840fdc20 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488b19e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488410e790 con 0x7f48840fca10 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34662/0 (socket says 172.21.15.38:34662) 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 -- 172.21.15.38:0/3090584599 learned_addr learned my addr 172.21.15.38:0/3090584599 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488a19c700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fca10 0x7f488410d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 -- 172.21.15.38:0/3090584599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fca10 msgr2=0x7f488410d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fca10 0x7f488410d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 -- 172.21.15.38:0/3090584599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880005040 con 0x7f48840fdc20 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.095+0000 7f488999b700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4874002a50 tx=0x7f48740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.096+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4874007cc0 con 0x7f48840fdc20 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.096+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f487400f040 con 0x7f48840fdc20 2023-12-16T20:08:50.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.096+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488410ea70 con 0x7f48840fdc20 2023-12-16T20:08:50.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.096+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487400d9c0 con 0x7f48840fdc20 2023-12-16T20:08:50.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.096+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488410efb0 con 0x7f48840fdc20 2023-12-16T20:08:50.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.097+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488404bb80 con 0x7f48840fdc20 2023-12-16T20:08:50.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.097+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f487400db20 con 0x7f48840fdc20 2023-12-16T20:08:50.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.098+0000 7f487affd700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 0x7f487006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:50.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.098+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4317+0+0 (secure 0 0 0) 0x7f4874086650 con 0x7f48840fdc20 2023-12-16T20:08:50.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.098+0000 7f488a19c700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 0x7f487006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:50.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.098+0000 7f488a19c700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 0x7f487006b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4880004890 tx=0x7f4880009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:50.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.103+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f48740569b0 con 0x7f48840fdc20 2023-12-16T20:08:50.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.298+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f48841053b0 con 0x7f48840fdc20 2023-12-16T20:08:50.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.298+0000 7f487affd700 1 -- 172.21.15.38:0/3090584599 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4874056540 con 0x7f48840fdc20 2023-12-16T20:08:50.300 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.300+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 msgr2=0x7f487006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.300+0000 7f488b19e700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 0x7f487006b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4880004890 tx=0x7f4880009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.300+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 msgr2=0x7f488410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.300+0000 7f488b19e700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4874002a50 tx=0x7f48740046b0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 shutdown_connections 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4870068f60 0x7f487006b410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48840fca10 0x7f488410d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 --2- 172.21.15.38:0/3090584599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48840fdc20 0x7f488410d8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 >> 172.21.15.38:0/3090584599 conn(0x7f48840f80d0 msgr2=0x7f4884100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 shutdown_connections 2023-12-16T20:08:50.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:50.301+0000 7f488b19e700 1 -- 172.21.15.38:0/3090584599 wait complete. 2023-12-16T20:08:50.523 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:50 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3090584599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:50.546 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1702757316,"num_in_osds":6,"osd_in_since":1702757317,"num_remapped_pgs":0} 2023-12-16T20:08:50.891 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:50 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3090584599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:50.891 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:08:50 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:08:50.627+0000 7fc3c0234540 -1 osd.5 0 log_to_monitors true 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:51.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:51 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.547 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T20:08:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:08:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:08:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:51 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: Detected new or changed devices on smithi141 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi141 to 5312M 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: from='osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:52.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:52 smithi038 ceph-mon[80659]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 -- 172.21.15.38:0/2478631579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 msgr2=0x7f799c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 --2- 172.21.15.38:0/2478631579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c0fd000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f798c004940 tx=0x7f798c009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 -- 172.21.15.38:0/2478631579 shutdown_connections 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 --2- 172.21.15.38:0/2478631579 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 0x7f799c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 --2- 172.21.15.38:0/2478631579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c0fd000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 -- 172.21.15.38:0/2478631579 >> 172.21.15.38:0/2478631579 conn(0x7f799c0f82d0 msgr2=0x7f799c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 -- 172.21.15.38:0/2478631579 shutdown_connections 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.598+0000 7f79a443e700 1 -- 172.21.15.38:0/2478631579 wait complete. 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 Processor -- start 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 -- start start 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 0x7f799c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c10e0a0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a443e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c10e940 con 0x7f799c0fde00 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50382/0 (socket says 172.21.15.38:50382) 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 -- 172.21.15.38:0/1964699093 learned_addr learned my addr 172.21.15.38:0/1964699093 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a19d9700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 0x7f799c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 -- 172.21.15.38:0/1964699093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 msgr2=0x7f799c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 0x7f799c10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 -- 172.21.15.38:0/1964699093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c005040 con 0x7f799c0fcbf0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.599+0000 7f79a21da700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f798c009360 tx=0x7f798c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.600+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c00e040 con 0x7f799c0fcbf0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.600+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f798c004290 con 0x7f799c0fcbf0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.600+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c10ebc0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.600+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c01c3f0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.600+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c10f100 con 0x7f799c0fcbf0 2023-12-16T20:08:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.601+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c1075d0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.601+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f798c0137e0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.602+0000 7f7992ffd700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 0x7f798806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.602+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f798c087b60 con 0x7f799c0fcbf0 2023-12-16T20:08:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.602+0000 7f79a19d9700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 0x7f798806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.602+0000 7f79a19d9700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 0x7f798806b420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7998004f40 tx=0x7f799800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.606+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f798c057f10 con 0x7f799c0fcbf0 2023-12-16T20:08:52.783 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi141 2023-12-16T20:08:52.783 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi141 to 5312M 2023-12-16T20:08:52.783 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T20:08:52.783 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T20:08:52.784 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:52.784 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: from='osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:52.784 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-mon[88165]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:08:52.784 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:08:52.528+0000 7fc3b6a19700 -1 osd.5 0 waiting for initial osdmap 2023-12-16T20:08:52.784 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:08:52 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:08:52.537+0000 7fc3b1013700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:08:52.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.805+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f799c04bb80 con 0x7f799c0fcbf0 2023-12-16T20:08:52.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.806+0000 7f7992ffd700 1 -- 172.21.15.38:0/1964699093 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f798c057aa0 con 0x7f799c0fcbf0 2023-12-16T20:08:52.807 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:08:52.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 msgr2=0x7f798806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 0x7f798806b420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7998004f40 tx=0x7f799800b040 comp rx=0 tx=0).stop 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 msgr2=0x7f799c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f798c009360 tx=0x7f798c009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 shutdown_connections 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7988068f70 0x7f798806b420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c0fcbf0 0x7f799c10d560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 --2- 172.21.15.38:0/1964699093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c0fde00 0x7f799c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 >> 172.21.15.38:0/1964699093 conn(0x7f799c0f82d0 msgr2=0x7f799c0fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 shutdown_connections 2023-12-16T20:08:52.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:52.808+0000 7f79a443e700 1 -- 172.21.15.38:0/1964699093 wait complete. 2023-12-16T20:08:53.036 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1702757316,"num_in_osds":6,"osd_in_since":1702757317,"num_remapped_pgs":0} 2023-12-16T20:08:53.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:53.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T20:08:53.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:53.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:53.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:53.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1964699093' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:53.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:53 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:53.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]': finished 2023-12-16T20:08:53.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T20:08:53.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:53.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:53.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T20:08:53.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1964699093' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:53.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:53 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:54.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T20:08:54.319 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:54.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:54 smithi038 ceph-mon[80659]: purged_snaps scrub starts 2023-12-16T20:08:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:54 smithi038 ceph-mon[80659]: purged_snaps scrub ok 2023-12-16T20:08:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:54 smithi038 ceph-mon[80659]: osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] boot 2023-12-16T20:08:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:54 smithi038 ceph-mon[80659]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T20:08:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:54 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:54.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:54 smithi141 ceph-mon[88165]: purged_snaps scrub starts 2023-12-16T20:08:54.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:54 smithi141 ceph-mon[88165]: purged_snaps scrub ok 2023-12-16T20:08:54.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:54 smithi141 ceph-mon[88165]: osd.5 [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] boot 2023-12-16T20:08:54.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:54 smithi141 ceph-mon[88165]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T20:08:54.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:54 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:08:55.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.089+0000 7f8cc60ef700 1 -- 172.21.15.38:0/3594395430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 msgr2=0x7f8cc00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:55.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.089+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/3594395430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc00fd000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0004940 tx=0x7f8cb0009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:55.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- 172.21.15.38:0/3594395430 shutdown_connections 2023-12-16T20:08:55.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/3594395430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/3594395430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc00fd000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- 172.21.15.38:0/3594395430 >> 172.21.15.38:0/3594395430 conn(0x7f8cc00f82d0 msgr2=0x7f8cc00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- 172.21.15.38:0/3594395430 shutdown_connections 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- 172.21.15.38:0/3594395430 wait complete. 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 Processor -- start 2023-12-16T20:08:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- start start 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc010dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc010e140 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.090+0000 7f8cc60ef700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc010e980 con 0x7f8cc00fde00 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50408/0 (socket says 172.21.15.38:50408) 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 -- 172.21.15.38:0/4062652188 learned_addr learned my addr 172.21.15.38:0/4062652188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbeffd700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc010dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 -- 172.21.15.38:0/4062652188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 msgr2=0x7f8cc010dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc010dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 -- 172.21.15.38:0/4062652188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0005040 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbeffd700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc010dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:08:55.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cbf7fe700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000c00 tx=0x7f8cb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb000e040 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb000bc50 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.091+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc010ec00 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.092+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb001c630 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.092+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc010f140 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.093+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc004bb80 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.093+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8cb0013420 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.094+0000 7f8ca7fff700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 0x7f8ca806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.094+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8cb0087dd0 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.094+0000 7f8cbeffd700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 0x7f8ca806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.094+0000 7f8cbeffd700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 0x7f8ca806b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009b10 tx=0x7f8cb4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.100+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8cb0057ff0 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.293+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8cc010f530 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.293+0000 7f8ca7fff700 1 -- 172.21.15.38:0/4062652188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f8cb0057b80 con 0x7f8cc00fcbf0 2023-12-16T20:08:55.294 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:08:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 msgr2=0x7f8ca806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 0x7f8ca806b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009b10 tx=0x7f8cb4008040 comp rx=0 tx=0).stop 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 msgr2=0x7f8cc010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000c00 tx=0x7f8cb0009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 shutdown_connections 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8ca8068f70 0x7f8ca806b420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cc00fcbf0 0x7f8cc010d570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 --2- 172.21.15.38:0/4062652188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc00fde00 0x7f8cc010dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 >> 172.21.15.38:0/4062652188 conn(0x7f8cc00f82d0 msgr2=0x7f8cc0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.295+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 shutdown_connections 2023-12-16T20:08:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:55.296+0000 7f8cc60ef700 1 -- 172.21.15.38:0/4062652188 wait complete. 2023-12-16T20:08:55.543 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1702757333,"num_in_osds":6,"osd_in_since":1702757317,"num_remapped_pgs":0} 2023-12-16T20:08:55.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T20:08:55.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:55 smithi038 ceph-mon[80659]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T20:08:55.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:55 smithi038 ceph-mon[80659]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:55.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:55 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4062652188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:55.810 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:55.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:55 smithi141 ceph-mon[88165]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T20:08:55.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:55 smithi141 ceph-mon[88165]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:55.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:55 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4062652188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T20:08:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 -- 172.21.15.38:0/1557809767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 msgr2=0x7f04bc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 --2- 172.21.15.38:0/1557809767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc101ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009ce0 tx=0x7f04b4004d10 comp rx=0 tx=0).stop 2023-12-16T20:08:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 -- 172.21.15.38:0/1557809767 shutdown_connections 2023-12-16T20:08:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 --2- 172.21.15.38:0/1557809767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 --2- 172.21.15.38:0/1557809767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc101ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 -- 172.21.15.38:0/1557809767 >> 172.21.15.38:0/1557809767 conn(0x7f04bc0f76c0 msgr2=0x7f04bc0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 -- 172.21.15.38:0/1557809767 shutdown_connections 2023-12-16T20:08:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.449+0000 7f04c376a700 1 -- 172.21.15.38:0/1557809767 wait complete. 2023-12-16T20:08:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 Processor -- start 2023-12-16T20:08:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 -- start start 2023-12-16T20:08:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc10e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10f360 con 0x7f04bc101b00 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c376a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10f4a0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c0d05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c0d05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50418/0 (socket says 172.21.15.38:50418) 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c0d05700 1 -- 172.21.15.38:0/717538991 learned_addr learned my addr 172.21.15.38:0/717538991 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.450+0000 7f04c1506700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc10e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c1506700 1 -- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 msgr2=0x7f04bc10edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c1506700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c1506700 1 -- 172.21.15.38:0/717538991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009940 con 0x7f04bc0fbb40 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c0d05700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c1506700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc10e890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000f80 tx=0x7f04b4004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b400e040 con 0x7f04bc0fbb40 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc1177a0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04b4008da0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b401c710 con 0x7f04bc0fbb40 2023-12-16T20:08:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.451+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc117cb0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.452+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc103fb0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.453+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f04b4012aa0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.453+0000 7f04b9ffb700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 0x7f04a406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:56.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.453+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f04b40886c0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.453+0000 7f04c0d05700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 0x7f04a406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:56.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.454+0000 7f04c0d05700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 0x7f04a406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0666c0 tx=0x7f04b0004470 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.458+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f04b4054db0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.655+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04bc0fb2c0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.656+0000 7f04b9ffb700 1 -- 172.21.15.38:0/717538991 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11096 (secure 0 0 0) 0x7f04b40583d0 con 0x7f04bc0fbb40 2023-12-16T20:08:56.656 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:08:56.656 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":38,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:08:54.538976+0000","last_up_change":"2023-12-16T20:08:53.523967+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6803","nonce":3282586212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6805","nonce":3282586212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6809","nonce":3282586212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6807","nonce":3282586212}]},"public_addr":"172.21.15.38:6803/3282586212","cluster_addr":"172.21.15.38:6805/3282586212","heartbeat_back_addr":"172.21.15.38:6809/3282586212","heartbeat_front_addr":"172.21.15.38:6807/3282586212","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6811","nonce":2098419945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6813","nonce":2098419945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6817","nonce":2098419945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6815","nonce":2098419945}]},"public_addr":"172.21.15.38:6811/2098419945","cluster_addr":"172.21.15.38:6813/2098419945","heartbeat_back_addr":"172.21.15.38:6817/2098419945","heartbeat_front_addr":"172.21.15.38:6815/2098419945","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6819","nonce":2982983662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6821","nonce":2982983662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6825","nonce":2982983662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6823","nonce":2982983662}]},"public_addr":"172.21.15.38:6819/2982983662","cluster_addr":"172.21.15.38:6821/2982983662","heartbeat_back_addr":"172.21.15.38:6825/2982983662","heartbeat_front_addr":"172.21.15.38:6823/2982983662","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6801","nonce":1223163151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6803","nonce":1223163151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6807","nonce":1223163151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6805","nonce":1223163151}]},"public_addr":"172.21.15.141:6801/1223163151","cluster_addr":"172.21.15.141:6803/1223163151","heartbeat_back_addr":"172.21.15.141:6807/1223163151","heartbeat_front_addr":"172.21.15.141:6805/1223163151","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6809","nonce":1281377798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6811","nonce":1281377798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6815","nonce":1281377798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6813","nonce":1281377798}]},"public_addr":"172.21.15.141:6809/1281377798","cluster_addr":"172.21.15.141:6811/1281377798","heartbeat_back_addr":"172.21.15.141:6815/1281377798","heartbeat_front_addr":"172.21.15.141:6813/1281377798","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6817","nonce":1487404021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6819","nonce":1487404021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6823","nonce":1487404021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6821","nonce":1487404021}]},"public_addr":"172.21.15.141:6817/1487404021","cluster_addr":"172.21.15.141:6819/1487404021","heartbeat_back_addr":"172.21.15.141:6823/1487404021","heartbeat_front_addr":"172.21.15.141:6821/1487404021","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 msgr2=0x7f04a406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 0x7f04a406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0666c0 tx=0x7f04b0004470 comp rx=0 tx=0).stop 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 msgr2=0x7f04bc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc10e890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000f80 tx=0x7f04b4004d10 comp rx=0 tx=0).stop 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 shutdown_connections 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f04a4068f60 0x7f04a406b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04bc0fbb40 0x7f04bc10e890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 --2- 172.21.15.38:0/717538991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc101b00 0x7f04bc10edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 >> 172.21.15.38:0/717538991 conn(0x7f04bc0f76c0 msgr2=0x7f04bc0f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 shutdown_connections 2023-12-16T20:08:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:56.658+0000 7f04c376a700 1 -- 172.21.15.38:0/717538991 wait complete. 2023-12-16T20:08:56.903 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:08:07.208300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-16T20:08:56.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-16T20:08:56.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:56 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/717538991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:08:57.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:56 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/717538991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:08:57.170 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:57.777 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:57 smithi038 ceph-mon[80659]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- 172.21.15.38:0/3727584380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 msgr2=0x7fe688102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 --2- 172.21.15.38:0/3727584380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688102fd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe678004940 tx=0x7fe678009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- 172.21.15.38:0/3727584380 shutdown_connections 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 --2- 172.21.15.38:0/3727584380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 0x7fe6880fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 --2- 172.21.15.38:0/3727584380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688102fd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- 172.21.15.38:0/3727584380 >> 172.21.15.38:0/3727584380 conn(0x7fe6880f8790 msgr2=0x7fe6880faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- 172.21.15.38:0/3727584380 shutdown_connections 2023-12-16T20:08:57.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- 172.21.15.38:0/3727584380 wait complete. 2023-12-16T20:08:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 Processor -- start 2023-12-16T20:08:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.880+0000 7fe68d056700 1 -- start start 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 0x7fe688113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68810d510 con 0x7fe688102c00 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68810d680 con 0x7fe6881035a0 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50432/0 (socket says 172.21.15.38:50432) 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 -- 172.21.15.38:0/2464054150 learned_addr learned my addr 172.21.15.38:0/2464054150 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68659c700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 0x7fe688113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 -- 172.21.15.38:0/2464054150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 msgr2=0x7fe688113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 0x7fe688113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 -- 172.21.15.38:0/2464054150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678005040 con 0x7fe688102c00 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe686d9d700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe678009360 tx=0x7fe678009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67800e040 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe678013420 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68810d900 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67801c610 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.881+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68810de40 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.882+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6880fc390 con 0x7fe688102c00 2023-12-16T20:08:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.883+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe678013590 con 0x7fe688102c00 2023-12-16T20:08:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.883+0000 7fe66f7fe700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 0x7fe67006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.883+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe678087cd0 con 0x7fe688102c00 2023-12-16T20:08:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.883+0000 7fe68659c700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 0x7fe67006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.884+0000 7fe68659c700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 0x7fe67006b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe68810eef0 tx=0x7fe67c0091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:57.888+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe678057fa0 con 0x7fe688102c00 2023-12-16T20:08:57.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:57 smithi141 ceph-mon[88165]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.085+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe68810ec30 con 0x7fe688102c00 2023-12-16T20:08:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.085+0000 7fe66f7fe700 1 -- 172.21.15.38:0/2464054150 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe678057b30 con 0x7fe688102c00 2023-12-16T20:08:58.085 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-16T20:08:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 msgr2=0x7fe67006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 0x7fe67006b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe68810eef0 tx=0x7fe67c0091a0 comp rx=0 tx=0).stop 2023-12-16T20:08:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 msgr2=0x7fe688113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe678009360 tx=0x7fe678009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 shutdown_connections 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe670068f70 0x7fe67006b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe688102c00 0x7fe688113650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 --2- 172.21.15.38:0/2464054150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6881035a0 0x7fe688113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 >> 172.21.15.38:0/2464054150 conn(0x7fe6880f8790 msgr2=0x7fe6880fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 shutdown_connections 2023-12-16T20:08:58.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:58.087+0000 7fe68d056700 1 -- 172.21.15.38:0/2464054150 wait complete. 2023-12-16T20:08:58.334 INFO:tasks.cephadm:Setting up client nodes... 2023-12-16T20:08:58.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T20:08:58.601 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:08:58.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:58 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:58.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:58 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2464054150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:08:58.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:58 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:08:58.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:58 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2464054150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:08:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 -- 172.21.15.38:0/1126006116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 msgr2=0x7f98b40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 --2- 172.21.15.38:0/1126006116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b40fe250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98a4004940 tx=0x7f98a4009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 -- 172.21.15.38:0/1126006116 shutdown_connections 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 --2- 172.21.15.38:0/1126006116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b40fe250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 --2- 172.21.15.38:0/1126006116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 0x7f98b40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 -- 172.21.15.38:0/1126006116 >> 172.21.15.38:0/1126006116 conn(0x7f98b40f82d0 msgr2=0x7f98b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 -- 172.21.15.38:0/1126006116 shutdown_connections 2023-12-16T20:08:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.253+0000 7f98b9e32700 1 -- 172.21.15.38:0/1126006116 wait complete. 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.254+0000 7f98b9e32700 1 Processor -- start 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.254+0000 7f98b9e32700 1 -- start start 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b9e32700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 0x7f98b410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b9e32700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b9e32700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41102e0 con 0x7f98b40fde00 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b9e32700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4110b80 con 0x7f98b40fcbf0 2023-12-16T20:08:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50448/0 (socket says 172.21.15.38:50448) 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 -- 172.21.15.38:0/283950697 learned_addr learned my addr 172.21.15.38:0/283950697 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b37fe700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 0x7f98b410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 -- 172.21.15.38:0/283950697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 msgr2=0x7f98b410f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 0x7f98b410f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 -- 172.21.15.38:0/283950697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4005040 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.255+0000 7f98b2ffd700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009380 tx=0x7f98a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.256+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a400e040 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.256+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98a400bc50 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.256+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4110e00 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.256+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a401c630 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.256+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b4111340 con 0x7f98b40fde00 2023-12-16T20:08:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.257+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4101ea0 con 0x7f98b40fde00 2023-12-16T20:08:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.257+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f98a4013420 con 0x7f98b40fde00 2023-12-16T20:08:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.258+0000 7f98abfff700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 0x7f98a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:08:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.258+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f98a4087de0 con 0x7f98b40fde00 2023-12-16T20:08:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.258+0000 7f98b37fe700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 0x7f98a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:08:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.258+0000 7f98b37fe700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 0x7f98a006b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98b40fdc60 tx=0x7f989c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:08:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.262+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f98a4058080 con 0x7f98b40fde00 2023-12-16T20:08:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.537+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f98b404bb80 con 0x7f98b40fde00 2023-12-16T20:08:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.542+0000 7f98abfff700 1 -- 172.21.15.38:0/283950697 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f98a4013e60 con 0x7f98b40fde00 2023-12-16T20:08:59.542 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-12-16T20:08:59.542 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDbA35l2ZIZIBAA65ACSnRdMKmi/sg8COhfdQ== 2023-12-16T20:08:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 msgr2=0x7f98a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 0x7f98a006b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98b40fdc60 tx=0x7f989c009040 comp rx=0 tx=0).stop 2023-12-16T20:08:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 msgr2=0x7f98b410fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:08:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009380 tx=0x7f98a4009e30 comp rx=0 tx=0).stop 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 shutdown_connections 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f98a0068f70 0x7f98a006b420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b40fcbf0 0x7f98b410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 --2- 172.21.15.38:0/283950697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b40fde00 0x7f98b410fce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 >> 172.21.15.38:0/283950697 conn(0x7f98b40f82d0 msgr2=0x7f98b40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 shutdown_connections 2023-12-16T20:08:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:08:59.544+0000 7f98b9e32700 1 -- 172.21.15.38:0/283950697 wait complete. 2023-12-16T20:08:59.776 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:08:59.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-16T20:08:59.777 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T20:08:59.805 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:59 smithi038 ceph-mon[80659]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:59.805 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:59 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/283950697' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:08:59.805 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:08:59 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/283950697' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T20:08:59.826 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T20:08:59.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:59 smithi141 ceph-mon[88165]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:08:59.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:59 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/283950697' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:08:59.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:08:59 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/283950697' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T20:09:00.089 INFO:teuthology.orchestra.run.smithi141.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi141/config 2023-12-16T20:09:00.846 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 -- 172.21.15.141:0/1721308204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fcd00 msgr2=0x7fe9a80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:00.846 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1721308204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fcd00 0x7fe9a80fd150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe998004940 tx=0x7fe998009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 -- 172.21.15.141:0/1721308204 shutdown_connections 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1721308204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fcd00 0x7fe9a80fd150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1721308204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 -- 172.21.15.141:0/1721308204 >> 172.21.15.141:0/1721308204 conn(0x7fe9a80f71d0 msgr2=0x7fe9a80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 -- 172.21.15.141:0/1721308204 shutdown_connections 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.840+0000 7fe9b0496700 1 -- 172.21.15.141:0/1721308204 wait complete. 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 Processor -- start 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 -- start start 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9a80fcd00 0x7fe9a810c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810d060 con 0x7fe9a80fcd00 2023-12-16T20:09:00.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9b0496700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810d8a0 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:37048/0 (socket says 172.21.15.141:37048) 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 -- 172.21.15.141:0/1747102549 learned_addr learned my addr 172.21.15.141:0/1747102549 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 -- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9a80fcd00 msgr2=0x7fe9a810c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9a80fcd00 0x7fe9a810c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 -- 172.21.15.141:0/1747102549 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998005040 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.841+0000 7fe9ae232700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b790 tx=0x7fe9a4009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.842+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a400f6f0 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.848 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.842+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9a400fd00 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.842+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a40103a0 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.842+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a810db80 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.842+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a810e0c0 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.843+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a804bb80 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.843+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe9a400f850 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.843+0000 7fe99effd700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 0x7fe99406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.844+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe9a40867e0 con 0x7fe9a80fbaf0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.844+0000 7fe9ada31700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 0x7fe99406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:00.849 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.844+0000 7fe9ada31700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 0x7fe99406b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe99800b3b0 tx=0x7fe998009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:00.850 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:00.848+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe9a4056a80 con 0x7fe9a80fbaf0 2023-12-16T20:09:01.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.103+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe9a8104530 con 0x7fe9a80fbaf0 2023-12-16T20:09:01.109 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.109+0000 7fe99effd700 1 -- 172.21.15.141:0/1747102549 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe9a4056610 con 0x7fe9a80fbaf0 2023-12-16T20:09:01.109 INFO:teuthology.orchestra.run.smithi141.stdout:[client.1] 2023-12-16T20:09:01.109 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDdA35lfFFIBhAANNphrwSy377w+PrMFTvKMg== 2023-12-16T20:09:01.111 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 msgr2=0x7fe99406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:01.111 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 0x7fe99406b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe99800b3b0 tx=0x7fe998009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:01.111 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 msgr2=0x7fe9a810c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:01.111 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b790 tx=0x7fe9a4009220 comp rx=0 tx=0).stop 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 shutdown_connections 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fe994068f60 0x7fe99406b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a80fbaf0 0x7fe9a810c490 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 --2- 172.21.15.141:0/1747102549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9a80fcd00 0x7fe9a810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 >> 172.21.15.141:0/1747102549 conn(0x7fe9a80f71d0 msgr2=0x7fe9a80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 shutdown_connections 2023-12-16T20:09:01.112 INFO:teuthology.orchestra.run.smithi141.stderr:2023-12-16T20:09:01.111+0000 7fe9b0496700 1 -- 172.21.15.141:0/1747102549 wait complete. 2023-12-16T20:09:01.351 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:09:01.351 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-16T20:09:01.351 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T20:09:01.393 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T20:09:01.393 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-16T20:09:01.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-16T20:09:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:01.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:01 smithi038 ceph-mon[80659]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:01.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:01 smithi038 ceph-mon[80659]: from='client.? 172.21.15.141:0/1747102549' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:09:01.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:01 smithi038 ceph-mon[80659]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:09:01.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:01 smithi038 ceph-mon[80659]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T20:09:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:01 smithi141 ceph-mon[88165]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:01 smithi141 ceph-mon[88165]: from='client.? 172.21.15.141:0/1747102549' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:09:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:01 smithi141 ceph-mon[88165]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T20:09:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:01 smithi141 ceph-mon[88165]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/3764251441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 msgr2=0x7f5ef00fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/3764251441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fb630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4004940 tx=0x7f5ee4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/3764251441 shutdown_connections 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/3764251441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fb630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/3764251441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef0103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/3764251441 >> 172.21.15.38:0/3764251441 conn(0x7f5ef00711a0 msgr2=0x7f5ef00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/3764251441 shutdown_connections 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/3764251441 wait complete. 2023-12-16T20:09:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 Processor -- start 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 -- start start 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.325+0000 7f5ef4c9a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef00fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5ef4c9a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00fcf00 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5ef4c9a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00fd070 con 0x7f5ef0102c70 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43614/0 (socket says 172.21.15.38:43614) 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 -- 172.21.15.38:0/1884420819 learned_addr learned my addr 172.21.15.38:0/1884420819 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eedd9b700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef00fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 -- 172.21.15.38:0/1884420819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 msgr2=0x7f5ef00fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:02.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef00fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 -- 172.21.15.38:0/1884420819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4005040 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eedd9b700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef00fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5eee59c700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c8c0 tx=0x7f5ee00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee000a980 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0119850 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ee000ce60 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee00113a0 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.326+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef0119d30 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.328+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0105050 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.328+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5ee0012400 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.328+0000 7f5edeffd700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 0x7f5ed806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:02.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.329+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5ee0086a70 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.329+0000 7f5eedd9b700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 0x7f5ed806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:02.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.329+0000 7f5eedd9b700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 0x7f5ed806b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009fd0 tx=0x7f5ee4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:02.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.333+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5ee0053320 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.599+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5ef0072cc0 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.603+0000 7f5edeffd700 1 -- 172.21.15.38:0/1884420819 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166777 (secure 0 0 0) 0x7f5ee0056940 con 0x7f5ef00fb1e0 2023-12-16T20:09:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 msgr2=0x7f5ed806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 0x7f5ed806b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009fd0 tx=0x7f5ee4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 msgr2=0x7f5ef00fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c8c0 tx=0x7f5ee00044c0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 shutdown_connections 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f5ed8068f60 0x7f5ed806b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ef00fb1e0 0x7f5ef00fc3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 --2- 172.21.15.38:0/1884420819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef0102c70 0x7f5ef00fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 >> 172.21.15.38:0/1884420819 conn(0x7f5ef00711a0 msgr2=0x7f5ef00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 shutdown_connections 2023-12-16T20:09:02.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:02.606+0000 7f5ef4c9a700 1 -- 172.21.15.38:0/1884420819 wait complete. 2023-12-16T20:09:02.843 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi038.gdlrfj","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":3097077380},{"type":"v1","addr":"172.21.15.38:6801","nonce":3097077380}]},"active_addr":"172.21.15.38:6801/3097077380","active_change":"2023-12-16T20:06:42.696986+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14236,"name":"smithi141.cycgjd","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.38:8443/","prometheus":"http://172.21.15.38:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3835823800}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":4145377918}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3571172552}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1425692992}]}]} 2023-12-16T20:09:02.846 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-16T20:09:02.847 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-16T20:09:02.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T20:09:02.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:02 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1884420819' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T20:09:02.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:02 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1884420819' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T20:09:03.113 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 -- 172.21.15.38:0/2160395905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a80fbb40 msgr2=0x7ff6a80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 --2- 172.21.15.38:0/2160395905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a80fbb40 0x7ff6a80fbfb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004940 tx=0x7ff69c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 -- 172.21.15.38:0/2160395905 shutdown_connections 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 --2- 172.21.15.38:0/2160395905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a80fbb40 0x7ff6a80fbfb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 --2- 172.21.15.38:0/2160395905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a8101b00 0x7ff6a8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 -- 172.21.15.38:0/2160395905 >> 172.21.15.38:0/2160395905 conn(0x7ff6a80719b0 msgr2=0x7ff6a8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 -- 172.21.15.38:0/2160395905 shutdown_connections 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.795+0000 7ff6af280700 1 -- 172.21.15.38:0/2160395905 wait complete. 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 Processor -- start 2023-12-16T20:09:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 -- start start 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a80fbb40 0x7ff6a810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a810f290 con 0x7ff6a8101b00 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6af280700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a810f400 con 0x7ff6a80fbb40 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43632/0 (socket says 172.21.15.38:43632) 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ad01c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a80fbb40 0x7ff6a810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 -- 172.21.15.38:0/1917187756 learned_addr learned my addr 172.21.15.38:0/1917187756 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 -- 172.21.15.38:0/1917187756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a80fbb40 msgr2=0x7ff6a810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a80fbb40 0x7ff6a810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 -- 172.21.15.38:0/1917187756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c005040 con 0x7ff6a8101b00 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.796+0000 7ff6ac81b700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b3b0 tx=0x7ff69c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.797+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69c00e040 con 0x7ff6a8101b00 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.797+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a8117710 con 0x7ff6a8101b00 2023-12-16T20:09:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.797+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff69c01c430 con 0x7ff6a8101b00 2023-12-16T20:09:03.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.797+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69c013640 con 0x7ff6a8101b00 2023-12-16T20:09:03.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.797+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a8117c20 con 0x7ff6a8101b00 2023-12-16T20:09:03.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.798+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8103fb0 con 0x7ff6a8101b00 2023-12-16T20:09:03.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.798+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff69c01c5a0 con 0x7ff6a8101b00 2023-12-16T20:09:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.799+0000 7ff6a5ffb700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 0x7ff69006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.799+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff69c087580 con 0x7ff6a8101b00 2023-12-16T20:09:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.799+0000 7ff6ad01c700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 0x7ff69006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.799+0000 7ff6ad01c700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 0x7ff69006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0004f40 tx=0x7ff6a000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:03.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.803+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff69c053e40 con 0x7ff6a8101b00 2023-12-16T20:09:03.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:03 smithi141 ceph-mon[88165]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:03.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.997+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a804bb80 con 0x7ff6a8101b00 2023-12-16T20:09:03.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:03 smithi038 ceph-mon[80659]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:03.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:03.998+0000 7ff6a5ffb700 1 -- 172.21.15.38:0/1917187756 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11096 (secure 0 0 0) 0x7ff69c057460 con 0x7ff6a8101b00 2023-12-16T20:09:03.998 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:03.999 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":38,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:08:54.538976+0000","last_up_change":"2023-12-16T20:08:53.523967+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6803","nonce":3282586212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6805","nonce":3282586212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6809","nonce":3282586212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6807","nonce":3282586212}]},"public_addr":"172.21.15.38:6803/3282586212","cluster_addr":"172.21.15.38:6805/3282586212","heartbeat_back_addr":"172.21.15.38:6809/3282586212","heartbeat_front_addr":"172.21.15.38:6807/3282586212","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6811","nonce":2098419945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6813","nonce":2098419945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6817","nonce":2098419945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6815","nonce":2098419945}]},"public_addr":"172.21.15.38:6811/2098419945","cluster_addr":"172.21.15.38:6813/2098419945","heartbeat_back_addr":"172.21.15.38:6817/2098419945","heartbeat_front_addr":"172.21.15.38:6815/2098419945","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6819","nonce":2982983662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6821","nonce":2982983662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6825","nonce":2982983662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6823","nonce":2982983662}]},"public_addr":"172.21.15.38:6819/2982983662","cluster_addr":"172.21.15.38:6821/2982983662","heartbeat_back_addr":"172.21.15.38:6825/2982983662","heartbeat_front_addr":"172.21.15.38:6823/2982983662","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6801","nonce":1223163151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6803","nonce":1223163151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6807","nonce":1223163151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6805","nonce":1223163151}]},"public_addr":"172.21.15.141:6801/1223163151","cluster_addr":"172.21.15.141:6803/1223163151","heartbeat_back_addr":"172.21.15.141:6807/1223163151","heartbeat_front_addr":"172.21.15.141:6805/1223163151","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6809","nonce":1281377798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6811","nonce":1281377798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6815","nonce":1281377798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6813","nonce":1281377798}]},"public_addr":"172.21.15.141:6809/1281377798","cluster_addr":"172.21.15.141:6811/1281377798","heartbeat_back_addr":"172.21.15.141:6815/1281377798","heartbeat_front_addr":"172.21.15.141:6813/1281377798","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6817","nonce":1487404021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6819","nonce":1487404021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6823","nonce":1487404021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6821","nonce":1487404021}]},"public_addr":"172.21.15.141:6817/1487404021","cluster_addr":"172.21.15.141:6819/1487404021","heartbeat_back_addr":"172.21.15.141:6823/1487404021","heartbeat_front_addr":"172.21.15.141:6821/1487404021","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:09:04.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 msgr2=0x7ff69006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:04.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 0x7ff69006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0004f40 tx=0x7ff6a000b040 comp rx=0 tx=0).stop 2023-12-16T20:09:04.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 msgr2=0x7ff6a810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b3b0 tx=0x7ff69c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 shutdown_connections 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff690068f60 0x7ff69006b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a80fbb40 0x7ff6a810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 --2- 172.21.15.38:0/1917187756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a8101b00 0x7ff6a810ece0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 >> 172.21.15.38:0/1917187756 conn(0x7ff6a80719b0 msgr2=0x7ff6a80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 shutdown_connections 2023-12-16T20:09:04.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:04.000+0000 7ff6af280700 1 -- 172.21.15.38:0/1917187756 wait complete. 2023-12-16T20:09:04.235 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-16T20:09:04.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T20:09:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:04.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:04 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1917187756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:05.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:04 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1917187756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/3027321455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4065390 msgr2=0x7f2fc4065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/3027321455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4065390 0x7f2fc4065800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8004940 tx=0x7f2fb8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/3027321455 shutdown_connections 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/3027321455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4065390 0x7f2fc4065800 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/3027321455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4102c20 0x7f2fc4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.306+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/3027321455 >> 172.21.15.38:0/3027321455 conn(0x7f2fc40719b0 msgr2=0x7f2fc4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.307+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/3027321455 shutdown_connections 2023-12-16T20:09:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.307+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/3027321455 wait complete. 2023-12-16T20:09:05.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.307+0000 7f2fc9ab4700 1 Processor -- start 2023-12-16T20:09:05.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.307+0000 7f2fc9ab4700 1 -- start start 2023-12-16T20:09:05.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc9ab4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 0x7f2fc4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc9ab4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc9ab4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41142c0 con 0x7f2fc4102c20 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc9ab4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc410d5f0 con 0x7f2fc4065390 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43648/0 (socket says 172.21.15.38:43648) 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 -- 172.21.15.38:0/271432955 learned_addr learned my addr 172.21.15.38:0/271432955 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc37fe700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 0x7f2fc4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 -- 172.21.15.38:0/271432955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 msgr2=0x7f2fc4113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 0x7f2fc4113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 -- 172.21.15.38:0/271432955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8005040 con 0x7f2fc4102c20 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc37fe700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 0x7f2fc4113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc2ffd700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b3b0 tx=0x7f2fb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb800e040 con 0x7f2fc4102c20 2023-12-16T20:09:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fb800bc50 con 0x7f2fc4102c20 2023-12-16T20:09:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc410d870 con 0x7f2fc4102c20 2023-12-16T20:09:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.308+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb8013420 con 0x7f2fc4102c20 2023-12-16T20:09:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.309+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc410ddb0 con 0x7f2fc4102c20 2023-12-16T20:09:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.309+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc40fff40 con 0x7f2fc4102c20 2023-12-16T20:09:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.310+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2fb801c430 con 0x7f2fc4102c20 2023-12-16T20:09:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.310+0000 7f2fabfff700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 0x7f2fac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.310+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2fb8087830 con 0x7f2fc4102c20 2023-12-16T20:09:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.310+0000 7f2fc37fe700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 0x7f2fac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.311+0000 7f2fc37fe700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 0x7f2fac06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009fd0 tx=0x7f2fb4009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:05.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.315+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2fb8057b80 con 0x7f2fc4102c20 2023-12-16T20:09:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.513+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc404bb80 con 0x7f2fc4102c20 2023-12-16T20:09:05.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.514+0000 7f2fabfff700 1 -- 172.21.15.38:0/271432955 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11096 (secure 0 0 0) 0x7f2fb8057710 con 0x7f2fc4102c20 2023-12-16T20:09:05.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:05.515 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":38,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:08:54.538976+0000","last_up_change":"2023-12-16T20:08:53.523967+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6803","nonce":3282586212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6805","nonce":3282586212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6809","nonce":3282586212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6807","nonce":3282586212}]},"public_addr":"172.21.15.38:6803/3282586212","cluster_addr":"172.21.15.38:6805/3282586212","heartbeat_back_addr":"172.21.15.38:6809/3282586212","heartbeat_front_addr":"172.21.15.38:6807/3282586212","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6811","nonce":2098419945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6813","nonce":2098419945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6817","nonce":2098419945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6815","nonce":2098419945}]},"public_addr":"172.21.15.38:6811/2098419945","cluster_addr":"172.21.15.38:6813/2098419945","heartbeat_back_addr":"172.21.15.38:6817/2098419945","heartbeat_front_addr":"172.21.15.38:6815/2098419945","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6819","nonce":2982983662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6821","nonce":2982983662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6825","nonce":2982983662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6823","nonce":2982983662}]},"public_addr":"172.21.15.38:6819/2982983662","cluster_addr":"172.21.15.38:6821/2982983662","heartbeat_back_addr":"172.21.15.38:6825/2982983662","heartbeat_front_addr":"172.21.15.38:6823/2982983662","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6801","nonce":1223163151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6803","nonce":1223163151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6807","nonce":1223163151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6805","nonce":1223163151}]},"public_addr":"172.21.15.141:6801/1223163151","cluster_addr":"172.21.15.141:6803/1223163151","heartbeat_back_addr":"172.21.15.141:6807/1223163151","heartbeat_front_addr":"172.21.15.141:6805/1223163151","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6809","nonce":1281377798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6811","nonce":1281377798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6815","nonce":1281377798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6813","nonce":1281377798}]},"public_addr":"172.21.15.141:6809/1281377798","cluster_addr":"172.21.15.141:6811/1281377798","heartbeat_back_addr":"172.21.15.141:6815/1281377798","heartbeat_front_addr":"172.21.15.141:6813/1281377798","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6817","nonce":1487404021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6819","nonce":1487404021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6823","nonce":1487404021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6821","nonce":1487404021}]},"public_addr":"172.21.15.141:6817/1487404021","cluster_addr":"172.21.15.141:6819/1487404021","heartbeat_back_addr":"172.21.15.141:6823/1487404021","heartbeat_front_addr":"172.21.15.141:6821/1487404021","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:09:05.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 msgr2=0x7f2fac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:05.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 0x7f2fac06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009fd0 tx=0x7f2fb4009ee0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 msgr2=0x7f2fc4113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b3b0 tx=0x7f2fb8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 shutdown_connections 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fac068f60 0x7f2fac06b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc4065390 0x7f2fc4113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 --2- 172.21.15.38:0/271432955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc4102c20 0x7f2fc4113c70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 >> 172.21.15.38:0/271432955 conn(0x7f2fc40719b0 msgr2=0x7f2fc40fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 shutdown_connections 2023-12-16T20:09:05.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:05.517+0000 7f2fc9ab4700 1 -- 172.21.15.38:0/271432955 wait complete. 2023-12-16T20:09:05.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-16T20:09:05.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-16T20:09:05.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-16T20:09:05.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-16T20:09:05.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-16T20:09:05.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-16T20:09:06.067 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:06.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:05 smithi038 ceph-mon[80659]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:06.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:05 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/271432955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:06.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:05 smithi141 ceph-mon[88165]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:06.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:05 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/271432955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:06.539 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:07.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 -- 172.21.15.38:0/3003036364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984102c20 msgr2=0x7f9984102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 --2- 172.21.15.38:0/3003036364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984102c20 0x7f9984102ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9974004940 tx=0x7f9974009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 -- 172.21.15.38:0/3003036364 shutdown_connections 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 --2- 172.21.15.38:0/3003036364 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984065390 0x7f9984065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 --2- 172.21.15.38:0/3003036364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984102c20 0x7f9984102ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 -- 172.21.15.38:0/3003036364 >> 172.21.15.38:0/3003036364 conn(0x7f99840719b0 msgr2=0x7f9984071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 -- 172.21.15.38:0/3003036364 shutdown_connections 2023-12-16T20:09:07.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.163+0000 7f9989523700 1 -- 172.21.15.38:0/3003036364 wait complete. 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 Processor -- start 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 -- start start 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 0x7f9984113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984114220 con 0x7f9984065390 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9989523700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998410d570 con 0x7f9984102c20 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9982ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9982ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43660/0 (socket says 172.21.15.38:43660) 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.164+0000 7f9982ffd700 1 -- 172.21.15.38:0/2398320727 learned_addr learned my addr 172.21.15.38:0/2398320727 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:07.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f99827fc700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 0x7f9984113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9982ffd700 1 -- 172.21.15.38:0/2398320727 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 msgr2=0x7f9984113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9982ffd700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 0x7f9984113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9982ffd700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974005040 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f99827fc700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 0x7f9984113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9982ffd700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f997400b3b0 tx=0x7f9974009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f997400e040 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998410d7f0 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f997400bc50 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9974013420 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.165+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998410dd30 con 0x7f9984065390 2023-12-16T20:09:07.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.166+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f998410e1d0 con 0x7f9984065390 2023-12-16T20:09:07.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f997401c430 con 0x7f9984065390 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 0x7f996c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9974088340 con 0x7f9984065390 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f99827fc700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 0x7f996c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 0x7f996c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f996c0716f0 con 0x7f996c06ec30 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9974088720 con 0x7f9984065390 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.167+0000 7f99837fe700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 0x7f996c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.168+0000 7f99827fc700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 0x7f996c06b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9978009fd0 tx=0x7f9978009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.168+0000 7f99837fe700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 0x7f996c071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.168+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== osd.1 v2:172.21.15.38:6810/2098419945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f996c0716f0 con 0x7f996c06ec30 2023-12-16T20:09:07.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.185+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 --> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f998405e340 con 0x7f996c06ec30 2023-12-16T20:09:07.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.185+0000 7f996b7fe700 1 -- 172.21.15.38:0/2398320727 <== osd.1 v2:172.21.15.38:6810/2098419945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f998405e340 con 0x7f996c06ec30 2023-12-16T20:09:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.185+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 msgr2=0x7f996c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.185+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 0x7f996c071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 msgr2=0x7f996c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 0x7f996c06b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9978009fd0 tx=0x7f9978009ee0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 msgr2=0x7f9984113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f997400b3b0 tx=0x7f9974009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 shutdown_connections 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6810/2098419945,v1:172.21.15.38:6811/2098419945] conn(0x7f996c06ec30 0x7f996c071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f996c068f60 0x7f996c06b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9984065390 0x7f9984113690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 --2- 172.21.15.38:0/2398320727 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9984102c20 0x7f9984113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 >> 172.21.15.38:0/2398320727 conn(0x7f99840719b0 msgr2=0x7f99840fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 shutdown_connections 2023-12-16T20:09:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.186+0000 7f9989523700 1 -- 172.21.15.38:0/2398320727 wait complete. 2023-12-16T20:09:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:07.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.353+0000 7fb27b5e2700 1 -- 172.21.15.38:0/3679380259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2740fbb40 msgr2=0x7fb2740fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.353+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/3679380259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2740fbb40 0x7fb2740fbfb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb264004940 tx=0x7fb264009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.353+0000 7fb27b5e2700 1 -- 172.21.15.38:0/3679380259 shutdown_connections 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.353+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/3679380259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2740fbb40 0x7fb2740fbfb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.353+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/3679380259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb274101b00 0x7fb274101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.354+0000 7fb27b5e2700 1 -- 172.21.15.38:0/3679380259 >> 172.21.15.38:0/3679380259 conn(0x7fb2740719b0 msgr2=0x7fb274071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 -- 172.21.15.38:0/3679380259 shutdown_connections 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 -- 172.21.15.38:0/3679380259 wait complete. 2023-12-16T20:09:07.355 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 Processor -- start 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 -- start start 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2740fbb40 0x7fb274115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2741163c0 con 0x7fb274101b00 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.355+0000 7fb27b5e2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27410f6f0 con 0x7fb2740fbb40 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43668/0 (socket says 172.21.15.38:43668) 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 -- 172.21.15.38:0/530280322 learned_addr learned my addr 172.21.15.38:0/530280322 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 -- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2740fbb40 msgr2=0x7fb274115830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2740fbb40 0x7fb274115830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264005040 con 0x7fb274101b00 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb278b7d700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb264009c90 tx=0x7fb264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26400e040 con 0x7fb274101b00 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27410f970 con 0x7fb274101b00 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb26400bc50 con 0x7fb274101b00 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.356+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26401c630 con 0x7fb274101b00 2023-12-16T20:09:07.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.357+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27410feb0 con 0x7fb274101b00 2023-12-16T20:09:07.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.358+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2741103d0 con 0x7fb274101b00 2023-12-16T20:09:07.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.358+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb264013420 con 0x7fb274101b00 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb269ffb700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 0x7fb26006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb264087dc0 con 0x7fb274101b00 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb27937e700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 0x7fb26006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb269ffb700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 0x7fb260071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2600716f0 con 0x7fb26006ec30 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb26408d3c0 con 0x7fb274101b00 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.359+0000 7fb279b7f700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 0x7fb260071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.360+0000 7fb27937e700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 0x7fb26006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb270004d00 tx=0x7fb270009ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.360+0000 7fb279b7f700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 0x7fb260071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.361+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== osd.4 v2:172.21.15.141:6808/1281377798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb2600716f0 con 0x7fb26006ec30 2023-12-16T20:09:07.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.376+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 --> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb274110590 con 0x7fb26006ec30 2023-12-16T20:09:07.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb269ffb700 1 -- 172.21.15.38:0/530280322 <== osd.4 v2:172.21.15.141:6808/1281377798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb274110590 con 0x7fb26006ec30 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 msgr2=0x7fb260071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 0x7fb260071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 msgr2=0x7fb26006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 0x7fb26006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb270004d00 tx=0x7fb270009ce0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 msgr2=0x7fb274115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb264009c90 tx=0x7fb264009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 shutdown_connections 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fb260068f60 0x7fb26006b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2740fbb40 0x7fb274115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.141:6808/1281377798,v1:172.21.15.141:6809/1281377798] conn(0x7fb26006ec30 0x7fb260071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 --2- 172.21.15.38:0/530280322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb274101b00 0x7fb274115d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:07.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.377+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 >> 172.21.15.38:0/530280322 conn(0x7fb2740719b0 msgr2=0x7fb274065430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:07.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.378+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 shutdown_connections 2023-12-16T20:09:07.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:07.378+0000 7fb27b5e2700 1 -- 172.21.15.38:0/530280322 wait complete. 2023-12-16T20:09:07.614 INFO:teuthology.orchestra.run.smithi038.stdout:60129542163 2023-12-16T20:09:07.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-16T20:09:07.834 INFO:teuthology.orchestra.run.smithi038.stdout:137438953481 2023-12-16T20:09:07.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-16T20:09:07.862 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:07 smithi038 ceph-mon[80659]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:08.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:07 smithi141 ceph-mon[88165]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:08.516 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 -- 172.21.15.38:0/1010500754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 msgr2=0x7faa540fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/1010500754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa540fbfb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faa44004940 tx=0x7faa44009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 -- 172.21.15.38:0/1010500754 shutdown_connections 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/1010500754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa540fbfb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/1010500754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa54101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:08.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.992+0000 7faa5b7bd700 1 -- 172.21.15.38:0/1010500754 >> 172.21.15.38:0/1010500754 conn(0x7faa540f76c0 msgr2=0x7faa540f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 -- 172.21.15.38:0/1010500754 shutdown_connections 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 -- 172.21.15.38:0/1010500754 wait complete. 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 Processor -- start 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 -- start start 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa5410ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5410f240 con 0x7faa540fbb40 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.993+0000 7faa5b7bd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5410f3b0 con 0x7faa54101b00 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43688/0 (socket says 172.21.15.38:43688) 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 -- 172.21.15.38:0/629821237 learned_addr learned my addr 172.21.15.38:0/629821237 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa58d58700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa5410ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 -- 172.21.15.38:0/629821237 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 msgr2=0x7faa5410ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa5410ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:08.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44005040 con 0x7faa540fbb40 2023-12-16T20:09:08.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa58d58700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa5410ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:09:08.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa59559700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b7c0 tx=0x7faa50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:08.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5000f6f0 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa5000fd00 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa54117700 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa50011e90 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.994+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa54117c10 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.995+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa5405e380 con 0x7faa540fbb40 2023-12-16T20:09:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.996+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faa5000f850 con 0x7faa540fbb40 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.996+0000 7faa49ffb700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 0x7faa4006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa500872d0 con 0x7faa540fbb40 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa58d58700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 0x7faa4006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa49ffb700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 0x7faa40070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa40071590 con 0x7faa4006ead0 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa50087610 con 0x7faa540fbb40 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa59d5a700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 0x7faa40070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa58d58700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 0x7faa4006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b3b0 tx=0x7faa44009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.997+0000 7faa59d5a700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 0x7faa40070ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:08.998+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== osd.0 v2:172.21.15.38:6802/3282586212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7faa40071590 con 0x7faa4006ead0 2023-12-16T20:09:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 --> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa5405e800 con 0x7faa4006ead0 2023-12-16T20:09:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa49ffb700 1 -- 172.21.15.38:0/629821237 <== osd.0 v2:172.21.15.38:6802/3282586212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa5405e800 con 0x7faa4006ead0 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 msgr2=0x7faa40070ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 0x7faa40070ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 msgr2=0x7faa4006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 0x7faa4006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b3b0 tx=0x7faa44009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 msgr2=0x7faa5410e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.015+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b7c0 tx=0x7faa50009250 comp rx=0 tx=0).stop 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 shutdown_connections 2023-12-16T20:09:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faa40068f70 0x7faa4006b420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa540fbb40 0x7faa5410e6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.38:6802/3282586212,v1:172.21.15.38:6803/3282586212] conn(0x7faa4006ead0 0x7faa40070ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 --2- 172.21.15.38:0/629821237 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa54101b00 0x7faa5410ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 >> 172.21.15.38:0/629821237 conn(0x7faa540f76c0 msgr2=0x7faa540f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 shutdown_connections 2023-12-16T20:09:09.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.016+0000 7faa5b7bd700 1 -- 172.21.15.38:0/629821237 wait complete. 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/709336801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd081057c0 msgr2=0x7fcd080fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/709336801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd081057c0 0x7fcd080fee30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fccf8004940 tx=0x7fccf8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/709336801 shutdown_connections 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/709336801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd081057c0 0x7fcd080fee30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/709336801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd08104e20 0x7fcd081051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/709336801 >> 172.21.15.38:0/709336801 conn(0x7fcd080fa990 msgr2=0x7fcd080fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:09.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/709336801 shutdown_connections 2023-12-16T20:09:09.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/709336801 wait complete. 2023-12-16T20:09:09.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 Processor -- start 2023-12-16T20:09:09.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- start start 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 0x7fcd08115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08116450 con 0x7fcd08104e20 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.310+0000 7fcd0f8f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0810f780 con 0x7fcd081057c0 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43698/0 (socket says 172.21.15.38:43698) 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 -- 172.21.15.38:0/518681689 learned_addr learned my addr 172.21.15.38:0/518681689 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0ce92700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 0x7fcd08115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 -- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 msgr2=0x7fcd08115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 0x7fcd08115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8005040 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0ce92700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 0x7fcd08115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0d693700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400eb70 tx=0x7fcd0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd04007cc0 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd0400f040 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0810fa00 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd040095f0 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.311+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0810ff10 con 0x7fcd08104e20 2023-12-16T20:09:09.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.312+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd081103c0 con 0x7fcd08104e20 2023-12-16T20:09:09.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcd04009750 con 0x7fcd08104e20 2023-12-16T20:09:09.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 0x7fccf406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:09.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcd040865b0 con 0x7fcd08104e20 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fcd0ce92700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 0x7fccf406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 0x7fccf4071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccf40716f0 con 0x7fccf406ec30 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.313+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd04088c00 con 0x7fcd08104e20 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.314+0000 7fcd0ce92700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 0x7fccf406b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd08110ab0 tx=0x7fccf8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.314+0000 7fcd0de94700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 0x7fccf4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.314+0000 7fcd0de94700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 0x7fccf4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:09.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.315+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== osd.5 v2:172.21.15.141:6816/1487404021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fccf40716f0 con 0x7fccf406ec30 2023-12-16T20:09:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.330+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 --> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd080fe5b0 con 0x7fccf406ec30 2023-12-16T20:09:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fccfdffb700 1 -- 172.21.15.38:0/518681689 <== osd.5 v2:172.21.15.141:6816/1487404021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcd080fe5b0 con 0x7fccf406ec30 2023-12-16T20:09:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 msgr2=0x7fccf4071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 0x7fccf4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 msgr2=0x7fccf406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 0x7fccf406b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd08110ab0 tx=0x7fccf8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 msgr2=0x7fcd081158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400eb70 tx=0x7fcd0400b040 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 shutdown_connections 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:6816/1487404021,v1:172.21.15.141:6817/1487404021] conn(0x7fccf406ec30 0x7fccf4071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fccf4068f60 0x7fccf406b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd08104e20 0x7fcd081158c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 --2- 172.21.15.38:0/518681689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd081057c0 0x7fcd08115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 >> 172.21.15.38:0/518681689 conn(0x7fcd080fa990 msgr2=0x7fcd080fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 shutdown_connections 2023-12-16T20:09:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:09.331+0000 7fcd0f8f7700 1 -- 172.21.15.38:0/518681689 wait complete. 2023-12-16T20:09:09.742 INFO:teuthology.orchestra.run.smithi038.stdout:158913789958 2023-12-16T20:09:09.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-16T20:09:09.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:09 smithi038 ceph-mon[80659]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:10.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- 172.21.15.38:0/3979176344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 msgr2=0x7f08ac0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 --2- 172.21.15.38:0/3979176344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac0fbfb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f089c004940 tx=0x7f089c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- 172.21.15.38:0/3979176344 shutdown_connections 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 --2- 172.21.15.38:0/3979176344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac0fbfb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 --2- 172.21.15.38:0/3979176344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 0x7f08ac101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- 172.21.15.38:0/3979176344 >> 172.21.15.38:0/3979176344 conn(0x7f08ac0f76c0 msgr2=0x7f08ac0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- 172.21.15.38:0/3979176344 shutdown_connections 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- 172.21.15.38:0/3979176344 wait complete. 2023-12-16T20:09:10.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 Processor -- start 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.126+0000 7f08b44fe700 1 -- start start 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b44fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b44fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 0x7f08ac106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b44fe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1074c0 con 0x7f08ac0fbb40 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b44fe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac107630 con 0x7f08ac101b00 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43704/0 (socket says 172.21.15.38:43704) 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 -- 172.21.15.38:0/954470040 learned_addr learned my addr 172.21.15.38:0/954470040 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b1a99700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 0x7f08ac106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 -- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 msgr2=0x7f08ac106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 0x7f08ac106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c005040 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b229a700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c830 tx=0x7f08a8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a80106f0 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08a8010d00 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.127+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac119900 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.128+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a8012e90 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.128+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac119db0 con 0x7f08ac0fbb40 2023-12-16T20:09:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.128+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08ac05e380 con 0x7f08ac0fbb40 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.129+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f08a8010850 con 0x7f08ac0fbb40 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.129+0000 7f08a2ffd700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 0x7f089806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.129+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f08a8086ac0 con 0x7f08ac0fbb40 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.129+0000 7f08b1a99700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 0x7f089806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08a2ffd700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 0x7f0898070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0898071580 con 0x7f089806eac0 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08a808b220 con 0x7f08ac0fbb40 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08b1a99700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 0x7f089806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f08ac108a90 tx=0x7f089c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08b2a9b700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 0x7f0898070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.130+0000 7f08b2a9b700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 0x7f0898070ed0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.131+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== osd.3 v2:172.21.15.141:6800/1223163151 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0898071580 con 0x7f089806eac0 2023-12-16T20:09:10.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 --> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08ac05e800 con 0x7f089806eac0 2023-12-16T20:09:10.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08a2ffd700 1 -- 172.21.15.38:0/954470040 <== osd.3 v2:172.21.15.141:6800/1223163151 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f08ac05e800 con 0x7f089806eac0 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 msgr2=0x7f0898070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 0x7f0898070ed0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 msgr2=0x7f089806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.147+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 0x7f089806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f08ac108a90 tx=0x7f089c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 msgr2=0x7f08ac106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c830 tx=0x7f08a8004470 comp rx=0 tx=0).stop 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 shutdown_connections 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:6800/1223163151,v1:172.21.15.141:6801/1223163151] conn(0x7f089806eac0 0x7f0898070ed0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f0898068f60 0x7f089806b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08ac0fbb40 0x7f08ac106980 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 --2- 172.21.15.38:0/954470040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08ac101b00 0x7f08ac106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:10.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 >> 172.21.15.38:0/954470040 conn(0x7f08ac0f76c0 msgr2=0x7f08ac0f9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:10.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 shutdown_connections 2023-12-16T20:09:10.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:10.148+0000 7f08b44fe700 1 -- 172.21.15.38:0/954470040 wait complete. 2023-12-16T20:09:10.206 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:10.229 INFO:teuthology.orchestra.run.smithi038.stdout:38654705687 2023-12-16T20:09:10.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-16T20:09:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:09 smithi141 ceph-mon[88165]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:10.681 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2643397267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac0fbb40 msgr2=0x7fd4ac0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2643397267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fbfb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd49c004940 tx=0x7fd49c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2643397267 shutdown_connections 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2643397267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fbfb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2643397267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac101b00 0x7fd4ac101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2643397267 >> 172.21.15.38:0/2643397267 conn(0x7fd4ac0f76c0 msgr2=0x7fd4ac0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2643397267 shutdown_connections 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.262+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2643397267 wait complete. 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 Processor -- start 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 -- start start 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0fe260 con 0x7fd4ac101b00 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b40c7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0fe3d0 con 0x7fd4ac0fbb40 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b1662700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b1662700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51904/0 (socket says 172.21.15.38:51904) 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.263+0000 7fd4b1662700 1 -- 172.21.15.38:0/2859950048 learned_addr learned my addr 172.21.15.38:0/2859950048 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1e63700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1662700 1 -- 172.21.15.38:0/2859950048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 msgr2=0x7fd4ac0fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1662700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1662700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c005040 con 0x7fd4ac101b00 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1e63700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b1662700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b3b0 tx=0x7fd49c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c00e040 con 0x7fd4ac101b00 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd49c00bc50 con 0x7fd4ac101b00 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac1199a0 con 0x7fd4ac101b00 2023-12-16T20:09:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c013420 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.264+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac119e00 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.265+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4ac100af0 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd49c01c430 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 0x7fd49806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd49c088340 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4b1e63700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 0x7fd49806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 0x7fd498071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4980716f0 con 0x7fd49806ec30 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd49c088720 con 0x7fd4ac101b00 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.266+0000 7fd4b2664700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 0x7fd498071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.267+0000 7fd4b1e63700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 0x7fd49806b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009fd0 tx=0x7fd4a8009f20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.267+0000 7fd4b2664700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 0x7fd498071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.267+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== osd.2 v2:172.21.15.38:6818/2982983662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd4980716f0 con 0x7fd49806ec30 2023-12-16T20:09:11.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 --> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4ac0fb2c0 con 0x7fd49806ec30 2023-12-16T20:09:11.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4a27fc700 1 -- 172.21.15.38:0/2859950048 <== osd.2 v2:172.21.15.38:6818/2982983662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4ac0fb2c0 con 0x7fd49806ec30 2023-12-16T20:09:11.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 msgr2=0x7fd498071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:11.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 0x7fd498071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 msgr2=0x7fd49806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 0x7fd49806b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009fd0 tx=0x7fd4a8009f20 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 msgr2=0x7fd4ac0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b3b0 tx=0x7fd49c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 shutdown_connections 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd498068f60 0x7fd49806b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:6818/2982983662,v1:172.21.15.38:6819/2982983662] conn(0x7fd49806ec30 0x7fd498071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4ac0fbb40 0x7fd4ac0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 --2- 172.21.15.38:0/2859950048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4ac101b00 0x7fd4ac0fdc60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.283+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 >> 172.21.15.38:0/2859950048 conn(0x7fd4ac0f76c0 msgr2=0x7fd4ac0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.284+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 shutdown_connections 2023-12-16T20:09:11.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:11.284+0000 7fd4b40c7700 1 -- 172.21.15.38:0/2859950048 wait complete. 2023-12-16T20:09:11.632 INFO:teuthology.orchestra.run.smithi038.stdout:77309411344 2023-12-16T20:09:11.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-16T20:09:11.819 INFO:teuthology.orchestra.run.smithi038.stdout:107374182412 2023-12-16T20:09:11.819 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-16T20:09:11.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:11 smithi038 ceph-mon[80659]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:12.040 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 -- 172.21.15.38:0/903399432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fdc10 msgr2=0x7f97e00fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 --2- 172.21.15.38:0/903399432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fdc10 0x7f97e00fdfe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97d0004970 tx=0x7f97d0009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 -- 172.21.15.38:0/903399432 shutdown_connections 2023-12-16T20:09:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 --2- 172.21.15.38:0/903399432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fe5b0 0x7f97e0106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 --2- 172.21.15.38:0/903399432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fdc10 0x7f97e00fdfe0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 -- 172.21.15.38:0/903399432 >> 172.21.15.38:0/903399432 conn(0x7f97e00f7690 msgr2=0x7f97e00f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:12.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 -- 172.21.15.38:0/903399432 shutdown_connections 2023-12-16T20:09:12.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.132+0000 7f97e52bc700 1 -- 172.21.15.38:0/903399432 wait complete. 2023-12-16T20:09:12.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 Processor -- start 2023-12-16T20:09:12.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 -- start start 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 0x7f97e0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01141e0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.133+0000 7f97e52bc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e010d4d0 con 0x7f97e00fdc10 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51926/0 (socket says 172.21.15.38:51926) 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 -- 172.21.15.38:0/234383676 learned_addr learned my addr 172.21.15.38:0/234383676 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97deffd700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 0x7f97e0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 -- 172.21.15.38:0/234383676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 msgr2=0x7f97e0113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 0x7f97e0113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 -- 172.21.15.38:0/234383676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0005040 con 0x7f97e00fe5b0 2023-12-16T20:09:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97deffd700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 0x7f97e0113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97de7fc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c8c0 tx=0x7f97d40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d400a980 con 0x7f97e00fe5b0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e010d760 con 0x7f97e00fe5b0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97d400ce60 con 0x7f97e00fe5b0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d40113a0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.134+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e010dca0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.135+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e0104340 con 0x7f97e00fe5b0 2023-12-16T20:09:12.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.136+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f97d400aae0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.136+0000 7f97c77fe700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 0x7f97c806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:12.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.136+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97d4086b80 con 0x7f97e00fe5b0 2023-12-16T20:09:12.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.136+0000 7f97deffd700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 0x7f97c806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:12.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.137+0000 7f97deffd700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 0x7f97c806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:12.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.141+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f97d4056e20 con 0x7f97e00fe5b0 2023-12-16T20:09:12.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:11 smithi141 ceph-mon[88165]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:12.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.349+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97e00647b0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.350+0000 7f97c77fe700 1 -- 172.21.15.38:0/234383676 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97d40569b0 con 0x7f97e00fe5b0 2023-12-16T20:09:12.350 INFO:teuthology.orchestra.run.smithi038.stdout:60129542164 2023-12-16T20:09:12.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 msgr2=0x7f97c806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:12.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 0x7f97c806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:12.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 msgr2=0x7f97e0113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:12.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c8c0 tx=0x7f97d40044c0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 shutdown_connections 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f97c8068f60 0x7f97c806b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97e00fdc10 0x7f97e0113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 --2- 172.21.15.38:0/234383676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97e00fe5b0 0x7f97e0113b90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 >> 172.21.15.38:0/234383676 conn(0x7f97e00f7690 msgr2=0x7f97e01014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 shutdown_connections 2023-12-16T20:09:12.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:12.352+0000 7f97e52bc700 1 -- 172.21.15.38:0/234383676 wait complete. 2023-12-16T20:09:12.463 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:12.825 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:12 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/234383676' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T20:09:12.825 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:12.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542163 got 60129542164 for osd.1 2023-12-16T20:09:12.849 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:13.063 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:12 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/234383676' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T20:09:13.064 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 -- 172.21.15.38:0/3732662049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 msgr2=0x7f05d00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/3732662049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d00fbfb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05c4004940 tx=0x7f05c4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 -- 172.21.15.38:0/3732662049 shutdown_connections 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/3732662049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d00fbfb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/3732662049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 0x7f05d0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 -- 172.21.15.38:0/3732662049 >> 172.21.15.38:0/3732662049 conn(0x7f05d00f76c0 msgr2=0x7f05d00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 -- 172.21.15.38:0/3732662049 shutdown_connections 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.388+0000 7f05d7fc8700 1 -- 172.21.15.38:0/3732662049 wait complete. 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 Processor -- start 2023-12-16T20:09:13.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 -- start start 2023-12-16T20:09:13.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 0x7f05d0113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d010d530 con 0x7f05d00fbb40 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d7fc8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d010d6a0 con 0x7f05d0101b00 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51944/0 (socket says 172.21.15.38:51944) 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 -- 172.21.15.38:0/1435823157 learned_addr learned my addr 172.21.15.38:0/1435823157 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5563700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 0x7f05d0113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 -- 172.21.15.38:0/1435823157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 msgr2=0x7f05d0113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 0x7f05d0113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 -- 172.21.15.38:0/1435823157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4005040 con 0x7f05d00fbb40 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.389+0000 7f05d5d64700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05c800bbb0 tx=0x7f05c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.390+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c80092e0 con 0x7f05d00fbb40 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.390+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05c800cb00 con 0x7f05d00fbb40 2023-12-16T20:09:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.390+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d010d980 con 0x7f05d00fbb40 2023-12-16T20:09:13.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.390+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c8015d10 con 0x7f05d00fbb40 2023-12-16T20:09:13.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.390+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d010dec0 con 0x7f05d00fbb40 2023-12-16T20:09:13.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.391+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00fb2c0 con 0x7f05d00fbb40 2023-12-16T20:09:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.391+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f05c8012070 con 0x7f05d00fbb40 2023-12-16T20:09:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.392+0000 7f05ce7fc700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 0x7f05b806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.392+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f05c8086560 con 0x7f05d00fbb40 2023-12-16T20:09:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.392+0000 7f05d5563700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 0x7f05b806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.392+0000 7f05d5563700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 0x7f05b806b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05d010ef10 tx=0x7f05c4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.396+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05c8056800 con 0x7f05d00fbb40 2023-12-16T20:09:13.499 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:13.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 -- 172.21.15.38:0/1449941970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc070870 msgr2=0x7f82cc108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 --2- 172.21.15.38:0/1449941970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc070870 0x7f82cc108f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f82bc004940 tx=0x7f82bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 -- 172.21.15.38:0/1449941970 shutdown_connections 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 --2- 172.21.15.38:0/1449941970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc070870 0x7f82cc108f90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 --2- 172.21.15.38:0/1449941970 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc06ff60 0x7f82cc070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 -- 172.21.15.38:0/1449941970 >> 172.21.15.38:0/1449941970 conn(0x7f82cc0f8790 msgr2=0x7f82cc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 -- 172.21.15.38:0/1449941970 shutdown_connections 2023-12-16T20:09:13.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.558+0000 7f82d122f700 1 -- 172.21.15.38:0/1449941970 wait complete. 2023-12-16T20:09:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 Processor -- start 2023-12-16T20:09:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 -- start start 2023-12-16T20:09:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc070870 0x7f82cc115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc116440 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82d122f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc10f770 con 0x7f82cc070870 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51958/0 (socket says 172.21.15.38:51958) 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 -- 172.21.15.38:0/493187357 learned_addr learned my addr 172.21.15.38:0/493187357 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82ca59c700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc070870 0x7f82cc115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 -- 172.21.15.38:0/493187357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc070870 msgr2=0x7f82cc115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc070870 0x7f82cc115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.559+0000 7f82cad9d700 1 -- 172.21.15.38:0/493187357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc005040 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82cad9d700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82b4002a50 tx=0x7f82b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b4007cc0 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc10fa50 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82b400f040 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b400d9c0 con 0x7f82cc06ff60 2023-12-16T20:09:13.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.560+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc10ff60 con 0x7f82cc06ff60 2023-12-16T20:09:13.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.561+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc106650 con 0x7f82cc06ff60 2023-12-16T20:09:13.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.562+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f82b400db20 con 0x7f82cc06ff60 2023-12-16T20:09:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.562+0000 7f82c37fe700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 0x7f82b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.562+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f82b40867f0 con 0x7f82cc06ff60 2023-12-16T20:09:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.562+0000 7f82ca59c700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 0x7f82b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.563+0000 7f82ca59c700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 0x7f82b806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82cc110aa0 tx=0x7f82bc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.571+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f82b40569b0 con 0x7f82cc06ff60 2023-12-16T20:09:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.608+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f05d010ec50 con 0x7f05d00fbb40 2023-12-16T20:09:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.608+0000 7f05ce7fc700 1 -- 172.21.15.38:0/1435823157 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05c8056390 con 0x7f05d00fbb40 2023-12-16T20:09:13.609 INFO:teuthology.orchestra.run.smithi038.stdout:158913789959 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.610+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 msgr2=0x7f05b806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.610+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 0x7f05b806b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05d010ef10 tx=0x7f05c4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.610+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 msgr2=0x7f05d0113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.610+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05c800bbb0 tx=0x7f05c8009840 comp rx=0 tx=0).stop 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 shutdown_connections 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f05b8068f70 0x7f05b806b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05d00fbb40 0x7f05d0113670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 --2- 172.21.15.38:0/1435823157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05d0101b00 0x7f05d0113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 >> 172.21.15.38:0/1435823157 conn(0x7f05d00f76c0 msgr2=0x7f05d00ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 shutdown_connections 2023-12-16T20:09:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.611+0000 7f05d7fc8700 1 -- 172.21.15.38:0/1435823157 wait complete. 2023-12-16T20:09:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- 172.21.15.38:0/3840041168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c065390 msgr2=0x7f200c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 --2- 172.21.15.38:0/3840041168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c065390 0x7f200c065800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2000004940 tx=0x7f2000009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- 172.21.15.38:0/3840041168 shutdown_connections 2023-12-16T20:09:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 --2- 172.21.15.38:0/3840041168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c065390 0x7f200c065800 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 --2- 172.21.15.38:0/3840041168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c102c20 0x7f200c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- 172.21.15.38:0/3840041168 >> 172.21.15.38:0/3840041168 conn(0x7f200c0719b0 msgr2=0x7f200c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- 172.21.15.38:0/3840041168 shutdown_connections 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- 172.21.15.38:0/3840041168 wait complete. 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 Processor -- start 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.717+0000 7f2013515700 1 -- start start 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2013515700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c065390 0x7f200c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2013515700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2013515700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c1142c0 con 0x7f200c102c20 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2013515700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c10d5f0 con 0x7f200c065390 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51968/0 (socket says 172.21.15.38:51968) 2023-12-16T20:09:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 -- 172.21.15.38:0/3173167101 learned_addr learned my addr 172.21.15.38:0/3173167101 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f20112b1700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c065390 0x7f200c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 -- 172.21.15.38:0/3173167101 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c065390 msgr2=0x7f200c113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c065390 0x7f200c113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 -- 172.21.15.38:0/3173167101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000005040 con 0x7f200c102c20 2023-12-16T20:09:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f2010ab0700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2000009360 tx=0x7f2000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.718+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200000e040 con 0x7f200c102c20 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.719+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2000004290 con 0x7f200c102c20 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.719+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200001c3f0 con 0x7f200c102c20 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.719+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c10d870 con 0x7f200c102c20 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.719+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c10ddb0 con 0x7f200c102c20 2023-12-16T20:09:13.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.720+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c0fff40 con 0x7f200c102c20 2023-12-16T20:09:13.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.720+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f200000bb80 con 0x7f200c102c20 2023-12-16T20:09:13.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.721+0000 7f1ffdffb700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 0x7f1ff806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:13.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.721+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2000087bf0 con 0x7f200c102c20 2023-12-16T20:09:13.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.721+0000 7f20112b1700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 0x7f1ff806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:13.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.722+0000 7f20112b1700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 0x7f1ff806b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2008004f40 tx=0x7f200800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.726+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2000057f40 con 0x7f200c102c20 2023-12-16T20:09:13.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.786+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f82cc0fc360 con 0x7f82cc06ff60 2023-12-16T20:09:13.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.786+0000 7f82c37fe700 1 -- 172.21.15.38:0/493187357 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82b4056540 con 0x7f82cc06ff60 2023-12-16T20:09:13.789 INFO:teuthology.orchestra.run.smithi038.stdout:137438953482 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 msgr2=0x7f82b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 0x7f82b806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82cc110aa0 tx=0x7f82bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 msgr2=0x7f82cc1158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f82b4002a50 tx=0x7f82b40046b0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 shutdown_connections 2023-12-16T20:09:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f82b8068f60 0x7f82b806b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82cc06ff60 0x7f82cc1158b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 --2- 172.21.15.38:0/493187357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82cc070870 0x7f82cc115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 >> 172.21.15.38:0/493187357 conn(0x7f82cc0f8790 msgr2=0x7f82cc1037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 shutdown_connections 2023-12-16T20:09:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.788+0000 7f82d122f700 1 -- 172.21.15.38:0/493187357 wait complete. 2023-12-16T20:09:13.860 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:13 smithi038 ceph-mon[80659]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:13.860 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:13 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1435823157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T20:09:13.860 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:13 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/493187357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T20:09:13.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789958 got 158913789959 for osd.5 2023-12-16T20:09:13.884 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:13.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.948+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f200c0fff40 con 0x7f200c102c20 2023-12-16T20:09:13.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.949+0000 7f1ffdffb700 1 -- 172.21.15.38:0/3173167101 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2000057ad0 con 0x7f200c102c20 2023-12-16T20:09:13.949 INFO:teuthology.orchestra.run.smithi038.stdout:38654705688 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 msgr2=0x7f1ff806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 0x7f1ff806b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2008004f40 tx=0x7f200800b040 comp rx=0 tx=0).stop 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 msgr2=0x7f200c113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2000009360 tx=0x7f2000009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 shutdown_connections 2023-12-16T20:09:13.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f1ff8068f70 0x7f1ff806b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200c065390 0x7f200c113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 --2- 172.21.15.38:0/3173167101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f200c102c20 0x7f200c113c70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 >> 172.21.15.38:0/3173167101 conn(0x7f200c0719b0 msgr2=0x7f200c0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 shutdown_connections 2023-12-16T20:09:13.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:13.951+0000 7f2013515700 1 -- 172.21.15.38:0/3173167101 wait complete. 2023-12-16T20:09:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:13 smithi141 ceph-mon[88165]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:13 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1435823157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T20:09:13.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:13 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/493187357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T20:09:14.395 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953481 got 137438953482 for osd.4 2023-12-16T20:09:14.395 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:15.034 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705687 got 38654705688 for osd.0 2023-12-16T20:09:15.034 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:15.058 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:14 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3173167101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 -- 172.21.15.38:0/4000380577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 msgr2=0x7f6d5c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 --2- 172.21.15.38:0/4000380577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c0fcc10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c004940 tx=0x7f6d4c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 -- 172.21.15.38:0/4000380577 shutdown_connections 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 --2- 172.21.15.38:0/4000380577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c0fcc10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 --2- 172.21.15.38:0/4000380577 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 0x7f6d5c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 -- 172.21.15.38:0/4000380577 >> 172.21.15.38:0/4000380577 conn(0x7f6d5c0f8790 msgr2=0x7f6d5c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 -- 172.21.15.38:0/4000380577 shutdown_connections 2023-12-16T20:09:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.220+0000 7f6d62963700 1 -- 172.21.15.38:0/4000380577 wait complete. 2023-12-16T20:09:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 Processor -- start 2023-12-16T20:09:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 -- start start 2023-12-16T20:09:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 0x7f6d5c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c070a80 con 0x7f6d5c1035a0 2023-12-16T20:09:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d62963700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c070bf0 con 0x7f6d5c102c00 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d5b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d5b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51986/0 (socket says 172.21.15.38:51986) 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.221+0000 7f6d5b7fe700 1 -- 172.21.15.38:0/1593422882 learned_addr learned my addr 172.21.15.38:0/1593422882 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d5bfff700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 0x7f6d5c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d5b7fe700 1 -- 172.21.15.38:0/1593422882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 msgr2=0x7f6d5c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d5b7fe700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 0x7f6d5c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d5b7fe700 1 -- 172.21.15.38:0/1593422882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c005040 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d5b7fe700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009fd0 tx=0x7f6d4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4c00e040 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d4c013420 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c119810 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4c01c630 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.222+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c119c70 con 0x7f6d5c1035a0 2023-12-16T20:09:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.223+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c1050d0 con 0x7f6d5c1035a0 2023-12-16T20:09:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.224+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6d4c013a00 con 0x7f6d5c1035a0 2023-12-16T20:09:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.225+0000 7f6d58ff9700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 0x7f6d4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.225+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6d4c087b80 con 0x7f6d5c1035a0 2023-12-16T20:09:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.225+0000 7f6d5bfff700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 0x7f6d4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.225+0000 7f6d5bfff700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 0x7f6d4806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007fd0 tx=0x7f6d44009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.230+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6d4c054430 con 0x7f6d5c1035a0 2023-12-16T20:09:15.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:14 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3173167101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 -- 172.21.15.38:0/1943891381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c102c20 msgr2=0x7f3c5c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 --2- 172.21.15.38:0/1943891381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c102c20 0x7f3c5c102ff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c004940 tx=0x7f3c4c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 -- 172.21.15.38:0/1943891381 shutdown_connections 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 --2- 172.21.15.38:0/1943891381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c065390 0x7f3c5c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 --2- 172.21.15.38:0/1943891381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c102c20 0x7f3c5c102ff0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 -- 172.21.15.38:0/1943891381 >> 172.21.15.38:0/1943891381 conn(0x7f3c5c0719b0 msgr2=0x7f3c5c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 -- 172.21.15.38:0/1943891381 shutdown_connections 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.279+0000 7f3c6174c700 1 -- 172.21.15.38:0/1943891381 wait complete. 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 Processor -- start 2023-12-16T20:09:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 -- start start 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c102c20 0x7f3c5c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c114220 con 0x7f3c5c065390 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c6174c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10d570 con 0x7f3c5c102c20 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52000/0 (socket says 172.21.15.38:52000) 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5affd700 1 -- 172.21.15.38:0/4120104702 learned_addr learned my addr 172.21.15.38:0/4120104702 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5a7fc700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c102c20 0x7f3c5c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5affd700 1 -- 172.21.15.38:0/4120104702 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c102c20 msgr2=0x7f3c5c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.280+0000 7f3c5affd700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c102c20 0x7f3c5c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c5affd700 1 -- 172.21.15.38:0/4120104702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c005040 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c5affd700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009360 tx=0x7f3c4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c4c00e040 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c4c013420 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c10d7f0 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c4c01c610 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.281+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c10dd30 con 0x7f3c5c065390 2023-12-16T20:09:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.282+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c0fff40 con 0x7f3c5c065390 2023-12-16T20:09:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.283+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3c4c013590 con 0x7f3c5c065390 2023-12-16T20:09:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.283+0000 7f3c437fe700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 0x7f3c4406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.283+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3c4c087cf0 con 0x7f3c5c065390 2023-12-16T20:09:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.283+0000 7f3c5a7fc700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 0x7f3c4406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.283+0000 7f3c5a7fc700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 0x7f3c4406b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c10ef70 tx=0x7f3c5000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:15.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.288+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3c4c057fc0 con 0x7f3c5c065390 2023-12-16T20:09:15.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.426+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d5c04bb80 con 0x7f6d5c1035a0 2023-12-16T20:09:15.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.426+0000 7f6d58ff9700 1 -- 172.21.15.38:0/1593422882 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d4c057a50 con 0x7f6d5c1035a0 2023-12-16T20:09:15.427 INFO:teuthology.orchestra.run.smithi038.stdout:107374182413 2023-12-16T20:09:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 msgr2=0x7f6d4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 0x7f6d4806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007fd0 tx=0x7f6d44009040 comp rx=0 tx=0).stop 2023-12-16T20:09:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 msgr2=0x7f6d5c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009fd0 tx=0x7f6d4c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 shutdown_connections 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6d48068f60 0x7f6d4806b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d5c102c00 0x7f6d5c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 --2- 172.21.15.38:0/1593422882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c1035a0 0x7f6d5c070480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 >> 172.21.15.38:0/1593422882 conn(0x7f6d5c0f8790 msgr2=0x7f6d5c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 shutdown_connections 2023-12-16T20:09:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.429+0000 7f6d62963700 1 -- 172.21.15.38:0/1593422882 wait complete. 2023-12-16T20:09:15.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.489+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c5c0fff40 con 0x7f3c5c065390 2023-12-16T20:09:15.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.489+0000 7f3c437fe700 1 -- 172.21.15.38:0/4120104702 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c4c057b50 con 0x7f3c5c065390 2023-12-16T20:09:15.490 INFO:teuthology.orchestra.run.smithi038.stdout:77309411344 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.491+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 msgr2=0x7f3c4406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.491+0000 7f3c6174c700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 0x7f3c4406b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c10ef70 tx=0x7f3c5000b040 comp rx=0 tx=0).stop 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.491+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 msgr2=0x7f3c5c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.491+0000 7f3c6174c700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009360 tx=0x7f3c4c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 shutdown_connections 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f3c44068f70 0x7f3c4406b420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c5c065390 0x7f3c5c113690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 --2- 172.21.15.38:0/4120104702 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c5c102c20 0x7f3c5c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:15.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 >> 172.21.15.38:0/4120104702 conn(0x7f3c5c0719b0 msgr2=0x7f3c5c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:15.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 shutdown_connections 2023-12-16T20:09:15.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:15.492+0000 7f3c6174c700 1 -- 172.21.15.38:0/4120104702 wait complete. 2023-12-16T20:09:15.742 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411344 got 77309411344 for osd.2 2023-12-16T20:09:15.743 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:15.881 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182412 got 107374182413 for osd.3 2023-12-16T20:09:15.882 DEBUG:teuthology.parallel:result is None 2023-12-16T20:09:15.882 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-16T20:09:15.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T20:09:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:15 smithi038 ceph-mon[80659]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:15 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1593422882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T20:09:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:15 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4120104702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T20:09:16.148 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:16.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:15 smithi141 ceph-mon[88165]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:16.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:15 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1593422882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T20:09:16.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:15 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4120104702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 -- 172.21.15.38:0/2146716705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 msgr2=0x7ff694106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2146716705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff694106ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff684004970 tx=0x7ff684009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 -- 172.21.15.38:0/2146716705 shutdown_connections 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2146716705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff694106ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2146716705 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 0x7ff6940fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 -- 172.21.15.38:0/2146716705 >> 172.21.15.38:0/2146716705 conn(0x7ff694071cf0 msgr2=0x7ff6940720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 -- 172.21.15.38:0/2146716705 shutdown_connections 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.874+0000 7ff69be5a700 1 -- 172.21.15.38:0/2146716705 wait complete. 2023-12-16T20:09:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 Processor -- start 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 -- start start 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 0x7ff6940fc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940fd370 con 0x7ff6940fb9b0 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff69be5a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940fd4e0 con 0x7ff6940fb010 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff6993f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff6993f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52008/0 (socket says 172.21.15.38:52008) 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff6993f5700 1 -- 172.21.15.38:0/2215718766 learned_addr learned my addr 172.21.15.38:0/2215718766 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.875+0000 7ff699bf6700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 0x7ff6940fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff6993f5700 1 -- 172.21.15.38:0/2215718766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 msgr2=0x7ff6940fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff6993f5700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 0x7ff6940fc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff6993f5700 1 -- 172.21.15.38:0/2215718766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684005040 con 0x7ff6940fb9b0 2023-12-16T20:09:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff6993f5700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff684004f50 tx=0x7ff684009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff68400e040 con 0x7ff6940fb9b0 2023-12-16T20:09:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff684004290 con 0x7ff6940fb9b0 2023-12-16T20:09:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff694119870 con 0x7ff6940fb9b0 2023-12-16T20:09:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694119cd0 con 0x7ff6940fb9b0 2023-12-16T20:09:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.876+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff68401c3f0 con 0x7ff6940fb9b0 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.877+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff694104180 con 0x7ff6940fb9b0 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.878+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff684013420 con 0x7ff6940fb9b0 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.878+0000 7ff68a7fc700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 0x7ff68006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.878+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff684087c90 con 0x7ff6940fb9b0 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.878+0000 7ff699bf6700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 0x7ff68006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.879+0000 7ff699bf6700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 0x7ff68006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff690004f40 tx=0x7ff69000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:16.883+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff6840544a0 con 0x7ff6940fb9b0 2023-12-16T20:09:17.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.073+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff69404bb80 con 0x7ff680068f70 2023-12-16T20:09:17.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.074+0000 7ff68a7fc700 1 -- 172.21.15.38:0/2215718766 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+21964 (secure 0 0 0) 0x7ff69404bb80 con 0x7ff680068f70 2023-12-16T20:09:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 msgr2=0x7ff68006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 0x7ff68006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff690004f40 tx=0x7ff69000b040 comp rx=0 tx=0).stop 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 msgr2=0x7ff6940fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff684004f50 tx=0x7ff684009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 shutdown_connections 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff680068f70 0x7ff68006b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6940fb010 0x7ff6940fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 --2- 172.21.15.38:0/2215718766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6940fb9b0 0x7ff6940fcd70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.076+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 >> 172.21.15.38:0/2215718766 conn(0x7ff694071cf0 msgr2=0x7ff694101210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.077+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 shutdown_connections 2023-12-16T20:09:17.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:17.077+0000 7ff69be5a700 1 -- 172.21.15.38:0/2215718766 wait complete. 2023-12-16T20:09:17.078 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-16T20:09:17.317 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-16T20:09:16.725273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2568702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001760"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T20:08:53.296330+0000","last_change":"2023-12-16T20:08:36.722046+0000","last_active":"2023-12-16T20:08:53.296330+0000","last_peered":"2023-12-16T20:08:53.296330+0000","last_clean":"2023-12-16T20:08:53.296330+0000","last_became_active":"2023-12-16T20:08:36.721726+0000","last_became_peered":"2023-12-16T20:08:36.721726+0000","last_unstale":"2023-12-16T20:08:53.296330+0000","last_undegraded":"2023-12-16T20:08:53.296330+0000","last_fullsized":"2023-12-16T20:08:53.296330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:08:07.727342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:08:07.727342+0000","last_clean_scrub_stamp":"2023-12-16T20:08:07.727342+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:23:00.206876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182414,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411345,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.376},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:09:17.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T20:09:17.584 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:17.973 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:17 smithi038 ceph-mon[80659]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:18.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:17 smithi141 ceph-mon[88165]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:18.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3955059377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc01057b0 msgr2=0x7f2fc00fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3955059377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc01057b0 0x7f2fc00fee20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4004940 tx=0x7f2fb4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3955059377 shutdown_connections 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3955059377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc01057b0 0x7f2fc00fee20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3955059377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc0104e10 0x7f2fc01051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3955059377 >> 172.21.15.38:0/3955059377 conn(0x7f2fc00fa960 msgr2=0x7f2fc00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3955059377 shutdown_connections 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.399+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3955059377 wait complete. 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 Processor -- start 2023-12-16T20:09:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 -- start start 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc01057b0 0x7f2fc0115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01163e0 con 0x7f2fc0104e10 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fc63ed700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc010f710 con 0x7f2fc01057b0 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52040/0 (socket says 172.21.15.38:52040) 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 -- 172.21.15.38:0/3846805759 learned_addr learned my addr 172.21.15.38:0/3846805759 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbf7fe700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc01057b0 0x7f2fc0115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 -- 172.21.15.38:0/3846805759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc01057b0 msgr2=0x7f2fc0115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc01057b0 0x7f2fc0115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.400+0000 7f2fbffff700 1 -- 172.21.15.38:0/3846805759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4005040 con 0x7f2fc0104e10 2023-12-16T20:09:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fbffff700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c830 tx=0x7f2fb0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb000a760 con 0x7f2fc0104e10 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc010f9f0 con 0x7f2fc0104e10 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fb000ad70 con 0x7f2fc0104e10 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fb00113a0 con 0x7f2fc0104e10 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.401+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc010ff30 con 0x7f2fc0104e10 2023-12-16T20:09:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.402+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc01072e0 con 0x7f2fc0104e10 2023-12-16T20:09:18.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.402+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2fb0012400 con 0x7f2fc0104e10 2023-12-16T20:09:18.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.403+0000 7f2fbcff9700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 0x7f2fa806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:18.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.403+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2fb0086ad0 con 0x7f2fc0104e10 2023-12-16T20:09:18.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.403+0000 7f2fbf7fe700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 0x7f2fa806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:18.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.403+0000 7f2fbf7fe700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 0x7f2fa806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0111080 tx=0x7f2fb4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:18.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.407+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2fb0056d70 con 0x7f2fc0104e10 2023-12-16T20:09:18.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.599+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fc004bbf0 con 0x7f2fa8068f60 2023-12-16T20:09:18.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.601+0000 7f2fbcff9700 1 -- 172.21.15.38:0/3846805759 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+21964 (secure 0 0 0) 0x7f2fc004bbf0 con 0x7f2fa8068f60 2023-12-16T20:09:18.601 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:18.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 msgr2=0x7f2fa806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:18.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 0x7f2fa806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0111080 tx=0x7f2fb4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:18.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 msgr2=0x7f2fc0115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c830 tx=0x7f2fb0004470 comp rx=0 tx=0).stop 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 shutdown_connections 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2fa8068f60 0x7f2fa806b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fc0104e10 0x7f2fc0115850 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 --2- 172.21.15.38:0/3846805759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc01057b0 0x7f2fc0115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 >> 172.21.15.38:0/3846805759 conn(0x7f2fc00fa960 msgr2=0x7f2fc00fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 shutdown_connections 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:18.603+0000 7f2fc63ed700 1 -- 172.21.15.38:0/3846805759 wait complete. 2023-12-16T20:09:18.604 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-16T20:09:18.842 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-16T20:09:16.725273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2568702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001760"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T20:08:53.296330+0000","last_change":"2023-12-16T20:08:36.722046+0000","last_active":"2023-12-16T20:08:53.296330+0000","last_peered":"2023-12-16T20:08:53.296330+0000","last_clean":"2023-12-16T20:08:53.296330+0000","last_became_active":"2023-12-16T20:08:36.721726+0000","last_became_peered":"2023-12-16T20:08:36.721726+0000","last_unstale":"2023-12-16T20:08:53.296330+0000","last_undegraded":"2023-12-16T20:08:53.296330+0000","last_fullsized":"2023-12-16T20:08:53.296330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:08:07.727342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:08:07.727342+0000","last_clean_scrub_stamp":"2023-12-16T20:08:07.727342+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:23:00.206876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182414,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411345,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.376},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":723301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:08:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:09:18.843 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-16T20:09:18.843 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T20:09:18.843 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-16T20:09:18.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-16T20:09:18.872 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:18 smithi038 ceph-mon[80659]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T20:09:19.111 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:19.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:18 smithi141 ceph-mon[88165]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T20:09:19.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:19 smithi038 ceph-mon[80659]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T20:09:19.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:19 smithi038 ceph-mon[80659]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:19.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 -- 172.21.15.38:0/939367626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25940fbb40 msgr2=0x7f25940fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:19.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 --2- 172.21.15.38:0/939367626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25940fbb40 0x7f25940fbfb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2584004940 tx=0x7f2584009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:19.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 -- 172.21.15.38:0/939367626 shutdown_connections 2023-12-16T20:09:19.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 --2- 172.21.15.38:0/939367626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25940fbb40 0x7f25940fbfb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:19.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 --2- 172.21.15.38:0/939367626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2594101b00 0x7f2594101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:19.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 -- 172.21.15.38:0/939367626 >> 172.21.15.38:0/939367626 conn(0x7f25940f76c0 msgr2=0x7f25940f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:19.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 -- 172.21.15.38:0/939367626 shutdown_connections 2023-12-16T20:09:19.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.909+0000 7f259ba96700 1 -- 172.21.15.38:0/939367626 wait complete. 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 Processor -- start 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 -- start start 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25940fbb40 0x7f2594112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594113190 con 0x7f2594101b00 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f259ba96700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259410c430 con 0x7f25940fbb40 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52048/0 (socket says 172.21.15.38:52048) 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 -- 172.21.15.38:0/2909006263 learned_addr learned my addr 172.21.15.38:0/2909006263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599832700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25940fbb40 0x7f2594112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 -- 172.21.15.38:0/2909006263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25940fbb40 msgr2=0x7f2594112570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25940fbb40 0x7f2594112570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 -- 172.21.15.38:0/2909006263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584005040 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.910+0000 7f2599031700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258400b3b0 tx=0x7f2584009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.911+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f258400e040 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.911+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2584009af0 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.911+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259410c6b0 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.911+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2584013660 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.911+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259410cbf0 con 0x7f2594101b00 2023-12-16T20:09:19.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.912+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25940fb2c0 con 0x7f2594101b00 2023-12-16T20:09:19.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.912+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f25840138e0 con 0x7f2594101b00 2023-12-16T20:09:19.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.912+0000 7f258a7fc700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 0x7f258006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:19.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.913+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f258408a580 con 0x7f2594101b00 2023-12-16T20:09:19.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.913+0000 7f2599832700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 0x7f258006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:19.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.913+0000 7f2599832700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 0x7f258006b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2590007580 tx=0x7f2590009780 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:19.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:19.917+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f258405a7a0 con 0x7f2594101b00 2023-12-16T20:09:20.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.156+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f259410db50 con 0x7f2594101b00 2023-12-16T20:09:20.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.156+0000 7f258a7fc700 1 -- 172.21.15.38:0/2909006263 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f258405a330 con 0x7f2594101b00 2023-12-16T20:09:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:20.157 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 msgr2=0x7f258006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 0x7f258006b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2590007580 tx=0x7f2590009780 comp rx=0 tx=0).stop 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 msgr2=0x7f2594112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258400b3b0 tx=0x7f2584009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 shutdown_connections 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f2580068f60 0x7f258006b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25940fbb40 0x7f2594112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 --2- 172.21.15.38:0/2909006263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2594101b00 0x7f2594112ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.158+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 >> 172.21.15.38:0/2909006263 conn(0x7f25940f76c0 msgr2=0x7f25940f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.159+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 shutdown_connections 2023-12-16T20:09:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:20.159+0000 7f259ba96700 1 -- 172.21.15.38:0/2909006263 wait complete. 2023-12-16T20:09:20.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:19 smithi141 ceph-mon[88165]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T20:09:20.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:19 smithi141 ceph-mon[88165]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:20.433 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-16T20:09:20.433 INFO:tasks.cephadm:Setup complete, yielding 2023-12-16T20:09:20.434 INFO:teuthology.run_tasks:Running task print... 2023-12-16T20:09:20.443 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-16T20:09:20.443 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:20.453 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:20.454 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-16T20:09:20.738 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:21.107 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:20 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2909006263' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T20:09:21.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:20 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2909006263' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 -- 172.21.15.38:0/107268831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fff70 msgr2=0x7f9f0c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 --2- 172.21.15.38:0/107268831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c1003e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4004940 tx=0x7f9ef4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 -- 172.21.15.38:0/107268831 shutdown_connections 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 --2- 172.21.15.38:0/107268831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c1003e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 --2- 172.21.15.38:0/107268831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 -- 172.21.15.38:0/107268831 >> 172.21.15.38:0/107268831 conn(0x7f9f0c0fa5d0 msgr2=0x7f9f0c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 -- 172.21.15.38:0/107268831 shutdown_connections 2023-12-16T20:09:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 -- 172.21.15.38:0/107268831 wait complete. 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.426+0000 7f9f1216f700 1 Processor -- start 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f1216f700 1 -- start start 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f1216f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f1216f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f1216f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c110300 con 0x7f9f0c0fee00 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f1216f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c110b40 con 0x7f9f0c0fff70 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59526/0 (socket says 172.21.15.38:59526) 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 -- 172.21.15.38:0/804429263 learned_addr learned my addr 172.21.15.38:0/804429263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0affd700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c10fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 -- 172.21.15.38:0/804429263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fff70 msgr2=0x7f9f0c10fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c10fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 -- 172.21.15.38:0/804429263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4005040 con 0x7f9f0c0fee00 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.427+0000 7f9f0b7fe700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400bbb0 tx=0x7f9f04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.428+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f040092e0 con 0x7f9f0c0fee00 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.428+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f0400cb00 con 0x7f9f0c0fee00 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.428+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c110e20 con 0x7f9f0c0fee00 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.428+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f04015d10 con 0x7f9f0c0fee00 2023-12-16T20:09:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.428+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c111360 con 0x7f9f0c0fee00 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.429+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c04bb80 con 0x7f9f0c0fee00 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.429+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9f04012070 con 0x7f9f0c0fee00 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.429+0000 7f9f03fff700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 0x7f9ef806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.430+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9f04086560 con 0x7f9f0c0fee00 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.430+0000 7f9f0affd700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 0x7f9ef806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.430+0000 7f9f0affd700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 0x7f9ef806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b3b0 tx=0x7f9ef4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.434+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9f04056800 con 0x7f9f0c0fee00 2023-12-16T20:09:21.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.628+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f9f0c1118c0 con 0x7f9f0c0fee00 2023-12-16T20:09:21.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.633+0000 7f9f03fff700 1 -- 172.21.15.38:0/804429263 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f9f04056390 con 0x7f9f0c0fee00 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 msgr2=0x7f9ef806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 0x7f9ef806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b3b0 tx=0x7f9ef4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 msgr2=0x7f9f0c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400bbb0 tx=0x7f9f04009840 comp rx=0 tx=0).stop 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 shutdown_connections 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ef8068f60 0x7f9ef806b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f0c0fee00 0x7f9f0c10f730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 --2- 172.21.15.38:0/804429263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f0c0fff70 0x7f9f0c10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 >> 172.21.15.38:0/804429263 conn(0x7f9f0c0fa5d0 msgr2=0x7f9f0c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 shutdown_connections 2023-12-16T20:09:21.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:21.636+0000 7f9f1216f700 1 -- 172.21.15.38:0/804429263 wait complete. 2023-12-16T20:09:21.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:21.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/804429263' entity='client.admin' 2023-12-16T20:09:21.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:21.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:21.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:21.941 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:21 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:21.965 INFO:teuthology.run_tasks:Running task print... 2023-12-16T20:09:21.976 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-16T20:09:21.976 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:21.985 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:21.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/804429263' entity='client.admin' 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:21 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 -- 172.21.15.38:0/732078364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fbaf0 msgr2=0x7fa3b80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/732078364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b80fbf00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8004940 tx=0x7fa3a8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 -- 172.21.15.38:0/732078364 shutdown_connections 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/732078364 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fcd00 0x7fa3b80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/732078364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b80fbf00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 -- 172.21.15.38:0/732078364 >> 172.21.15.38:0/732078364 conn(0x7fa3b80f7190 msgr2=0x7fa3b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 -- 172.21.15.38:0/732078364 shutdown_connections 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.934+0000 7fa3bc80e700 1 -- 172.21.15.38:0/732078364 wait complete. 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 Processor -- start 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 -- start start 2023-12-16T20:09:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b8112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8066060 con 0x7fa3b80fcd00 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3bc80e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80661a0 con 0x7fa3b80fbaf0 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59538/0 (socket says 172.21.15.38:59538) 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.935+0000 7fa3b5d9b700 1 -- 172.21.15.38:0/212083593 learned_addr learned my addr 172.21.15.38:0/212083593 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b659c700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b8112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b5d9b700 1 -- 172.21.15.38:0/212083593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 msgr2=0x7fa3b8112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b5d9b700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b8112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b5d9b700 1 -- 172.21.15.38:0/212083593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8005040 con 0x7fa3b80fcd00 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b659c700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b8112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3b5d9b700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c8c0 tx=0x7fa3ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac00a980 con 0x7fa3b80fcd00 2023-12-16T20:09:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b81150d0 con 0x7fa3b80fcd00 2023-12-16T20:09:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3ac00ce60 con 0x7fa3b80fcd00 2023-12-16T20:09:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac0113a0 con 0x7fa3b80fcd00 2023-12-16T20:09:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.936+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b8115530 con 0x7fa3b80fcd00 2023-12-16T20:09:22.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.937+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b804bb80 con 0x7fa3b80fcd00 2023-12-16T20:09:22.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.938+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa3ac012400 con 0x7fa3b80fcd00 2023-12-16T20:09:22.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.938+0000 7fa3a6ffd700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 0x7fa3a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:22.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.938+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa3ac086b70 con 0x7fa3b80fcd00 2023-12-16T20:09:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.938+0000 7fa3b659c700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 0x7fa3a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.939+0000 7fa3b659c700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 0x7fa3a006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009fd0 tx=0x7fa3a8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:22.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:22.946+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa3ac053380 con 0x7fa3b80fcd00 2023-12-16T20:09:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.157+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3b8101670 con 0x7fa3a0068f70 2023-12-16T20:09:23.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.158+0000 7fa3a6ffd700 1 -- 172.21.15.38:0/212083593 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa3b8101670 con 0x7fa3a0068f70 2023-12-16T20:09:23.158 INFO:teuthology.orchestra.run.smithi038.stdout:Backend: cephadm 2023-12-16T20:09:23.158 INFO:teuthology.orchestra.run.smithi038.stdout:Available: Yes 2023-12-16T20:09:23.159 INFO:teuthology.orchestra.run.smithi038.stdout:Paused: No 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 msgr2=0x7fa3a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 0x7fa3a006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009fd0 tx=0x7fa3a8009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 msgr2=0x7fa3b8114b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c8c0 tx=0x7fa3ac0044c0 comp rx=0 tx=0).stop 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 shutdown_connections 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa3a0068f70 0x7fa3a006b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80fbaf0 0x7fa3b8112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.160+0000 7fa3bc80e700 1 --2- 172.21.15.38:0/212083593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3b80fcd00 0x7fa3b8114b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.161+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 >> 172.21.15.38:0/212083593 conn(0x7fa3b80f7190 msgr2=0x7fa3b80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.161+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 shutdown_connections 2023-12-16T20:09:23.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:23.161+0000 7fa3bc80e700 1 -- 172.21.15.38:0/212083593 wait complete. 2023-12-16T20:09:23.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-16T20:09:23.720 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:23.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:23 smithi141 ceph-mon[88165]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:24.073 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:23 smithi038 ceph-mon[80659]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:24.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- 172.21.15.38:0/1580417880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 msgr2=0x7f65a8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 --2- 172.21.15.38:0/1580417880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a8102430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f659c004940 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- 172.21.15.38:0/1580417880 shutdown_connections 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 --2- 172.21.15.38:0/1580417880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a8102430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 --2- 172.21.15.38:0/1580417880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 0x7f65a80ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- 172.21.15.38:0/1580417880 >> 172.21.15.38:0/1580417880 conn(0x7f65a80f71d0 msgr2=0x7f65a80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- 172.21.15.38:0/1580417880 shutdown_connections 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- 172.21.15.38:0/1580417880 wait complete. 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 Processor -- start 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.375+0000 7f65ae75d700 1 -- start start 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65ae75d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 0x7f65a80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65ae75d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65ae75d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80fbcd0 con 0x7f65a8100050 2023-12-16T20:09:24.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65ae75d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80fbe40 con 0x7f65a80fd730 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59556/0 (socket says 172.21.15.38:59556) 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 -- 172.21.15.38:0/3343041047 learned_addr learned my addr 172.21.15.38:0/3343041047 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a7fff700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 0x7f65a80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 -- 172.21.15.38:0/3343041047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 msgr2=0x7f65a80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 0x7f65a80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 -- 172.21.15.38:0/3343041047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c005040 con 0x7f65a8100050 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a77fe700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f659c009360 tx=0x7f659c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659c00e040 con 0x7f65a8100050 2023-12-16T20:09:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a80fc0c0 con 0x7f65a8100050 2023-12-16T20:09:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f659c00bcd0 con 0x7f65a8100050 2023-12-16T20:09:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.376+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659c01c630 con 0x7f65a8100050 2023-12-16T20:09:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.377+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8115560 con 0x7f65a8100050 2023-12-16T20:09:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.377+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a804bb80 con 0x7f65a8100050 2023-12-16T20:09:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.378+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f659c013960 con 0x7f65a8100050 2023-12-16T20:09:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.378+0000 7f65a4ff9700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 0x7f659006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.379+0000 7f65a7fff700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 0x7f659006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.379+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f659c087f20 con 0x7f65a8100050 2023-12-16T20:09:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.379+0000 7f65a7fff700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 0x7f659006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.383+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f659c0b9a00 con 0x7f65a8100050 2023-12-16T20:09:24.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.587+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a8100cb0 con 0x7f6590068f60 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.596+0000 7f65a4ff9700 1 -- 172.21.15.38:0/3343041047 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f65a8100cb0 con 0x7f6590068f60 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (2m) 82s ago 3m 25.6M - 0.25.0 c8568f914cd2 3b37fdee0436 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (3m) 82s ago 3m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (2m) 36s ago 2m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (2m) 82s ago 2m 78.2M - 9.4.7 954c08fa6188 aef7cc507220 2023-12-16T20:09:24.596 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:9283 running (4m) 82s ago 4m 469M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6c2471ed13fc 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 running (2m) 36s ago 2m 432M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7b529681218a 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (4m) 82s ago 4m 40.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (2m) 36s ago 2m 40.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (3m) 82s ago 3m 14.1M - 1.5.0 0da6a335fe13 529b4731a151 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (2m) 36s ago 2m 15.4M - 1.5.0 0da6a335fe13 0c4b9420e095 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (2m) 82s ago 119s 35.3M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (102s) 82s ago 102s 37.7M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (85s) 82s ago 85s 11.0M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (70s) 36s ago 70s 39.6M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (54s) 36s ago 54s 37.4M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (38s) 36s ago 37s 13.5M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:09:24.597 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 82s ago 2m 31.5M - 2.43.0 a07b618ecd1d aa5366916390 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 msgr2=0x7f659006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 0x7f659006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 msgr2=0x7f65a80fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f659c009360 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 shutdown_connections 2023-12-16T20:09:24.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6590068f60 0x7f659006b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65a80fd730 0x7f65a80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 --2- 172.21.15.38:0/3343041047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65a8100050 0x7f65a80fb640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:24.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 >> 172.21.15.38:0/3343041047 conn(0x7f65a80f71d0 msgr2=0x7f65a80f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:24.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 shutdown_connections 2023-12-16T20:09:24.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:24.598+0000 7f65ae75d700 1 -- 172.21.15.38:0/3343041047 wait complete. 2023-12-16T20:09:24.847 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:24 smithi038 ceph-mon[80659]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:24.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-16T20:09:24.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:24 smithi141 ceph-mon[88165]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:25.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:25 smithi038 ceph-mon[80659]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:25.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:25 smithi038 ceph-mon[80659]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2688456031 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 msgr2=0x7fc5ac0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2688456031 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac0ff7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009ce0 tx=0x7fc5a4004d10 comp rx=0 tx=0).stop 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2688456031 shutdown_connections 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2688456031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2688456031 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac0ff7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2688456031 >> 172.21.15.38:0/2688456031 conn(0x7fc5ac0f7190 msgr2=0x7fc5ac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2688456031 shutdown_connections 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2688456031 wait complete. 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 Processor -- start 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.948+0000 7fc5b3b9f700 1 -- start start 2023-12-16T20:09:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b3b9f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b3b9f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac10dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b3b9f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac10e2c0 con 0x7fc5ac066090 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b3b9f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac10eb00 con 0x7fc5ac0ffd70 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59566/0 (socket says 172.21.15.38:59566) 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 -- 172.21.15.38:0/2050593517 learned_addr learned my addr 172.21.15.38:0/2050593517 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b113a700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac10dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 -- 172.21.15.38:0/2050593517 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 msgr2=0x7fc5ac10dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac10dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 -- 172.21.15.38:0/2050593517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009940 con 0x7fc5ac066090 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b113a700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b193b700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4015040 tx=0x7fc5a4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a400e040 con 0x7fc5ac066090 2023-12-16T20:09:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5a40128c0 con 0x7fc5ac066090 2023-12-16T20:09:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac10ed80 con 0x7fc5ac066090 2023-12-16T20:09:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.949+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a401c840 con 0x7fc5ac066090 2023-12-16T20:09:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.950+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac10f2c0 con 0x7fc5ac066090 2023-12-16T20:09:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.950+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac04bb80 con 0x7fc5ac066090 2023-12-16T20:09:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.951+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc5a4012a30 con 0x7fc5ac066090 2023-12-16T20:09:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.951+0000 7fc5aa7fc700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 0x7fc59406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.951+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc5a4088830 con 0x7fc5ac066090 2023-12-16T20:09:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.951+0000 7fc5b113a700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 0x7fc59406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.952+0000 7fc5b113a700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 0x7fc59406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac065dd0 tx=0x7fc5a0008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:25.956+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc5a4058a30 con 0x7fc5ac066090 2023-12-16T20:09:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.159+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5ac10f760 con 0x7fc594068f60 2023-12-16T20:09:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.163+0000 7fc5aa7fc700 1 -- 172.21.15.38:0/2050593517 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fc5ac10f760 con 0x7fc594068f60 2023-12-16T20:09:26.163 INFO:teuthology.orchestra.run.smithi038.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-16T20:09:26.163 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager ?:9093,9094 1/1 83s ago 3m count:1 2023-12-16T20:09:26.163 INFO:teuthology.orchestra.run.smithi038.stdout:crash 2/2 83s ago 3m * 2023-12-16T20:09:26.163 INFO:teuthology.orchestra.run.smithi038.stdout:grafana ?:3000 1/1 83s ago 3m count:1 2023-12-16T20:09:26.164 INFO:teuthology.orchestra.run.smithi038.stdout:mgr 2/2 83s ago 3m count:2 2023-12-16T20:09:26.164 INFO:teuthology.orchestra.run.smithi038.stdout:mon 2/2 83s ago 3m smithi038:172.21.15.38=smithi038;smithi141:172.21.15.141=smithi141;count:2 2023-12-16T20:09:26.164 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter ?:9100 2/2 83s ago 3m * 2023-12-16T20:09:26.164 INFO:teuthology.orchestra.run.smithi038.stdout:osd 6 83s ago - 2023-12-16T20:09:26.164 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus ?:9095 1/1 83s ago 3m count:1 2023-12-16T20:09:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 msgr2=0x7fc59406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 0x7fc59406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac065dd0 tx=0x7fc5a0008040 comp rx=0 tx=0).stop 2023-12-16T20:09:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 msgr2=0x7fc5ac10d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4015040 tx=0x7fc5a4004d10 comp rx=0 tx=0).stop 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 shutdown_connections 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fc594068f60 0x7fc59406b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5ac066090 0x7fc5ac10d6f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 --2- 172.21.15.38:0/2050593517 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5ac0ffd70 0x7fc5ac10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 >> 172.21.15.38:0/2050593517 conn(0x7fc5ac0f7190 msgr2=0x7fc5ac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 shutdown_connections 2023-12-16T20:09:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:26.165+0000 7fc5b3b9f700 1 -- 172.21.15.38:0/2050593517 wait complete. 2023-12-16T20:09:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:25 smithi141 ceph-mon[88165]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:25 smithi141 ceph-mon[88165]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:26.558 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-16T20:09:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 -- 172.21.15.38:0/1497973841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fcbf0 msgr2=0x7faab00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 --2- 172.21.15.38:0/1497973841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fcbf0 0x7faab00fd000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faaa4004940 tx=0x7faaa4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 -- 172.21.15.38:0/1497973841 shutdown_connections 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 --2- 172.21.15.38:0/1497973841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fde00 0x7faab00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 --2- 172.21.15.38:0/1497973841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fcbf0 0x7faab00fd000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 -- 172.21.15.38:0/1497973841 >> 172.21.15.38:0/1497973841 conn(0x7faab00f82d0 msgr2=0x7faab00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.503+0000 7faab6abc700 1 -- 172.21.15.38:0/1497973841 shutdown_connections 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 -- 172.21.15.38:0/1497973841 wait complete. 2023-12-16T20:09:27.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 Processor -- start 2023-12-16T20:09:27.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 -- start start 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fcbf0 0x7faab010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab010e0a0 con 0x7faab00fde00 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.504+0000 7faab6abc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab010e940 con 0x7faab00fcbf0 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59594/0 (socket says 172.21.15.38:59594) 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 -- 172.21.15.38:0/456304320 learned_addr learned my addr 172.21.15.38:0/456304320 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:27.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faab4858700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fcbf0 0x7faab010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 -- 172.21.15.38:0/456304320 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fcbf0 msgr2=0x7faab010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fcbf0 0x7faab010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 -- 172.21.15.38:0/456304320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4005040 con 0x7faab00fde00 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaaffff700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c830 tx=0x7faa9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c00a760 con 0x7faab00fde00 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab010ec20 con 0x7faab00fde00 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa9c00ad70 con 0x7faab00fde00 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c0113a0 con 0x7faab00fde00 2023-12-16T20:09:27.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.505+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab010f160 con 0x7faab00fde00 2023-12-16T20:09:27.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.507+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab004bb80 con 0x7faab00fde00 2023-12-16T20:09:27.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.507+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faa9c012400 con 0x7faab00fde00 2023-12-16T20:09:27.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.507+0000 7faaad7fa700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 0x7faaa006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:27.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.508+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa9c086ab0 con 0x7faab00fde00 2023-12-16T20:09:27.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.508+0000 7faab4858700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 0x7faaa006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:27.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.508+0000 7faab4858700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 0x7faaa006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faaa400b3b0 tx=0x7faaa4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:27.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.512+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faa9c056d50 con 0x7faab00fde00 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.715+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faab010f5f0 con 0x7faaa0068f60 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.716+0000 7faaad7fa700 1 -- 172.21.15.38:0/456304320 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7faab010f5f0 con 0x7faaa0068f60 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stdout:HOST ADDR LABELS STATUS 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 172.21.15.38 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stdout:smithi141 172.21.15.141 2023-12-16T20:09:27.717 INFO:teuthology.orchestra.run.smithi038.stdout:2 hosts in cluster 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 msgr2=0x7faaa006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 0x7faaa006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faaa400b3b0 tx=0x7faaa4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 msgr2=0x7faab010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c830 tx=0x7faa9c004470 comp rx=0 tx=0).stop 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 shutdown_connections 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faaa0068f60 0x7faaa006b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faab00fcbf0 0x7faab010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 --2- 172.21.15.38:0/456304320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faab00fde00 0x7faab010daa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 >> 172.21.15.38:0/456304320 conn(0x7faab00f82d0 msgr2=0x7faab0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:27.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 shutdown_connections 2023-12-16T20:09:27.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:27.719+0000 7faab6abc700 1 -- 172.21.15.38:0/456304320 wait complete. 2023-12-16T20:09:28.103 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:27 smithi038 ceph-mon[80659]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:28.104 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:27 smithi038 ceph-mon[80659]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:28.104 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:28.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-16T20:09:28.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:27 smithi141 ceph-mon[88165]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:28.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:27 smithi141 ceph-mon[88165]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:28.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:28.372 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:29.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 -- 172.21.15.38:0/3809219550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 msgr2=0x7f45440ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:29.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 --2- 172.21.15.38:0/3809219550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f45440ffb10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ce0 tx=0x7f453c004d10 comp rx=0 tx=0).stop 2023-12-16T20:09:29.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:28 smithi038 ceph-mon[80659]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 -- 172.21.15.38:0/3809219550 shutdown_connections 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 --2- 172.21.15.38:0/3809219550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 0x7f4544102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 --2- 172.21.15.38:0/3809219550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f45440ffb10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 -- 172.21.15.38:0/3809219550 >> 172.21.15.38:0/3809219550 conn(0x7f45440f7190 msgr2=0x7f45440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 -- 172.21.15.38:0/3809219550 shutdown_connections 2023-12-16T20:09:29.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.036+0000 7f454910e700 1 -- 172.21.15.38:0/3809219550 wait complete. 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 Processor -- start 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 -- start start 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 0x7f454410dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454410e1b0 con 0x7f45440fd730 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454910e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454410ea50 con 0x7f4544100050 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59616/0 (socket says 172.21.15.38:59616) 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 -- 172.21.15.38:0/739865904 learned_addr learned my addr 172.21.15.38:0/739865904 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f454259c700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 0x7f454410dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 -- 172.21.15.38:0/739865904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 msgr2=0x7f454410dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 0x7f454410dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 -- 172.21.15.38:0/739865904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c009940 con 0x7f45440fd730 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.037+0000 7f4542d9d700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f453c015040 tx=0x7f453c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.038+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453c00e040 con 0x7f45440fd730 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.038+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f453c0128c0 con 0x7f45440fd730 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.038+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453c01c7a0 con 0x7f45440fd730 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.038+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454410ecd0 con 0x7f45440fd730 2023-12-16T20:09:29.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.038+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454410f210 con 0x7f45440fd730 2023-12-16T20:09:29.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.039+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454404bb80 con 0x7f45440fd730 2023-12-16T20:09:29.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.039+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f453c012a30 con 0x7f45440fd730 2023-12-16T20:09:29.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.040+0000 7f453b7fe700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 0x7f453006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:29.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.040+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f453c088700 con 0x7f45440fd730 2023-12-16T20:09:29.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.040+0000 7f454259c700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 0x7f453006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:29.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.040+0000 7f454259c700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 0x7f453006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f452c0041d0 tx=0x7f452c0043c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.044+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f453c0589a0 con 0x7f45440fd730 2023-12-16T20:09:29.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:28 smithi141 ceph-mon[88165]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.250+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f454410f8d0 con 0x7f4530068f60 2023-12-16T20:09:29.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.251+0000 7f453b7fe700 1 -- 172.21.15.38:0/739865904 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f454410f8d0 con 0x7f4530068f60 2023-12-16T20:09:29.251 INFO:teuthology.orchestra.run.smithi038.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-16T20:09:29.251 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN 3726G No 84s ago Has a FileSystem, LVM detected 2023-12-16T20:09:29.252 INFO:teuthology.orchestra.run.smithi038.stdout:smithi141 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6242001S400BGN 372G No 38s ago Has a FileSystem, LVM detected 2023-12-16T20:09:29.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 msgr2=0x7f453006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:29.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 0x7f453006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f452c0041d0 tx=0x7f452c0043c0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 msgr2=0x7f454410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:29.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f453c015040 tx=0x7f453c004d10 comp rx=0 tx=0).stop 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 shutdown_connections 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4530068f60 0x7f453006b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45440fd730 0x7f454410d670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 --2- 172.21.15.38:0/739865904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4544100050 0x7f454410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 >> 172.21.15.38:0/739865904 conn(0x7f45440f7190 msgr2=0x7f45440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 shutdown_connections 2023-12-16T20:09:29.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:29.253+0000 7f454910e700 1 -- 172.21.15.38:0/739865904 wait complete. 2023-12-16T20:09:29.497 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:29.508 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:29.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-16T20:09:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:30.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:29 smithi038 ceph-mon[80659]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:30.146 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:29 smithi141 ceph-mon[88165]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 -- 172.21.15.38:0/2875903325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 msgr2=0x7fa2140fcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 --2- 172.21.15.38:0/2875903325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa2140fcff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa208004940 tx=0x7fa208009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 -- 172.21.15.38:0/2875903325 shutdown_connections 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 --2- 172.21.15.38:0/2875903325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 0x7fa2140fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 --2- 172.21.15.38:0/2875903325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa2140fcff0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 -- 172.21.15.38:0/2875903325 >> 172.21.15.38:0/2875903325 conn(0x7fa2140f8360 msgr2=0x7fa2140fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 -- 172.21.15.38:0/2875903325 shutdown_connections 2023-12-16T20:09:30.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.478+0000 7fa219828700 1 -- 172.21.15.38:0/2875903325 wait complete. 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 Processor -- start 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 -- start start 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 0x7fa21410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21410e060 con 0x7fa2140fcbe0 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa219828700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21410e900 con 0x7fa2140fde90 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.479+0000 7fa212ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59638/0 (socket says 172.21.15.38:59638) 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 -- 172.21.15.38:0/2050332411 learned_addr learned my addr 172.21.15.38:0/2050332411 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa2127fc700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 0x7fa21410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:30.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 -- 172.21.15.38:0/2050332411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 msgr2=0x7fa21410da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 0x7fa21410da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 -- 172.21.15.38:0/2050332411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208005040 con 0x7fa2140fcbe0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa212ffd700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa208009fd0 tx=0x7fa208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20800e040 con 0x7fa2140fcbe0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa208004290 con 0x7fa2140fcbe0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21410eb80 con 0x7fa2140fcbe0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20801c3f0 con 0x7fa2140fcbe0 2023-12-16T20:09:30.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.480+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21410f0c0 con 0x7fa2140fcbe0 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.481+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21404bb80 con 0x7fa2140fcbe0 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.482+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa208013420 con 0x7fa2140fcbe0 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.482+0000 7fa1fb7fe700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 0x7fa1fc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.482+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa208087ed0 con 0x7fa2140fcbe0 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.482+0000 7fa2127fc700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 0x7fa1fc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:30.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.483+0000 7fa2127fc700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 0x7fa1fc06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa204007fd0 tx=0x7fa204009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:30.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.487+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa2080580f0 con 0x7fa2140fcbe0 2023-12-16T20:09:30.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:30.711+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa21410f7a0 con 0x7fa1fc068f70 2023-12-16T20:09:31.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:31 smithi141 ceph-mon[88165]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:31.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:31 smithi038 ceph-mon[80659]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:32.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.227+0000 7fa1fb7fe700 1 -- 172.21.15.38:0/2050332411 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa21410f7a0 con 0x7fa1fc068f70 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 msgr2=0x7fa1fc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 0x7fa1fc06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa204007fd0 tx=0x7fa204009040 comp rx=0 tx=0).stop 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 msgr2=0x7fa21410d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa208009fd0 tx=0x7fa208009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 shutdown_connections 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa1fc068f70 0x7fa1fc06b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2140fcbe0 0x7fa21410d520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 --2- 172.21.15.38:0/2050332411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2140fde90 0x7fa21410da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.232+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 >> 172.21.15.38:0/2050332411 conn(0x7fa2140f8360 msgr2=0x7fa2141010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.233+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 shutdown_connections 2023-12-16T20:09:32.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:32.233+0000 7fa219828700 1 -- 172.21.15.38:0/2050332411 wait complete. 2023-12-16T20:09:32.455 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T20:09:32.456 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:32 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[80655]: 2023-12-16T20:09:32.205+0000 7f910ff91700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T20:09:32.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T20:09:32.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:09:32.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T20:09:32.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:32.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T20:09:32.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T20:09:32.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:32 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T20:09:32.971 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:33.330 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: fsmap cephfs:0 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: Saving service mds.cephfs spec with placement count:4 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:33.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:33.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:33.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:33.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: Deploying daemon mds.cephfs.smithi038.dbcjir on smithi038 2023-12-16T20:09:33.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:33 smithi038 ceph-mon[80659]: pgmap v114: 65 pgs: 9 creating+peering, 4 active+clean, 52 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T20:09:33.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: fsmap cephfs:0 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: Saving service mds.cephfs spec with placement count:4 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: Deploying daemon mds.cephfs.smithi038.dbcjir on smithi038 2023-12-16T20:09:33.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:33 smithi141 ceph-mon[88165]: pgmap v114: 65 pgs: 9 creating+peering, 4 active+clean, 52 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 -- 172.21.15.38:0/3584491464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00faed0 msgr2=0x7f4eb00fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 --2- 172.21.15.38:0/3584491464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00faed0 0x7f4eb00fb2e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0004940 tx=0x7f4ea0009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 -- 172.21.15.38:0/3584491464 shutdown_connections 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 --2- 172.21.15.38:0/3584491464 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00fdf60 0x7f4eb00fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 --2- 172.21.15.38:0/3584491464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00faed0 0x7f4eb00fb2e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 -- 172.21.15.38:0/3584491464 >> 172.21.15.38:0/3584491464 conn(0x7f4eb00f6950 msgr2=0x7f4eb00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 -- 172.21.15.38:0/3584491464 shutdown_connections 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 -- 172.21.15.38:0/3584491464 wait complete. 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.918+0000 7f4eb787b700 1 Processor -- start 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb787b700 1 -- start start 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb787b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00faed0 0x7f4eb010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb787b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb787b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb010e120 con 0x7f4eb00fdf60 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb787b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb010e9c0 con 0x7f4eb00faed0 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59554/0 (socket says 172.21.15.38:59554) 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 -- 172.21.15.38:0/2683082834 learned_addr learned my addr 172.21.15.38:0/2683082834 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb5617700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00faed0 0x7f4eb010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 -- 172.21.15.38:0/2683082834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00faed0 msgr2=0x7f4eb010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00faed0 0x7f4eb010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 -- 172.21.15.38:0/2683082834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0005040 con 0x7f4eb00fdf60 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4eb4e16700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4eac002a50 tx=0x7f4eac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.919+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac007cc0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.920+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb010eca0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.920+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4eac00f040 con 0x7f4eb00fdf60 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.920+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac00d9c0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.920+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb010f1e0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.921+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb01075f0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.921+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4eac00db20 con 0x7f4eb00fdf60 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.922+0000 7f4ea5ffb700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 0x7f4e9c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.922+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4eac086ad0 con 0x7f4eb00fdf60 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.922+0000 7f4eb5617700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 0x7f4e9c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.922+0000 7f4eb5617700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 0x7f4e9c06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b3b0 tx=0x7f4ea0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:33.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:33.927+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4eac0569b0 con 0x7f4eb00fdf60 2023-12-16T20:09:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.190+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4eb010f400 con 0x7f4eb00fdf60 2023-12-16T20:09:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.190+0000 7f4ea5ffb700 1 -- 172.21.15.38:0/2683082834 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f4eac056540 con 0x7f4eb00fdf60 2023-12-16T20:09:34.191 INFO:teuthology.orchestra.run.smithi038.stdout:e2 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 2 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:09:32.206321+0000 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:09:34.192 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 1 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:in 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:up {} 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:09:34.193 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:09:34.194 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:09:34.194 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 0 2023-12-16T20:09:34.194 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:34.194 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 msgr2=0x7f4e9c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 0x7f4e9c06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b3b0 tx=0x7f4ea0009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 msgr2=0x7f4eb010db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4eac002a50 tx=0x7f4eac0046b0 comp rx=0 tx=0).stop 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 shutdown_connections 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4e9c068f60 0x7f4e9c06b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb00faed0 0x7f4eb010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 --2- 172.21.15.38:0/2683082834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4eb00fdf60 0x7f4eb010db20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 >> 172.21.15.38:0/2683082834 conn(0x7f4eb00f6950 msgr2=0x7f4eb00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 shutdown_connections 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:34.193+0000 7f4eb787b700 1 -- 172.21.15.38:0/2683082834 wait complete. 2023-12-16T20:09:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 2 2023-12-16T20:09:34.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:34 smithi141 ceph-mon[88165]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T20:09:34.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:34 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2683082834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:09:34.497 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:34 smithi038 ceph-mon[80659]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T20:09:34.497 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:34 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2683082834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:09:34.523 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:34.543 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:34.543 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-16T20:09:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: Deploying daemon mds.cephfs.smithi141.xhutny on smithi141 2023-12-16T20:09:35.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:35 smithi141 ceph-mon[88165]: pgmap v117: 65 pgs: 9 creating+peering, 29 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- 172.21.15.38:0/1031066063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 msgr2=0x7f98240fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 --2- 172.21.15.38:0/1031066063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f98240fd000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9814004940 tx=0x7f9814009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- 172.21.15.38:0/1031066063 shutdown_connections 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 --2- 172.21.15.38:0/1031066063 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 0x7f98240fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 --2- 172.21.15.38:0/1031066063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f98240fd000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- 172.21.15.38:0/1031066063 >> 172.21.15.38:0/1031066063 conn(0x7f98240f82d0 msgr2=0x7f98240fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- 172.21.15.38:0/1031066063 shutdown_connections 2023-12-16T20:09:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- 172.21.15.38:0/1031066063 wait complete. 2023-12-16T20:09:35.519 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: Deploying daemon mds.cephfs.smithi141.xhutny on smithi141 2023-12-16T20:09:35.520 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:35 smithi038 ceph-mon[80659]: pgmap v117: 65 pgs: 9 creating+peering, 29 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T20:09:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 Processor -- start 2023-12-16T20:09:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.518+0000 7f9829345700 1 -- start start 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9829345700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9829345700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 0x7f982406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9829345700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982406f850 con 0x7f98240fcbf0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9829345700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824117060 con 0x7f98240fde00 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59598/0 (socket says 172.21.15.38:59598) 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 -- 172.21.15.38:0/3816826202 learned_addr learned my addr 172.21.15.38:0/3816826202 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f98227fc700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 0x7f982406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 -- 172.21.15.38:0/3816826202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 msgr2=0x7f982406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 0x7f982406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 -- 172.21.15.38:0/3816826202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814005040 con 0x7f98240fcbf0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f9822ffd700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.519+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9814021070 con 0x7f98240fcbf0 2023-12-16T20:09:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.520+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f981401c400 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.520+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98241172b0 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.520+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981400e070 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.520+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9824117790 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.521+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982404bb80 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.521+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f981401ca00 con 0x7f98240fcbf0 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.522+0000 7f980b7fe700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 0x7f980c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.522+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9814087eb0 con 0x7f98240fcbf0 2023-12-16T20:09:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.522+0000 7f98227fc700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 0x7f980c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.522+0000 7f98227fc700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 0x7f980c06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9818009b80 tx=0x7f981800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.526+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9814057eb0 con 0x7f98240fcbf0 2023-12-16T20:09:35.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:35.766+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f9824117d00 con 0x7f98240fcbf0 2023-12-16T20:09:36.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.226+0000 7f980b7fe700 1 -- 172.21.15.38:0/3816826202 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9814057a40 con 0x7f98240fcbf0 2023-12-16T20:09:36.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 msgr2=0x7f980c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:36.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 0x7f980c06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9818009b80 tx=0x7f981800b040 comp rx=0 tx=0).stop 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 msgr2=0x7f982406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 shutdown_connections 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f980c068f60 0x7f980c06b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98240fcbf0 0x7f982406ed10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 --2- 172.21.15.38:0/3816826202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98240fde00 0x7f982406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 >> 172.21.15.38:0/3816826202 conn(0x7f98240f82d0 msgr2=0x7f9824101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 shutdown_connections 2023-12-16T20:09:36.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:36.229+0000 7f9829345700 1 -- 172.21.15.38:0/3816826202 wait complete. 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6826/1754224692,v1:172.21.15.38:6827/1754224692] up:boot 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: daemon mds.cephfs.smithi038.dbcjir assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: Cluster is now healthy 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: fsmap cephfs:0 1 up:standby 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: fsmap cephfs:1 {0=cephfs.smithi038.dbcjir=up:creating} 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: daemon mds.cephfs.smithi038.dbcjir is now active in filesystem cephfs as rank 0 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3816826202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.490 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.490 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:36.490 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:36.490 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:36 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6826/1754224692,v1:172.21.15.38:6827/1754224692] up:boot 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: daemon mds.cephfs.smithi038.dbcjir assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: Cluster is now healthy 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: fsmap cephfs:0 1 up:standby 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: fsmap cephfs:1 {0=cephfs.smithi038.dbcjir=up:creating} 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: daemon mds.cephfs.smithi038.dbcjir is now active in filesystem cephfs as rank 0 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3816826202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:36.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:36.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:36.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:36 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:36.517 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:36.529 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:36.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2023-12-16T20:09:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: Deploying daemon mds.cephfs.smithi038.aofkae on smithi038 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6826/1754224692,v1:172.21.15.38:6827/1754224692] up:active 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3816826202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:boot 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: daemon mds.cephfs.smithi141.xhutny assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T20:09:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: fsmap cephfs:1 {0=cephfs.smithi038.dbcjir=up:active} 1 up:standby 2023-12-16T20:09:37.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:09:37.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:creating} 2023-12-16T20:09:37.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: daemon mds.cephfs.smithi141.xhutny is now active in filesystem cephfs as rank 1 2023-12-16T20:09:37.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:37 smithi038 ceph-mon[80659]: pgmap v118: 65 pgs: 9 creating+peering, 53 active+clean, 3 unknown; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 678 B/s wr, 6 op/s 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: Deploying daemon mds.cephfs.smithi038.aofkae on smithi038 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6826/1754224692,v1:172.21.15.38:6827/1754224692] up:active 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3816826202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:boot 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: daemon mds.cephfs.smithi141.xhutny assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: fsmap cephfs:1 {0=cephfs.smithi038.dbcjir=up:active} 1 up:standby 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:09:37.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:creating} 2023-12-16T20:09:37.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: daemon mds.cephfs.smithi141.xhutny is now active in filesystem cephfs as rank 1 2023-12-16T20:09:37.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:37 smithi141 ceph-mon[88165]: pgmap v118: 65 pgs: 9 creating+peering, 53 active+clean, 3 unknown; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 678 B/s wr, 6 op/s 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 -- 172.21.15.38:0/560960010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa264066900 msgr2=0x7fa2640ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/560960010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa264066900 0x7fa2640ff7d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa260004940 tx=0x7fa260009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 -- 172.21.15.38:0/560960010 shutdown_connections 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/560960010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2640ffd10 0x7fa264102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/560960010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa264066900 0x7fa2640ff7d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 -- 172.21.15.38:0/560960010 >> 172.21.15.38:0/560960010 conn(0x7fa2640f7240 msgr2=0x7fa2640f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 -- 172.21.15.38:0/560960010 shutdown_connections 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.730+0000 7fa26c7a2700 1 -- 172.21.15.38:0/560960010 wait complete. 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 Processor -- start 2023-12-16T20:09:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 -- start start 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 0x7fa26406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406f8f0 con 0x7fa2640ffd10 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.731+0000 7fa26c7a2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2641170e0 con 0x7fa264066900 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59618/0 (socket says 172.21.15.38:59618) 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 -- 172.21.15.38:0/583492510 learned_addr learned my addr 172.21.15.38:0/583492510 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa26a53e700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 0x7fa26406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 -- 172.21.15.38:0/583492510 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 msgr2=0x7fa26406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 0x7fa26406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 -- 172.21.15.38:0/583492510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260005040 con 0x7fa2640ffd10 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa26a53e700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 0x7fa26406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa269d3d700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa254011ee0 tx=0x7fa2540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254007ea0 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2540090d0 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254019620 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2641173c0 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.732+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2641178d0 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.734+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa264068df0 con 0x7fa2640ffd10 2023-12-16T20:09:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.734+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa254009240 con 0x7fa2640ffd10 2023-12-16T20:09:37.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.735+0000 7fa25affd700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 0x7fa25006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:37.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.735+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa25408b100 con 0x7fa2640ffd10 2023-12-16T20:09:37.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.735+0000 7fa26a53e700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 0x7fa25006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:37.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.735+0000 7fa26a53e700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 0x7fa25006b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa26000b7d0 tx=0x7fa260009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:37.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.739+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa254057680 con 0x7fa2640ffd10 2023-12-16T20:09:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:37.990+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fa2640faf60 con 0x7fa2640ffd10 2023-12-16T20:09:38.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:active 2023-12-16T20:09:38.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2023-12-16T20:09:38.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:38.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:38 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/583492510' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-16T20:09:38.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:active 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:38 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/583492510' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-16T20:09:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.722+0000 7fa25affd700 1 -- 172.21.15.38:0/583492510 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa25405aca0 con 0x7fa2640ffd10 2023-12-16T20:09:38.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 msgr2=0x7fa25006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:38.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 0x7fa25006b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa26000b7d0 tx=0x7fa260009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 msgr2=0x7fa26406f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa254011ee0 tx=0x7fa2540046b0 comp rx=0 tx=0).stop 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 shutdown_connections 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa250068f70 0x7fa25006b420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa264066900 0x7fa26406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 --2- 172.21.15.38:0/583492510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2640ffd10 0x7fa26406f2a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 >> 172.21.15.38:0/583492510 conn(0x7fa2640f7240 msgr2=0x7fa2640f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.725+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 shutdown_connections 2023-12-16T20:09:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:38.726+0000 7fa26c7a2700 1 -- 172.21.15.38:0/583492510 wait complete. 2023-12-16T20:09:38.982 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:38.996 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:38.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-16T20:09:39.272 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:39.494 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: Deploying daemon mds.cephfs.smithi141.eyrunj on smithi141 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: Cluster is now healthy 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:boot 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/583492510' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: pgmap v119: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2023-12-16T20:09:39.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:39 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: Deploying daemon mds.cephfs.smithi141.eyrunj on smithi141 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: Cluster is now healthy 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:boot 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/583492510' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: pgmap v119: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2023-12-16T20:09:39.620 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:39 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.969+0000 7f43e96bb700 1 -- 172.21.15.38:0/1648471121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 msgr2=0x7f43e40ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.969+0000 7f43e96bb700 1 --2- 172.21.15.38:0/1648471121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e40ffb10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f43d4004940 tx=0x7f43d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 -- 172.21.15.38:0/1648471121 shutdown_connections 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 --2- 172.21.15.38:0/1648471121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 0x7f43e4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 --2- 172.21.15.38:0/1648471121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e40ffb10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 -- 172.21.15.38:0/1648471121 >> 172.21.15.38:0/1648471121 conn(0x7f43e40f71b0 msgr2=0x7f43e40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:39.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 -- 172.21.15.38:0/1648471121 shutdown_connections 2023-12-16T20:09:39.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 -- 172.21.15.38:0/1648471121 wait complete. 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 Processor -- start 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.970+0000 7f43e96bb700 1 -- start start 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e96bb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e96bb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 0x7f43e410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e96bb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e410e020 con 0x7f43e40fd730 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e96bb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e410e8c0 con 0x7f43e4100050 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59654/0 (socket says 172.21.15.38:59654) 2023-12-16T20:09:39.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 -- 172.21.15.38:0/2053766146 learned_addr learned my addr 172.21.15.38:0/2053766146 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e27fc700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 0x7f43e410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 -- 172.21.15.38:0/2053766146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 msgr2=0x7f43e410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 0x7f43e410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 -- 172.21.15.38:0/2053766146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4005040 con 0x7f43e40fd730 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.971+0000 7f43e2ffd700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43d400b3b0 tx=0x7f43d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.972+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d400e040 con 0x7f43e40fd730 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.972+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43d4009b10 con 0x7f43e40fd730 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.972+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e410eb40 con 0x7f43e40fd730 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.972+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e410f080 con 0x7f43e40fd730 2023-12-16T20:09:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.972+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d401c630 con 0x7f43e40fd730 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.973+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e404bb80 con 0x7f43e40fd730 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.974+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f43d400bc50 con 0x7f43e40fd730 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.974+0000 7f43cb7fe700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 0x7f43cc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.974+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f43d4088170 con 0x7f43e40fd730 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.974+0000 7f43e27fc700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 0x7f43cc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.975+0000 7f43e27fc700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 0x7f43cc06b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43d8004f40 tx=0x7f43d800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:39.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:39.979+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f43d40580d0 con 0x7f43e40fd730 2023-12-16T20:09:40.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:40.270+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f43e4105580 con 0x7f43e40fd730 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] up:boot 2023-12-16T20:09:40.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:active 2023-12-16T20:09:40.532 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:40.532 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:09:40.532 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:40.532 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:40 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2053766146' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] up:boot 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] up:active 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:09:40.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:40.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:40 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2053766146' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-16T20:09:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.264+0000 7f43cb7fe700 1 -- 172.21.15.38:0/2053766146 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f43d4013e60 con 0x7f43e40fd730 2023-12-16T20:09:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 msgr2=0x7f43cc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 0x7f43cc06b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43d8004f40 tx=0x7f43d800b040 comp rx=0 tx=0).stop 2023-12-16T20:09:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 msgr2=0x7f43e410d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43d400b3b0 tx=0x7f43d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 shutdown_connections 2023-12-16T20:09:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f43cc068f60 0x7f43cc06b410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e40fd730 0x7f43e410d4e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 --2- 172.21.15.38:0/2053766146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e4100050 0x7f43e410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 >> 172.21.15.38:0/2053766146 conn(0x7f43e40f71b0 msgr2=0x7f43e40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 shutdown_connections 2023-12-16T20:09:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:41.267+0000 7f43e96bb700 1 -- 172.21.15.38:0/2053766146 wait complete. 2023-12-16T20:09:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:inline data disabled 2023-12-16T20:09:41.580 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:41 smithi038 ceph-mon[80659]: pgmap v120: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 2.9 KiB/s wr, 8 op/s 2023-12-16T20:09:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:41 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:41 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:41 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2053766146' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-16T20:09:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:41 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:41.582 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T20:09:41.623 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:41.624 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T20:09:41.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:41 smithi141 ceph-mon[88165]: pgmap v120: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 2.9 KiB/s wr, 8 op/s 2023-12-16T20:09:41.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:41 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:41.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:41 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:41.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:41 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2053766146' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-16T20:09:41.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:41 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 -- 172.21.15.38:0/2681769188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 msgr2=0x7faf240fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 --2- 172.21.15.38:0/2681769188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf240fd000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faf14004940 tx=0x7faf14009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 -- 172.21.15.38:0/2681769188 shutdown_connections 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 --2- 172.21.15.38:0/2681769188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf240fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 --2- 172.21.15.38:0/2681769188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf240fd000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 -- 172.21.15.38:0/2681769188 >> 172.21.15.38:0/2681769188 conn(0x7faf240f82d0 msgr2=0x7faf240fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:42.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 -- 172.21.15.38:0/2681769188 shutdown_connections 2023-12-16T20:09:42.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.722+0000 7faf299f0700 1 -- 172.21.15.38:0/2681769188 wait complete. 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.723+0000 7faf299f0700 1 Processor -- start 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf299f0700 1 -- start start 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf299f0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf2410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf299f0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf299f0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2410e170 con 0x7faf240fcbf0 2023-12-16T20:09:42.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf299f0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2410e9b0 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:34626/0 (socket says 172.21.15.38:34626) 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 -- 172.21.15.38:0/1011964845 learned_addr learned my addr 172.21.15.38:0/1011964845 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf22ffd700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf2410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 -- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 msgr2=0x7faf2410d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf2410d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.724+0000 7faf227fc700 1 -- 172.21.15.38:0/1011964845 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14005040 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf227fc700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b790 tx=0x7faf18009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1800f6f0 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf1800fd00 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2410ec90 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf180103a0 con 0x7faf240fde00 2023-12-16T20:09:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.725+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2410f1d0 con 0x7faf240fde00 2023-12-16T20:09:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.726+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2404bb80 con 0x7faf240fde00 2023-12-16T20:09:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.726+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faf18010500 con 0x7faf240fde00 2023-12-16T20:09:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.727+0000 7faf0b7fe700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 0x7faf0c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.727+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faf18086c90 con 0x7faf240fde00 2023-12-16T20:09:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.727+0000 7faf22ffd700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 0x7faf0c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.727+0000 7faf22ffd700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 0x7faf0c06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf140043d0 tx=0x7faf14009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:42.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:42.732+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faf18056b40 con 0x7faf240fde00 2023-12-16T20:09:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.002+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf2410f5e0 con 0x7faf240fde00 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.003+0000 7faf0b7fe700 1 -- 172.21.15.38:0/1011964845 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1635 (secure 0 0 0) 0x7faf180566d0 con 0x7faf240fde00 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stdout:e14 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:09:43.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 14 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:09:42.440326+0000 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:09:43.005 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:09:43.006 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:09:43.007 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:43.007 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 msgr2=0x7faf0c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 0x7faf0c06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf140043d0 tx=0x7faf14009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 msgr2=0x7faf2410dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b790 tx=0x7faf18009250 comp rx=0 tx=0).stop 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 shutdown_connections 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7faf0c068f70 0x7faf0c06b420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf240fcbf0 0x7faf2410d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 --2- 172.21.15.38:0/1011964845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf240fde00 0x7faf2410dae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 >> 172.21.15.38:0/1011964845 conn(0x7faf240f82d0 msgr2=0x7faf24101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 shutdown_connections 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:43.006+0000 7faf299f0700 1 -- 172.21.15.38:0/1011964845 wait complete. 2023-12-16T20:09:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 14 2023-12-16T20:09:43.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:standby-replay 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: Dropping low affinity active daemon mds.cephfs.smithi038.dbcjir in favor of higher affinity standby. 2023-12-16T20:09:43.320 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: Replacing daemon mds.cephfs.smithi038.dbcjir as rank 0 with standby daemon mds.cephfs.smithi038.aofkae 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:replay,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: pgmap v122: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.321 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:43 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1011964845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:09:43.541 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:standby-replay 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: Dropping low affinity active daemon mds.cephfs.smithi038.dbcjir in favor of higher affinity standby. 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: Replacing daemon mds.cephfs.smithi038.dbcjir as rank 0 with standby daemon mds.cephfs.smithi038.aofkae 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-16T20:09:43.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.dbcjir=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:replay,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: pgmap v122: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:43.633 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:43 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1011964845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] up:boot 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:resolve 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] up:standby-replay 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:resolve,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:44.621 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:44 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] up:boot 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:resolve 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] up:standby-replay 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:resolve,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:44 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 -- 172.21.15.38:0/2395118244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fcd00 msgr2=0x7f88980fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 --2- 172.21.15.38:0/2395118244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fcd00 0x7f88980fd150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f888c004940 tx=0x7f888c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 -- 172.21.15.38:0/2395118244 shutdown_connections 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 --2- 172.21.15.38:0/2395118244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fcd00 0x7f88980fd150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 --2- 172.21.15.38:0/2395118244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fbaf0 0x7f88980fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 -- 172.21.15.38:0/2395118244 >> 172.21.15.38:0/2395118244 conn(0x7f88980f7190 msgr2=0x7f88980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 -- 172.21.15.38:0/2395118244 shutdown_connections 2023-12-16T20:09:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.805+0000 7f889dbee700 1 -- 172.21.15.38:0/2395118244 wait complete. 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.806+0000 7f889dbee700 1 Processor -- start 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.806+0000 7f889dbee700 1 -- start start 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.806+0000 7f889dbee700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f889dbee700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fcd00 0x7f88981127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f889dbee700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980661a0 con 0x7f88980fbaf0 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f889dbee700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980662e0 con 0x7f88980fcd00 2023-12-16T20:09:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56678/0 (socket says 172.21.15.38:56678) 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 -- 172.21.15.38:0/3873402251 learned_addr learned my addr 172.21.15.38:0/3873402251 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f8896ffd700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fcd00 0x7f88981127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 -- 172.21.15.38:0/3873402251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fcd00 msgr2=0x7f88981127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fcd00 0x7f88981127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.807+0000 7f88977fe700 1 -- 172.21.15.38:0/3873402251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c005040 con 0x7f88980fbaf0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f88977fe700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f888800b790 tx=0x7f8888009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f888800f6f0 con 0x7f88980fbaf0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f888800fd00 con 0x7f88980fbaf0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8898112e70 con 0x7f88980fbaf0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8888011e30 con 0x7f88980fbaf0 2023-12-16T20:09:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.808+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8898113320 con 0x7f88980fbaf0 2023-12-16T20:09:44.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.809+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889804bb80 con 0x7f88980fbaf0 2023-12-16T20:09:44.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.810+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f888800f850 con 0x7f88980fbaf0 2023-12-16T20:09:44.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.810+0000 7f887ffff700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 0x7f888006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:44.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.811+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8888086ad0 con 0x7f88980fbaf0 2023-12-16T20:09:44.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.811+0000 7f8896ffd700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 0x7f888006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:44.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.812+0000 7f8896ffd700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 0x7f888006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f888c004890 tx=0x7f888c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:44.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:44.816+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8888052ff0 con 0x7f88980fbaf0 2023-12-16T20:09:45.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.063+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8898104530 con 0x7f88980fbaf0 2023-12-16T20:09:45.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.064+0000 7f887ffff700 1 -- 172.21.15.38:0/3873402251 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f8888056610 con 0x7f88980fbaf0 2023-12-16T20:09:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 msgr2=0x7f888006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 0x7f888006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f888c004890 tx=0x7f888c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 msgr2=0x7f8898110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f888800b790 tx=0x7f8888009220 comp rx=0 tx=0).stop 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 shutdown_connections 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f8880068f60 0x7f888006b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88980fbaf0 0x7f8898110290 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 --2- 172.21.15.38:0/3873402251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88980fcd00 0x7f88981127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 >> 172.21.15.38:0/3873402251 conn(0x7f88980f7190 msgr2=0x7f88980fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 shutdown_connections 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:45.066+0000 7f889dbee700 1 -- 172.21.15.38:0/3873402251 wait complete. 2023-12-16T20:09:45.068 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-16T20:09:45.077 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:09:45.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-16T20:09:45.613 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:45 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:reconnect 2023-12-16T20:09:45.613 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:45 smithi038 ceph-mon[80659]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:reconnect,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:45.613 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:45 smithi038 ceph-mon[80659]: pgmap v123: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2023-12-16T20:09:45.613 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:45 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3873402251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T20:09:45.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:45 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:reconnect 2023-12-16T20:09:45.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:45 smithi141 ceph-mon[88165]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:reconnect,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:45.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:45 smithi141 ceph-mon[88165]: pgmap v123: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2023-12-16T20:09:45.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:45 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3873402251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T20:09:45.772 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:46.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.581+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2146811461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fcbf0 msgr2=0x7fef940fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.581+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2146811461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fcbf0 0x7fef940fd000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef90004940 tx=0x7fef90009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2146811461 shutdown_connections 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2146811461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fde00 0x7fef940fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2146811461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fcbf0 0x7fef940fd000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2146811461 >> 172.21.15.38:0/2146811461 conn(0x7fef940f82d0 msgr2=0x7fef940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2146811461 shutdown_connections 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2146811461 wait complete. 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 Processor -- start 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- start start 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fcbf0 0x7fef94071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94070590 con 0x7fef940fde00 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef9b9ae700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94070700 con 0x7fef940fcbf0 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef98f49700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef98f49700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56696/0 (socket says 172.21.15.38:56696) 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.582+0000 7fef98f49700 1 -- 172.21.15.38:0/2415579358 learned_addr learned my addr 172.21.15.38:0/2415579358 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef9974a700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fcbf0 0x7fef94071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef98f49700 1 -- 172.21.15.38:0/2415579358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fcbf0 msgr2=0x7fef94071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef98f49700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fcbf0 0x7fef94071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef98f49700 1 -- 172.21.15.38:0/2415579358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90005040 con 0x7fef940fde00 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef98f49700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef84002a50 tx=0x7fef840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef84007cc0 con 0x7fef940fde00 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef940709e0 con 0x7fef940fde00 2023-12-16T20:09:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef8400f040 con 0x7fef940fde00 2023-12-16T20:09:46.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8400d9c0 con 0x7fef940fde00 2023-12-16T20:09:46.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.583+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef94115590 con 0x7fef940fde00 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.584+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9404bb80 con 0x7fef940fde00 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.585+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fef8400db20 con 0x7fef940fde00 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.585+0000 7fef89ffb700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 0x7fef8006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.585+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fef84086a30 con 0x7fef940fde00 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.585+0000 7fef9974a700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 0x7fef8006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.586+0000 7fef9974a700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 0x7fef8006b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef9000b7d0 tx=0x7fef90009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:46.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.589+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fef84056940 con 0x7fef940fde00 2023-12-16T20:09:46.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:rejoin 2023-12-16T20:09:46.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:rejoin,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:46.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: daemon mds.cephfs.smithi038.aofkae is now active in filesystem cephfs as rank 0 2023-12-16T20:09:46.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:46 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.873+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fef94105590 con 0x7fef940fde00 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:rejoin 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: fsmap cephfs:2/2 {0=cephfs.smithi038.aofkae=up:rejoin,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: daemon mds.cephfs.smithi038.aofkae is now active in filesystem cephfs as rank 0 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:09:46.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:46 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:46.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.873+0000 7fef89ffb700 1 -- 172.21.15.38:0/2415579358 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+99 (secure 0 0 0) 0x7fef840564d0 con 0x7fef940fde00 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 msgr2=0x7fef8006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 0x7fef8006b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef9000b7d0 tx=0x7fef90009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 msgr2=0x7fef9406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef84002a50 tx=0x7fef840046b0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 shutdown_connections 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fef80068f60 0x7fef8006b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef940fcbf0 0x7fef94071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 --2- 172.21.15.38:0/2415579358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef940fde00 0x7fef9406ff90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:46.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 >> 172.21.15.38:0/2415579358 conn(0x7fef940f82d0 msgr2=0x7fef94101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:46.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 shutdown_connections 2023-12-16T20:09:46.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:46.877+0000 7fef9b9ae700 1 -- 172.21.15.38:0/2415579358 wait complete. 2023-12-16T20:09:46.888 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:09:47.112 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-16T20:09:47.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:09:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 -- 172.21.15.38:0/2245389216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400faed0 msgr2=0x7f86400fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 --2- 172.21.15.38:0/2245389216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400faed0 0x7f86400fb2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f863c0048d0 tx=0x7f863c009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 -- 172.21.15.38:0/2245389216 shutdown_connections 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 --2- 172.21.15.38:0/2245389216 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400fc060 0x7f86400fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 --2- 172.21.15.38:0/2245389216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400faed0 0x7f86400fb2e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 -- 172.21.15.38:0/2245389216 >> 172.21.15.38:0/2245389216 conn(0x7f86400f65f0 msgr2=0x7f86400f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 -- 172.21.15.38:0/2245389216 shutdown_connections 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.277+0000 7f86484ae640 1 -- 172.21.15.38:0/2245389216 wait complete. 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 Processor -- start 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 -- start start 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400faed0 0x7f864010c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864010d2b0 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f86484ae640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640111d00 con 0x7f86400faed0 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f8645a49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f8645a49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56722/0 (socket says 172.21.15.38:56722) 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f8645a49640 1 -- 172.21.15.38:0/3130734898 learned_addr learned my addr 172.21.15.38:0/3130734898 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.278+0000 7f864624a640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400faed0 0x7f864010c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8645a49640 1 -- 172.21.15.38:0/3130734898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400faed0 msgr2=0x7f864010c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8645a49640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400faed0 0x7f864010c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8645a49640 1 -- 172.21.15.38:0/3130734898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c005040 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8645a49640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f863000eb70 tx=0x7f863000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8630007c30 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f863000f040 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640111e40 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863000ca00 con 0x7f86400fc060 2023-12-16T20:09:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.279+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86401123b0 con 0x7f86400fc060 2023-12-16T20:09:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.280+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8640103860 con 0x7f86400fc060 2023-12-16T20:09:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.280+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f863000cb80 con 0x7f86400fc060 2023-12-16T20:09:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.281+0000 7f8636ffd640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 0x7f862c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.281+0000 7f864624a640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 0x7f862c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.281+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f86300869b0 con 0x7f86400fc060 2023-12-16T20:09:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.281+0000 7f864624a640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 0x7f862c06b390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f863c034040 tx=0x7f863c009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.286+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8630052ee0 con 0x7f86400fc060 2023-12-16T20:09:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.460+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86401126e0 con 0x7f86400fc060 2023-12-16T20:09:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.460+0000 7f8636ffd640 1 -- 172.21.15.38:0/3130734898 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14411 (secure 0 0 0) 0x7f8630056500 con 0x7f86400fc060 2023-12-16T20:09:47.462 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":44,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:09:42.440206+0000","last_up_change":"2023-12-16T20:08:53.523967+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T20:09:31.147492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T20:09:31.639182+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6803","nonce":3282586212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6805","nonce":3282586212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6809","nonce":3282586212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3282586212},{"type":"v1","addr":"172.21.15.38:6807","nonce":3282586212}]},"public_addr":"172.21.15.38:6803/3282586212","cluster_addr":"172.21.15.38:6805/3282586212","heartbeat_back_addr":"172.21.15.38:6809/3282586212","heartbeat_front_addr":"172.21.15.38:6807/3282586212","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6811","nonce":2098419945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6813","nonce":2098419945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6817","nonce":2098419945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2098419945},{"type":"v1","addr":"172.21.15.38:6815","nonce":2098419945}]},"public_addr":"172.21.15.38:6811/2098419945","cluster_addr":"172.21.15.38:6813/2098419945","heartbeat_back_addr":"172.21.15.38:6817/2098419945","heartbeat_front_addr":"172.21.15.38:6815/2098419945","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6819","nonce":2982983662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6821","nonce":2982983662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6825","nonce":2982983662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2982983662},{"type":"v1","addr":"172.21.15.38:6823","nonce":2982983662}]},"public_addr":"172.21.15.38:6819/2982983662","cluster_addr":"172.21.15.38:6821/2982983662","heartbeat_back_addr":"172.21.15.38:6825/2982983662","heartbeat_front_addr":"172.21.15.38:6823/2982983662","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6801","nonce":1223163151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6803","nonce":1223163151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6807","nonce":1223163151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":1223163151},{"type":"v1","addr":"172.21.15.141:6805","nonce":1223163151}]},"public_addr":"172.21.15.141:6801/1223163151","cluster_addr":"172.21.15.141:6803/1223163151","heartbeat_back_addr":"172.21.15.141:6807/1223163151","heartbeat_front_addr":"172.21.15.141:6805/1223163151","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6809","nonce":1281377798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6811","nonce":1281377798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6815","nonce":1281377798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1281377798},{"type":"v1","addr":"172.21.15.141:6813","nonce":1281377798}]},"public_addr":"172.21.15.141:6809/1281377798","cluster_addr":"172.21.15.141:6811/1281377798","heartbeat_back_addr":"172.21.15.141:6815/1281377798","heartbeat_front_addr":"172.21.15.141:6813/1281377798","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6817","nonce":1487404021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6819","nonce":1487404021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6823","nonce":1487404021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":1487404021},{"type":"v1","addr":"172.21.15.141:6821","nonce":1487404021}]},"public_addr":"172.21.15.141:6817/1487404021","cluster_addr":"172.21.15.141:6819/1487404021","heartbeat_back_addr":"172.21.15.141:6823/1487404021","heartbeat_front_addr":"172.21.15.141:6821/1487404021","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6827/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6826/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 msgr2=0x7f862c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 0x7f862c06b390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f863c034040 tx=0x7f863c009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 msgr2=0x7f864010cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f863000eb70 tx=0x7f863000b040 comp rx=0 tx=0).stop 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 shutdown_connections 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f862c068ee0 0x7f862c06b390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86400fc060 0x7f864010cc60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 --2- 172.21.15.38:0/3130734898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86400faed0 0x7f864010c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 >> 172.21.15.38:0/3130734898 conn(0x7f86400f65f0 msgr2=0x7f86400653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:47.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 shutdown_connections 2023-12-16T20:09:47.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.463+0000 7f86484ae640 1 -- 172.21.15.38:0/3130734898 wait complete. 2023-12-16T20:09:47.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:08:07.208300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T20:09:31.147492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T20:09:31.639182+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:09:47.475 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:09:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- 172.21.15.38:0/267679577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 msgr2=0x7fa36c0fda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 --2- 172.21.15.38:0/267679577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c0fda70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa3600048d0 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- 172.21.15.38:0/267679577 shutdown_connections 2023-12-16T20:09:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 --2- 172.21.15.38:0/267679577 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c0fa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 --2- 172.21.15.38:0/267679577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c0fda70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- 172.21.15.38:0/267679577 >> 172.21.15.38:0/267679577 conn(0x7fa36c0f5da0 msgr2=0x7fa36c0f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- 172.21.15.38:0/267679577 shutdown_connections 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- 172.21.15.38:0/267679577 wait complete. 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 Processor -- start 2023-12-16T20:09:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.581+0000 7fa372e2e640 1 -- start start 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c10cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c10d380 con 0x7fa36c0fd660 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c111dd0 con 0x7fa36c0fdfb0 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56748/0 (socket says 172.21.15.38:56748) 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 -- 172.21.15.38:0/3725622032 learned_addr learned my addr 172.21.15.38:0/3725622032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa36bfff640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c10cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 -- 172.21.15.38:0/3725622032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 msgr2=0x7fa36c10cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c10cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 -- 172.21.15.38:0/3725622032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360005040 con 0x7fa36c0fd660 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa36bfff640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:47.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa370bca640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa36002bda0 tx=0x7fa360009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3600094c0 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa360009620 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c111f10 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36003b400 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.582+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c112420 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.583+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c1049e0 con 0x7fa36c0fd660 2023-12-16T20:09:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.584+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa36002f070 con 0x7fa36c0fd660 2023-12-16T20:09:47.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.584+0000 7fa3697fa640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 0x7fa35c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.584+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa3600a9480 con 0x7fa36c0fd660 2023-12-16T20:09:47.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.584+0000 7fa36bfff640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 0x7fa35c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.585+0000 7fa36bfff640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 0x7fa35c06b380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa358007fd0 tx=0x7fa358009e90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.588+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa360075880 con 0x7fa36c0fd660 2023-12-16T20:09:47.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: Cluster is now healthy 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:active 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: pgmap v124: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2415579358' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T20:09:47.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:47 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3130734898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.760+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa36c112860 con 0x7fa36c0fd660 2023-12-16T20:09:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.760+0000 7fa3697fa640 1 -- 172.21.15.38:0/3725622032 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa360078ea0 con 0x7fa36c0fd660 2023-12-16T20:09:47.762 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-16T20:09:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 msgr2=0x7fa35c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 0x7fa35c06b380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa358007fd0 tx=0x7fa358009e90 comp rx=0 tx=0).stop 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 msgr2=0x7fa36c10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa36002bda0 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 shutdown_connections 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa35c068ed0 0x7fa35c06b380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa36c0fdfb0 0x7fa36c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 --2- 172.21.15.38:0/3725622032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa36c0fd660 0x7fa36c10c7f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 >> 172.21.15.38:0/3725622032 conn(0x7fa36c0f5da0 msgr2=0x7fa36c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 shutdown_connections 2023-12-16T20:09:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.762+0000 7fa372e2e640 1 -- 172.21.15.38:0/3725622032 wait complete. 2023-12-16T20:09:47.773 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-16T20:09:47.773 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: Cluster is now healthy 2023-12-16T20:09:47.773 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: mds.? [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] up:active 2023-12-16T20:09:47.774 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 1 up:standby-replay 1 up:standby 2023-12-16T20:09:47.774 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:09:47.774 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: pgmap v124: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2023-12-16T20:09:47.774 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2415579358' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T20:09:47.774 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:47 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3130734898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:09:47.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 -- 172.21.15.38:0/2523890497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0faef0 msgr2=0x7f91ac0fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2523890497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0faef0 0x7f91ac0fb300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f919c0048d0 tx=0x7f919c009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 -- 172.21.15.38:0/2523890497 shutdown_connections 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2523890497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0fc080 0x7f91ac0fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2523890497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0faef0 0x7f91ac0fb300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 -- 172.21.15.38:0/2523890497 >> 172.21.15.38:0/2523890497 conn(0x7f91ac0f6610 msgr2=0x7f91ac0f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 -- 172.21.15.38:0/2523890497 shutdown_connections 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.880+0000 7f91b28ae640 1 -- 172.21.15.38:0/2523890497 wait complete. 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 Processor -- start 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 -- start start 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0faef0 0x7f91ac10c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac10d300 con 0x7f91ac0fc080 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91b28ae640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac111d50 con 0x7f91ac0faef0 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56770/0 (socket says 172.21.15.38:56770) 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.881+0000 7f91ab7fe640 1 -- 172.21.15.38:0/2769919750 learned_addr learned my addr 172.21.15.38:0/2769919750 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91abfff640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0faef0 0x7f91ac10c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91ab7fe640 1 -- 172.21.15.38:0/2769919750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0faef0 msgr2=0x7f91ac10c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91ab7fe640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0faef0 0x7f91ac10c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91ab7fe640 1 -- 172.21.15.38:0/2769919750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c005040 con 0x7f91ac0fc080 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91ab7fe640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c790 tx=0x7f91a00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a000a820 con 0x7f91ac0fc080 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91a000ae30 con 0x7f91ac0fc080 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac111ef0 con 0x7f91ac0fc080 2023-12-16T20:09:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a00113a0 con 0x7f91ac0fc080 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.882+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac112460 con 0x7f91ac0fc080 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.883+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac103880 con 0x7f91ac0fc080 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.883+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f91a0012400 con 0x7f91ac0fc080 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.884+0000 7f91a8ff9640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 0x7f919406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.884+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f91a0086f10 con 0x7f91ac0fc080 2023-12-16T20:09:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.884+0000 7f91abfff640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 0x7f919406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.884+0000 7f91abfff640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 0x7f919406b380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f919c000c00 tx=0x7f919c009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:47.889+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f91a00534f0 con 0x7f91ac0fc080 2023-12-16T20:09:48.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.060+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f91ac112c00 con 0x7f91ac0fc080 2023-12-16T20:09:48.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.060+0000 7f91a8ff9640 1 -- 172.21.15.38:0/2769919750 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7f91a0056b10 con 0x7f91ac0fc080 2023-12-16T20:09:48.061 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 msgr2=0x7f919406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 0x7f919406b380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f919c000c00 tx=0x7f919c009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 msgr2=0x7f91ac10ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c790 tx=0x7f91a00043c0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 shutdown_connections 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9194068ed0 0x7f919406b380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0fc080 0x7f91ac10ccb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.062+0000 7f91b28ae640 1 --2- 172.21.15.38:0/2769919750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91ac0faef0 0x7f91ac10c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.063+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 >> 172.21.15.38:0/2769919750 conn(0x7f91ac0f6610 msgr2=0x7f91ac0652e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.063+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 shutdown_connections 2023-12-16T20:09:48.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.063+0000 7f91b28ae640 1 -- 172.21.15.38:0/2769919750 wait complete. 2023-12-16T20:09:48.074 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 -- 172.21.15.38:0/4281623035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980faed0 msgr2=0x7f92980fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 --2- 172.21.15.38:0/4281623035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980faed0 0x7f92980fb2e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92900048d0 tx=0x7f9290009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 -- 172.21.15.38:0/4281623035 shutdown_connections 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 --2- 172.21.15.38:0/4281623035 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980fc060 0x7f92980fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 --2- 172.21.15.38:0/4281623035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980faed0 0x7f92980fb2e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 -- 172.21.15.38:0/4281623035 >> 172.21.15.38:0/4281623035 conn(0x7f92980f6610 msgr2=0x7f92980f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 -- 172.21.15.38:0/4281623035 shutdown_connections 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.180+0000 7f929eeae640 1 -- 172.21.15.38:0/4281623035 wait complete. 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 Processor -- start 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 -- start start 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980faed0 0x7f9298065dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298111a90 con 0x7f92980fc060 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929eeae640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298111bd0 con 0x7f92980faed0 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f9297fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f9297fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56798/0 (socket says 172.21.15.38:56798) 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f9297fff640 1 -- 172.21.15.38:0/3413669589 learned_addr learned my addr 172.21.15.38:0/3413669589 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.181+0000 7f929cc4a640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980faed0 0x7f9298065dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f9297fff640 1 -- 172.21.15.38:0/3413669589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980faed0 msgr2=0x7f9298065dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f9297fff640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980faed0 0x7f9298065dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f9297fff640 1 -- 172.21.15.38:0/3413669589 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290005040 con 0x7f92980fc060 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f9297fff640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f928800ece0 tx=0x7f928800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928800ee40 con 0x7f92980fc060 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9298111e60 con 0x7f92980fc060 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f928800f040 con 0x7f92980fc060 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9288009670 con 0x7f92980fc060 2023-12-16T20:09:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.182+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92981123d0 con 0x7f92980fc060 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.183+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298103860 con 0x7f92980fc060 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.183+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9288007890 con 0x7f92980fc060 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.184+0000 7f92957fa640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 0x7f928406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.184+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f92880874d0 con 0x7f92980fc060 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.184+0000 7f929cc4a640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 0x7f928406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.184+0000 7f929cc4a640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 0x7f928406b380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9290003080 tx=0x7f9290009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.188+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f92880538d0 con 0x7f92980fc060 2023-12-16T20:09:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.363+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f9298112af0 con 0x7f92980fc060 2023-12-16T20:09:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.363+0000 7f92957fa640 1 -- 172.21.15.38:0/3413669589 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9288056ef0 con 0x7f92980fc060 2023-12-16T20:09:48.364 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:09:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 msgr2=0x7f928406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 0x7f928406b380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9290003080 tx=0x7f9290009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 msgr2=0x7f9298111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f928800ece0 tx=0x7f928800b040 comp rx=0 tx=0).stop 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 shutdown_connections 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9284068ed0 0x7f928406b380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92980fc060 0x7f9298111550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 --2- 172.21.15.38:0/3413669589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92980faed0 0x7f9298065dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 >> 172.21.15.38:0/3413669589 conn(0x7f92980f6610 msgr2=0x7f92980ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 shutdown_connections 2023-12-16T20:09:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.365+0000 7f929eeae640 1 -- 172.21.15.38:0/3413669589 wait complete. 2023-12-16T20:09:48.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 -- 172.21.15.38:0/460250028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fbf60 msgr2=0x7f9c240fc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/460250028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fbf60 0x7f9c240fc370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c140048d0 tx=0x7f9c14009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 -- 172.21.15.38:0/460250028 shutdown_connections 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/460250028 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fd230 0x7f9c240fd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/460250028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fbf60 0x7f9c240fc370 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 -- 172.21.15.38:0/460250028 >> 172.21.15.38:0/460250028 conn(0x7f9c240f7720 msgr2=0x7f9c240f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 -- 172.21.15.38:0/460250028 shutdown_connections 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 -- 172.21.15.38:0/460250028 wait complete. 2023-12-16T20:09:48.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.479+0000 7f9c29d5d640 1 Processor -- start 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 -- start start 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fbf60 0x7f9c2410c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2410d2d0 con 0x7f9c240fd230 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24111d20 con 0x7f9c240fbf60 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56822/0 (socket says 172.21.15.38:56822) 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 -- 172.21.15.38:0/351287817 learned_addr learned my addr 172.21.15.38:0/351287817 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c237fe640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fbf60 0x7f9c2410c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 -- 172.21.15.38:0/351287817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fbf60 msgr2=0x7f9c2410c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fbf60 0x7f9c2410c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 -- 172.21.15.38:0/351287817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14005040 con 0x7f9c240fd230 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c22ffd640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c830 tx=0x7f9c18004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:48.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1800a850 con 0x7f9c240fd230 2023-12-16T20:09:48.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c1800ae60 con 0x7f9c240fd230 2023-12-16T20:09:48.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c180113a0 con 0x7f9c240fd230 2023-12-16T20:09:48.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.480+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c24111ec0 con 0x7f9c240fd230 2023-12-16T20:09:48.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.481+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c24112430 con 0x7f9c240fd230 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.482+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c24104970 con 0x7f9c240fd230 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.482+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9c18012400 con 0x7f9c240fd230 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.482+0000 7f9c0bfff640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 0x7f9c0c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.482+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9c18087090 con 0x7f9c240fd230 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.482+0000 7f9c237fe640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 0x7f9c0c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:48.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.483+0000 7f9c237fe640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 0x7f9c0c06b380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c140315d0 tx=0x7f9c14009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:48.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.487+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9c18053510 con 0x7f9c240fd230 2023-12-16T20:09:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.693+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c24112680 con 0x7f9c240fd230 2023-12-16T20:09:48.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.694+0000 7f9c0bfff640 1 -- 172.21.15.38:0/351287817 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4713 (secure 0 0 0) 0x7f9c18056b30 con 0x7f9c240fd230 2023-12-16T20:09:48.694 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:09:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-16T20:09:32.206228+0000","modified":"2023-12-16T20:09:46.474184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14498,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14498":{"gid":14498,"name":"cephfs.smithi038.aofkae","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/798907765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":798907765},{"type":"v1","addr":"172.21.15.38:6829","nonce":798907765}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14510":{"gid":14510,"name":"cephfs.smithi038.dbcjir","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6827/64603490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":64603490},{"type":"v1","addr":"172.21.15.38:6827","nonce":64603490}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi141.xhutny","rank":1,"incarnation":6,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6825/2182927496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":2182927496},{"type":"v1","addr":"172.21.15.141:6825","nonce":2182927496}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi141.eyrunj","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.141:6827/246239581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":246239581},{"type":"v1","addr":"172.21.15.141:6827","nonce":246239581}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-16T20:09:48.694 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 19 2023-12-16T20:09:48.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 msgr2=0x7f9c0c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 0x7f9c0c06b380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c140315d0 tx=0x7f9c14009da0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 msgr2=0x7f9c2410cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:48.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c830 tx=0x7f9c18004430 comp rx=0 tx=0).stop 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 shutdown_connections 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9c0c068ed0 0x7f9c0c06b380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c240fd230 0x7f9c2410cc80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 --2- 172.21.15.38:0/351287817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c240fbf60 0x7f9c2410c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 >> 172.21.15.38:0/351287817 conn(0x7f9c240f7720 msgr2=0x7f9c24100460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 shutdown_connections 2023-12-16T20:09:48.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:48.696+0000 7f9c29d5d640 1 -- 172.21.15.38:0/351287817 wait complete. 2023-12-16T20:09:48.707 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2023-12-16T20:09:48.707 INFO:teuthology.run_tasks:Running task kclient... 2023-12-16T20:09:48.735 INFO:tasks.kclient:Mounting kernel clients... 2023-12-16T20:09:48.735 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-16T20:09:48.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:48.736 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-16T20:09:48.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:48.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-16T20:09:48.825 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2023-12-16T20:09:48.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:09:48.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:48.830 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-12-16T20:09:48.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:48.849 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-12-16T20:09:48.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:48 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3725622032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:48 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:48.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:48 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2769919750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:48 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3413669589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.918 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:48 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/351287817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T20:09:48.924 INFO:teuthology.orchestra.run.smithi141.stderr:Cannot find device "ceph-brx" 2023-12-16T20:09:48.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:09:48.926 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-16T20:09:48.926 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T20:09:48.926 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:48.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T20:09:48.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3725622032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:48 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:48.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2769919750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3413669589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:09:48.957 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/351287817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T20:09:49.194 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 -- 172.21.15.38:0/3907111829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 msgr2=0x7f735c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 --2- 172.21.15.38:0/3907111829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c101ed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f734c004940 tx=0x7f734c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 -- 172.21.15.38:0/3907111829 shutdown_connections 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 --2- 172.21.15.38:0/3907111829 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 0x7f735c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 --2- 172.21.15.38:0/3907111829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c101ed0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 -- 172.21.15.38:0/3907111829 >> 172.21.15.38:0/3907111829 conn(0x7f735c0719b0 msgr2=0x7f735c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 -- 172.21.15.38:0/3907111829 shutdown_connections 2023-12-16T20:09:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 -- 172.21.15.38:0/3907111829 wait complete. 2023-12-16T20:09:49.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:49 smithi038 ceph-mon[80659]: pgmap v125: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.831+0000 7f736197f700 1 Processor -- start 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f736197f700 1 -- start start 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f736197f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 0x7f735c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f736197f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f736197f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c114250 con 0x7f735c101b00 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f736197f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c10d540 con 0x7f735c0fbb40 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56840/0 (socket says 172.21.15.38:56840) 2023-12-16T20:09:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735affd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 0x7f735c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 -- 172.21.15.38:0/245528918 learned_addr learned my addr 172.21.15.38:0/245528918 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 -- 172.21.15.38:0/245528918 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 msgr2=0x7f735c1136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 0x7f735c1136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 -- 172.21.15.38:0/245528918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c005040 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.832+0000 7f735a7fc700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f735000c8c0 tx=0x7f73500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.833+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f735000a760 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.833+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c10d820 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.833+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f735000ad70 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.833+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c10dd60 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.833+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73500113a0 con 0x7f735c101b00 2023-12-16T20:09:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.834+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480052b0 con 0x7f735c101b00 2023-12-16T20:09:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.834+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f735000a8c0 con 0x7f735c101b00 2023-12-16T20:09:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.835+0000 7f73437fe700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 0x7f734406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.835+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7350086e00 con 0x7f735c101b00 2023-12-16T20:09:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.835+0000 7f735affd700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 0x7f734406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.835+0000 7f735affd700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 0x7f734406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f734c004f90 tx=0x7f734c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:49.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:49.839+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7350056d10 con 0x7f735c101b00 2023-12-16T20:09:49.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:49 smithi141 ceph-mon[88165]: pgmap v125: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-12-16T20:09:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.080+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7348005d70 con 0x7f735c101b00 2023-12-16T20:09:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.080+0000 7f73437fe700 1 -- 172.21.15.38:0/245528918 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f73500568a0 con 0x7f735c101b00 2023-12-16T20:09:50.080 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T20:09:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.082+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 msgr2=0x7f734406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.082+0000 7f736197f700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 0x7f734406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f734c004f90 tx=0x7f734c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.082+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 msgr2=0x7f735c113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.082+0000 7f736197f700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f735000c8c0 tx=0x7f73500044c0 comp rx=0 tx=0).stop 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 shutdown_connections 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7344068f60 0x7f734406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f735c0fbb40 0x7f735c1136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 --2- 172.21.15.38:0/245528918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f735c101b00 0x7f735c113c00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 >> 172.21.15.38:0/245528918 conn(0x7f735c0719b0 msgr2=0x7f735c065410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 shutdown_connections 2023-12-16T20:09:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:50.083+0000 7f736197f700 1 -- 172.21.15.38:0/245528918 wait complete. 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T20:09:50.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T20:09:50.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T20:09:50.321 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T20:09:50.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.321 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:50.378 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:50.379 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-16T20:09:50.379 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T20:09:50.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T20:09:50.380 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-16T20:09:50.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.562 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T20:09:50.592 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-16T20:09:50.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.594 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-16T20:09:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-16T20:09:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T20:09:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-16T20:09:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-16T20:09:50.668 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T20:09:50.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T20:09:50.669 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-16T20:09:50.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.954 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-16T20:09:50.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:50.970 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2023-12-16T20:09:50.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:50 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/245528918' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T20:09:51.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.026 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-16T20:09:51.026 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-16T20:09:51.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:09:51.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T20:09:51.026 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-16T20:09:51.095 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:50 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/245528918' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T20:09:51.116 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T20:09:51.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T20:09:51.117 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-16T20:09:51.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.272 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-16T20:09:51.273 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-16T20:09:51.273 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-16T20:09:51.273 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T20:09:51.273 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-16T20:09:51.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:09:51.322 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:51.337 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T20:09:51.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:09:51.337 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:51.392 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T20:09:51.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T20:09:51.487 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T20:09:51.487 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T20:09:51.487 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2023-12-16T20:09:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T20:09:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T20:09:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2023-12-16T20:09:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.141:3300" 2023-12-16T20:09:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.141:3300" 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.141:6789" 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.141:6789:/ 2023-12-16T20:09:51.608 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=56b1cbe2-9c4e-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T20:09:51.609 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-16T20:09:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-16T20:09:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-16T20:09:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-16T20:09:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-16T20:09:51.611 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T20:09:51.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:51.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.646 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:51.708 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2023-12-16T20:09:51.708 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:09:51.708 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:09:51.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.765 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:51.827 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2023-12-16T20:09:51.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.827 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:51.889 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2023-12-16T20:09:51.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:51.889 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715.client24319/status') 2023-12-16T20:09:51.963 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.24319 (3)172.21.15.38:0/2532131961 2023-12-16T20:09:51.963 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2023-12-16T20:09:51.963 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2023-12-16T20:09:51.963 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2023-12-16T20:09:51.963 INFO:teuthology.orchestra.run.smithi038.stderr:71 bytes copied, 2.3709e-05 s, 3.0 MB/s 2023-12-16T20:09:51.964 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-16T20:09:51.965 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T20:09:51.965 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:51.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T20:09:51.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:51 smithi141 ceph-mon[88165]: pgmap v126: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 102 B/s wr, 9 op/s 2023-12-16T20:09:52.010 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:51 smithi038 ceph-mon[80659]: pgmap v126: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 102 B/s wr, 9 op/s 2023-12-16T20:09:52.285 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:53.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 -- 172.21.15.38:0/1213452908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b54070870 msgr2=0x7f4b54108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:53.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 --2- 172.21.15.38:0/1213452908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b54070870 0x7f4b54108f90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b44004940 tx=0x7f4b44009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:53.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 -- 172.21.15.38:0/1213452908 shutdown_connections 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 --2- 172.21.15.38:0/1213452908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b54070870 0x7f4b54108f90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 --2- 172.21.15.38:0/1213452908 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b5406ff60 0x7f4b54070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 -- 172.21.15.38:0/1213452908 >> 172.21.15.38:0/1213452908 conn(0x7f4b540f8790 msgr2=0x7f4b540faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 -- 172.21.15.38:0/1213452908 shutdown_connections 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.004+0000 7f4b5b514700 1 -- 172.21.15.38:0/1213452908 wait complete. 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 Processor -- start 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 -- start start 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b54070870 0x7f4b54115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:53.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54116440 con 0x7f4b5406ff60 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b5b514700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5410f770 con 0x7f4b54070870 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b592b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b592b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50852/0 (socket says 172.21.15.38:50852) 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b592b0700 1 -- 172.21.15.38:0/2161720110 learned_addr learned my addr 172.21.15.38:0/2161720110 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.005+0000 7f4b58aaf700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b54070870 0x7f4b54115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b592b0700 1 -- 172.21.15.38:0/2161720110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b54070870 msgr2=0x7f4b54115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b592b0700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b54070870 0x7f4b54115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b592b0700 1 -- 172.21.15.38:0/2161720110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44005040 con 0x7f4b5406ff60 2023-12-16T20:09:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b592b0700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c830 tx=0x7f4b50004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b5000a760 con 0x7f4b5406ff60 2023-12-16T20:09:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5410fa50 con 0x7f4b5406ff60 2023-12-16T20:09:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b5000ad70 con 0x7f4b5406ff60 2023-12-16T20:09:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b500113a0 con 0x7f4b5406ff60 2023-12-16T20:09:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.006+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5410ff90 con 0x7f4b5406ff60 2023-12-16T20:09:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.007+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54106650 con 0x7f4b5406ff60 2023-12-16T20:09:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.008+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4b50012400 con 0x7f4b5406ff60 2023-12-16T20:09:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.008+0000 7f4b49ffb700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 0x7f4b4006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.008+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4b50086d70 con 0x7f4b5406ff60 2023-12-16T20:09:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.008+0000 7f4b58aaf700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 0x7f4b4006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.009+0000 7f4b58aaf700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 0x7f4b4006b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400b3b0 tx=0x7f4b44009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:53.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.016+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4b50056d20 con 0x7f4b5406ff60 2023-12-16T20:09:53.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.255+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b540fc360 con 0x7f4b5406ff60 2023-12-16T20:09:53.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.255+0000 7f4b49ffb700 1 -- 172.21.15.38:0/2161720110 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f4b500568b0 con 0x7f4b5406ff60 2023-12-16T20:09:53.256 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 msgr2=0x7f4b4006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 0x7f4b4006b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400b3b0 tx=0x7f4b44009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 msgr2=0x7f4b541158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c830 tx=0x7f4b50004470 comp rx=0 tx=0).stop 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 shutdown_connections 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f4b40068f60 0x7f4b4006b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b5406ff60 0x7f4b541158b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 --2- 172.21.15.38:0/2161720110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b54070870 0x7f4b54115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 >> 172.21.15.38:0/2161720110 conn(0x7f4b540f8790 msgr2=0x7f4b541037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 shutdown_connections 2023-12-16T20:09:53.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:53.258+0000 7f4b5b514700 1 -- 172.21.15.38:0/2161720110 wait complete. 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi141.front.sepia.ceph.com 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T20:09:53.495 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T20:09:53.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:53.496 DEBUG:teuthology.orchestra.run.smithi141:> ip addr 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-12-16T20:09:53.515 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:26 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f0 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:27 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f1 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6c brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6d brd ff:ff:ff:ff:ff:ff 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: inet 172.21.15.141/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::ec4:7aff:fe88:726d/64 scope link 2023-12-16T20:09:53.516 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:09:53.517 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T20:09:53.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add name ceph-brx type bridge 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr flush dev ceph-brx 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set ceph-brx up 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T20:09:53.517 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-12-16T20:09:53.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:53.690 DEBUG:teuthology.orchestra.run.smithi141:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T20:09:53.716 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-12-16T20:09:53.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:53.718 DEBUG:teuthology.orchestra.run.smithi141:> route 2023-12-16T20:09:53.791 INFO:teuthology.orchestra.run.smithi141.stdout:Kernel IP routing table 2023-12-16T20:09:53.792 INFO:teuthology.orchestra.run.smithi141.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T20:09:53.792 INFO:teuthology.orchestra.run.smithi141.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T20:09:53.792 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T20:09:53.792 INFO:teuthology.orchestra.run.smithi141.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T20:09:53.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:53.792 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-12-16T20:09:53.792 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-12-16T20:09:53.792 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T20:09:53.792 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T20:09:53.792 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T20:09:53.793 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-12-16T20:09:53.856 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:53 smithi141 ceph-mon[88165]: pgmap v127: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2023-12-16T20:09:53.856 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:53 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2161720110' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T20:09:53.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:53 smithi038 ceph-mon[80659]: pgmap v127: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2023-12-16T20:09:53.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:53 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2161720110' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T20:09:54.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.029 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-12-16T20:09:54.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.085 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list-id 2023-12-16T20:09:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.140 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-12-16T20:09:54.140 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-12-16T20:09:54.140 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T20:09:54.140 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-16T20:09:54.140 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-12-16T20:09:54.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-16T20:09:54.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-16T20:09:54.223 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-12-16T20:09:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.384 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-12-16T20:09:54.384 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-12-16T20:09:54.384 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set brx.0 up 2023-12-16T20:09:54.384 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T20:09:54.384 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-12-16T20:09:54.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:09:54.425 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:54.480 INFO:teuthology.orchestra.run.smithi141.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T20:09:54.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:09:54.480 DEBUG:teuthology.orchestra.run.smithi141:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:54.535 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T20:09:54.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.535 DEBUG:teuthology.orchestra.run.smithi141:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T20:09:54.626 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T20:09:54.627 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T20:09:54.627 INFO:teuthology.orchestra.run.smithi141.stdout:invalid new device string format 2023-12-16T20:09:54.726 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T20:09:54.726 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T20:09:54.726 INFO:teuthology.orchestra.run.smithi141.stdout:invalid new device string format 2023-12-16T20:09:54.727 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.141:3300" 2023-12-16T20:09:54.727 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:invalid new device string format 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.141:3300" 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.141:6789" 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.141:6789:/ 2023-12-16T20:09:54.731 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=56b1cbe2-9c4e-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T20:09:54.735 INFO:teuthology.orchestra.run.smithi141.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-16T20:09:54.735 INFO:teuthology.orchestra.run.smithi141.stdout: You just mounted a file system that supports labels which does not 2023-12-16T20:09:54.735 INFO:teuthology.orchestra.run.smithi141.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-16T20:09:54.735 INFO:teuthology.orchestra.run.smithi141.stdout: applications will generate AVC messages and not be allowed access to 2023-12-16T20:09:54.735 INFO:teuthology.orchestra.run.smithi141.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-16T20:09:54.737 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T20:09:54.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.737 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:54.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.764 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:54.820 INFO:teuthology.orchestra.run.smithi141.stdout:client24323 2023-12-16T20:09:54.821 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:09:54.821 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:09:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.877 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:54.933 INFO:teuthology.orchestra.run.smithi141.stdout:client24323 2023-12-16T20:09:54.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.934 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T20:09:54.990 INFO:teuthology.orchestra.run.smithi141.stdout:client24323 2023-12-16T20:09:54.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:09:54.990 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715.client24323/status') 2023-12-16T20:09:55.057 INFO:teuthology.orchestra.run.smithi141.stdout:instance: client.24323 (3)192.168.0.1:0/3480786889 2023-12-16T20:09:55.057 INFO:teuthology.orchestra.run.smithi141.stdout:blocklisted: false 2023-12-16T20:09:55.057 INFO:teuthology.orchestra.run.smithi141.stderr:0+1 records in 2023-12-16T20:09:55.057 INFO:teuthology.orchestra.run.smithi141.stderr:0+1 records out 2023-12-16T20:09:55.057 INFO:teuthology.orchestra.run.smithi141.stderr:70 bytes copied, 2.07e-05 s, 3.4 MB/s 2023-12-16T20:09:55.058 INFO:teuthology.run_tasks:Running task print... 2023-12-16T20:09:55.069 INFO:teuthology.task.print:**** done client 2023-12-16T20:09:55.069 INFO:teuthology.run_tasks:Running task parallel... 2023-12-16T20:09:55.088 INFO:teuthology.task.parallel:starting parallel... 2023-12-16T20:09:55.088 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T20:09:55.089 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T20:09:55.089 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:09:55.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T20:09:55.090 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T20:09:55.090 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-16T20:09:55.094 INFO:tasks.workunit:Pulling workunits from ref c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:09:55.095 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T20:09:55.095 INFO:tasks.workunit:timeout=3h 2023-12-16T20:09:55.095 INFO:tasks.workunit:cleanup=True 2023-12-16T20:09:55.095 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:55.117 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 7eh/126d Inode: 1 Links: 2 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:unlabeled_t:s0 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-16 20:09:35.225986611 +0000 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-16 20:09:51.640825883 +0000 2023-12-16T20:09:55.118 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-16 20:09:35.225986611 +0000 2023-12-16T20:09:55.118 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T20:09:55.118 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T20:09:55.195 DEBUG:teuthology.orchestra.run.smithi141:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:55.211 INFO:teuthology.orchestra.run.smithi141.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 73h/115d Inode: 1 Links: 3 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:unlabeled_t:s0 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-12-16 20:09:55.189758592 +0000 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-12-16 20:09:55.189758592 +0000 2023-12-16T20:09:55.212 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-12-16 20:09:35.225986611 +0000 2023-12-16T20:09:55.212 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-16T20:09:55.213 DEBUG:teuthology.orchestra.run.smithi141:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-16T20:09:55.286 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:09:55.287 DEBUG:teuthology.orchestra.run.smithi141:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:09:55.302 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T20:09:55.342 INFO:tasks.workunit.client.1.smithi141.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-16T20:09:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:56.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:55 smithi038 ceph-mon[80659]: pgmap v128: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 -- 172.21.15.38:0/463340109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 msgr2=0x7f78300fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 --2- 172.21.15.38:0/463340109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f78300fbf00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7820004940 tx=0x7f7820009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 -- 172.21.15.38:0/463340109 shutdown_connections 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 --2- 172.21.15.38:0/463340109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 0x7f78300fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 --2- 172.21.15.38:0/463340109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f78300fbf00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 -- 172.21.15.38:0/463340109 >> 172.21.15.38:0/463340109 conn(0x7f78300f7190 msgr2=0x7f78300f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 -- 172.21.15.38:0/463340109 shutdown_connections 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.133+0000 7f78369de700 1 -- 172.21.15.38:0/463340109 wait complete. 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 Processor -- start 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 -- start start 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 0x7f783010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783010cfc0 con 0x7f78300fbaf0 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f78369de700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783010d860 con 0x7f78300fcd00 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50870/0 (socket says 172.21.15.38:50870) 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 -- 172.21.15.38:0/1698173373 learned_addr learned my addr 172.21.15.38:0/1698173373 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782f7fe700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 0x7f783010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 -- 172.21.15.38:0/1698173373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 msgr2=0x7f783010c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 0x7f783010c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.134+0000 7f782ffff700 1 -- 172.21.15.38:0/1698173373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820005040 con 0x7f78300fbaf0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f782ffff700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7820009380 tx=0x7f7820009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f782000e040 con 0x7f78300fbaf0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783010dae0 con 0x7f78300fbaf0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f782000be60 con 0x7f78300fbaf0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783010dfc0 con 0x7f78300fbaf0 2023-12-16T20:09:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.135+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7820013660 con 0x7f78300fbaf0 2023-12-16T20:09:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.136+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783004bb80 con 0x7f78300fbaf0 2023-12-16T20:09:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.136+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f782001ea60 con 0x7f78300fbaf0 2023-12-16T20:09:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.137+0000 7f782cff9700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 0x7f781806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.137+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f782008ad80 con 0x7f78300fbaf0 2023-12-16T20:09:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.137+0000 7f782f7fe700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 0x7f781806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.137+0000 7f782f7fe700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 0x7f781806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7824004f40 tx=0x7f782400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.141+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f782005ac10 con 0x7f78300fbaf0 2023-12-16T20:09:56.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:55 smithi141 ceph-mon[88165]: pgmap v128: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-12-16T20:09:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.338+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f7830104490 con 0x7f78300fbaf0 2023-12-16T20:09:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.339+0000 7f782cff9700 1 -- 172.21.15.38:0/1698173373 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f782005a7a0 con 0x7f78300fbaf0 2023-12-16T20:09:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 msgr2=0x7f781806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 0x7f781806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7824004f40 tx=0x7f782400b040 comp rx=0 tx=0).stop 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 msgr2=0x7f783010c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7820009380 tx=0x7f7820009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 shutdown_connections 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7818068f60 0x7f781806b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78300fbaf0 0x7f783010c480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 --2- 172.21.15.38:0/1698173373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78300fcd00 0x7f783010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 >> 172.21.15.38:0/1698173373 conn(0x7f78300f7190 msgr2=0x7f78300fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 shutdown_connections 2023-12-16T20:09:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:56.341+0000 7f78369de700 1 -- 172.21.15.38:0/1698173373 wait complete. 2023-12-16T20:09:56.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T20:09:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 -- 172.21.15.38:0/3522925589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5650066920 msgr2=0x7f56500ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 --2- 172.21.15.38:0/3522925589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5650066920 0x7f56500ff7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f564c004940 tx=0x7f564c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 -- 172.21.15.38:0/3522925589 shutdown_connections 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 --2- 172.21.15.38:0/3522925589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56500ffd70 0x7f56501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 --2- 172.21.15.38:0/3522925589 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5650066920 0x7f56500ff7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.602+0000 7f5657997700 1 -- 172.21.15.38:0/3522925589 >> 172.21.15.38:0/3522925589 conn(0x7f56500f71d0 msgr2=0x7f56500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 -- 172.21.15.38:0/3522925589 shutdown_connections 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 -- 172.21.15.38:0/3522925589 wait complete. 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 Processor -- start 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 -- start start 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5650066920 0x7f565010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565010e150 con 0x7f56500ffd70 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5657997700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565010e990 con 0x7f5650066920 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.603+0000 7f5654f32700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50888/0 (socket says 172.21.15.38:50888) 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 -- 172.21.15.38:0/883458394 learned_addr learned my addr 172.21.15.38:0/883458394 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5655733700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5650066920 0x7f565010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 -- 172.21.15.38:0/883458394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5650066920 msgr2=0x7f565010d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5650066920 0x7f565010d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 -- 172.21.15.38:0/883458394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c005040 con 0x7f56500ffd70 2023-12-16T20:09:57.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5654f32700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f564000b790 tx=0x7f5640009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f564000f6f0 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f564000fd00 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56400103a0 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565010ec70 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.604+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565010f1b0 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.605+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565004bb80 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.606+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f564000f850 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.606+0000 7f5645ffb700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 0x7f563c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.606+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5640086c60 con 0x7f56500ffd70 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.606+0000 7f5655733700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 0x7f563c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:57.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.607+0000 7f5655733700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 0x7f563c06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b3b0 tx=0x7f564c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:57.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.610+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5640056af0 con 0x7f56500ffd70 2023-12-16T20:09:57.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.823+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f565010f5c0 con 0x7f56500ffd70 2023-12-16T20:09:57.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.824+0000 7f5645ffb700 1 -- 172.21.15.38:0/883458394 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f5640056680 con 0x7f56500ffd70 2023-12-16T20:09:57.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 msgr2=0x7f563c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:57.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 0x7f563c06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b3b0 tx=0x7f564c009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:57.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 msgr2=0x7f565010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f564000b790 tx=0x7f5640009220 comp rx=0 tx=0).stop 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 shutdown_connections 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f563c068f60 0x7f563c06b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5650066920 0x7f565010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 --2- 172.21.15.38:0/883458394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56500ffd70 0x7f565010dac0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 >> 172.21.15.38:0/883458394 conn(0x7f56500f71d0 msgr2=0x7f56500f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 shutdown_connections 2023-12-16T20:09:57.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:57.826+0000 7f5657997700 1 -- 172.21.15.38:0/883458394 wait complete. 2023-12-16T20:09:58.059 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:57 smithi038 ceph-mon[80659]: pgmap v129: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 853 B/s wr, 8 op/s 2023-12-16T20:09:58.059 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:57 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:58.060 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:57 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:58.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T20:09:58.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:57 smithi141 ceph-mon[88165]: pgmap v129: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 853 B/s wr, 8 op/s 2023-12-16T20:09:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:57 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:09:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:57 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:09:58.330 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 -- 172.21.15.38:0/3360008367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 msgr2=0x7ff8cc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/3360008367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc0fe250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc004940 tx=0x7ff8bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 -- 172.21.15.38:0/3360008367 shutdown_connections 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/3360008367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc0fe250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/3360008367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 -- 172.21.15.38:0/3360008367 >> 172.21.15.38:0/3360008367 conn(0x7ff8cc0f82d0 msgr2=0x7ff8cc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 -- 172.21.15.38:0/3360008367 shutdown_connections 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 -- 172.21.15.38:0/3360008367 wait complete. 2023-12-16T20:09:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.054+0000 7ff8d24d8700 1 Processor -- start 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8d24d8700 1 -- start start 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8d24d8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8d24d8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8d24d8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc070620 con 0x7ff8cc0fde00 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8d24d8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc070790 con 0x7ff8cc0fcbf0 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50908/0 (socket says 172.21.15.38:50908) 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 -- 172.21.15.38:0/935884537 learned_addr learned my addr 172.21.15.38:0/935884537 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cbfff700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 -- 172.21.15.38:0/935884537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 msgr2=0x7ff8cc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cb7fe700 1 -- 172.21.15.38:0/935884537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc005040 con 0x7ff8cc0fde00 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.055+0000 7ff8cbfff700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:09:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8cb7fe700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009380 tx=0x7ff8bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:59.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc00e040 con 0x7ff8cc0fde00 2023-12-16T20:09:59.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8bc00bda0 con 0x7ff8cc0fde00 2023-12-16T20:09:59.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc070a10 con 0x7ff8cc0fde00 2023-12-16T20:09:59.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc01c630 con 0x7ff8cc0fde00 2023-12-16T20:09:59.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.056+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc115590 con 0x7ff8cc0fde00 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.057+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc04bb80 con 0x7ff8cc0fde00 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.057+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff8bc0139d0 con 0x7ff8cc0fde00 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.058+0000 7ff8c8ff9700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 0x7ff8b406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.058+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff8bc0882a0 con 0x7ff8cc0fde00 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.058+0000 7ff8cbfff700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 0x7ff8b406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:09:59.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.058+0000 7ff8cbfff700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 0x7ff8b406b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0718a0 tx=0x7ff8c0008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:09:59.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.062+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff8bc0581b0 con 0x7ff8cc0fde00 2023-12-16T20:09:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.257+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff8cc105630 con 0x7ff8cc0fde00 2023-12-16T20:09:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.257+0000 7ff8c8ff9700 1 -- 172.21.15.38:0/935884537 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff8bc057d40 con 0x7ff8cc0fde00 2023-12-16T20:09:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 msgr2=0x7ff8b406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 0x7ff8b406b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0718a0 tx=0x7ff8c0008040 comp rx=0 tx=0).stop 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 msgr2=0x7ff8cc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009380 tx=0x7ff8bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 shutdown_connections 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7ff8b4068f60 0x7ff8b406b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8cc0fcbf0 0x7ff8cc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 --2- 172.21.15.38:0/935884537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8cc0fde00 0x7ff8cc06ff90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 >> 172.21.15.38:0/935884537 conn(0x7ff8cc0f82d0 msgr2=0x7ff8cc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.259+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 shutdown_connections 2023-12-16T20:09:59.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:09:59.260+0000 7ff8d24d8700 1 -- 172.21.15.38:0/935884537 wait complete. 2023-12-16T20:09:59.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-16T20:09:59.778 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:10:00.051 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:09:59 smithi141 ceph-mon[88165]: pgmap v130: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-12-16T20:10:00.127 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:09:59 smithi038 ceph-mon[80659]: pgmap v130: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 -- 172.21.15.38:0/383023119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 msgr2=0x7fee740fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/383023119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee740fc4f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee70004940 tx=0x7fee70009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 -- 172.21.15.38:0/383023119 shutdown_connections 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/383023119 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 0x7fee740fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/383023119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee740fc4f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.539+0000 7fee7b4d9700 1 -- 172.21.15.38:0/383023119 >> 172.21.15.38:0/383023119 conn(0x7fee740f6950 msgr2=0x7fee740f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 -- 172.21.15.38:0/383023119 shutdown_connections 2023-12-16T20:10:00.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 -- 172.21.15.38:0/383023119 wait complete. 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 Processor -- start 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 -- start start 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 0x7fee7410c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7410cf80 con 0x7fee740fc0e0 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.540+0000 7fee7b4d9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7410d820 con 0x7fee740fcac0 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50936/0 (socket says 172.21.15.38:50936) 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 -- 172.21.15.38:0/3568402810 learned_addr learned my addr 172.21.15.38:0/3568402810 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee78a74700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 0x7fee7410c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:00.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 -- 172.21.15.38:0/3568402810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 msgr2=0x7fee7410c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 0x7fee7410c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 -- 172.21.15.38:0/3568402810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70005040 con 0x7fee740fc0e0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee79275700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee70000c00 tx=0x7fee70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee70021070 con 0x7fee740fc0e0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee7001c400 con 0x7fee740fc0e0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7000e070 con 0x7fee740fc0e0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7410daa0 con 0x7fee740fc0e0 2023-12-16T20:10:00.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.541+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7410df80 con 0x7fee740fc0e0 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.543+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7404bb80 con 0x7fee740fc0e0 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.543+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fee7001c9c0 con 0x7fee740fc0e0 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.543+0000 7fee69ffb700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 0x7fee6006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.544+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fee70087ff0 con 0x7fee740fc0e0 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.544+0000 7fee78a74700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 0x7fee6006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:00.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.544+0000 7fee78a74700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 0x7fee6006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee64009b80 tx=0x7fee6400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:00.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.548+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fee700b9a00 con 0x7fee740fc0e0 2023-12-16T20:10:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:00.759+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7410e5f0 con 0x7fee60068f60 2023-12-16T20:10:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:00 smithi038 ceph-mon[80659]: overall HEALTH_OK 2023-12-16T20:10:01.221 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:00 smithi141 ceph-mon[88165]: overall HEALTH_OK 2023-12-16T20:10:02.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:01 smithi038 ceph-mon[80659]: pgmap v131: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-12-16T20:10:02.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:01 smithi038 ceph-mon[80659]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:01 smithi141 ceph-mon[88165]: pgmap v131: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-12-16T20:10:02.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:01 smithi141 ceph-mon[88165]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:03.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:03 smithi141 ceph-mon[88165]: pgmap v132: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-16T20:10:04.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:03 smithi038 ceph-mon[80659]: pgmap v132: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-16T20:10:06.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:05 smithi038 ceph-mon[80659]: pgmap v133: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2023-12-16T20:10:06.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:05 smithi141 ceph-mon[88165]: pgmap v133: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2023-12-16T20:10:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:07 smithi038 ceph-mon[80659]: pgmap v134: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-12-16T20:10:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:07 smithi141 ceph-mon[88165]: pgmap v134: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2023-12-16T20:10:10.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:09 smithi038 ceph-mon[80659]: pgmap v135: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2023-12-16T20:10:10.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:09 smithi141 ceph-mon[88165]: pgmap v135: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2023-12-16T20:10:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:11 smithi038 ceph-mon[80659]: pgmap v136: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T20:10:12.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:11 smithi141 ceph-mon[88165]: pgmap v136: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T20:10:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:13 smithi141 ceph-mon[88165]: pgmap v137: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:13.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:13 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:13 smithi038 ceph-mon[80659]: pgmap v137: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:13 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:15 smithi038 ceph-mon[80659]: pgmap v138: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:16.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:15 smithi141 ceph-mon[88165]: pgmap v138: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:18.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:17 smithi038 ceph-mon[80659]: pgmap v139: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:18.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:17 smithi141 ceph-mon[88165]: pgmap v139: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:20.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:19 smithi038 ceph-mon[80659]: pgmap v140: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:20.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:19 smithi141 ceph-mon[88165]: pgmap v140: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:22.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:21 smithi038 ceph-mon[80659]: pgmap v141: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:10:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:21 smithi141 ceph-mon[88165]: pgmap v141: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:10:23.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:23 smithi141 ceph-mon[88165]: pgmap v142: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:24.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:23 smithi038 ceph-mon[80659]: pgmap v142: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:26.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:25 smithi038 ceph-mon[80659]: pgmap v143: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:26.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:25 smithi141 ceph-mon[88165]: pgmap v143: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:27 smithi038 ceph-mon[80659]: pgmap v144: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:28.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:27 smithi141 ceph-mon[88165]: pgmap v144: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T20:10:29.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:28 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:29.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:28 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:30.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:29 smithi038 ceph-mon[80659]: pgmap v145: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:30.145 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:29 smithi141 ceph-mon[88165]: pgmap v145: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:10:30.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.980+0000 7fee69ffb700 1 -- 172.21.15.38:0/3568402810 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fee7410e5f0 con 0x7fee60068f60 2023-12-16T20:10:30.981 INFO:teuthology.orchestra.run.smithi038.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:10:30.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 msgr2=0x7fee6006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:30.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 0x7fee6006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee64009b80 tx=0x7fee6400b040 comp rx=0 tx=0).stop 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 msgr2=0x7fee7410c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee70000c00 tx=0x7fee70009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 shutdown_connections 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fee60068f60 0x7fee6006b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee740fc0e0 0x7fee7410c440 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 --2- 172.21.15.38:0/3568402810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee740fcac0 0x7fee7410c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 >> 172.21.15.38:0/3568402810 conn(0x7fee740f6950 msgr2=0x7fee741000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 shutdown_connections 2023-12-16T20:10:30.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:30.983+0000 7fee7b4d9700 1 -- 172.21.15.38:0/3568402810 wait complete. 2023-12-16T20:10:31.218 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-16T20:10:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:10:32.089 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: pgmap v146: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:10:32.089 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:32.090 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:10:32.090 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:10:32.090 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:10:32.090 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:31 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:32.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: pgmap v146: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:10:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:10:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:10:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:10:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:31 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 -- 172.21.15.38:0/1440550081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fbe10 msgr2=0x7fdfc40fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 --2- 172.21.15.38:0/1440550081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fbe10 0x7fdfc40fc280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8004940 tx=0x7fdfb8009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 -- 172.21.15.38:0/1440550081 shutdown_connections 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 --2- 172.21.15.38:0/1440550081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fbe10 0x7fdfc40fc280 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 --2- 172.21.15.38:0/1440550081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fd190 0x7fdfc40fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 -- 172.21.15.38:0/1440550081 >> 172.21.15.38:0/1440550081 conn(0x7fdfc40f6950 msgr2=0x7fdfc40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 -- 172.21.15.38:0/1440550081 shutdown_connections 2023-12-16T20:10:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.435+0000 7fdfc9111700 1 -- 172.21.15.38:0/1440550081 wait complete. 2023-12-16T20:10:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 Processor -- start 2023-12-16T20:10:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 -- start start 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 0x7fdfc41125d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc2d9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 0x7fdfc41125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56614/0 (socket says 172.21.15.38:56614) 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc259c700 1 -- 172.21.15.38:0/2821921511 learned_addr learned my addr 172.21.15.38:0/2821921511 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40fb9f0 con 0x7fdfc40fd190 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.436+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40fbb30 con 0x7fdfc40fbe10 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc259c700 1 -- 172.21.15.38:0/2821921511 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 msgr2=0x7fdfc41125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc259c700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 0x7fdfc41125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc259c700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8005040 con 0x7fdfc40fd190 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc2d9d700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 0x7fdfc41125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:10:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc259c700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000c00 tx=0x7fdfb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb800e070 con 0x7fdfc40fd190 2023-12-16T20:10:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfb801c400 con 0x7fdfc40fd190 2023-12-16T20:10:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4115060 con 0x7fdfc40fd190 2023-12-16T20:10:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.437+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb800b650 con 0x7fdfc40fd190 2023-12-16T20:10:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.438+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc41153b0 con 0x7fdfc40fd190 2023-12-16T20:10:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.439+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb00052e0 con 0x7fdfc40fd190 2023-12-16T20:10:32.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.439+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdfb800b8c0 con 0x7fdfc40fd190 2023-12-16T20:10:32.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.440+0000 7fdfab7fe700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 0x7fdfac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.440+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdfb8088390 con 0x7fdfc40fd190 2023-12-16T20:10:32.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.440+0000 7fdfc2d9d700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 0x7fdfac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.441+0000 7fdfc2d9d700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 0x7fdfac06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40fb780 tx=0x7fdfb400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.448+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdfb80558c0 con 0x7fdfc40fd190 2023-12-16T20:10:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.666+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfb0000bf0 con 0x7fdfac068f60 2023-12-16T20:10:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.667+0000 7fdfab7fe700 1 -- 172.21.15.38:0/2821921511 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fdfb0000bf0 con 0x7fdfac068f60 2023-12-16T20:10:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.670+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 msgr2=0x7fdfac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.670+0000 7fdfc9111700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 0x7fdfac06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40fb780 tx=0x7fdfb400b040 comp rx=0 tx=0).stop 2023-12-16T20:10:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.670+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 msgr2=0x7fdfc4114b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.670+0000 7fdfc9111700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000c00 tx=0x7fdfb8009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 shutdown_connections 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fdfac068f60 0x7fdfac06b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc40fbe10 0x7fdfc41125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 --2- 172.21.15.38:0/2821921511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfc40fd190 0x7fdfc4114b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 >> 172.21.15.38:0/2821921511 conn(0x7fdfc40f6950 msgr2=0x7fdfc4100050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 shutdown_connections 2023-12-16T20:10:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.671+0000 7fdfc9111700 1 -- 172.21.15.38:0/2821921511 wait complete. 2023-12-16T20:10:32.686 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:10:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 -- 172.21.15.38:0/1929707490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2800fc4a0 msgr2=0x7fa2800fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 --2- 172.21.15.38:0/1929707490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2800fc4a0 0x7fa2800fc8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa274004940 tx=0x7fa274009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 -- 172.21.15.38:0/1929707490 shutdown_connections 2023-12-16T20:10:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 --2- 172.21.15.38:0/1929707490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2800fc4a0 0x7fa2800fc8f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 --2- 172.21.15.38:0/1929707490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa2800fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 -- 172.21.15.38:0/1929707490 >> 172.21.15.38:0/1929707490 conn(0x7fa2800f6950 msgr2=0x7fa2800f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.809+0000 7fa286070700 1 -- 172.21.15.38:0/1929707490 shutdown_connections 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.810+0000 7fa286070700 1 -- 172.21.15.38:0/1929707490 wait complete. 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.810+0000 7fa286070700 1 Processor -- start 2023-12-16T20:10:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa286070700 1 -- start start 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa286070700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa28010d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa286070700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa286070700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28010e1a0 con 0x7fa28010dce0 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa286070700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28010e2e0 con 0x7fa2800fb290 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa27effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa27f7fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa28010d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa27effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56640/0 (socket says 172.21.15.38:56640) 2023-12-16T20:10:32.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.811+0000 7fa27effd700 1 -- 172.21.15.38:0/3032161695 learned_addr learned my addr 172.21.15.38:0/3032161695 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa27f7fe700 1 -- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 msgr2=0x7fa28010eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa27f7fe700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa27f7fe700 1 -- 172.21.15.38:0/3032161695 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274005040 con 0x7fa2800fb290 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa27effd700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa27f7fe700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa28010d7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa270002840 tx=0x7fa270004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa270007cc0 con 0x7fa2800fb290 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28010f1e0 con 0x7fa2800fb290 2023-12-16T20:10:32.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa27000f040 con 0x7fa2800fb290 2023-12-16T20:10:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28010f6f0 con 0x7fa2800fb290 2023-12-16T20:10:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.812+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa270013860 con 0x7fa2800fb290 2023-12-16T20:10:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.813+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280107c80 con 0x7fa2800fb290 2023-12-16T20:10:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.814+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa27001c400 con 0x7fa2800fb290 2023-12-16T20:10:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.815+0000 7fa267fff700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 0x7fa26806b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.815+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa270086a90 con 0x7fa2800fb290 2023-12-16T20:10:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.815+0000 7fa27effd700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 0x7fa26806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:32.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.815+0000 7fa27effd700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 0x7fa26806b480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b3b0 tx=0x7fa274009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:32.823+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa2700568c0 con 0x7fa2800fb290 2023-12-16T20:10:32.925 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:32 smithi038 ceph-mon[80659]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:10:32.925 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:32 smithi038 ceph-mon[80659]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:10:33.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.107+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa28005e080 con 0x7fa268068fd0 2023-12-16T20:10:33.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.109+0000 7fa267fff700 1 -- 172.21.15.38:0/3032161695 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fa28005e080 con 0x7fa268068fd0 2023-12-16T20:10:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 msgr2=0x7fa26806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 0x7fa26806b480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b3b0 tx=0x7fa274009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 msgr2=0x7fa28010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa28010d7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa270002840 tx=0x7fa270004570 comp rx=0 tx=0).stop 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 shutdown_connections 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fa268068fd0 0x7fa26806b480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2800fb290 0x7fa28010d7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 --2- 172.21.15.38:0/3032161695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa28010dce0 0x7fa28010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 >> 172.21.15.38:0/3032161695 conn(0x7fa2800f6950 msgr2=0x7fa2801009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 shutdown_connections 2023-12-16T20:10:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.112+0000 7fa286070700 1 -- 172.21.15.38:0/3032161695 wait complete. 2023-12-16T20:10:33.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.239+0000 7f7b108f9700 1 -- 172.21.15.38:0/1319074806 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b08013ab0 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.240+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1319074806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fbaf0 msgr2=0x7f7b0c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.240+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1319074806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c0fbf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b08004940 tx=0x7f7b08009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:33.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1319074806 shutdown_connections 2023-12-16T20:10:33.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1319074806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fcd00 0x7f7b0c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1319074806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c0fbf00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1319074806 >> 172.21.15.38:0/1319074806 conn(0x7f7b0c0f7190 msgr2=0x7f7b0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:33.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1319074806 shutdown_connections 2023-12-16T20:10:33.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.242+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1319074806 wait complete. 2023-12-16T20:10:33.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 Processor -- start 2023-12-16T20:10:33.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 -- start start 2023-12-16T20:10:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fcd00 0x7f7b0c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c10cf30 con 0x7f7b0c0fcd00 2023-12-16T20:10:33.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:32 smithi141 ceph-mon[88165]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:10:33.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:32 smithi141 ceph-mon[88165]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:10:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b13b5f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c10d7d0 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b118fb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b118fb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:47560/0 (socket says 172.21.15.38:47560) 2023-12-16T20:10:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.243+0000 7f7b118fb700 1 -- 172.21.15.38:0/1068896456 learned_addr learned my addr 172.21.15.38:0/1068896456 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:33.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b110fa700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fcd00 0x7f7b0c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b118fb700 1 -- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fcd00 msgr2=0x7f7b0c10c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b118fb700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fcd00 0x7f7b0c10c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b118fb700 1 -- 172.21.15.38:0/1068896456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b08005040 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b118fb700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b08009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b08021070 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b0801c400 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.244+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0800e030 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.245+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c10d9d0 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.245+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c10de50 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.246+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0c04bb80 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.247+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7b0801c9e0 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.249+0000 7f7b027fc700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 0x7f7af806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.249+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7b08088060 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.249+0000 7f7b110fa700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 0x7f7af806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.250+0000 7f7b110fa700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 0x7f7af806b4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009b80 tx=0x7f7afc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:33.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.256+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7b08057f50 con 0x7f7b0c0fbaf0 2023-12-16T20:10:33.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.610+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b0c101650 con 0x7f7af8069030 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.628+0000 7f7b027fc700 1 -- 172.21.15.38:0/1068896456 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7b0c101650 con 0x7f7af8069030 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (3m) 47s ago 4m 24.2M - 0.25.0 c8568f914cd2 3b37fdee0436 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (4m) 47s ago 4m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (3m) 49s ago 3m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (3m) 47s ago 4m 83.9M - 9.4.7 954c08fa6188 aef7cc507220 2023-12-16T20:10:33.629 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (56s) 47s ago 55s 15.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (59s) 47s ago 59s 9445k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (54s) 49s ago 54s 12.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (57s) 49s ago 57s 15.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:9283 running (5m) 47s ago 5m 476M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6c2471ed13fc 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 running (3m) 49s ago 3m 432M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7b529681218a 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (5m) 47s ago 5m 47.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (3m) 49s ago 3m 43.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (4m) 47s ago 4m 14.3M - 1.5.0 0da6a335fe13 529b4731a151 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (3m) 49s ago 3m 15.8M - 1.5.0 0da6a335fe13 0c4b9420e095 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 47s ago 3m 45.5M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (2m) 47s ago 2m 47.9M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (2m) 47s ago 2m 45.7M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (2m) 49s ago 2m 44.4M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (2m) 49s ago 2m 41.5M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:10:33.630 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (107s) 49s ago 106s 43.9M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:10:33.631 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 47s ago 3m 42.8M - 2.43.0 a07b618ecd1d aa5366916390 2023-12-16T20:10:33.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 msgr2=0x7f7af806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 0x7f7af806b4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009b80 tx=0x7f7afc00b040 comp rx=0 tx=0).stop 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 msgr2=0x7f7b0c10c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b08009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 shutdown_connections 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f7af8069030 0x7f7af806b4e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b0c0fbaf0 0x7f7b0c10c3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 --2- 172.21.15.38:0/1068896456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b0c0fcd00 0x7f7b0c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 >> 172.21.15.38:0/1068896456 conn(0x7f7b0c0f7190 msgr2=0x7f7b0c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 shutdown_connections 2023-12-16T20:10:33.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.632+0000 7f7b13b5f700 1 -- 172.21.15.38:0/1068896456 wait complete. 2023-12-16T20:10:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.749+0000 7f31da9c5700 1 -- 172.21.15.38:0/3534056232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 msgr2=0x7f31d40fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.749+0000 7f31da9c5700 1 --2- 172.21.15.38:0/3534056232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d40fb680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31c4004940 tx=0x7f31c4009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 -- 172.21.15.38:0/3534056232 shutdown_connections 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 --2- 172.21.15.38:0/3534056232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 0x7f31d40fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 --2- 172.21.15.38:0/3534056232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d40fb680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 -- 172.21.15.38:0/3534056232 >> 172.21.15.38:0/3534056232 conn(0x7f31d40f69d0 msgr2=0x7f31d40f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 -- 172.21.15.38:0/3534056232 shutdown_connections 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 -- 172.21.15.38:0/3534056232 wait complete. 2023-12-16T20:10:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.750+0000 7f31da9c5700 1 Processor -- start 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31da9c5700 1 -- start start 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31da9c5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31da9c5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 0x7f31d410dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31da9c5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d410e340 con 0x7f31d40fb270 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31da9c5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d410ebe0 con 0x7f31d40fc520 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56660/0 (socket says 172.21.15.38:56660) 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 -- 172.21.15.38:0/2271231081 learned_addr learned my addr 172.21.15.38:0/2271231081 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:33.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d37fe700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 0x7f31d410dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 -- 172.21.15.38:0/2271231081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 msgr2=0x7f31d410dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 0x7f31d410dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.751+0000 7f31d3fff700 1 -- 172.21.15.38:0/2271231081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4005040 con 0x7f31d40fb270 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31d3fff700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c4021070 con 0x7f31d40fb270 2023-12-16T20:10:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d410ee60 con 0x7f31d40fb270 2023-12-16T20:10:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d410f3a0 con 0x7f31d40fb270 2023-12-16T20:10:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31c401c400 con 0x7f31d40fb270 2023-12-16T20:10:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.752+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c400e070 con 0x7f31d40fb270 2023-12-16T20:10:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.754+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c00052e0 con 0x7f31d40fb270 2023-12-16T20:10:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.755+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f31c401ca00 con 0x7f31d40fb270 2023-12-16T20:10:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.755+0000 7f31d0ff9700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 0x7f31bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.756+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f31c4087ff0 con 0x7f31d40fb270 2023-12-16T20:10:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.756+0000 7f31d37fe700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 0x7f31bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:33.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.756+0000 7f31d37fe700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 0x7f31bc06b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009fd0 tx=0x7f31c800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:33.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:33.760+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f31c4057f20 con 0x7f31d40fb270 2023-12-16T20:10:33.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:33 smithi038 ceph-mon[80659]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:33.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:33 smithi038 ceph-mon[80659]: pgmap v147: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:10:33.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:33.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:10:33.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:33 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.194+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31c0005da0 con 0x7f31d40fb270 2023-12-16T20:10:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.195+0000 7f31d0ff9700 1 -- 172.21.15.38:0/2271231081 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f31c4057ab0 con 0x7f31d40fb270 2023-12-16T20:10:34.195 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:10:34.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T20:10:34.196 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:10:34.197 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 msgr2=0x7f31bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 0x7f31bc06b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009fd0 tx=0x7f31c800b040 comp rx=0 tx=0).stop 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 msgr2=0x7f31d410d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 shutdown_connections 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f31bc068f60 0x7f31bc06b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31d40fb270 0x7f31d410d800 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 --2- 172.21.15.38:0/2271231081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31d40fc520 0x7f31d410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 >> 172.21.15.38:0/2271231081 conn(0x7f31d40f69d0 msgr2=0x7f31d40ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 shutdown_connections 2023-12-16T20:10:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.198+0000 7f31da9c5700 1 -- 172.21.15.38:0/2271231081 wait complete. 2023-12-16T20:10:34.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:33 smithi141 ceph-mon[88165]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:33 smithi141 ceph-mon[88165]: pgmap v147: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:10:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:10:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:33 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:34.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/2257341421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 msgr2=0x7f9ebc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/2257341421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc0fbf00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9eac004940 tx=0x7f9eac009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/2257341421 shutdown_connections 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/2257341421 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/2257341421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc0fbf00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.368+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/2257341421 >> 172.21.15.38:0/2257341421 conn(0x7f9ebc0f7190 msgr2=0x7f9ebc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.369+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/2257341421 shutdown_connections 2023-12-16T20:10:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.369+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/2257341421 wait complete. 2023-12-16T20:10:34.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.370+0000 7f9ec1ac7700 1 Processor -- start 2023-12-16T20:10:34.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.370+0000 7f9ec1ac7700 1 -- start start 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.370+0000 7f9ec1ac7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc10c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ec1ac7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ec1ac7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc10cd40 con 0x7f9ebc0fbaf0 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ec1ac7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc10d5e0 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:47600/0 (socket says 172.21.15.38:47600) 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 -- 172.21.15.38:0/301559609 learned_addr learned my addr 172.21.15.38:0/301559609 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc10c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:34.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 -- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 msgr2=0x7f9ebc10c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc10c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebaffd700 1 -- 172.21.15.38:0/301559609 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac005040 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.371+0000 7f9ebb7fe700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc10c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:10:34.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ebaffd700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000eb70 tx=0x7f9eb000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb0007cc0 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9eb000f040 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb00095f0 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc10d860 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.372+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc10dce0 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.374+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc04bb80 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.374+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9eb0009750 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.375+0000 7f9ea3fff700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 0x7f9ea406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:10:34.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.375+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9eb00869e0 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.375+0000 7f9ebb7fe700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 0x7f9ea406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:10:34.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.376+0000 7f9ebb7fe700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 0x7f9ea406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000c00 tx=0x7f9eac009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:10:34.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.383+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9eb0056850 con 0x7f9ebc0fcd00 2023-12-16T20:10:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.769+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ebc10e1e0 con 0x7f9ea4068f60 2023-12-16T20:10:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.770+0000 7f9ea3fff700 1 -- 172.21.15.38:0/301559609 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f9ebc10e1e0 con 0x7f9ea4068f60 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 image on host smithi141", 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:10:34.771 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:10:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 msgr2=0x7f9ea406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 0x7f9ea406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000c00 tx=0x7f9eac009e30 comp rx=0 tx=0).stop 2023-12-16T20:10:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 msgr2=0x7f9ebc10c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:10:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000eb70 tx=0x7f9eb000b040 comp rx=0 tx=0).stop 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 shutdown_connections 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f9ea4068f60 0x7f9ea406b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ebc0fbaf0 0x7f9ebc10c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 --2- 172.21.15.38:0/301559609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc0fcd00 0x7f9ebc10c740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 >> 172.21.15.38:0/301559609 conn(0x7f9ebc0f7190 msgr2=0x7f9ebc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 shutdown_connections 2023-12-16T20:10:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:10:34.773+0000 7f9ec1ac7700 1 -- 172.21.15.38:0/301559609 wait complete. 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: Upgrade: Target is version 19.0.0-202-gc7586e95 (unknown) 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5'] 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: Upgrade: Need to upgrade myself (mgr.smithi038.gdlrfj) 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 on smithi141 2023-12-16T20:10:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:34 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2271231081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:10:35.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: Upgrade: Target is version 19.0.0-202-gc7586e95 (unknown) 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5'] 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: Upgrade: Need to upgrade myself (mgr.smithi038.gdlrfj) 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 on smithi141 2023-12-16T20:10:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:34 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2271231081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:10:36.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:35 smithi038 ceph-mon[80659]: pgmap v148: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:36.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:35 smithi038 ceph-mon[80659]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:35 smithi141 ceph-mon[88165]: pgmap v148: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:35 smithi141 ceph-mon[88165]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:10:38.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:37 smithi038 ceph-mon[80659]: pgmap v149: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:38.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:37 smithi141 ceph-mon[88165]: pgmap v149: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:40.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:39 smithi038 ceph-mon[80659]: pgmap v150: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:39 smithi141 ceph-mon[88165]: pgmap v150: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T20:10:42.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:41 smithi038 ceph-mon[80659]: pgmap v151: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2023-12-16T20:10:42.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:41 smithi141 ceph-mon[88165]: pgmap v151: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2023-12-16T20:10:42.471 INFO:tasks.workunit.client.1.smithi141.stderr:Updating files: 98% (11449/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:Note: switching to 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'. 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T20:10:43.321 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: git switch -c 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr:Or undo this operation with: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: git switch - 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr: 2023-12-16T20:10:43.322 INFO:tasks.workunit.client.1.smithi141.stderr:HEAD is now at c7586e95519 Merge branch 'wip-qa-container-distros-s' of https://github.com/cbodley/ceph into wip-yuri8-testing-2023-12-15-0911 2023-12-16T20:10:43.326 DEBUG:teuthology.orchestra.run.smithi141:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-16T20:10:43.387 INFO:tasks.workunit.client.1.smithi141.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T20:10:43.389 INFO:tasks.workunit.client.1.smithi141.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T20:10:43.389 INFO:tasks.workunit.client.1.smithi141.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T20:10:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:43 smithi141 ceph-mon[88165]: pgmap v152: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T20:10:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:43 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:44.048 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:43 smithi038 ceph-mon[80659]: pgmap v152: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T20:10:44.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:43 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:44.200 INFO:tasks.workunit.client.1.smithi141.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T20:10:44.269 INFO:tasks.workunit.client.1.smithi141.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T20:10:44.322 INFO:tasks.workunit.client.1.smithi141.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T20:10:44.323 INFO:tasks.workunit.client.1.smithi141.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T20:10:44.324 INFO:tasks.workunit.client.1.smithi141.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T20:10:44.363 INFO:tasks.workunit.client.1.smithi141.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T20:10:44.366 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:10:44.366 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-16T20:10:44.423 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-16T20:10:44.426 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T20:10:44.426 DEBUG:teuthology.orchestra.run.smithi141:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-16T20:10:44.487 INFO:tasks.workunit.client.1.smithi141.stderr:+ mkdir -p fsstress 2023-12-16T20:10:44.489 INFO:tasks.workunit.client.1.smithi141.stderr:+ pushd fsstress 2023-12-16T20:10:44.490 INFO:tasks.workunit.client.1.smithi141.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T20:10:44.490 INFO:tasks.workunit.client.1.smithi141.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T20:10:45.659 INFO:tasks.workunit.client.1.smithi141.stderr:+ tar xzf ltp-full.tgz 2023-12-16T20:10:46.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:45 smithi038 ceph-mon[80659]: pgmap v153: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-16T20:10:46.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:45 smithi141 ceph-mon[88165]: pgmap v153: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-16T20:10:48.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:47 smithi038 ceph-mon[80659]: pgmap v154: 65 pgs: 65 active+clean; 605 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2023-12-16T20:10:48.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:47 smithi141 ceph-mon[88165]: pgmap v154: 65 pgs: 65 active+clean; 605 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2023-12-16T20:10:48.840 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 86% (10099/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T20:10:49.898 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'. 2023-12-16T20:10:49.898 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.898 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T20:10:49.898 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T20:10:49.899 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-12-16T20:10:49.900 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at c7586e95519 Merge branch 'wip-qa-container-distros-s' of https://github.com/cbodley/ceph into wip-yuri8-testing-2023-12-15-0911 2023-12-16T20:10:49.906 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T20:10:49.939 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T20:10:49.945 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T20:10:49.945 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T20:10:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:49 smithi038 ceph-mon[80659]: pgmap v155: 65 pgs: 65 active+clean; 605 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2023-12-16T20:10:50.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:49 smithi141 ceph-mon[88165]: pgmap v155: 65 pgs: 65 active+clean; 605 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2023-12-16T20:10:50.766 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T20:10:50.880 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T20:10:50.999 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T20:10:51.000 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T20:10:51.000 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T20:10:51.040 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T20:10:51.044 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:10:51.044 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T20:10:51.101 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-16T20:10:51.102 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T20:10:51.102 DEBUG:teuthology.orchestra.run.smithi038:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-16T20:10:51.165 INFO:tasks.workunit.client.0.smithi038.stderr:+ mkdir -p fsstress 2023-12-16T20:10:51.168 INFO:tasks.workunit.client.0.smithi038.stderr:+ pushd fsstress 2023-12-16T20:10:51.168 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T20:10:51.168 INFO:tasks.workunit.client.0.smithi038.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T20:10:52.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:51 smithi038 ceph-mon[80659]: pgmap v156: 65 pgs: 65 active+clean; 17 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 417 KiB/s rd, 1.4 MiB/s wr, 97 op/s 2023-12-16T20:10:52.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:51 smithi141 ceph-mon[88165]: pgmap v156: 65 pgs: 65 active+clean; 17 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 417 KiB/s rd, 1.4 MiB/s wr, 97 op/s 2023-12-16T20:10:53.025 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar xzf ltp-full.tgz 2023-12-16T20:10:53.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:53 smithi141 ceph-mon[88165]: pgmap v157: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 416 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-12-16T20:10:54.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:53 smithi038 ceph-mon[80659]: pgmap v157: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 416 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-12-16T20:10:55.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:54 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:10:55.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:54 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:10:56.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:55 smithi038 ceph-mon[80659]: pgmap v158: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 417 KiB/s rd, 2.7 MiB/s wr, 255 op/s 2023-12-16T20:10:56.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:55 smithi141 ceph-mon[88165]: pgmap v158: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 417 KiB/s rd, 2.7 MiB/s wr, 255 op/s 2023-12-16T20:10:58.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:57 smithi038 ceph-mon[80659]: pgmap v159: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 321 op/s 2023-12-16T20:10:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:57 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:57 smithi141 ceph-mon[88165]: pgmap v159: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 321 op/s 2023-12-16T20:10:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:57 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:10:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:59 smithi141 ceph-mon[88165]: pgmap v160: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 346 op/s 2023-12-16T20:10:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:10:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:10:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:10:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:10:59 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:00.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:59 smithi038 ceph-mon[80659]: pgmap v160: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 346 op/s 2023-12-16T20:11:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:11:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:11:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:10:59 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:01.072 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:00 smithi141 ceph-mon[88165]: Upgrade: Updating mgr.smithi141.cycgjd 2023-12-16T20:11:01.073 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:00 smithi141 ceph-mon[88165]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:11:01.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:00 smithi038 ceph-mon[80659]: Upgrade: Updating mgr.smithi141.cycgjd 2023-12-16T20:11:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:00 smithi038 ceph-mon[80659]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:11:01.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:01 smithi141 ceph-mon[88165]: pgmap v161: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.9 MiB/s wr, 444 op/s 2023-12-16T20:11:02.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:01 smithi038 ceph-mon[80659]: pgmap v161: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.9 MiB/s wr, 444 op/s 2023-12-16T20:11:03.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:02 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:03.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:02 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:03.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:02 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:03.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:02 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:03.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:02 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:03.242 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:02 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:04.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:03 smithi038 ceph-mon[80659]: pgmap v162: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 351 op/s 2023-12-16T20:11:04.147 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:03 smithi141 ceph-mon[88165]: pgmap v162: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 351 op/s 2023-12-16T20:11:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 -- 172.21.15.38:0/419056429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 msgr2=0x7fd8500fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 --2- 172.21.15.38:0/419056429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd8500fe250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd840004940 tx=0x7fd840009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 -- 172.21.15.38:0/419056429 shutdown_connections 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 --2- 172.21.15.38:0/419056429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd8500fe250 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 --2- 172.21.15.38:0/419056429 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd8500fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 -- 172.21.15.38:0/419056429 >> 172.21.15.38:0/419056429 conn(0x7fd8500f82d0 msgr2=0x7fd8500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.901+0000 7fd858438700 1 -- 172.21.15.38:0/419056429 shutdown_connections 2023-12-16T20:11:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.902+0000 7fd858438700 1 -- 172.21.15.38:0/419056429 wait complete. 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.902+0000 7fd858438700 1 Processor -- start 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd858438700 1 -- start start 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd858438700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd858438700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd858438700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850110210 con 0x7fd8500fde00 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd858438700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850110ab0 con 0x7fd8500fcbf0 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8559d3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:47690/0 (socket says 172.21.15.38:47690) 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8559d3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34468/0 (socket says 172.21.15.38:34468) 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 -- 172.21.15.38:0/2688643451 learned_addr learned my addr 172.21.15.38:0/2688643451 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 -- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 msgr2=0x7fd85010fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8561d4700 1 -- 172.21.15.38:0/2688643451 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840005040 con 0x7fd8500fcbf0 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.903+0000 7fd8559d3700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.904+0000 7fd8561d4700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00eb40 tx=0x7fd84c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.904+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c007cc0 con 0x7fd8500fcbf0 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.904+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850110d30 con 0x7fd8500fcbf0 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.904+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd84c00f040 con 0x7fd8500fcbf0 2023-12-16T20:11:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.904+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850111270 con 0x7fd8500fcbf0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.905+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c00c9f0 con 0x7fd8500fcbf0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.905+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850101ea0 con 0x7fd8500fcbf0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.905+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd84c00cc10 con 0x7fd8500fcbf0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.906+0000 7fd846ffd700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 0x7fd83c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.906+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd84c086900 con 0x7fd8500fcbf0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.906+0000 7fd8559d3700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 0x7fd83c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.907+0000 7fd8559d3700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 0x7fd83c06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd840013600 tx=0x7fd840009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:04.915+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd84c056770 con 0x7fd8500fcbf0 2023-12-16T20:11:05.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.180+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8501114e0 con 0x7fd83c068f60 2023-12-16T20:11:05.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.182+0000 7fd846ffd700 1 -- 172.21.15.38:0/2688643451 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fd8501114e0 con 0x7fd83c068f60 2023-12-16T20:11:05.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 msgr2=0x7fd83c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 0x7fd83c06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd840013600 tx=0x7fd840009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 msgr2=0x7fd85010f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00eb40 tx=0x7fd84c00b040 comp rx=0 tx=0).stop 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 shutdown_connections 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd83c068f60 0x7fd83c06b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8500fcbf0 0x7fd85010f6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 --2- 172.21.15.38:0/2688643451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8500fde00 0x7fd85010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 >> 172.21.15.38:0/2688643451 conn(0x7fd8500f82d0 msgr2=0x7fd8500ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 shutdown_connections 2023-12-16T20:11:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.184+0000 7fd858438700 1 -- 172.21.15.38:0/2688643451 wait complete. 2023-12-16T20:11:05.196 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 -- 172.21.15.38:0/3141386447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fde00 msgr2=0x7f37f40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 --2- 172.21.15.38:0/3141386447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fde00 0x7f37f40fe250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37e4004940 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 -- 172.21.15.38:0/3141386447 shutdown_connections 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 --2- 172.21.15.38:0/3141386447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fde00 0x7f37f40fe250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 --2- 172.21.15.38:0/3141386447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fcbf0 0x7f37f40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 -- 172.21.15.38:0/3141386447 >> 172.21.15.38:0/3141386447 conn(0x7f37f40f82d0 msgr2=0x7f37f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:05.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.312+0000 7f37fc506700 1 -- 172.21.15.38:0/3141386447 shutdown_connections 2023-12-16T20:11:05.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.313+0000 7f37fc506700 1 -- 172.21.15.38:0/3141386447 wait complete. 2023-12-16T20:11:05.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.313+0000 7f37fc506700 1 Processor -- start 2023-12-16T20:11:05.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.313+0000 7f37fc506700 1 -- start start 2023-12-16T20:11:05.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fc506700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fc506700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fde00 0x7f37f406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fc506700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4070590 con 0x7f37f40fcbf0 2023-12-16T20:11:05.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fc506700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4070700 con 0x7f37f40fde00 2023-12-16T20:11:05.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37f9aa1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fde00 0x7f37f406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34490/0 (socket says 172.21.15.38:34490) 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 -- 172.21.15.38:0/3011039184 learned_addr learned my addr 172.21.15.38:0/3011039184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 -- 172.21.15.38:0/3011039184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fde00 msgr2=0x7f37f406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fde00 0x7f37f406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.314+0000 7f37fa2a2700 1 -- 172.21.15.38:0/3011039184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4005040 con 0x7f37f40fcbf0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37fa2a2700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37f000eb40 tx=0x7f37f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f0007cc0 con 0x7f37f40fcbf0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37f000f040 con 0x7f37f40fcbf0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f4070980 con 0x7f37f40fcbf0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f000cad0 con 0x7f37f40fcbf0 2023-12-16T20:11:05.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.315+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f4115510 con 0x7f37f40fcbf0 2023-12-16T20:11:05.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.316+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f404bb80 con 0x7f37f40fcbf0 2023-12-16T20:11:05.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.317+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f37f000cc30 con 0x7f37f40fcbf0 2023-12-16T20:11:05.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.318+0000 7f37eaffd700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 0x7f37e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.318+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f37f00868f0 con 0x7f37f40fcbf0 2023-12-16T20:11:05.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.318+0000 7f37f9aa1700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 0x7f37e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.319+0000 7f37f9aa1700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 0x7f37e006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b0d0 tx=0x7f37e4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:05.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.323+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f37f0056800 con 0x7f37f40fcbf0 2023-12-16T20:11:05.463 INFO:tasks.workunit.client.1.smithi141.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T20:11:05.463 INFO:tasks.workunit.client.1.smithi141.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T20:11:05.463 INFO:tasks.workunit.client.1.smithi141.stderr:+ make 2023-12-16T20:11:05.603 INFO:tasks.workunit.client.1.smithi141.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T20:11:05.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.608+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37f4102750 con 0x7f37e0068f60 2023-12-16T20:11:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.610+0000 7f37eaffd700 1 -- 172.21.15.38:0/3011039184 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f37f4102750 con 0x7f37e0068f60 2023-12-16T20:11:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 msgr2=0x7f37e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 0x7f37e006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b0d0 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 msgr2=0x7f37f4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37f000eb40 tx=0x7f37f000b040 comp rx=0 tx=0).stop 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 shutdown_connections 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f37e0068f60 0x7f37e006b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37f40fcbf0 0x7f37f4071b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 --2- 172.21.15.38:0/3011039184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37f40fde00 0x7f37f406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 >> 172.21.15.38:0/3011039184 conn(0x7f37f40f82d0 msgr2=0x7f37f4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 shutdown_connections 2023-12-16T20:11:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.613+0000 7f37fc506700 1 -- 172.21.15.38:0/3011039184 wait complete. 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.728+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/1592120553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fde00 msgr2=0x7fd2d80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.728+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/1592120553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fde00 0x7fd2d80fe250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc004940 tx=0x7fd2cc009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/1592120553 shutdown_connections 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/1592120553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fde00 0x7fd2d80fe250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/1592120553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/1592120553 >> 172.21.15.38:0/1592120553 conn(0x7fd2d80f82d0 msgr2=0x7fd2d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/1592120553 shutdown_connections 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/1592120553 wait complete. 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 Processor -- start 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- start start 2023-12-16T20:11:05.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fde00 0x7fd2d810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d810dfd0 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2dcd0b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d810e870 con 0x7fd2d80fde00 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34498/0 (socket says 172.21.15.38:34498) 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2d659c700 1 -- 172.21.15.38:0/238888086 learned_addr learned my addr 172.21.15.38:0/238888086 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:05.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.729+0000 7fd2d5d9b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fde00 0x7fd2d810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2d659c700 1 -- 172.21.15.38:0/238888086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fde00 msgr2=0x7fd2d810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2d659c700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fde00 0x7fd2d810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2d659c700 1 -- 172.21.15.38:0/238888086 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc005040 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2d659c700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8002a80 tx=0x7fd2c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c8007cc0 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2c800f040 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d810eb50 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c800d9e0 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.730+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d810f090 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.731+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d804bb80 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.732+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd2c800dc50 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.732+0000 7fd2c6ffd700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 0x7fd2c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:05.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.733+0000 7fd2d5d9b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 0x7fd2c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:05.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.733+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd2c80865f0 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.733+0000 7fd2d5d9b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 0x7fd2c006b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc004890 tx=0x7fd2cc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:05.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.737+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd2c804ca00 con 0x7fd2d80fcbf0 2023-12-16T20:11:05.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:05 smithi038 ceph-mon[80659]: pgmap v163: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-12-16T20:11:05.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.962+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2d810f4f0 con 0x7fd2c0068f60 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.973+0000 7fd2c6ffd700 1 -- 172.21.15.38:0/238888086 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fd2d810f4f0 con 0x7fd2c0068f60 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (3m) 79s ago 4m 24.2M - 0.25.0 c8568f914cd2 3b37fdee0436 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (5m) 79s ago 5m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (4m) 82s ago 4m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (3m) 79s ago 4m 83.9M - 9.4.7 954c08fa6188 aef7cc507220 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (88s) 79s ago 88s 15.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:11:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (91s) 79s ago 91s 9445k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (86s) 82s ago 86s 12.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (90s) 82s ago 90s 15.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:9283 running (5m) 79s ago 5m 476M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6c2471ed13fc 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 starting - - - - 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (5m) 79s ago 5m 47.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (4m) 82s ago 4m 43.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (4m) 79s ago 4m 14.3M - 1.5.0 0da6a335fe13 529b4731a151 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (4m) 82s ago 4m 15.8M - 1.5.0 0da6a335fe13 0c4b9420e095 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 79s ago 3m 45.5M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (3m) 79s ago 3m 47.9M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (3m) 79s ago 3m 45.7M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (2m) 82s ago 2m 44.4M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (2m) 82s ago 2m 41.5M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (2m) 82s ago 2m 43.9M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:11:05.975 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 79s ago 4m 42.8M - 2.43.0 a07b618ecd1d aa5366916390 2023-12-16T20:11:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 msgr2=0x7fd2c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 0x7fd2c006b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc004890 tx=0x7fd2cc009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 msgr2=0x7fd2d810d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8002a80 tx=0x7fd2c80046b0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 shutdown_connections 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7fd2c0068f60 0x7fd2c006b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d80fcbf0 0x7fd2d810d490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 --2- 172.21.15.38:0/238888086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2d80fde00 0x7fd2d810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.975+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 >> 172.21.15.38:0/238888086 conn(0x7fd2d80f82d0 msgr2=0x7fd2d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.976+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 shutdown_connections 2023-12-16T20:11:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:05.976+0000 7fd2dcd0b700 1 -- 172.21.15.38:0/238888086 wait complete. 2023-12-16T20:11:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.131+0000 7f7600931700 1 -- 172.21.15.38:0/2228665148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06eb60 msgr2=0x7f75fc108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.131+0000 7f7600931700 1 --2- 172.21.15.38:0/2228665148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06eb60 0x7f75fc108c60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f75ec004940 tx=0x7f75ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.134+0000 7f7600931700 1 -- 172.21.15.38:0/2228665148 shutdown_connections 2023-12-16T20:11:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.134+0000 7f7600931700 1 --2- 172.21.15.38:0/2228665148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06eb60 0x7f75fc108c60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.134+0000 7f7600931700 1 --2- 172.21.15.38:0/2228665148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06e210 0x7f75fc06e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.134+0000 7f7600931700 1 -- 172.21.15.38:0/2228665148 >> 172.21.15.38:0/2228665148 conn(0x7f75fc069b20 msgr2=0x7f75fc06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.135+0000 7f7600931700 1 -- 172.21.15.38:0/2228665148 shutdown_connections 2023-12-16T20:11:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.135+0000 7f7600931700 1 -- 172.21.15.38:0/2228665148 wait complete. 2023-12-16T20:11:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.136+0000 7f7600931700 1 Processor -- start 2023-12-16T20:11:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.137+0000 7f7600931700 1 -- start start 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f7600931700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 0x7f75fc1128e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f7600931700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f7600931700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc113450 con 0x7f75fc06e210 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f7600931700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc125f00 con 0x7f75fc06eb60 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f75f9d9b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f75f9d9b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:47728/0 (socket says 172.21.15.38:47728) 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.138+0000 7f75f9d9b700 1 -- 172.21.15.38:0/3620119455 learned_addr learned my addr 172.21.15.38:0/3620119455 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.139+0000 7f75f9d9b700 1 -- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 msgr2=0x7f75fc1128e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.139+0000 7f75fa59c700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 0x7f75fc1128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.139+0000 7f75f9d9b700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 0x7f75fc1128e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.139+0000 7f75f9d9b700 1 -- 172.21.15.38:0/3620119455 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec005040 con 0x7f75fc06eb60 2023-12-16T20:11:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.139+0000 7f75fa59c700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 0x7f75fc1128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:11:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.143+0000 7f75f9d9b700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00b730 tx=0x7f75ec009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.144+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75ec00e070 con 0x7f75fc06eb60 2023-12-16T20:11:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.144+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75ec00bc10 con 0x7f75fc06eb60 2023-12-16T20:11:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.144+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75ec01c400 con 0x7f75fc06eb60 2023-12-16T20:11:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.146+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc126120 con 0x7f75fc06eb60 2023-12-16T20:11:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.146+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc126570 con 0x7f75fc06eb60 2023-12-16T20:11:06.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.149+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc10c9c0 con 0x7f75fc06eb60 2023-12-16T20:11:06.153 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:05 smithi141 ceph-mon[88165]: pgmap v163: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2023-12-16T20:11:06.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.154+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f75ec013420 con 0x7f75fc06eb60 2023-12-16T20:11:06.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.154+0000 7f75eaffd700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 0x7f75e406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.154+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f75ec088590 con 0x7f75fc06eb60 2023-12-16T20:11:06.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.155+0000 7f75fa59c700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 0x7f75e406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:06.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.157+0000 7f75fa59c700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 0x7f75e406b5b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007fd0 tx=0x7f75f0009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:06.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.164+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f75ec0549f0 con 0x7f75fc06eb60 2023-12-16T20:11:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.743+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75fc114400 con 0x7f75fc06eb60 2023-12-16T20:11:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.746+0000 7f75eaffd700 1 -- 172.21.15.38:0/3620119455 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f75ec058010 con 0x7f75fc06eb60 2023-12-16T20:11:06.747 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:11:06.747 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:11:06.747 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:11:06.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:06.747 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:11:06.748 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:11:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 msgr2=0x7f75e406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 0x7f75e406b5b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007fd0 tx=0x7f75f0009040 comp rx=0 tx=0).stop 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 msgr2=0x7f75fc112e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00b730 tx=0x7f75ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 shutdown_connections 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f75e4069100 0x7f75e406b5b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75fc06e210 0x7f75fc1128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 --2- 172.21.15.38:0/3620119455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75fc06eb60 0x7f75fc112e20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.752+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 >> 172.21.15.38:0/3620119455 conn(0x7f75fc069b20 msgr2=0x7f75fc1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.753+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 shutdown_connections 2023-12-16T20:11:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.754+0000 7f7600931700 1 -- 172.21.15.38:0/3620119455 wait complete. 2023-12-16T20:11:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 -- 172.21.15.38:0/1521989642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06fa30 msgr2=0x7f67ac06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 --2- 172.21.15.38:0/1521989642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06fa30 0x7f67ac06dea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f679c004940 tx=0x7f679c009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 -- 172.21.15.38:0/1521989642 shutdown_connections 2023-12-16T20:11:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 --2- 172.21.15.38:0/1521989642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67ac06e470 0x7f67ac06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 --2- 172.21.15.38:0/1521989642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06fa30 0x7f67ac06dea0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.952+0000 7f67ab59e700 1 -- 172.21.15.38:0/1521989642 >> 172.21.15.38:0/1521989642 conn(0x7f67ac069b70 msgr2=0x7f67ac06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.955+0000 7f67ab59e700 1 -- 172.21.15.38:0/1521989642 shutdown_connections 2023-12-16T20:11:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.955+0000 7f67ab59e700 1 -- 172.21.15.38:0/1521989642 wait complete. 2023-12-16T20:11:06.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 Processor -- start 2023-12-16T20:11:06.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 -- start start 2023-12-16T20:11:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67ac06fa30 0x7f67ac11c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac11cc20 con 0x7f67ac06fa30 2023-12-16T20:11:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67ab59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac11d4c0 con 0x7f67ac06e470 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.956+0000 7f67aa59c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.957+0000 7f67aa59c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:47742/0 (socket says 172.21.15.38:47742) 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.957+0000 7f67aa59c700 1 -- 172.21.15.38:0/616931994 learned_addr learned my addr 172.21.15.38:0/616931994 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.957+0000 7f67aa59c700 1 -- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67ac06fa30 msgr2=0x7f67ac11c620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.957+0000 7f67aa59c700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67ac06fa30 0x7f67ac11c620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.957+0000 7f67aa59c700 1 -- 172.21.15.38:0/616931994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c005040 con 0x7f67ac06e470 2023-12-16T20:11:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.958+0000 7f67aa59c700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b730 tx=0x7f679c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.959+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f679c00e070 con 0x7f67ac06e470 2023-12-16T20:11:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.959+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f679c00bc10 con 0x7f67ac06e470 2023-12-16T20:11:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.959+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f679c01c400 con 0x7f67ac06e470 2023-12-16T20:11:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.959+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac11d740 con 0x7f67ac06e470 2023-12-16T20:11:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.960+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac11dc80 con 0x7f67ac06e470 2023-12-16T20:11:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.961+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac04bb80 con 0x7f67ac06e470 2023-12-16T20:11:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.962+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f679c013420 con 0x7f67ac06e470 2023-12-16T20:11:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.963+0000 7f679affd700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 0x7f679406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.963+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f679c0888e0 con 0x7f67ac06e470 2023-12-16T20:11:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.964+0000 7f67a9d9b700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 0x7f679406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.964+0000 7f67a9d9b700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 0x7f679406b5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67a0004d00 tx=0x7f67a0009ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:06.971+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f679c0587d0 con 0x7f67ac06e470 2023-12-16T20:11:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:06 smithi038 ceph-mon[80659]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:06 smithi038 ceph-mon[80659]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:06 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3620119455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:11:07.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:06 smithi141 ceph-mon[88165]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:07.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:06 smithi141 ceph-mon[88165]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:07.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:06 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3620119455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:11:07.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.416+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 --> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67ac108370 con 0x7f6794069100 2023-12-16T20:11:07.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.418+0000 7f679affd700 1 -- 172.21.15.38:0/616931994 <== mgr.14214 v2:172.21.15.38:6800/3097077380 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f67ac108370 con 0x7f6794069100 2023-12-16T20:11:07.419 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:11:07.419 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:11:07.419 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:11:07.419 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:11:07.420 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2023-12-16T20:11:07.420 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "", 2023-12-16T20:11:07.420 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mgr daemons", 2023-12-16T20:11:07.420 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:11:07.420 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:11:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 msgr2=0x7f679406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 0x7f679406b5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67a0004d00 tx=0x7f67a0009ce0 comp rx=0 tx=0).stop 2023-12-16T20:11:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 msgr2=0x7f67ac11c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b730 tx=0x7f679c009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 shutdown_connections 2023-12-16T20:11:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:6800/3097077380,v1:172.21.15.38:6801/3097077380] conn(0x7f6794069100 0x7f679406b5b0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67a0004d00 tx=0x7f67a0009ce0 comp rx=0 tx=0).stop 2023-12-16T20:11:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac06e470 0x7f67ac11c0e0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b730 tx=0x7f679c009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 --2- 172.21.15.38:0/616931994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67ac06fa30 0x7f67ac11c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.426+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 >> 172.21.15.38:0/616931994 conn(0x7f67ac069b70 msgr2=0x7f67ac106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.430+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 shutdown_connections 2023-12-16T20:11:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:07.431+0000 7f67ab59e700 1 -- 172.21.15.38:0/616931994 wait complete. 2023-12-16T20:11:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:07 smithi038 ceph-mon[80659]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:07 smithi038 ceph-mon[80659]: pgmap v164: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 196 op/s 2023-12-16T20:11:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:07 smithi141 ceph-mon[88165]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:07 smithi141 ceph-mon[88165]: pgmap v164: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 196 op/s 2023-12-16T20:11:09.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:08 smithi038 ceph-mon[80659]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:08 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:08 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:09.190 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:08 smithi141 ceph-mon[88165]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:09.190 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:08 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:09.190 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:08 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:10.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:09 smithi038 ceph-mon[80659]: pgmap v165: 65 pgs: 65 active+clean; 103 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 271 op/s 2023-12-16T20:11:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:09 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:09 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:09 smithi141 ceph-mon[88165]: pgmap v165: 65 pgs: 65 active+clean; 103 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 271 op/s 2023-12-16T20:11:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:09 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:09 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: pgmap v166: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 1.05k op/s 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:11:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:11 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: pgmap v166: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 1.05k op/s 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:11:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:11 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:11:13.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:12 smithi038 ceph-mon[80659]: mgrmap e20: smithi038.gdlrfj(active, since 4m), standbys: smithi141.cycgjd 2023-12-16T20:11:13.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:12 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:12 smithi141 ceph-mon[88165]: mgrmap e20: smithi038.gdlrfj(active, since 4m), standbys: smithi141.cycgjd 2023-12-16T20:11:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:12 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:13 smithi038 ceph-mon[80659]: pgmap v167: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 1.12k op/s 2023-12-16T20:11:14.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:13 smithi141 ceph-mon[88165]: pgmap v167: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 1.12k op/s 2023-12-16T20:11:14.261 INFO:tasks.workunit.client.0.smithi038.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T20:11:14.268 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T20:11:14.268 INFO:tasks.workunit.client.0.smithi038.stderr:+ make 2023-12-16T20:11:14.347 INFO:tasks.workunit.client.0.smithi038.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T20:11:15.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ readlink -f fsstress 2023-12-16T20:11:15.120 INFO:tasks.workunit.client.0.smithi038.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T20:11:15.120 INFO:tasks.workunit.client.0.smithi038.stderr:+ popd 2023-12-16T20:11:15.141 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T20:11:15.141 INFO:tasks.workunit.client.0.smithi038.stderr:+ popd 2023-12-16T20:11:15.141 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-16T20:11:15.142 INFO:tasks.workunit.client.0.smithi038.stderr:++ mktemp -d -p . 2023-12-16T20:11:15.143 INFO:tasks.workunit.client.0.smithi038.stderr:+ T=./tmp.d6soZLuafT 2023-12-16T20:11:15.143 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.d6soZLuafT -l 1 -n 1000 -p 10 -v 2023-12-16T20:11:15.144 INFO:tasks.workunit.client.0.smithi038.stdout:seed = 1702638504 2023-12-16T20:11:15.146 INFO:tasks.workunit.client.0.smithi038.stdout:0/0: stat - no entries 2023-12-16T20:11:15.146 INFO:tasks.workunit.client.0.smithi038.stdout:0/1: dread - no filename 2023-12-16T20:11:15.146 INFO:tasks.workunit.client.0.smithi038.stdout:1/0: rename - no filename 2023-12-16T20:11:15.146 INFO:tasks.workunit.client.0.smithi038.stdout:1/1: dwrite - no filename 2023-12-16T20:11:15.147 INFO:tasks.workunit.client.0.smithi038.stdout:0/2: creat f0 x:0 0 0 2023-12-16T20:11:15.147 INFO:tasks.workunit.client.0.smithi038.stdout:0/3: dread - f0 zero size 2023-12-16T20:11:15.147 INFO:tasks.workunit.client.0.smithi038.stdout:0/4: dread - f0 zero size 2023-12-16T20:11:15.148 INFO:tasks.workunit.client.0.smithi038.stdout:2/0: chown . 378 1 2023-12-16T20:11:15.148 INFO:tasks.workunit.client.0.smithi038.stdout:2/1: truncate - no filename 2023-12-16T20:11:15.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/2: mknod c0 0 2023-12-16T20:11:15.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/3: dwrite - no filename 2023-12-16T20:11:15.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/4: dread - no filename 2023-12-16T20:11:15.149 INFO:tasks.workunit.client.0.smithi038.stdout:0/5: link f0 f1 0 2023-12-16T20:11:15.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/0: chown . 2 1 2023-12-16T20:11:15.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/1: read - no filename 2023-12-16T20:11:15.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/2: chown . 28786647 1 2023-12-16T20:11:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/2: symlink l0 0 2023-12-16T20:11:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:1/5: mknod c1 0 2023-12-16T20:11:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:1/6: fsync - no filename 2023-12-16T20:11:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:1/7: fdatasync - no filename 2023-12-16T20:11:15.151 INFO:tasks.workunit.client.0.smithi038.stdout:1/8: fdatasync - no filename 2023-12-16T20:11:15.152 INFO:tasks.workunit.client.0.smithi038.stdout:0/6: mknod c2 0 2023-12-16T20:11:15.152 INFO:tasks.workunit.client.0.smithi038.stdout:0/7: creat f3 x:0 0 0 2023-12-16T20:11:15.152 INFO:tasks.workunit.client.0.smithi038.stdout:0/8: chown c2 22694 1 2023-12-16T20:11:15.152 INFO:tasks.workunit.client.0.smithi038.stdout:0/9: dread - f3 zero size 2023-12-16T20:11:15.152 INFO:tasks.workunit.client.0.smithi038.stdout:0/10: creat f4 x:0 0 0 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/11: rmdir - no directory 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/12: chown f3 4573 1 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/13: chown f3 2646321 1 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/14: dread - f4 zero size 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:4/0: fsync - no filename 2023-12-16T20:11:15.153 INFO:tasks.workunit.client.0.smithi038.stdout:4/1: truncate - no filename 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:3/3: creat f0 x:0 0 0 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:3/4: chown f0 863438 1 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/3: mkdir d1 0 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/4: truncate - no filename 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/5: readlink l0 0 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/6: getdents d1 0 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/7: dread - no filename 2023-12-16T20:11:15.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/8: fdatasync - no filename 2023-12-16T20:11:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/9: getdents d1 0 2023-12-16T20:11:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/10: dwrite - no filename 2023-12-16T20:11:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/11: fsync - no filename 2023-12-16T20:11:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:1/9: creat f2 x:0 0 0 2023-12-16T20:11:15.155 INFO:tasks.workunit.client.0.smithi038.stdout:1/10: chown c0 411157586 1 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/0: readlink - no filename 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/1: rmdir - no directory 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/2: stat - no entries 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/3: dread - no filename 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/4: chown . 25 1 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/5: chown . 97069873 1 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/6: chown . 36740950 1 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/7: getdents . 0 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/8: read - no filename 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/9: read - no filename 2023-12-16T20:11:15.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/10: read - no filename 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/11: read - no filename 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/12: dwrite - no filename 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/13: chown . 267669797 1 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/14: stat - no entries 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/15: write - no filename 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:5/16: dread - no filename 2023-12-16T20:11:15.157 INFO:tasks.workunit.client.0.smithi038.stdout:4/2: mknod c0 0 2023-12-16T20:11:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:2/12: symlink d1/l2 0 2023-12-16T20:11:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:2/13: chown l0 6 1 2023-12-16T20:11:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:1/11: symlink l3 0 2023-12-16T20:11:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:6/0: dwrite - no filename 2023-12-16T20:11:15.158 INFO:tasks.workunit.client.0.smithi038.stdout:6/1: readlink - no filename 2023-12-16T20:11:15.159 INFO:tasks.workunit.client.0.smithi038.stdout:5/17: creat f0 x:0 0 0 2023-12-16T20:11:15.159 INFO:tasks.workunit.client.0.smithi038.stdout:5/18: chown f0 0 1 2023-12-16T20:11:15.159 INFO:tasks.workunit.client.0.smithi038.stdout:5/19: chown f0 3614395 1 2023-12-16T20:11:15.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/3: creat f1 x:0 0 0 2023-12-16T20:11:15.160 INFO:tasks.workunit.client.0.smithi038.stdout:2/14: mknod d1/c3 0 2023-12-16T20:11:15.161 INFO:tasks.workunit.client.0.smithi038.stdout:2/15: dread - no filename 2023-12-16T20:11:15.161 INFO:tasks.workunit.client.0.smithi038.stdout:1/12: rename l3 to l4 0 2023-12-16T20:11:15.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/13: dread - f2 zero size 2023-12-16T20:11:15.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/14: dread - f2 zero size 2023-12-16T20:11:15.164 INFO:tasks.workunit.client.0.smithi038.stdout:2/16: mknod d1/c4 0 2023-12-16T20:11:15.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/0: rename - no filename 2023-12-16T20:11:15.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/1: chown . 81 1 2023-12-16T20:11:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/0: mknod c0 0 2023-12-16T20:11:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/1: chown c0 13815 1 2023-12-16T20:11:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/2: dwrite - no filename 2023-12-16T20:11:15.172 INFO:tasks.workunit.client.0.smithi038.stdout:2/17: mkdir d1/d5 0 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/18: dread - no filename 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/19: fdatasync - no filename 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/20: dread - no filename 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/21: dwrite - no filename 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/22: write - no filename 2023-12-16T20:11:15.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/23: dread - no filename 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/15: fsync f0 0 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/16: creat f5 x:0 0 0 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/17: write f5 [676763,6070] 0 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/18: readlink - no filename 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/19: stat f5 0 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/20: chown f3 13 1 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/21: creat f6 x:0 0 0 2023-12-16T20:11:15.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/22: write f0 [486765,35901] 0 2023-12-16T20:11:15.177 INFO:tasks.workunit.client.0.smithi038.stdout:9/0: dread - no filename 2023-12-16T20:11:15.180 INFO:tasks.workunit.client.0.smithi038.stdout:8/2: creat f0 x:0 0 0 2023-12-16T20:11:15.181 INFO:tasks.workunit.client.0.smithi038.stdout:7/3: link c0 c1 0 2023-12-16T20:11:15.181 INFO:tasks.workunit.client.0.smithi038.stdout:7/4: dread - no filename 2023-12-16T20:11:15.181 INFO:tasks.workunit.client.0.smithi038.stdout:7/5: rmdir - no directory 2023-12-16T20:11:15.185 INFO:tasks.workunit.client.0.smithi038.stdout:2/24: link d1/c4 d1/c6 0 2023-12-16T20:11:15.185 INFO:tasks.workunit.client.0.smithi038.stdout:2/25: dread - no filename 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:9/1: symlink l0 0 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:9/2: dread - no filename 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/23: symlink l7 0 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/24: chown f4 2889 1 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/25: write f1 [1459487,84326] 0 2023-12-16T20:11:15.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/26: creat f8 x:0 0 0 2023-12-16T20:11:15.196 INFO:tasks.workunit.client.0.smithi038.stdout:8/3: rename f0 to f1 0 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/6: mknod c2 0 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/7: read - no filename 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/8: fsync - no filename 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/9: write - no filename 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/10: truncate - no filename 2023-12-16T20:11:15.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/11: chown c0 150656 1 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:2/26: creat d1/d5/f7 x:0 0 0 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:8/4: dread - f1 zero size 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/3: mknod c1 0 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/4: fdatasync - no filename 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/5: dwrite - no filename 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/6: dread - no filename 2023-12-16T20:11:15.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/7: stat l0 0 2023-12-16T20:11:15.199 INFO:tasks.workunit.client.0.smithi038.stdout:7/12: rename c2 to c3 0 2023-12-16T20:11:15.199 INFO:tasks.workunit.client.0.smithi038.stdout:7/13: fdatasync - no filename 2023-12-16T20:11:15.199 INFO:tasks.workunit.client.0.smithi038.stdout:7/14: chown c3 3733552 1 2023-12-16T20:11:15.199 INFO:tasks.workunit.client.0.smithi038.stdout:9/8: creat f2 x:0 0 0 2023-12-16T20:11:15.199 INFO:tasks.workunit.client.0.smithi038.stdout:9/9: truncate f2 701710 0 2023-12-16T20:11:15.202 INFO:tasks.workunit.client.0.smithi038.stdout:7/15: unlink c1 0 2023-12-16T20:11:15.203 INFO:tasks.workunit.client.0.smithi038.stdout:7/16: dread - no filename 2023-12-16T20:11:15.203 INFO:tasks.workunit.client.0.smithi038.stdout:7/17: fdatasync - no filename 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/4: fsync f1 0 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/5: dread - f1 zero size 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/6: stat f1 0 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/7: chown f1 30 1 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/8: dread - f1 zero size 2023-12-16T20:11:15.233 INFO:tasks.workunit.client.0.smithi038.stdout:4/9: fdatasync f1 0 2023-12-16T20:11:15.234 INFO:tasks.workunit.client.0.smithi038.stdout:4/10: creat f2 x:0 0 0 2023-12-16T20:11:15.234 INFO:tasks.workunit.client.0.smithi038.stdout:1/15: getdents . 0 2023-12-16T20:11:15.251 INFO:tasks.workunit.client.0.smithi038.stdout:1/16: symlink l5 0 2023-12-16T20:11:15.251 INFO:tasks.workunit.client.0.smithi038.stdout:1/17: rmdir - no directory 2023-12-16T20:11:15.280 INFO:tasks.workunit.client.0.smithi038.stdout:1/18: rename c0 to c6 0 2023-12-16T20:11:15.326 INFO:tasks.workunit.client.0.smithi038.stdout:3/5: dwrite f0 [0,4194304] 0 2023-12-16T20:11:15.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/5: dwrite f1 [0,4194304] 0 2023-12-16T20:11:15.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/6: creat f2 x:0 0 0 2023-12-16T20:11:15.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/7: chown f2 134788 1 2023-12-16T20:11:15.688 INFO:tasks.workunit.client.0.smithi038.stdout:2/27: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:15.711 INFO:tasks.workunit.client.0.smithi038.stdout:8/8: dread f1 [0,4194304] 0 2023-12-16T20:11:15.737 INFO:tasks.workunit.client.0.smithi038.stdout:9/10: dwrite f2 [0,4194304] 0 2023-12-16T20:11:15.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/19: dwrite f2 [0,4194304] 0 2023-12-16T20:11:15.782 INFO:tasks.workunit.client.0.smithi038.stdout:0/27: truncate f0 298227 0 2023-12-16T20:11:15.803 INFO:tasks.workunit.client.0.smithi038.stdout:4/11: getdents . 0 2023-12-16T20:11:15.803 INFO:tasks.workunit.client.0.smithi038.stdout:4/12: dread - f1 zero size 2023-12-16T20:11:15.803 INFO:tasks.workunit.client.0.smithi038.stdout:4/13: write f2 [259285,20796] 0 2023-12-16T20:11:15.803 INFO:tasks.workunit.client.0.smithi038.stdout:4/14: write f1 [683632,81218] 0 2023-12-16T20:11:15.862 INFO:tasks.workunit.client.0.smithi038.stdout:2/28: write d1/d5/f7 [63511,55814] 0 2023-12-16T20:11:15.866 INFO:tasks.workunit.client.0.smithi038.stdout:9/11: dread f2 [0,4194304] 0 2023-12-16T20:11:15.866 INFO:tasks.workunit.client.0.smithi038.stdout:9/12: truncate f2 4543228 0 2023-12-16T20:11:15.866 INFO:tasks.workunit.client.0.smithi038.stdout:9/13: creat f3 x:0 0 0 2023-12-16T20:11:15.887 INFO:tasks.workunit.client.0.smithi038.stdout:2/29: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:15.994 INFO:tasks.workunit.client.0.smithi038.stdout:3/6: truncate f0 3529724 0 2023-12-16T20:11:15.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:15 smithi141 ceph-mon[88165]: pgmap v168: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 9.8 MiB/s wr, 1.14k op/s 2023-12-16T20:11:16.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:15 smithi038 ceph-mon[80659]: pgmap v168: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 9.8 MiB/s wr, 1.14k op/s 2023-12-16T20:11:16.691 INFO:tasks.workunit.client.1.smithi141.stderr:++ readlink -f fsstress 2023-12-16T20:11:16.691 INFO:tasks.workunit.client.1.smithi141.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T20:11:16.691 INFO:tasks.workunit.client.1.smithi141.stderr:+ popd 2023-12-16T20:11:16.692 INFO:tasks.workunit.client.1.smithi141.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T20:11:16.692 INFO:tasks.workunit.client.1.smithi141.stderr:+ popd 2023-12-16T20:11:16.692 INFO:tasks.workunit.client.1.smithi141.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-16T20:11:16.692 INFO:tasks.workunit.client.1.smithi141.stderr:++ mktemp -d -p . 2023-12-16T20:11:16.693 INFO:tasks.workunit.client.1.smithi141.stderr:+ T=./tmp.4xHX90MwIG 2023-12-16T20:11:16.693 INFO:tasks.workunit.client.1.smithi141.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.4xHX90MwIG -l 1 -n 1000 -p 10 -v 2023-12-16T20:11:16.694 INFO:tasks.workunit.client.1.smithi141.stdout:seed = 1702140455 2023-12-16T20:11:16.696 INFO:tasks.workunit.client.1.smithi141.stdout:0/0: chown . 20228304 1 2023-12-16T20:11:16.697 INFO:tasks.workunit.client.1.smithi141.stdout:1/0: dwrite - no filename 2023-12-16T20:11:16.697 INFO:tasks.workunit.client.1.smithi141.stdout:1/1: dwrite - no filename 2023-12-16T20:11:16.697 INFO:tasks.workunit.client.1.smithi141.stdout:1/2: write - no filename 2023-12-16T20:11:16.697 INFO:tasks.workunit.client.1.smithi141.stdout:1/3: dwrite - no filename 2023-12-16T20:11:16.697 INFO:tasks.workunit.client.1.smithi141.stdout:1/4: write - no filename 2023-12-16T20:11:16.698 INFO:tasks.workunit.client.1.smithi141.stdout:1/5: dread - no filename 2023-12-16T20:11:16.698 INFO:tasks.workunit.client.1.smithi141.stdout:0/1: symlink l0 0 2023-12-16T20:11:16.698 INFO:tasks.workunit.client.1.smithi141.stdout:0/2: truncate - no filename 2023-12-16T20:11:16.699 INFO:tasks.workunit.client.1.smithi141.stdout:1/6: creat f0 x:0 0 0 2023-12-16T20:11:16.700 INFO:tasks.workunit.client.1.smithi141.stdout:0/3: creat f1 x:0 0 0 2023-12-16T20:11:16.700 INFO:tasks.workunit.client.1.smithi141.stdout:0/4: creat f2 x:0 0 0 2023-12-16T20:11:16.700 INFO:tasks.workunit.client.1.smithi141.stdout:0/5: read - f1 zero size 2023-12-16T20:11:16.700 INFO:tasks.workunit.client.1.smithi141.stdout:0/6: dread - f1 zero size 2023-12-16T20:11:16.701 INFO:tasks.workunit.client.1.smithi141.stdout:3/0: dread - no filename 2023-12-16T20:11:16.701 INFO:tasks.workunit.client.1.smithi141.stdout:3/1: truncate - no filename 2023-12-16T20:11:16.701 INFO:tasks.workunit.client.1.smithi141.stdout:3/2: write - no filename 2023-12-16T20:11:16.701 INFO:tasks.workunit.client.1.smithi141.stdout:2/0: creat f0 x:0 0 0 2023-12-16T20:11:16.701 INFO:tasks.workunit.client.1.smithi141.stdout:1/7: rename f0 to f1 0 2023-12-16T20:11:16.702 INFO:tasks.workunit.client.1.smithi141.stdout:1/8: readlink - no filename 2023-12-16T20:11:16.703 INFO:tasks.workunit.client.1.smithi141.stdout:4/0: rename - no filename 2023-12-16T20:11:16.703 INFO:tasks.workunit.client.1.smithi141.stdout:4/1: dwrite - no filename 2023-12-16T20:11:16.703 INFO:tasks.workunit.client.1.smithi141.stdout:4/2: write - no filename 2023-12-16T20:11:16.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/3: mkdir d0 0 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/4: dwrite - no filename 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/5: rename d0 to d0/d1 22 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/6: write - no filename 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/7: dread - no filename 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/8: chown d0 113 1 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/9: rename d0 to d0/d2 22 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/10: dread - no filename 2023-12-16T20:11:16.704 INFO:tasks.workunit.client.1.smithi141.stdout:2/1: symlink l1 0 2023-12-16T20:11:16.705 INFO:tasks.workunit.client.1.smithi141.stdout:1/9: mknod c2 0 2023-12-16T20:11:16.705 INFO:tasks.workunit.client.1.smithi141.stdout:1/10: dread - f1 zero size 2023-12-16T20:11:16.705 INFO:tasks.workunit.client.1.smithi141.stdout:1/11: chown f1 1311334 1 2023-12-16T20:11:16.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/0: rename - no filename 2023-12-16T20:11:16.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/1: write - no filename 2023-12-16T20:11:16.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/2: fdatasync - no filename 2023-12-16T20:11:16.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/3: dread - no filename 2023-12-16T20:11:16.706 INFO:tasks.workunit.client.1.smithi141.stdout:4/3: symlink l0 0 2023-12-16T20:11:16.707 INFO:tasks.workunit.client.1.smithi141.stdout:4/4: dread - no filename 2023-12-16T20:11:16.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/11: symlink d0/l3 0 2023-12-16T20:11:16.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/12: write - no filename 2023-12-16T20:11:16.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/13: dwrite - no filename 2023-12-16T20:11:16.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/2: unlink f0 0 2023-12-16T20:11:16.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/3: dwrite - no filename 2023-12-16T20:11:16.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/4: truncate - no filename 2023-12-16T20:11:16.711 INFO:tasks.workunit.client.1.smithi141.stdout:6/0: dwrite - no filename 2023-12-16T20:11:16.711 INFO:tasks.workunit.client.1.smithi141.stdout:6/1: truncate - no filename 2023-12-16T20:11:16.713 INFO:tasks.workunit.client.1.smithi141.stdout:5/4: mkdir d0 0 2023-12-16T20:11:16.713 INFO:tasks.workunit.client.1.smithi141.stdout:0/7: fsync f1 0 2023-12-16T20:11:16.715 INFO:tasks.workunit.client.1.smithi141.stdout:4/5: creat f1 x:0 0 0 2023-12-16T20:11:16.715 INFO:tasks.workunit.client.1.smithi141.stdout:4/6: creat f2 x:0 0 0 2023-12-16T20:11:16.717 INFO:tasks.workunit.client.1.smithi141.stdout:3/14: link d0/l3 d0/l4 0 2023-12-16T20:11:16.719 INFO:tasks.workunit.client.1.smithi141.stdout:2/5: symlink l2 0 2023-12-16T20:11:16.719 INFO:tasks.workunit.client.1.smithi141.stdout:2/6: dwrite - no filename 2023-12-16T20:11:16.721 INFO:tasks.workunit.client.1.smithi141.stdout:7/0: rename - no filename 2023-12-16T20:11:16.722 INFO:tasks.workunit.client.1.smithi141.stdout:6/2: mknod c0 0 2023-12-16T20:11:16.723 INFO:tasks.workunit.client.1.smithi141.stdout:1/12: getdents . 0 2023-12-16T20:11:16.724 INFO:tasks.workunit.client.1.smithi141.stdout:5/5: mknod d0/c1 0 2023-12-16T20:11:16.724 INFO:tasks.workunit.client.1.smithi141.stdout:5/6: dwrite - no filename 2023-12-16T20:11:16.724 INFO:tasks.workunit.client.1.smithi141.stdout:5/7: dread - no filename 2023-12-16T20:11:16.725 INFO:tasks.workunit.client.1.smithi141.stdout:5/8: fsync - no filename 2023-12-16T20:11:16.725 INFO:tasks.workunit.client.1.smithi141.stdout:5/9: fsync - no filename 2023-12-16T20:11:16.725 INFO:tasks.workunit.client.1.smithi141.stdout:5/10: chown d0/c1 12372 1 2023-12-16T20:11:16.728 INFO:tasks.workunit.client.1.smithi141.stdout:4/7: symlink l3 0 2023-12-16T20:11:16.730 INFO:tasks.workunit.client.1.smithi141.stdout:3/15: symlink d0/l5 0 2023-12-16T20:11:16.730 INFO:tasks.workunit.client.1.smithi141.stdout:3/16: truncate - no filename 2023-12-16T20:11:16.730 INFO:tasks.workunit.client.1.smithi141.stdout:3/17: truncate - no filename 2023-12-16T20:11:16.730 INFO:tasks.workunit.client.1.smithi141.stdout:3/18: readlink d0/l4 0 2023-12-16T20:11:16.731 INFO:tasks.workunit.client.1.smithi141.stdout:2/7: mknod c3 0 2023-12-16T20:11:16.731 INFO:tasks.workunit.client.1.smithi141.stdout:2/8: dread - no filename 2023-12-16T20:11:16.733 INFO:tasks.workunit.client.1.smithi141.stdout:8/0: write - no filename 2023-12-16T20:11:16.733 INFO:tasks.workunit.client.1.smithi141.stdout:8/1: dwrite - no filename 2023-12-16T20:11:16.736 INFO:tasks.workunit.client.1.smithi141.stdout:1/13: unlink f1 0 2023-12-16T20:11:16.736 INFO:tasks.workunit.client.1.smithi141.stdout:1/14: dread - no filename 2023-12-16T20:11:16.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/3: unlink c0 0 2023-12-16T20:11:16.741 INFO:tasks.workunit.client.1.smithi141.stdout:5/11: mknod d0/c2 0 2023-12-16T20:11:16.741 INFO:tasks.workunit.client.1.smithi141.stdout:5/12: dread - no filename 2023-12-16T20:11:16.742 INFO:tasks.workunit.client.1.smithi141.stdout:0/8: getdents . 0 2023-12-16T20:11:16.742 INFO:tasks.workunit.client.1.smithi141.stdout:0/9: chown f1 434 1 2023-12-16T20:11:16.742 INFO:tasks.workunit.client.1.smithi141.stdout:0/10: fsync f2 0 2023-12-16T20:11:16.743 INFO:tasks.workunit.client.1.smithi141.stdout:4/8: mknod c4 0 2023-12-16T20:11:16.743 INFO:tasks.workunit.client.1.smithi141.stdout:3/19: creat d0/f6 x:0 0 0 2023-12-16T20:11:16.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/9: symlink l4 0 2023-12-16T20:11:16.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/10: readlink l1 0 2023-12-16T20:11:16.745 INFO:tasks.workunit.client.1.smithi141.stdout:9/0: chown . 52398 1 2023-12-16T20:11:16.745 INFO:tasks.workunit.client.1.smithi141.stdout:9/1: dwrite - no filename 2023-12-16T20:11:16.745 INFO:tasks.workunit.client.1.smithi141.stdout:8/2: creat f0 x:0 0 0 2023-12-16T20:11:16.745 INFO:tasks.workunit.client.1.smithi141.stdout:8/3: readlink - no filename 2023-12-16T20:11:16.746 INFO:tasks.workunit.client.1.smithi141.stdout:1/15: chown c2 89121 1 2023-12-16T20:11:16.746 INFO:tasks.workunit.client.1.smithi141.stdout:1/16: dwrite - no filename 2023-12-16T20:11:16.746 INFO:tasks.workunit.client.1.smithi141.stdout:5/13: rmdir d0 39 2023-12-16T20:11:16.747 INFO:tasks.workunit.client.1.smithi141.stdout:5/14: dread - no filename 2023-12-16T20:11:16.748 INFO:tasks.workunit.client.1.smithi141.stdout:0/11: creat f3 x:0 0 0 2023-12-16T20:11:16.749 INFO:tasks.workunit.client.1.smithi141.stdout:4/9: rename l0 to l5 0 2023-12-16T20:11:16.749 INFO:tasks.workunit.client.1.smithi141.stdout:4/10: chown f1 6 1 2023-12-16T20:11:16.749 INFO:tasks.workunit.client.1.smithi141.stdout:4/11: write f2 [429626,70009] 0 2023-12-16T20:11:16.751 INFO:tasks.workunit.client.1.smithi141.stdout:2/11: symlink l5 0 2023-12-16T20:11:16.752 INFO:tasks.workunit.client.1.smithi141.stdout:2/12: read - no filename 2023-12-16T20:11:16.752 INFO:tasks.workunit.client.1.smithi141.stdout:2/13: rmdir - no directory 2023-12-16T20:11:16.753 INFO:tasks.workunit.client.1.smithi141.stdout:9/2: symlink l0 0 2023-12-16T20:11:16.756 INFO:tasks.workunit.client.1.smithi141.stdout:5/15: unlink d0/c1 0 2023-12-16T20:11:16.756 INFO:tasks.workunit.client.1.smithi141.stdout:5/16: write - no filename 2023-12-16T20:11:16.756 INFO:tasks.workunit.client.1.smithi141.stdout:5/17: dread - no filename 2023-12-16T20:11:16.756 INFO:tasks.workunit.client.1.smithi141.stdout:5/18: dread - no filename 2023-12-16T20:11:16.756 INFO:tasks.workunit.client.1.smithi141.stdout:5/19: readlink - no filename 2023-12-16T20:11:16.757 INFO:tasks.workunit.client.1.smithi141.stdout:0/12: write f1 [468191,73343] 0 2023-12-16T20:11:16.757 INFO:tasks.workunit.client.1.smithi141.stdout:0/13: truncate f1 1512680 0 2023-12-16T20:11:16.757 INFO:tasks.workunit.client.1.smithi141.stdout:6/4: getdents . 0 2023-12-16T20:11:16.759 INFO:tasks.workunit.client.1.smithi141.stdout:4/12: rename c4 to c6 0 2023-12-16T20:11:16.760 INFO:tasks.workunit.client.1.smithi141.stdout:2/14: mkdir d6 0 2023-12-16T20:11:16.760 INFO:tasks.workunit.client.1.smithi141.stdout:3/20: rmdir d0 39 2023-12-16T20:11:16.761 INFO:tasks.workunit.client.1.smithi141.stdout:9/3: mkdir d1 0 2023-12-16T20:11:16.761 INFO:tasks.workunit.client.1.smithi141.stdout:9/4: truncate - no filename 2023-12-16T20:11:16.762 INFO:tasks.workunit.client.1.smithi141.stdout:8/4: getdents . 0 2023-12-16T20:11:16.763 INFO:tasks.workunit.client.1.smithi141.stdout:5/20: mknod d0/c3 0 2023-12-16T20:11:16.763 INFO:tasks.workunit.client.1.smithi141.stdout:5/21: dwrite - no filename 2023-12-16T20:11:16.763 INFO:tasks.workunit.client.1.smithi141.stdout:5/22: write - no filename 2023-12-16T20:11:16.765 INFO:tasks.workunit.client.1.smithi141.stdout:6/5: mkdir d1 0 2023-12-16T20:11:16.765 INFO:tasks.workunit.client.1.smithi141.stdout:6/6: write - no filename 2023-12-16T20:11:16.765 INFO:tasks.workunit.client.1.smithi141.stdout:6/7: fdatasync - no filename 2023-12-16T20:11:16.765 INFO:tasks.workunit.client.1.smithi141.stdout:6/8: getdents d1 0 2023-12-16T20:11:16.765 INFO:tasks.workunit.client.1.smithi141.stdout:6/9: link - no file 2023-12-16T20:11:16.769 INFO:tasks.workunit.client.1.smithi141.stdout:4/13: mknod c7 0 2023-12-16T20:11:16.769 INFO:tasks.workunit.client.1.smithi141.stdout:2/15: creat d6/f7 x:0 0 0 2023-12-16T20:11:16.769 INFO:tasks.workunit.client.1.smithi141.stdout:3/21: symlink d0/l7 0 2023-12-16T20:11:16.769 INFO:tasks.workunit.client.1.smithi141.stdout:9/5: mknod d1/c2 0 2023-12-16T20:11:16.770 INFO:tasks.workunit.client.1.smithi141.stdout:9/6: write - no filename 2023-12-16T20:11:16.770 INFO:tasks.workunit.client.1.smithi141.stdout:9/7: dread - no filename 2023-12-16T20:11:16.770 INFO:tasks.workunit.client.1.smithi141.stdout:8/5: mkdir d1 0 2023-12-16T20:11:16.771 INFO:tasks.workunit.client.1.smithi141.stdout:5/23: creat d0/f4 x:0 0 0 2023-12-16T20:11:16.771 INFO:tasks.workunit.client.1.smithi141.stdout:0/14: mkdir d4 0 2023-12-16T20:11:16.771 INFO:tasks.workunit.client.1.smithi141.stdout:6/10: symlink d1/l2 0 2023-12-16T20:11:16.771 INFO:tasks.workunit.client.1.smithi141.stdout:3/22: creat d0/f8 x:0 0 0 2023-12-16T20:11:16.771 INFO:tasks.workunit.client.1.smithi141.stdout:3/23: dread - d0/f6 zero size 2023-12-16T20:11:16.772 INFO:tasks.workunit.client.1.smithi141.stdout:8/6: chown f0 3 1 2023-12-16T20:11:16.773 INFO:tasks.workunit.client.1.smithi141.stdout:6/11: mkdir d1/d3 0 2023-12-16T20:11:16.774 INFO:tasks.workunit.client.1.smithi141.stdout:6/12: read - no filename 2023-12-16T20:11:16.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/24: symlink d0/l9 0 2023-12-16T20:11:16.776 INFO:tasks.workunit.client.1.smithi141.stdout:3/25: truncate d0/f6 187751 0 2023-12-16T20:11:16.776 INFO:tasks.workunit.client.1.smithi141.stdout:3/26: write d0/f6 [553499,122036] 0 2023-12-16T20:11:16.776 INFO:tasks.workunit.client.1.smithi141.stdout:8/7: rmdir d1 0 2023-12-16T20:11:16.784 INFO:tasks.workunit.client.1.smithi141.stdout:8/8: symlink l2 0 2023-12-16T20:11:16.784 INFO:tasks.workunit.client.1.smithi141.stdout:8/9: stat l2 0 2023-12-16T20:11:16.786 INFO:tasks.workunit.client.1.smithi141.stdout:8/10: rename l2 to l3 0 2023-12-16T20:11:16.786 INFO:tasks.workunit.client.1.smithi141.stdout:5/24: fsync d0/f4 0 2023-12-16T20:11:16.786 INFO:tasks.workunit.client.1.smithi141.stdout:8/11: write f0 [992391,123599] 0 2023-12-16T20:11:16.787 INFO:tasks.workunit.client.1.smithi141.stdout:5/25: write d0/f4 [91609,70404] 0 2023-12-16T20:11:16.787 INFO:tasks.workunit.client.1.smithi141.stdout:5/26: rename d0/c3 to d0/c5 0 2023-12-16T20:11:16.788 INFO:tasks.workunit.client.1.smithi141.stdout:4/14: dwrite f2 [0,4194304] 0 2023-12-16T20:11:16.789 INFO:tasks.workunit.client.1.smithi141.stdout:5/27: symlink d0/l6 0 2023-12-16T20:11:16.789 INFO:tasks.workunit.client.1.smithi141.stdout:5/28: readlink d0/l6 0 2023-12-16T20:11:16.789 INFO:tasks.workunit.client.1.smithi141.stdout:6/13: getdents d1 0 2023-12-16T20:11:16.791 INFO:tasks.workunit.client.1.smithi141.stdout:4/15: rename c6 to c8 0 2023-12-16T20:11:16.791 INFO:tasks.workunit.client.1.smithi141.stdout:4/16: creat f9 x:0 0 0 2023-12-16T20:11:16.791 INFO:tasks.workunit.client.1.smithi141.stdout:4/17: write f1 [220809,125393] 0 2023-12-16T20:11:16.791 INFO:tasks.workunit.client.1.smithi141.stdout:4/18: rmdir - no directory 2023-12-16T20:11:16.792 INFO:tasks.workunit.client.1.smithi141.stdout:5/29: link d0/l6 d0/l7 0 2023-12-16T20:11:16.792 INFO:tasks.workunit.client.1.smithi141.stdout:3/27: rmdir d0 39 2023-12-16T20:11:16.792 INFO:tasks.workunit.client.1.smithi141.stdout:3/28: write d0/f8 [658157,67436] 0 2023-12-16T20:11:16.793 INFO:tasks.workunit.client.1.smithi141.stdout:6/14: creat d1/f4 x:0 0 0 2023-12-16T20:11:16.794 INFO:tasks.workunit.client.1.smithi141.stdout:6/15: dread - d1/f4 zero size 2023-12-16T20:11:16.794 INFO:tasks.workunit.client.1.smithi141.stdout:6/16: chown d1/l2 61 1 2023-12-16T20:11:16.795 INFO:tasks.workunit.client.1.smithi141.stdout:8/12: dread f0 [0,4194304] 0 2023-12-16T20:11:16.795 INFO:tasks.workunit.client.1.smithi141.stdout:6/17: mkdir d1/d3/d5 0 2023-12-16T20:11:16.804 INFO:tasks.workunit.client.1.smithi141.stdout:0/15: dwrite f2 [0,4194304] 0 2023-12-16T20:11:16.804 INFO:tasks.workunit.client.1.smithi141.stdout:0/16: write f3 [1008201,77006] 0 2023-12-16T20:11:16.806 INFO:tasks.workunit.client.1.smithi141.stdout:3/29: read d0/f6 [132798,83058] 0 2023-12-16T20:11:16.806 INFO:tasks.workunit.client.1.smithi141.stdout:3/30: readlink d0/l9 0 2023-12-16T20:11:16.807 INFO:tasks.workunit.client.1.smithi141.stdout:3/31: read d0/f8 [408053,32718] 0 2023-12-16T20:11:16.810 INFO:tasks.workunit.client.1.smithi141.stdout:3/32: mknod d0/ca 0 2023-12-16T20:11:16.812 INFO:tasks.workunit.client.1.smithi141.stdout:3/33: creat d0/fb x:0 0 0 2023-12-16T20:11:16.813 INFO:tasks.workunit.client.1.smithi141.stdout:3/34: symlink d0/lc 0 2023-12-16T20:11:16.814 INFO:tasks.workunit.client.1.smithi141.stdout:3/35: rename d0 to d0/dd 22 2023-12-16T20:11:16.814 INFO:tasks.workunit.client.1.smithi141.stdout:3/36: truncate d0/f8 1441108 0 2023-12-16T20:11:16.816 INFO:tasks.workunit.client.1.smithi141.stdout:0/17: dread f2 [0,4194304] 0 2023-12-16T20:11:16.817 INFO:tasks.workunit.client.1.smithi141.stdout:0/18: symlink d4/l5 0 2023-12-16T20:11:16.819 INFO:tasks.workunit.client.1.smithi141.stdout:0/19: mknod d4/c6 0 2023-12-16T20:11:16.819 INFO:tasks.workunit.client.1.smithi141.stdout:3/37: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:16.819 INFO:tasks.workunit.client.1.smithi141.stdout:0/20: readlink l0 0 2023-12-16T20:11:16.819 INFO:tasks.workunit.client.1.smithi141.stdout:0/21: mkdir d4/d7 0 2023-12-16T20:11:16.824 INFO:tasks.workunit.client.1.smithi141.stdout:6/18: dwrite d1/f4 [0,4194304] 0 2023-12-16T20:11:16.825 INFO:tasks.workunit.client.1.smithi141.stdout:8/13: dwrite f0 [0,4194304] 0 2023-12-16T20:11:16.825 INFO:tasks.workunit.client.1.smithi141.stdout:5/30: dwrite d0/f4 [0,4194304] 0 2023-12-16T20:11:16.835 INFO:tasks.workunit.client.1.smithi141.stdout:5/31: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:16.836 INFO:tasks.workunit.client.1.smithi141.stdout:8/14: write f0 [2119923,123245] 0 2023-12-16T20:11:16.836 INFO:tasks.workunit.client.1.smithi141.stdout:3/38: dwrite d0/fb [0,4194304] 0 2023-12-16T20:11:16.836 INFO:tasks.workunit.client.1.smithi141.stdout:3/39: write d0/f6 [429155,77468] 0 2023-12-16T20:11:16.836 INFO:tasks.workunit.client.1.smithi141.stdout:3/40: chown d0/lc 214509768 1 2023-12-16T20:11:16.839 INFO:tasks.workunit.client.1.smithi141.stdout:3/41: dread d0/f8 [0,4194304] 0 2023-12-16T20:11:16.839 INFO:tasks.workunit.client.1.smithi141.stdout:5/32: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:16.840 INFO:tasks.workunit.client.1.smithi141.stdout:8/15: mknod c4 0 2023-12-16T20:11:16.841 INFO:tasks.workunit.client.1.smithi141.stdout:8/16: write f0 [3959407,123199] 0 2023-12-16T20:11:16.843 INFO:tasks.workunit.client.1.smithi141.stdout:8/17: creat f5 x:0 0 0 2023-12-16T20:11:16.845 INFO:tasks.workunit.client.1.smithi141.stdout:8/18: mknod c6 0 2023-12-16T20:11:16.845 INFO:tasks.workunit.client.1.smithi141.stdout:6/19: truncate d1/f4 1908721 0 2023-12-16T20:11:16.850 INFO:tasks.workunit.client.1.smithi141.stdout:6/20: link d1/l2 d1/l6 0 2023-12-16T20:11:16.850 INFO:tasks.workunit.client.1.smithi141.stdout:5/33: write d0/f4 [5203928,84278] 0 2023-12-16T20:11:16.851 INFO:tasks.workunit.client.1.smithi141.stdout:8/19: mkdir d7 0 2023-12-16T20:11:16.852 INFO:tasks.workunit.client.1.smithi141.stdout:8/20: write f5 [389458,96861] 0 2023-12-16T20:11:16.853 INFO:tasks.workunit.client.1.smithi141.stdout:5/34: symlink d0/l8 0 2023-12-16T20:11:16.862 INFO:tasks.workunit.client.1.smithi141.stdout:3/42: dwrite d0/f6 [0,4194304] 0 2023-12-16T20:11:16.865 INFO:tasks.workunit.client.1.smithi141.stdout:3/43: mknod d0/ce 0 2023-12-16T20:11:16.866 INFO:tasks.workunit.client.1.smithi141.stdout:6/21: write d1/f4 [444184,2954] 0 2023-12-16T20:11:16.866 INFO:tasks.workunit.client.1.smithi141.stdout:3/44: rename d0/fb to d0/ff 0 2023-12-16T20:11:16.867 INFO:tasks.workunit.client.1.smithi141.stdout:6/22: symlink d1/d3/l7 0 2023-12-16T20:11:16.868 INFO:tasks.workunit.client.1.smithi141.stdout:5/35: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:16.868 INFO:tasks.workunit.client.1.smithi141.stdout:6/23: mknod d1/c8 0 2023-12-16T20:11:16.868 INFO:tasks.workunit.client.1.smithi141.stdout:6/24: write d1/f4 [1013777,78054] 0 2023-12-16T20:11:16.869 INFO:tasks.workunit.client.1.smithi141.stdout:6/25: creat d1/d3/d5/f9 x:0 0 0 2023-12-16T20:11:16.880 INFO:tasks.workunit.client.1.smithi141.stdout:3/45: unlink d0/ff 0 2023-12-16T20:11:16.881 INFO:tasks.workunit.client.1.smithi141.stdout:8/21: dwrite f5 [0,4194304] 0 2023-12-16T20:11:16.881 INFO:tasks.workunit.client.1.smithi141.stdout:3/46: mknod d0/c10 0 2023-12-16T20:11:16.883 INFO:tasks.workunit.client.1.smithi141.stdout:3/47: mknod d0/c11 0 2023-12-16T20:11:16.885 INFO:tasks.workunit.client.1.smithi141.stdout:5/36: truncate d0/f4 4579363 0 2023-12-16T20:11:16.886 INFO:tasks.workunit.client.1.smithi141.stdout:6/26: dwrite d1/d3/d5/f9 [0,4194304] 0 2023-12-16T20:11:16.887 INFO:tasks.workunit.client.1.smithi141.stdout:6/27: creat d1/fa x:0 0 0 2023-12-16T20:11:16.887 INFO:tasks.workunit.client.1.smithi141.stdout:8/22: fdatasync f0 0 2023-12-16T20:11:16.888 INFO:tasks.workunit.client.1.smithi141.stdout:5/37: mkdir d0/d9 0 2023-12-16T20:11:16.898 INFO:tasks.workunit.client.1.smithi141.stdout:5/38: read d0/f4 [3107438,93544] 0 2023-12-16T20:11:16.899 INFO:tasks.workunit.client.1.smithi141.stdout:5/39: rename d0/c2 to d0/d9/ca 0 2023-12-16T20:11:16.900 INFO:tasks.workunit.client.1.smithi141.stdout:3/48: truncate d0/f6 2763670 0 2023-12-16T20:11:16.900 INFO:tasks.workunit.client.1.smithi141.stdout:3/49: fsync d0/f8 0 2023-12-16T20:11:16.900 INFO:tasks.workunit.client.1.smithi141.stdout:8/23: write f5 [1874127,68523] 0 2023-12-16T20:11:16.901 INFO:tasks.workunit.client.1.smithi141.stdout:5/40: link d0/l8 d0/lb 0 2023-12-16T20:11:16.902 INFO:tasks.workunit.client.1.smithi141.stdout:5/41: write d0/f4 [496519,128084] 0 2023-12-16T20:11:16.902 INFO:tasks.workunit.client.1.smithi141.stdout:5/42: chown d0/c5 338435 1 2023-12-16T20:11:16.902 INFO:tasks.workunit.client.1.smithi141.stdout:5/43: stat d0/d9 0 2023-12-16T20:11:16.903 INFO:tasks.workunit.client.1.smithi141.stdout:3/50: link d0/l4 d0/l12 0 2023-12-16T20:11:16.903 INFO:tasks.workunit.client.1.smithi141.stdout:3/51: fdatasync d0/f8 0 2023-12-16T20:11:16.903 INFO:tasks.workunit.client.1.smithi141.stdout:3/52: chown d0/l12 4116 1 2023-12-16T20:11:16.904 INFO:tasks.workunit.client.1.smithi141.stdout:8/24: rmdir d7 0 2023-12-16T20:11:16.906 INFO:tasks.workunit.client.1.smithi141.stdout:5/44: getdents d0/d9 0 2023-12-16T20:11:16.908 INFO:tasks.workunit.client.1.smithi141.stdout:6/28: dwrite d1/fa [0,4194304] 0 2023-12-16T20:11:16.908 INFO:tasks.workunit.client.1.smithi141.stdout:6/29: write d1/f4 [2120875,36926] 0 2023-12-16T20:11:16.908 INFO:tasks.workunit.client.1.smithi141.stdout:6/30: creat d1/fb x:0 0 0 2023-12-16T20:11:16.910 INFO:tasks.workunit.client.1.smithi141.stdout:3/53: getdents d0 0 2023-12-16T20:11:16.911 INFO:tasks.workunit.client.1.smithi141.stdout:5/45: mknod d0/d9/cc 0 2023-12-16T20:11:16.916 INFO:tasks.workunit.client.1.smithi141.stdout:6/31: link d1/l6 d1/d3/lc 0 2023-12-16T20:11:16.916 INFO:tasks.workunit.client.1.smithi141.stdout:6/32: chown d1/d3/d5/f9 3 1 2023-12-16T20:11:16.916 INFO:tasks.workunit.client.1.smithi141.stdout:8/25: truncate f5 3392272 0 2023-12-16T20:11:16.916 INFO:tasks.workunit.client.1.smithi141.stdout:8/26: write f0 [2565480,129521] 0 2023-12-16T20:11:16.919 INFO:tasks.workunit.client.1.smithi141.stdout:8/27: creat f8 x:0 0 0 2023-12-16T20:11:16.919 INFO:tasks.workunit.client.1.smithi141.stdout:5/46: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:16.923 INFO:tasks.workunit.client.1.smithi141.stdout:6/33: rename d1/d3/d5 to d1/dd 0 2023-12-16T20:11:16.924 INFO:tasks.workunit.client.1.smithi141.stdout:8/28: mknod c9 0 2023-12-16T20:11:16.925 INFO:tasks.workunit.client.1.smithi141.stdout:8/29: write f5 [4273327,21425] 0 2023-12-16T20:11:16.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/9: symlink l3 0 2023-12-16T20:11:16.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/10: dread - f2 zero size 2023-12-16T20:11:16.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/11: write f2 [589005,6950] 0 2023-12-16T20:11:16.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/12: truncate f2 825284 0 2023-12-16T20:11:16.927 INFO:tasks.workunit.client.1.smithi141.stdout:6/34: mkdir d1/dd/de 0 2023-12-16T20:11:16.927 INFO:tasks.workunit.client.1.smithi141.stdout:6/35: chown d1 2 1 2023-12-16T20:11:16.927 INFO:tasks.workunit.client.1.smithi141.stdout:6/36: creat d1/d3/ff x:0 0 0 2023-12-16T20:11:16.928 INFO:tasks.workunit.client.1.smithi141.stdout:8/30: mknod ca 0 2023-12-16T20:11:16.929 INFO:tasks.workunit.client.1.smithi141.stdout:8/31: mknod cb 0 2023-12-16T20:11:16.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/32: write f5 [3942332,89595] 0 2023-12-16T20:11:16.933 INFO:tasks.workunit.client.1.smithi141.stdout:8/33: link cb cc 0 2023-12-16T20:11:16.933 INFO:tasks.workunit.client.1.smithi141.stdout:8/34: dread - f8 zero size 2023-12-16T20:11:16.935 INFO:tasks.workunit.client.1.smithi141.stdout:8/35: rename c9 to cd 0 2023-12-16T20:11:16.936 INFO:tasks.workunit.client.1.smithi141.stdout:3/54: dwrite d0/f6 [0,4194304] 0 2023-12-16T20:11:16.937 INFO:tasks.workunit.client.1.smithi141.stdout:3/55: mkdir d0/d13 0 2023-12-16T20:11:16.941 INFO:tasks.workunit.client.1.smithi141.stdout:6/37: write d1/dd/f9 [3449312,94982] 0 2023-12-16T20:11:16.941 INFO:tasks.workunit.client.1.smithi141.stdout:6/38: write d1/fa [4524435,44723] 0 2023-12-16T20:11:16.941 INFO:tasks.workunit.client.1.smithi141.stdout:8/36: dread f0 [0,4194304] 0 2023-12-16T20:11:16.941 INFO:tasks.workunit.client.1.smithi141.stdout:8/37: readlink l3 0 2023-12-16T20:11:16.946 INFO:tasks.workunit.client.0.smithi038.stdout:8/13: dwrite f1 [0,4194304] 0 2023-12-16T20:11:16.946 INFO:tasks.workunit.client.0.smithi038.stdout:8/14: stat l3 0 2023-12-16T20:11:16.974 INFO:tasks.workunit.client.1.smithi141.stdout:3/56: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:16.974 INFO:tasks.workunit.client.1.smithi141.stdout:3/57: chown d0/c10 341 1 2023-12-16T20:11:16.974 INFO:tasks.workunit.client.1.smithi141.stdout:8/38: dwrite f8 [0,4194304] 0 2023-12-16T20:11:16.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/15: dwrite f2 [0,4194304] 0 2023-12-16T20:11:16.975 INFO:tasks.workunit.client.1.smithi141.stdout:3/58: symlink d0/d13/l14 0 2023-12-16T20:11:16.978 INFO:tasks.workunit.client.1.smithi141.stdout:3/59: symlink d0/l15 0 2023-12-16T20:11:16.978 INFO:tasks.workunit.client.1.smithi141.stdout:8/39: symlink le 0 2023-12-16T20:11:16.985 INFO:tasks.workunit.client.1.smithi141.stdout:8/40: dread f0 [0,4194304] 0 2023-12-16T20:11:16.986 INFO:tasks.workunit.client.1.smithi141.stdout:3/60: dread d0/f8 [0,4194304] 0 2023-12-16T20:11:16.986 INFO:tasks.workunit.client.1.smithi141.stdout:8/41: creat ff x:0 0 0 2023-12-16T20:11:16.987 INFO:tasks.workunit.client.1.smithi141.stdout:3/61: mknod d0/c16 0 2023-12-16T20:11:16.988 INFO:tasks.workunit.client.1.smithi141.stdout:3/62: creat d0/f17 x:0 0 0 2023-12-16T20:11:16.988 INFO:tasks.workunit.client.1.smithi141.stdout:3/63: chown d0/d13/l14 1527 1 2023-12-16T20:11:16.989 INFO:tasks.workunit.client.1.smithi141.stdout:3/64: dread - d0/f17 zero size 2023-12-16T20:11:16.989 INFO:tasks.workunit.client.1.smithi141.stdout:3/65: write d0/f17 [739728,62539] 0 2023-12-16T20:11:16.989 INFO:tasks.workunit.client.1.smithi141.stdout:3/66: mknod d0/d13/c18 0 2023-12-16T20:11:16.995 INFO:tasks.workunit.client.1.smithi141.stdout:8/42: dread f8 [0,4194304] 0 2023-12-16T20:11:16.995 INFO:tasks.workunit.client.1.smithi141.stdout:8/43: rmdir - no directory 2023-12-16T20:11:16.995 INFO:tasks.workunit.client.1.smithi141.stdout:8/44: fsync f5 0 2023-12-16T20:11:16.997 INFO:tasks.workunit.client.1.smithi141.stdout:8/45: mknod c10 0 2023-12-16T20:11:16.997 INFO:tasks.workunit.client.1.smithi141.stdout:8/46: rmdir - no directory 2023-12-16T20:11:16.998 INFO:tasks.workunit.client.1.smithi141.stdout:8/47: creat f11 x:0 0 0 2023-12-16T20:11:17.017 INFO:tasks.workunit.client.1.smithi141.stdout:8/48: dwrite f8 [0,4194304] 0 2023-12-16T20:11:17.017 INFO:tasks.workunit.client.1.smithi141.stdout:8/49: write f5 [2964277,60856] 0 2023-12-16T20:11:17.018 INFO:tasks.workunit.client.1.smithi141.stdout:8/50: read f0 [87403,71731] 0 2023-12-16T20:11:17.125 INFO:tasks.workunit.client.0.smithi038.stdout:1/20: stat c6 0 2023-12-16T20:11:17.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/21: dread f2 [0,4194304] 0 2023-12-16T20:11:17.224 INFO:tasks.workunit.client.0.smithi038.stdout:0/28: mknod c9 0 2023-12-16T20:11:17.364 INFO:tasks.workunit.client.0.smithi038.stdout:9/14: rename c1 to c4 0 2023-12-16T20:11:17.400 INFO:tasks.workunit.client.0.smithi038.stdout:1/22: unlink c6 0 2023-12-16T20:11:17.400 INFO:tasks.workunit.client.0.smithi038.stdout:1/23: readlink l5 0 2023-12-16T20:11:17.402 INFO:tasks.workunit.client.0.smithi038.stdout:9/15: rename l0 to l5 0 2023-12-16T20:11:17.404 INFO:tasks.workunit.client.0.smithi038.stdout:3/7: link f0 f1 0 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/8: mknod c2 0 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/9: rmdir - no directory 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/10: creat f3 x:0 0 0 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/11: truncate f0 3911238 0 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/12: rmdir - no directory 2023-12-16T20:11:17.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/13: fdatasync f3 0 2023-12-16T20:11:17.407 INFO:tasks.workunit.client.0.smithi038.stdout:3/14: mkdir d4 0 2023-12-16T20:11:17.409 INFO:tasks.workunit.client.0.smithi038.stdout:3/15: creat d4/f5 x:0 0 0 2023-12-16T20:11:17.409 INFO:tasks.workunit.client.0.smithi038.stdout:3/16: creat d4/f6 x:0 0 0 2023-12-16T20:11:17.409 INFO:tasks.workunit.client.0.smithi038.stdout:3/17: rename d4 to d4/d7 22 2023-12-16T20:11:17.410 INFO:tasks.workunit.client.0.smithi038.stdout:3/18: mkdir d4/d8 0 2023-12-16T20:11:17.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/19: mknod d4/d8/c9 0 2023-12-16T20:11:17.413 INFO:tasks.workunit.client.0.smithi038.stdout:3/20: rename d4/d8/c9 to d4/ca 0 2023-12-16T20:11:17.415 INFO:tasks.workunit.client.0.smithi038.stdout:3/21: symlink d4/d8/lb 0 2023-12-16T20:11:17.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/16: link l5 l6 0 2023-12-16T20:11:17.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/17: readlink l6 0 2023-12-16T20:11:17.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/18: write f3 [264278,112813] 0 2023-12-16T20:11:17.529 INFO:tasks.workunit.client.0.smithi038.stdout:2/30: truncate d1/d5/f7 2371567 0 2023-12-16T20:11:17.530 INFO:tasks.workunit.client.0.smithi038.stdout:8/16: truncate f2 2001837 0 2023-12-16T20:11:17.532 INFO:tasks.workunit.client.0.smithi038.stdout:8/17: symlink l4 0 2023-12-16T20:11:17.534 INFO:tasks.workunit.client.0.smithi038.stdout:3/22: getdents d4/d8 0 2023-12-16T20:11:17.534 INFO:tasks.workunit.client.0.smithi038.stdout:3/23: creat d4/fc x:0 0 0 2023-12-16T20:11:17.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/24: link d4/f6 d4/d8/fd 0 2023-12-16T20:11:17.538 INFO:tasks.workunit.client.0.smithi038.stdout:3/25: chown d4/d8/fd 94775 1 2023-12-16T20:11:17.560 INFO:tasks.workunit.client.0.smithi038.stdout:3/26: getdents d4 0 2023-12-16T20:11:17.568 INFO:tasks.workunit.client.0.smithi038.stdout:8/18: dread f2 [0,4194304] 0 2023-12-16T20:11:17.568 INFO:tasks.workunit.client.0.smithi038.stdout:8/19: creat f5 x:0 0 0 2023-12-16T20:11:17.568 INFO:tasks.workunit.client.0.smithi038.stdout:8/20: chown l4 205126 1 2023-12-16T20:11:17.587 INFO:tasks.workunit.client.0.smithi038.stdout:3/27: dwrite f3 [0,4194304] 0 2023-12-16T20:11:17.587 INFO:tasks.workunit.client.0.smithi038.stdout:2/31: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.587 INFO:tasks.workunit.client.0.smithi038.stdout:2/32: creat d1/d5/f8 x:0 0 0 2023-12-16T20:11:17.587 INFO:tasks.workunit.client.0.smithi038.stdout:8/21: fsync f5 0 2023-12-16T20:11:17.590 INFO:tasks.workunit.client.0.smithi038.stdout:8/22: write f2 [1551151,60804] 0 2023-12-16T20:11:17.590 INFO:tasks.workunit.client.0.smithi038.stdout:8/23: truncate f5 711669 0 2023-12-16T20:11:17.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/33: rename l0 to d1/l9 0 2023-12-16T20:11:17.592 INFO:tasks.workunit.client.0.smithi038.stdout:3/28: symlink d4/d8/le 0 2023-12-16T20:11:17.592 INFO:tasks.workunit.client.0.smithi038.stdout:2/34: symlink d1/d5/la 0 2023-12-16T20:11:17.592 INFO:tasks.workunit.client.0.smithi038.stdout:2/35: write d1/d5/f8 [529885,59828] 0 2023-12-16T20:11:17.597 INFO:tasks.workunit.client.0.smithi038.stdout:3/29: write f1 [140257,106594] 0 2023-12-16T20:11:17.601 INFO:tasks.workunit.client.0.smithi038.stdout:3/30: creat d4/d8/ff x:0 0 0 2023-12-16T20:11:17.602 INFO:tasks.workunit.client.0.smithi038.stdout:2/36: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.607 INFO:tasks.workunit.client.0.smithi038.stdout:2/37: getdents d1/d5 0 2023-12-16T20:11:17.612 INFO:tasks.workunit.client.0.smithi038.stdout:2/38: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/39: chown d1/d5/la 2 1 2023-12-16T20:11:17.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/40: getdents d1 0 2023-12-16T20:11:17.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/41: truncate d1/d5/f7 2747297 0 2023-12-16T20:11:17.622 INFO:tasks.workunit.client.0.smithi038.stdout:3/31: dwrite f0 [0,4194304] 0 2023-12-16T20:11:17.623 INFO:tasks.workunit.client.0.smithi038.stdout:3/32: truncate d4/d8/ff 1013585 0 2023-12-16T20:11:17.623 INFO:tasks.workunit.client.0.smithi038.stdout:3/33: creat d4/f10 x:0 0 0 2023-12-16T20:11:17.624 INFO:tasks.workunit.client.0.smithi038.stdout:3/34: rmdir d4/d8 39 2023-12-16T20:11:17.633 INFO:tasks.workunit.client.0.smithi038.stdout:3/35: write f0 [3748438,31794] 0 2023-12-16T20:11:17.633 INFO:tasks.workunit.client.0.smithi038.stdout:3/36: write d4/f10 [803801,22497] 0 2023-12-16T20:11:17.633 INFO:tasks.workunit.client.0.smithi038.stdout:3/37: write d4/d8/fd [211531,52101] 0 2023-12-16T20:11:17.633 INFO:tasks.workunit.client.0.smithi038.stdout:3/38: chown d4/d8 159 1 2023-12-16T20:11:17.633 INFO:tasks.workunit.client.0.smithi038.stdout:3/39: mkdir d4/d11 0 2023-12-16T20:11:17.635 INFO:tasks.workunit.client.0.smithi038.stdout:3/40: rename d4/d8/le to d4/l12 0 2023-12-16T20:11:17.635 INFO:tasks.workunit.client.0.smithi038.stdout:3/41: getdents d4/d11 0 2023-12-16T20:11:17.636 INFO:tasks.workunit.client.0.smithi038.stdout:3/42: unlink d4/d8/ff 0 2023-12-16T20:11:17.636 INFO:tasks.workunit.client.0.smithi038.stdout:3/43: creat d4/d8/f13 x:0 0 0 2023-12-16T20:11:17.638 INFO:tasks.workunit.client.0.smithi038.stdout:3/44: rmdir d4/d11 0 2023-12-16T20:11:17.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/45: fsync d4/fc 0 2023-12-16T20:11:17.639 INFO:tasks.workunit.client.0.smithi038.stdout:2/42: dwrite d1/d5/f8 [0,4194304] 0 2023-12-16T20:11:17.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/46: rename d4/fc to d4/f14 0 2023-12-16T20:11:17.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/43: rmdir d1 39 2023-12-16T20:11:17.641 INFO:tasks.workunit.client.0.smithi038.stdout:2/44: write d1/d5/f7 [3365052,63482] 0 2023-12-16T20:11:17.642 INFO:tasks.workunit.client.0.smithi038.stdout:3/47: mkdir d4/d8/d15 0 2023-12-16T20:11:17.642 INFO:tasks.workunit.client.0.smithi038.stdout:3/48: dread - d4/f5 zero size 2023-12-16T20:11:17.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/49: creat d4/d8/f16 x:0 0 0 2023-12-16T20:11:17.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/50: creat d4/f17 x:0 0 0 2023-12-16T20:11:17.644 INFO:tasks.workunit.client.0.smithi038.stdout:2/45: write d1/d5/f7 [504992,91744] 0 2023-12-16T20:11:17.645 INFO:tasks.workunit.client.0.smithi038.stdout:3/51: mkdir d4/d18 0 2023-12-16T20:11:17.646 INFO:tasks.workunit.client.0.smithi038.stdout:3/52: creat d4/d8/d15/f19 x:0 0 0 2023-12-16T20:11:17.648 INFO:tasks.workunit.client.0.smithi038.stdout:3/53: creat d4/d8/f1a x:0 0 0 2023-12-16T20:11:17.651 INFO:tasks.workunit.client.0.smithi038.stdout:3/54: mkdir d4/d8/d1b 0 2023-12-16T20:11:17.665 INFO:tasks.workunit.client.0.smithi038.stdout:3/55: dwrite d4/f17 [0,4194304] 0 2023-12-16T20:11:17.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/56: link d4/d8/fd d4/d8/f1c 0 2023-12-16T20:11:17.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/57: write f0 [375276,106542] 0 2023-12-16T20:11:17.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/58: getdents d4/d8/d1b 0 2023-12-16T20:11:17.668 INFO:tasks.workunit.client.0.smithi038.stdout:3/59: symlink d4/l1d 0 2023-12-16T20:11:17.669 INFO:tasks.workunit.client.0.smithi038.stdout:3/60: mkdir d4/d8/d15/d1e 0 2023-12-16T20:11:17.670 INFO:tasks.workunit.client.0.smithi038.stdout:3/61: rename d4/d8/fd to d4/d8/d15/d1e/f1f 0 2023-12-16T20:11:17.671 INFO:tasks.workunit.client.0.smithi038.stdout:3/62: unlink f0 0 2023-12-16T20:11:17.688 INFO:tasks.workunit.client.0.smithi038.stdout:3/63: dwrite d4/f14 [0,4194304] 0 2023-12-16T20:11:17.689 INFO:tasks.workunit.client.0.smithi038.stdout:3/64: mkdir d4/d8/d15/d20 0 2023-12-16T20:11:17.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/65: stat d4/f14 0 2023-12-16T20:11:17.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/66: read - d4/d8/f16 zero size 2023-12-16T20:11:17.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/67: write d4/d8/d15/d1e/f1f [1132968,42242] 0 2023-12-16T20:11:17.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/68: mknod d4/d8/c21 0 2023-12-16T20:11:17.692 INFO:tasks.workunit.client.0.smithi038.stdout:3/69: link d4/d8/f16 d4/d8/d15/d1e/f22 0 2023-12-16T20:11:17.692 INFO:tasks.workunit.client.0.smithi038.stdout:3/70: write d4/f5 [497744,75437] 0 2023-12-16T20:11:17.870 INFO:tasks.workunit.client.0.smithi038.stdout:2/46: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.871 INFO:tasks.workunit.client.0.smithi038.stdout:2/47: fdatasync d1/d5/f8 0 2023-12-16T20:11:17.872 INFO:tasks.workunit.client.0.smithi038.stdout:2/48: mknod d1/d5/cb 0 2023-12-16T20:11:17.872 INFO:tasks.workunit.client.0.smithi038.stdout:2/49: chown d1/d5/cb 879551 1 2023-12-16T20:11:17.872 INFO:tasks.workunit.client.0.smithi038.stdout:2/50: chown d1/c6 5790 1 2023-12-16T20:11:17.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/51: read d1/d5/f8 [3422467,100197] 0 2023-12-16T20:11:17.884 INFO:tasks.workunit.client.0.smithi038.stdout:2/52: truncate d1/d5/f8 3794130 0 2023-12-16T20:11:17.885 INFO:tasks.workunit.client.0.smithi038.stdout:2/53: rename d1/d5/la to d1/d5/lc 0 2023-12-16T20:11:17.900 INFO:tasks.workunit.client.0.smithi038.stdout:2/54: dwrite d1/d5/f8 [0,4194304] 0 2023-12-16T20:11:17.901 INFO:tasks.workunit.client.0.smithi038.stdout:2/55: rename d1/c3 to d1/cd 0 2023-12-16T20:11:17.901 INFO:tasks.workunit.client.0.smithi038.stdout:2/56: fdatasync d1/d5/f7 0 2023-12-16T20:11:17.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/57: truncate d1/d5/f8 3955462 0 2023-12-16T20:11:17.908 INFO:tasks.workunit.client.0.smithi038.stdout:2/58: rename d1/d5/f8 to d1/d5/fe 0 2023-12-16T20:11:17.925 INFO:tasks.workunit.client.0.smithi038.stdout:2/59: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.926 INFO:tasks.workunit.client.0.smithi038.stdout:2/60: mkdir d1/df 0 2023-12-16T20:11:17.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/61: mkdir d1/df/d10 0 2023-12-16T20:11:17.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/62: chown d1/l9 22 1 2023-12-16T20:11:17.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/63: unlink d1/cd 0 2023-12-16T20:11:17.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/64: fsync d1/d5/f7 0 2023-12-16T20:11:17.929 INFO:tasks.workunit.client.0.smithi038.stdout:2/65: symlink d1/l11 0 2023-12-16T20:11:17.931 INFO:tasks.workunit.client.0.smithi038.stdout:2/66: mkdir d1/df/d12 0 2023-12-16T20:11:17.931 INFO:tasks.workunit.client.0.smithi038.stdout:2/67: chown d1/d5 1 1 2023-12-16T20:11:17.937 INFO:tasks.workunit.client.0.smithi038.stdout:2/68: write d1/d5/fe [2914169,45074] 0 2023-12-16T20:11:17.938 INFO:tasks.workunit.client.0.smithi038.stdout:2/69: mknod d1/d5/c13 0 2023-12-16T20:11:17.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/70: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/71: stat d1/l2 0 2023-12-16T20:11:17.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/72: write d1/d5/fe [1853661,67011] 0 2023-12-16T20:11:17.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/73: truncate d1/d5/f7 4535502 0 2023-12-16T20:11:17.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/74: mknod d1/df/d10/c14 0 2023-12-16T20:11:17.952 INFO:tasks.workunit.client.0.smithi038.stdout:2/75: truncate d1/d5/fe 3471082 0 2023-12-16T20:11:17.952 INFO:tasks.workunit.client.0.smithi038.stdout:2/76: truncate d1/d5/f7 5156752 0 2023-12-16T20:11:17.954 INFO:tasks.workunit.client.0.smithi038.stdout:2/77: read d1/d5/fe [1845048,5882] 0 2023-12-16T20:11:17.954 INFO:tasks.workunit.client.0.smithi038.stdout:2/78: write d1/d5/fe [2358812,88173] 0 2023-12-16T20:11:17.955 INFO:tasks.workunit.client.0.smithi038.stdout:2/79: mknod d1/d5/c15 0 2023-12-16T20:11:17.960 INFO:tasks.workunit.client.0.smithi038.stdout:2/80: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:17.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/81: write d1/d5/f7 [2453618,33630] 0 2023-12-16T20:11:17.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/82: write d1/d5/fe [2426861,63426] 0 2023-12-16T20:11:17.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/83: mkdir d1/d5/d16 0 2023-12-16T20:11:17.966 INFO:tasks.workunit.client.0.smithi038.stdout:2/84: mknod d1/c17 0 2023-12-16T20:11:17.967 INFO:tasks.workunit.client.0.smithi038.stdout:2/85: getdents d1/df/d10 0 2023-12-16T20:11:17.975 INFO:tasks.workunit.client.0.smithi038.stdout:2/86: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:18.019 INFO:tasks.workunit.client.0.smithi038.stdout:2/87: unlink d1/d5/fe 0 2023-12-16T20:11:18.019 INFO:tasks.workunit.client.0.smithi038.stdout:2/88: readlink d1/d5/lc 0 2023-12-16T20:11:18.020 INFO:tasks.workunit.client.0.smithi038.stdout:2/89: mknod d1/d5/d16/c18 0 2023-12-16T20:11:18.020 INFO:tasks.workunit.client.0.smithi038.stdout:2/90: rmdir d1/d5/d16 39 2023-12-16T20:11:18.022 INFO:tasks.workunit.client.0.smithi038.stdout:2/91: read d1/d5/f7 [4213640,79745] 0 2023-12-16T20:11:18.023 INFO:tasks.workunit.client.0.smithi038.stdout:2/92: symlink d1/df/d10/l19 0 2023-12-16T20:11:18.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/93: mkdir d1/d1a 0 2023-12-16T20:11:18.038 INFO:tasks.workunit.client.0.smithi038.stdout:2/94: unlink d1/d5/d16/c18 0 2023-12-16T20:11:18.038 INFO:tasks.workunit.client.0.smithi038.stdout:2/95: write d1/d5/f7 [5183401,29238] 0 2023-12-16T20:11:18.040 INFO:tasks.workunit.client.0.smithi038.stdout:2/96: mkdir d1/d5/d16/d1b 0 2023-12-16T20:11:18.047 INFO:tasks.workunit.client.0.smithi038.stdout:2/97: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:18.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:17 smithi038 ceph-mon[80659]: pgmap v169: 65 pgs: 65 active+clean; 219 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 1.22k op/s 2023-12-16T20:11:18.211 INFO:tasks.workunit.client.0.smithi038.stdout:2/98: link d1/c4 d1/c1c 0 2023-12-16T20:11:18.211 INFO:tasks.workunit.client.0.smithi038.stdout:2/99: chown d1/df 13209 1 2023-12-16T20:11:18.211 INFO:tasks.workunit.client.0.smithi038.stdout:2/100: chown d1/d5/d16 974 1 2023-12-16T20:11:18.234 INFO:tasks.workunit.client.0.smithi038.stdout:2/101: rename d1/l9 to d1/df/d10/l1d 0 2023-12-16T20:11:18.234 INFO:tasks.workunit.client.0.smithi038.stdout:2/102: fsync d1/d5/f7 0 2023-12-16T20:11:18.236 INFO:tasks.workunit.client.0.smithi038.stdout:2/103: dread d1/d5/f7 [4194304,4194304] 0 2023-12-16T20:11:18.236 INFO:tasks.workunit.client.0.smithi038.stdout:2/104: read d1/d5/f7 [737813,107784] 0 2023-12-16T20:11:18.236 INFO:tasks.workunit.client.0.smithi038.stdout:2/105: write d1/d5/f7 [2721688,30908] 0 2023-12-16T20:11:18.238 INFO:tasks.workunit.client.0.smithi038.stdout:2/106: symlink d1/d1a/l1e 0 2023-12-16T20:11:18.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:17 smithi141 ceph-mon[88165]: pgmap v169: 65 pgs: 65 active+clean; 219 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 1.22k op/s 2023-12-16T20:11:20.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:19 smithi141 ceph-mon[88165]: pgmap v170: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s rd, 14 MiB/s wr, 1.29k op/s 2023-12-16T20:11:20.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:19 smithi038 ceph-mon[80659]: pgmap v170: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s rd, 14 MiB/s wr, 1.29k op/s 2023-12-16T20:11:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:21 smithi141 ceph-mon[88165]: pgmap v171: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 20 MiB/s wr, 1.27k op/s 2023-12-16T20:11:22.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:21 smithi038 ceph-mon[80659]: pgmap v171: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 20 MiB/s wr, 1.27k op/s 2023-12-16T20:11:23.448 INFO:tasks.workunit.client.0.smithi038.stdout:1/24: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:9/19: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:0/29: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:4/15: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:5/20: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:8/24: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/18: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/19: dread - no filename 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:8/25: chown l3 27477213 1 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:5/21: chown f0 5324 1 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/20: readlink - no filename 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:5/22: fsync f0 0 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:3/71: sync 2023-12-16T20:11:23.449 INFO:tasks.workunit.client.0.smithi038.stdout:6/2: sync 2023-12-16T20:11:23.450 INFO:tasks.workunit.client.0.smithi038.stdout:6/3: dread - no filename 2023-12-16T20:11:23.450 INFO:tasks.workunit.client.0.smithi038.stdout:2/107: sync 2023-12-16T20:11:23.450 INFO:tasks.workunit.client.0.smithi038.stdout:9/20: mknod c7 0 2023-12-16T20:11:23.451 INFO:tasks.workunit.client.0.smithi038.stdout:0/30: mknod ca 0 2023-12-16T20:11:23.451 INFO:tasks.workunit.client.0.smithi038.stdout:0/31: readlink l7 0 2023-12-16T20:11:23.451 INFO:tasks.workunit.client.0.smithi038.stdout:1/25: creat f7 x:0 0 0 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:0/32: read f0 [253269,121350] 0 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:5/23: mknod c1 0 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:5/24: write f0 [443270,95419] 0 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:5/25: readlink - no filename 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:5/26: chown f0 0 1 2023-12-16T20:11:23.453 INFO:tasks.workunit.client.0.smithi038.stdout:7/21: getdents . 0 2023-12-16T20:11:23.454 INFO:tasks.workunit.client.0.smithi038.stdout:3/72: chown d4/d8/d15/d20 602 1 2023-12-16T20:11:23.454 INFO:tasks.workunit.client.0.smithi038.stdout:6/4: mknod c0 0 2023-12-16T20:11:23.454 INFO:tasks.workunit.client.0.smithi038.stdout:6/5: readlink - no filename 2023-12-16T20:11:23.456 INFO:tasks.workunit.client.0.smithi038.stdout:9/21: symlink l8 0 2023-12-16T20:11:23.458 INFO:tasks.workunit.client.0.smithi038.stdout:1/26: creat f8 x:0 0 0 2023-12-16T20:11:23.459 INFO:tasks.workunit.client.0.smithi038.stdout:0/33: mkdir db 0 2023-12-16T20:11:23.459 INFO:tasks.workunit.client.0.smithi038.stdout:9/22: dread f3 [0,4194304] 0 2023-12-16T20:11:23.460 INFO:tasks.workunit.client.0.smithi038.stdout:5/27: dread f0 [0,4194304] 0 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:5/28: fdatasync f0 0 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:5/29: chown c1 20827407 1 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:6/6: mkdir d1 0 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:6/7: dread - no filename 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:6/8: dwrite - no filename 2023-12-16T20:11:23.461 INFO:tasks.workunit.client.0.smithi038.stdout:6/9: chown c0 38676 1 2023-12-16T20:11:23.465 INFO:tasks.workunit.client.0.smithi038.stdout:0/34: symlink db/lc 0 2023-12-16T20:11:23.465 INFO:tasks.workunit.client.0.smithi038.stdout:6/10: symlink d1/l2 0 2023-12-16T20:11:23.465 INFO:tasks.workunit.client.0.smithi038.stdout:6/11: dread - no filename 2023-12-16T20:11:23.465 INFO:tasks.workunit.client.0.smithi038.stdout:9/23: mkdir d9 0 2023-12-16T20:11:23.465 INFO:tasks.workunit.client.0.smithi038.stdout:9/24: write f3 [1252389,67235] 0 2023-12-16T20:11:23.467 INFO:tasks.workunit.client.0.smithi038.stdout:0/35: link c9 db/cd 0 2023-12-16T20:11:23.468 INFO:tasks.workunit.client.0.smithi038.stdout:6/12: symlink d1/l3 0 2023-12-16T20:11:23.470 INFO:tasks.workunit.client.0.smithi038.stdout:6/13: mkdir d1/d4 0 2023-12-16T20:11:23.470 INFO:tasks.workunit.client.0.smithi038.stdout:6/14: dread - no filename 2023-12-16T20:11:23.471 INFO:tasks.workunit.client.0.smithi038.stdout:6/15: symlink d1/l5 0 2023-12-16T20:11:23.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/16: rename d1/l5 to d1/d4/l6 0 2023-12-16T20:11:23.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/17: truncate - no filename 2023-12-16T20:11:23.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/18: chown d1/l2 22238413 1 2023-12-16T20:11:23.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/19: truncate - no filename 2023-12-16T20:11:23.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/20: rmdir d1 39 2023-12-16T20:11:23.476 INFO:tasks.workunit.client.0.smithi038.stdout:6/21: mknod d1/d4/c7 0 2023-12-16T20:11:23.476 INFO:tasks.workunit.client.0.smithi038.stdout:6/22: truncate - no filename 2023-12-16T20:11:23.478 INFO:tasks.workunit.client.0.smithi038.stdout:6/23: creat d1/d4/f8 x:0 0 0 2023-12-16T20:11:23.478 INFO:tasks.workunit.client.0.smithi038.stdout:6/24: dread - d1/d4/f8 zero size 2023-12-16T20:11:23.478 INFO:tasks.workunit.client.0.smithi038.stdout:6/25: truncate d1/d4/f8 880379 0 2023-12-16T20:11:23.478 INFO:tasks.workunit.client.0.smithi038.stdout:6/26: chown d1/d4/f8 858048 1 2023-12-16T20:11:23.479 INFO:tasks.workunit.client.0.smithi038.stdout:6/27: rename d1/d4/c7 to d1/d4/c9 0 2023-12-16T20:11:23.490 INFO:tasks.workunit.client.0.smithi038.stdout:9/25: fsync f3 0 2023-12-16T20:11:23.491 INFO:tasks.workunit.client.0.smithi038.stdout:8/26: dwrite f1 [0,4194304] 0 2023-12-16T20:11:23.491 INFO:tasks.workunit.client.0.smithi038.stdout:3/73: dwrite d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:23.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/16: dwrite f2 [0,4194304] 0 2023-12-16T20:11:23.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/17: stat f1 0 2023-12-16T20:11:23.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/27: mknod c6 0 2023-12-16T20:11:23.494 INFO:tasks.workunit.client.0.smithi038.stdout:1/27: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.494 INFO:tasks.workunit.client.0.smithi038.stdout:1/28: fdatasync f7 0 2023-12-16T20:11:23.494 INFO:tasks.workunit.client.0.smithi038.stdout:0/36: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.494 INFO:tasks.workunit.client.0.smithi038.stdout:0/37: fdatasync f0 0 2023-12-16T20:11:23.494 INFO:tasks.workunit.client.0.smithi038.stdout:0/38: readlink l7 0 2023-12-16T20:11:23.496 INFO:tasks.workunit.client.0.smithi038.stdout:4/18: mknod c3 0 2023-12-16T20:11:23.502 INFO:tasks.workunit.client.0.smithi038.stdout:0/39: mknod db/ce 0 2023-12-16T20:11:23.502 INFO:tasks.workunit.client.0.smithi038.stdout:3/74: dread f3 [0,4194304] 0 2023-12-16T20:11:23.503 INFO:tasks.workunit.client.0.smithi038.stdout:4/19: unlink f2 0 2023-12-16T20:11:23.503 INFO:tasks.workunit.client.0.smithi038.stdout:0/40: dread f1 [0,4194304] 0 2023-12-16T20:11:23.504 INFO:tasks.workunit.client.0.smithi038.stdout:1/29: mknod c9 0 2023-12-16T20:11:23.504 INFO:tasks.workunit.client.0.smithi038.stdout:8/28: read f1 [2155644,27408] 0 2023-12-16T20:11:23.505 INFO:tasks.workunit.client.0.smithi038.stdout:3/75: rename d4/d8/d1b to d4/d8/d15/d20/d23 0 2023-12-16T20:11:23.506 INFO:tasks.workunit.client.0.smithi038.stdout:4/20: link c3 c4 0 2023-12-16T20:11:23.506 INFO:tasks.workunit.client.0.smithi038.stdout:4/21: rmdir - no directory 2023-12-16T20:11:23.507 INFO:tasks.workunit.client.0.smithi038.stdout:1/30: creat fa x:0 0 0 2023-12-16T20:11:23.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/76: dread d4/d8/d15/d1e/f1f [0,4194304] 0 2023-12-16T20:11:23.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/77: fsync d4/d8/f13 0 2023-12-16T20:11:23.510 INFO:tasks.workunit.client.0.smithi038.stdout:3/78: read d4/f10 [27333,71466] 0 2023-12-16T20:11:23.511 INFO:tasks.workunit.client.0.smithi038.stdout:1/31: symlink lb 0 2023-12-16T20:11:23.511 INFO:tasks.workunit.client.0.smithi038.stdout:1/32: dread - f7 zero size 2023-12-16T20:11:23.512 INFO:tasks.workunit.client.0.smithi038.stdout:3/79: creat d4/d8/f24 x:0 0 0 2023-12-16T20:11:23.517 INFO:tasks.workunit.client.0.smithi038.stdout:3/80: creat d4/d18/f25 x:0 0 0 2023-12-16T20:11:23.517 INFO:tasks.workunit.client.0.smithi038.stdout:1/33: symlink lc 0 2023-12-16T20:11:23.517 INFO:tasks.workunit.client.0.smithi038.stdout:6/28: truncate d1/d4/f8 100689 0 2023-12-16T20:11:23.519 INFO:tasks.workunit.client.0.smithi038.stdout:0/41: dwrite f3 [0,4194304] 0 2023-12-16T20:11:23.519 INFO:tasks.workunit.client.0.smithi038.stdout:0/42: write f0 [177008,123833] 0 2023-12-16T20:11:23.523 INFO:tasks.workunit.client.0.smithi038.stdout:3/81: dread d4/d8/f16 [0,4194304] 0 2023-12-16T20:11:23.525 INFO:tasks.workunit.client.0.smithi038.stdout:3/82: mkdir d4/d8/d15/d20/d23/d26 0 2023-12-16T20:11:23.527 INFO:tasks.workunit.client.0.smithi038.stdout:3/83: truncate d4/f17 3755813 0 2023-12-16T20:11:23.530 INFO:tasks.workunit.client.0.smithi038.stdout:0/43: dread f1 [0,4194304] 0 2023-12-16T20:11:23.530 INFO:tasks.workunit.client.0.smithi038.stdout:0/44: write f5 [1310355,8354] 0 2023-12-16T20:11:23.531 INFO:tasks.workunit.client.0.smithi038.stdout:4/22: getdents . 0 2023-12-16T20:11:23.534 INFO:tasks.workunit.client.0.smithi038.stdout:4/23: dread f1 [0,4194304] 0 2023-12-16T20:11:23.535 INFO:tasks.workunit.client.0.smithi038.stdout:6/29: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:23.535 INFO:tasks.workunit.client.0.smithi038.stdout:6/30: write d1/d4/f8 [807588,127186] 0 2023-12-16T20:11:23.536 INFO:tasks.workunit.client.0.smithi038.stdout:4/24: dread f1 [0,4194304] 0 2023-12-16T20:11:23.536 INFO:tasks.workunit.client.0.smithi038.stdout:4/25: write f1 [683622,29201] 0 2023-12-16T20:11:23.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/31: mkdir d1/d4/da 0 2023-12-16T20:11:23.542 INFO:tasks.workunit.client.0.smithi038.stdout:3/84: rename d4/d8/d15/d20 to d4/d27 0 2023-12-16T20:11:23.549 INFO:tasks.workunit.client.0.smithi038.stdout:1/34: dwrite fa [0,4194304] 0 2023-12-16T20:11:23.549 INFO:tasks.workunit.client.0.smithi038.stdout:1/35: truncate f8 4536929 0 2023-12-16T20:11:23.550 INFO:tasks.workunit.client.0.smithi038.stdout:4/26: dread f1 [0,4194304] 0 2023-12-16T20:11:23.552 INFO:tasks.workunit.client.0.smithi038.stdout:0/45: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/36: rename lc to ld 0 2023-12-16T20:11:23.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/37: write f2 [4350316,62474] 0 2023-12-16T20:11:23.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/38: chown f2 14 1 2023-12-16T20:11:23.553 INFO:tasks.workunit.client.0.smithi038.stdout:1/39: readlink ld 0 2023-12-16T20:11:23.554 INFO:tasks.workunit.client.0.smithi038.stdout:0/46: getdents db 0 2023-12-16T20:11:23.554 INFO:tasks.workunit.client.0.smithi038.stdout:0/47: truncate f6 616636 0 2023-12-16T20:11:23.554 INFO:tasks.workunit.client.0.smithi038.stdout:0/48: dread - f4 zero size 2023-12-16T20:11:23.554 INFO:tasks.workunit.client.0.smithi038.stdout:0/49: dread - f4 zero size 2023-12-16T20:11:23.554 INFO:tasks.workunit.client.0.smithi038.stdout:0/50: fsync f8 0 2023-12-16T20:11:23.556 INFO:tasks.workunit.client.0.smithi038.stdout:6/32: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:23.560 INFO:tasks.workunit.client.0.smithi038.stdout:6/33: mknod d1/d4/da/cb 0 2023-12-16T20:11:23.562 INFO:tasks.workunit.client.0.smithi038.stdout:1/40: rename f2 to fe 0 2023-12-16T20:11:23.564 INFO:tasks.workunit.client.0.smithi038.stdout:6/34: truncate d1/d4/f8 329286 0 2023-12-16T20:11:23.566 INFO:tasks.workunit.client.0.smithi038.stdout:1/41: mknod cf 0 2023-12-16T20:11:23.569 INFO:tasks.workunit.client.0.smithi038.stdout:0/51: dwrite f5 [0,4194304] 0 2023-12-16T20:11:23.569 INFO:tasks.workunit.client.0.smithi038.stdout:0/52: truncate f1 551340 0 2023-12-16T20:11:23.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/53: creat db/ff x:0 0 0 2023-12-16T20:11:23.574 INFO:tasks.workunit.client.0.smithi038.stdout:1/42: dread f8 [0,4194304] 0 2023-12-16T20:11:23.575 INFO:tasks.workunit.client.0.smithi038.stdout:1/43: creat f10 x:0 0 0 2023-12-16T20:11:23.576 INFO:tasks.workunit.client.0.smithi038.stdout:1/44: creat f11 x:0 0 0 2023-12-16T20:11:23.577 INFO:tasks.workunit.client.0.smithi038.stdout:6/35: truncate d1/d4/f8 38952 0 2023-12-16T20:11:23.577 INFO:tasks.workunit.client.0.smithi038.stdout:6/36: chown d1/d4/c9 2449 1 2023-12-16T20:11:23.579 INFO:tasks.workunit.client.0.smithi038.stdout:6/37: creat d1/fc x:0 0 0 2023-12-16T20:11:23.581 INFO:tasks.workunit.client.0.smithi038.stdout:6/38: write d1/d4/f8 [63348,67751] 0 2023-12-16T20:11:23.582 INFO:tasks.workunit.client.0.smithi038.stdout:0/54: write f8 [1953240,126231] 0 2023-12-16T20:11:23.582 INFO:tasks.workunit.client.0.smithi038.stdout:0/55: creat db/f10 x:0 0 0 2023-12-16T20:11:23.583 INFO:tasks.workunit.client.0.smithi038.stdout:6/39: getdents d1 0 2023-12-16T20:11:23.583 INFO:tasks.workunit.client.0.smithi038.stdout:6/40: readlink d1/l3 0 2023-12-16T20:11:23.586 INFO:tasks.workunit.client.0.smithi038.stdout:6/41: fsync d1/d4/f8 0 2023-12-16T20:11:23.586 INFO:tasks.workunit.client.0.smithi038.stdout:6/42: write d1/fc [873965,9487] 0 2023-12-16T20:11:23.586 INFO:tasks.workunit.client.0.smithi038.stdout:1/45: dread fe [0,4194304] 0 2023-12-16T20:11:23.588 INFO:tasks.workunit.client.0.smithi038.stdout:1/46: getdents . 0 2023-12-16T20:11:23.589 INFO:tasks.workunit.client.0.smithi038.stdout:0/56: getdents db 0 2023-12-16T20:11:23.589 INFO:tasks.workunit.client.0.smithi038.stdout:6/43: dread d1/fc [0,4194304] 0 2023-12-16T20:11:23.590 INFO:tasks.workunit.client.0.smithi038.stdout:0/57: creat db/f11 x:0 0 0 2023-12-16T20:11:23.595 INFO:tasks.workunit.client.0.smithi038.stdout:0/58: dread f6 [0,4194304] 0 2023-12-16T20:11:23.597 INFO:tasks.workunit.client.0.smithi038.stdout:0/59: truncate f5 2209603 0 2023-12-16T20:11:23.604 INFO:tasks.workunit.client.0.smithi038.stdout:2/108: sync 2023-12-16T20:11:23.608 INFO:tasks.workunit.client.0.smithi038.stdout:6/44: dwrite d1/fc [0,4194304] 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:6/45: readlink d1/l3 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/47: dwrite fe [0,4194304] 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/48: getdents . 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/49: write f11 [157792,84933] 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/50: truncate f11 431165 0 2023-12-16T20:11:23.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/51: readlink lb 0 2023-12-16T20:11:23.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/46: truncate d1/fc 3789017 0 2023-12-16T20:11:23.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/47: stat d1/d4/f8 0 2023-12-16T20:11:23.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/48: creat d1/d4/fd x:0 0 0 2023-12-16T20:11:23.617 INFO:tasks.workunit.client.0.smithi038.stdout:0/60: write f5 [1727265,33056] 0 2023-12-16T20:11:23.617 INFO:tasks.workunit.client.0.smithi038.stdout:6/49: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:23.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/50: creat d1/fe x:0 0 0 2023-12-16T20:11:23.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/51: chown d1/d4/l6 104849 1 2023-12-16T20:11:23.619 INFO:tasks.workunit.client.0.smithi038.stdout:0/61: getdents db 0 2023-12-16T20:11:23.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/62: rename f0 to db/f12 0 2023-12-16T20:11:23.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/63: readlink db/lc 0 2023-12-16T20:11:23.628 INFO:tasks.workunit.client.0.smithi038.stdout:2/109: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:23.628 INFO:tasks.workunit.client.0.smithi038.stdout:2/110: write d1/d5/f7 [6054143,28734] 0 2023-12-16T20:11:23.628 INFO:tasks.workunit.client.0.smithi038.stdout:1/52: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.629 INFO:tasks.workunit.client.0.smithi038.stdout:2/111: mknod d1/d5/c1f 0 2023-12-16T20:11:23.644 INFO:tasks.workunit.client.0.smithi038.stdout:1/53: write fe [301983,47638] 0 2023-12-16T20:11:23.644 INFO:tasks.workunit.client.0.smithi038.stdout:1/54: getdents . 0 2023-12-16T20:11:23.645 INFO:tasks.workunit.client.0.smithi038.stdout:1/55: link f11 f12 0 2023-12-16T20:11:23.651 INFO:tasks.workunit.client.0.smithi038.stdout:1/56: getdents . 0 2023-12-16T20:11:23.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/22: sync 2023-12-16T20:11:23.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/23: chown c0 109261 1 2023-12-16T20:11:23.673 INFO:tasks.workunit.client.0.smithi038.stdout:7/24: mknod c4 0 2023-12-16T20:11:23.674 INFO:tasks.workunit.client.0.smithi038.stdout:2/112: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:23.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/25: creat f5 x:0 0 0 2023-12-16T20:11:23.683 INFO:tasks.workunit.client.0.smithi038.stdout:2/113: write d1/d5/f7 [2546055,44285] 0 2023-12-16T20:11:23.683 INFO:tasks.workunit.client.0.smithi038.stdout:2/114: mknod d1/d5/d16/c20 0 2023-12-16T20:11:23.684 INFO:tasks.workunit.client.0.smithi038.stdout:1/57: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/58: link ld l13 0 2023-12-16T20:11:23.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/59: chown c9 1019269 1 2023-12-16T20:11:23.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/60: fdatasync f7 0 2023-12-16T20:11:23.685 INFO:tasks.workunit.client.0.smithi038.stdout:2/115: fdatasync d1/d5/f7 0 2023-12-16T20:11:23.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/61: creat f14 x:0 0 0 2023-12-16T20:11:23.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/62: chown f7 26 1 2023-12-16T20:11:23.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/63: fdatasync f7 0 2023-12-16T20:11:23.687 INFO:tasks.workunit.client.0.smithi038.stdout:1/64: stat f7 0 2023-12-16T20:11:23.687 INFO:tasks.workunit.client.0.smithi038.stdout:7/26: getdents . 0 2023-12-16T20:11:23.687 INFO:tasks.workunit.client.0.smithi038.stdout:7/27: write f5 [305771,124367] 0 2023-12-16T20:11:23.689 INFO:tasks.workunit.client.0.smithi038.stdout:2/116: mkdir d1/df/d21 0 2023-12-16T20:11:23.689 INFO:tasks.workunit.client.0.smithi038.stdout:1/65: mkdir d15 0 2023-12-16T20:11:23.691 INFO:tasks.workunit.client.0.smithi038.stdout:7/28: creat f6 x:0 0 0 2023-12-16T20:11:23.691 INFO:tasks.workunit.client.0.smithi038.stdout:7/29: chown c0 383 1 2023-12-16T20:11:23.693 INFO:tasks.workunit.client.0.smithi038.stdout:2/117: rename d1/d5/lc to d1/d5/d16/l22 0 2023-12-16T20:11:23.693 INFO:tasks.workunit.client.0.smithi038.stdout:2/118: write d1/d5/f7 [4862744,61122] 0 2023-12-16T20:11:23.694 INFO:tasks.workunit.client.0.smithi038.stdout:7/30: symlink l7 0 2023-12-16T20:11:23.695 INFO:tasks.workunit.client.0.smithi038.stdout:1/66: dread fe [0,4194304] 0 2023-12-16T20:11:23.695 INFO:tasks.workunit.client.0.smithi038.stdout:1/67: dread - f14 zero size 2023-12-16T20:11:23.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/68: stat ld 0 2023-12-16T20:11:23.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/69: write fe [3534984,64181] 0 2023-12-16T20:11:23.698 INFO:tasks.workunit.client.0.smithi038.stdout:1/70: creat d15/f16 x:0 0 0 2023-12-16T20:11:23.700 INFO:tasks.workunit.client.0.smithi038.stdout:1/71: rename d15/f16 to d15/f17 0 2023-12-16T20:11:23.701 INFO:tasks.workunit.client.0.smithi038.stdout:1/72: link ld d15/l18 0 2023-12-16T20:11:23.710 INFO:tasks.workunit.client.0.smithi038.stdout:1/73: write fa [1525808,95301] 0 2023-12-16T20:11:23.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/74: write f8 [1695788,22124] 0 2023-12-16T20:11:23.717 INFO:tasks.workunit.client.0.smithi038.stdout:1/75: readlink ld 0 2023-12-16T20:11:23.717 INFO:tasks.workunit.client.0.smithi038.stdout:1/76: write fa [381114,31879] 0 2023-12-16T20:11:23.717 INFO:tasks.workunit.client.0.smithi038.stdout:1/77: write f7 [321049,26278] 0 2023-12-16T20:11:23.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/78: unlink f14 0 2023-12-16T20:11:23.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/79: getdents d15 0 2023-12-16T20:11:23.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/80: stat fa 0 2023-12-16T20:11:23.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/81: chown d15/f17 5 1 2023-12-16T20:11:23.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/82: creat d15/f19 x:0 0 0 2023-12-16T20:11:23.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/83: rmdir d15 39 2023-12-16T20:11:23.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/84: dread - d15/f19 zero size 2023-12-16T20:11:23.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/85: creat d15/f1a x:0 0 0 2023-12-16T20:11:23.728 INFO:tasks.workunit.client.0.smithi038.stdout:1/86: creat d15/f1b x:0 0 0 2023-12-16T20:11:23.729 INFO:tasks.workunit.client.0.smithi038.stdout:1/87: mknod d15/c1c 0 2023-12-16T20:11:23.731 INFO:tasks.workunit.client.0.smithi038.stdout:1/88: fsync fa 0 2023-12-16T20:11:23.738 INFO:tasks.workunit.client.0.smithi038.stdout:4/27: sync 2023-12-16T20:11:23.738 INFO:tasks.workunit.client.0.smithi038.stdout:8/29: sync 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:5/30: sync 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:4/28: readlink - no filename 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:9/26: sync 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:3/85: sync 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:9/27: truncate f2 340936 0 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:9/28: chown l8 746583674 1 2023-12-16T20:11:23.739 INFO:tasks.workunit.client.0.smithi038.stdout:9/29: chown d9 112442 1 2023-12-16T20:11:23.740 INFO:tasks.workunit.client.0.smithi038.stdout:4/29: write f1 [267630,14864] 0 2023-12-16T20:11:23.742 INFO:tasks.workunit.client.0.smithi038.stdout:3/86: unlink d4/ca 0 2023-12-16T20:11:23.742 INFO:tasks.workunit.client.0.smithi038.stdout:3/87: chown d4/l12 96 1 2023-12-16T20:11:23.743 INFO:tasks.workunit.client.0.smithi038.stdout:9/30: creat d9/fa x:0 0 0 2023-12-16T20:11:23.743 INFO:tasks.workunit.client.0.smithi038.stdout:9/31: dread - d9/fa zero size 2023-12-16T20:11:23.743 INFO:tasks.workunit.client.0.smithi038.stdout:9/32: chown f3 0 1 2023-12-16T20:11:23.744 INFO:tasks.workunit.client.0.smithi038.stdout:8/30: dread f1 [0,4194304] 0 2023-12-16T20:11:23.744 INFO:tasks.workunit.client.0.smithi038.stdout:4/30: symlink l5 0 2023-12-16T20:11:23.745 INFO:tasks.workunit.client.0.smithi038.stdout:3/88: truncate d4/d8/d15/d1e/f22 2519643 0 2023-12-16T20:11:23.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/89: dwrite f11 [0,4194304] 0 2023-12-16T20:11:23.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/90: fdatasync f8 0 2023-12-16T20:11:23.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/91: write fa [1628204,78087] 0 2023-12-16T20:11:23.751 INFO:tasks.workunit.client.0.smithi038.stdout:3/89: link f1 d4/f28 0 2023-12-16T20:11:23.755 INFO:tasks.workunit.client.0.smithi038.stdout:1/92: fsync d15/f1b 0 2023-12-16T20:11:23.757 INFO:tasks.workunit.client.0.smithi038.stdout:5/31: dwrite f0 [0,4194304] 0 2023-12-16T20:11:23.758 INFO:tasks.workunit.client.0.smithi038.stdout:1/93: truncate f8 838416 0 2023-12-16T20:11:23.764 INFO:tasks.workunit.client.0.smithi038.stdout:4/31: truncate f1 722878 0 2023-12-16T20:11:23.789 INFO:tasks.workunit.client.0.smithi038.stdout:1/94: dwrite d15/f19 [0,4194304] 0 2023-12-16T20:11:23.789 INFO:tasks.workunit.client.0.smithi038.stdout:8/31: dwrite f5 [0,4194304] 0 2023-12-16T20:11:23.792 INFO:tasks.workunit.client.0.smithi038.stdout:1/95: creat d15/f1d x:0 0 0 2023-12-16T20:11:23.793 INFO:tasks.workunit.client.0.smithi038.stdout:5/32: dwrite f0 [0,4194304] 0 2023-12-16T20:11:23.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/90: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:23.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/91: fdatasync d4/d8/f13 0 2023-12-16T20:11:23.795 INFO:tasks.workunit.client.0.smithi038.stdout:9/33: write f2 [87473,117861] 0 2023-12-16T20:11:23.797 INFO:tasks.workunit.client.0.smithi038.stdout:5/33: mkdir d2 0 2023-12-16T20:11:23.804 INFO:tasks.workunit.client.0.smithi038.stdout:1/96: mkdir d15/d1e 0 2023-12-16T20:11:23.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/34: link f0 d2/f3 0 2023-12-16T20:11:23.806 INFO:tasks.workunit.client.0.smithi038.stdout:4/32: link f1 f6 0 2023-12-16T20:11:23.807 INFO:tasks.workunit.client.0.smithi038.stdout:1/97: rename c1 to d15/d1e/c1f 0 2023-12-16T20:11:23.808 INFO:tasks.workunit.client.0.smithi038.stdout:4/33: creat f7 x:0 0 0 2023-12-16T20:11:23.808 INFO:tasks.workunit.client.0.smithi038.stdout:1/98: truncate f8 255221 0 2023-12-16T20:11:23.808 INFO:tasks.workunit.client.0.smithi038.stdout:8/32: dwrite f2 [0,4194304] 0 2023-12-16T20:11:23.810 INFO:tasks.workunit.client.0.smithi038.stdout:1/99: mkdir d15/d1e/d20 0 2023-12-16T20:11:23.810 INFO:tasks.workunit.client.0.smithi038.stdout:1/100: readlink l5 0 2023-12-16T20:11:23.811 INFO:tasks.workunit.client.0.smithi038.stdout:1/101: read - d15/f1d zero size 2023-12-16T20:11:23.815 INFO:tasks.workunit.client.0.smithi038.stdout:8/33: rename l4 to l7 0 2023-12-16T20:11:23.817 INFO:tasks.workunit.client.0.smithi038.stdout:8/34: mknod c8 0 2023-12-16T20:11:23.819 INFO:tasks.workunit.client.0.smithi038.stdout:1/102: link fa d15/f21 0 2023-12-16T20:11:23.821 INFO:tasks.workunit.client.0.smithi038.stdout:8/35: link f1 f9 0 2023-12-16T20:11:23.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/35: dread f0 [0,4194304] 0 2023-12-16T20:11:23.822 INFO:tasks.workunit.client.0.smithi038.stdout:1/103: unlink cf 0 2023-12-16T20:11:23.824 INFO:tasks.workunit.client.0.smithi038.stdout:5/36: mkdir d2/d4 0 2023-12-16T20:11:23.828 INFO:tasks.workunit.client.0.smithi038.stdout:1/104: mkdir d15/d22 0 2023-12-16T20:11:23.828 INFO:tasks.workunit.client.0.smithi038.stdout:8/36: write f5 [1346055,127555] 0 2023-12-16T20:11:23.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/105: mkdir d15/d1e/d23 0 2023-12-16T20:11:23.831 INFO:tasks.workunit.client.0.smithi038.stdout:5/37: write d2/f3 [2402960,96111] 0 2023-12-16T20:11:23.831 INFO:tasks.workunit.client.0.smithi038.stdout:1/106: creat d15/f24 x:0 0 0 2023-12-16T20:11:23.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/107: dread d15/f21 [0,4194304] 0 2023-12-16T20:11:23.841 INFO:tasks.workunit.client.0.smithi038.stdout:1/108: mkdir d15/d1e/d25 0 2023-12-16T20:11:23.842 INFO:tasks.workunit.client.0.smithi038.stdout:1/109: write f10 [799907,34874] 0 2023-12-16T20:11:23.843 INFO:tasks.workunit.client.0.smithi038.stdout:1/110: rename fa to d15/d22/f26 0 2023-12-16T20:11:23.844 INFO:tasks.workunit.client.0.smithi038.stdout:1/111: mknod d15/d22/c27 0 2023-12-16T20:11:23.844 INFO:tasks.workunit.client.0.smithi038.stdout:1/112: read f7 [336656,111057] 0 2023-12-16T20:11:23.844 INFO:tasks.workunit.client.0.smithi038.stdout:1/113: mknod d15/d1e/d25/c28 0 2023-12-16T20:11:23.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/34: dwrite f2 [0,4194304] 0 2023-12-16T20:11:23.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/35: truncate d9/fa 532752 0 2023-12-16T20:11:23.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/36: truncate d9/fa 836774 0 2023-12-16T20:11:23.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/37: readlink l5 0 2023-12-16T20:11:23.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/38: stat l8 0 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:0/64: sync 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:0/65: chown f6 17167 1 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/52: sync 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/53: stat d1/fc 0 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/54: chown d1/d4/fd 9 1 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/55: rename d1 to d1/d4/df 22 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:2/119: sync 2023-12-16T20:11:23.848 INFO:tasks.workunit.client.0.smithi038.stdout:7/31: sync 2023-12-16T20:11:23.849 INFO:tasks.workunit.client.0.smithi038.stdout:2/120: readlink d1/d5/d16/l22 0 2023-12-16T20:11:23.849 INFO:tasks.workunit.client.0.smithi038.stdout:4/34: dwrite f1 [0,4194304] 0 2023-12-16T20:11:23.850 INFO:tasks.workunit.client.0.smithi038.stdout:7/32: read f5 [183224,22673] 0 2023-12-16T20:11:23.850 INFO:tasks.workunit.client.0.smithi038.stdout:7/33: write f5 [493822,5883] 0 2023-12-16T20:11:23.855 INFO:tasks.workunit.client.0.smithi038.stdout:7/34: link c4 c8 0 2023-12-16T20:11:23.855 INFO:tasks.workunit.client.0.smithi038.stdout:7/35: readlink l7 0 2023-12-16T20:11:23.856 INFO:tasks.workunit.client.0.smithi038.stdout:2/121: getdents d1/d5/d16 0 2023-12-16T20:11:23.859 INFO:tasks.workunit.client.0.smithi038.stdout:0/66: dread f8 [0,4194304] 0 2023-12-16T20:11:23.859 INFO:tasks.workunit.client.0.smithi038.stdout:8/37: dwrite f9 [0,4194304] 0 2023-12-16T20:11:23.861 INFO:tasks.workunit.client.0.smithi038.stdout:7/36: rename c0 to c9 0 2023-12-16T20:11:23.862 INFO:tasks.workunit.client.0.smithi038.stdout:2/122: mkdir d1/df/d10/d23 0 2023-12-16T20:11:23.863 INFO:tasks.workunit.client.0.smithi038.stdout:5/38: dread d2/f3 [0,4194304] 0 2023-12-16T20:11:23.863 INFO:tasks.workunit.client.0.smithi038.stdout:5/39: write d2/f3 [2955938,123605] 0 2023-12-16T20:11:23.865 INFO:tasks.workunit.client.0.smithi038.stdout:0/67: unlink db/f12 0 2023-12-16T20:11:23.867 INFO:tasks.workunit.client.0.smithi038.stdout:7/37: mkdir da 0 2023-12-16T20:11:23.870 INFO:tasks.workunit.client.0.smithi038.stdout:5/40: symlink d2/l5 0 2023-12-16T20:11:23.870 INFO:tasks.workunit.client.0.smithi038.stdout:5/41: read f0 [1466239,73247] 0 2023-12-16T20:11:23.871 INFO:tasks.workunit.client.0.smithi038.stdout:2/123: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:23.871 INFO:tasks.workunit.client.0.smithi038.stdout:7/38: mkdir da/db 0 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:7/39: chown f6 37 1 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:7/40: dread - f6 zero size 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:9/39: dwrite f3 [0,4194304] 0 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:9/40: chown l5 66991249 1 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:1/114: dwrite f8 [0,4194304] 0 2023-12-16T20:11:23.872 INFO:tasks.workunit.client.0.smithi038.stdout:9/41: chown d9/fa 0 1 2023-12-16T20:11:23.873 INFO:tasks.workunit.client.0.smithi038.stdout:0/68: dread f8 [0,4194304] 0 2023-12-16T20:11:23.873 INFO:tasks.workunit.client.0.smithi038.stdout:5/42: link c1 d2/c6 0 2023-12-16T20:11:23.875 INFO:tasks.workunit.client.0.smithi038.stdout:2/124: mknod d1/d1a/c24 0 2023-12-16T20:11:23.875 INFO:tasks.workunit.client.0.smithi038.stdout:2/125: chown d1/d1a/l1e 3 1 2023-12-16T20:11:23.875 INFO:tasks.workunit.client.0.smithi038.stdout:2/126: write d1/d5/f7 [4440588,6276] 0 2023-12-16T20:11:23.875 INFO:tasks.workunit.client.0.smithi038.stdout:2/127: chown d1/df/d10/d23 254 1 2023-12-16T20:11:23.876 INFO:tasks.workunit.client.0.smithi038.stdout:7/41: mkdir da/dc 0 2023-12-16T20:11:23.883 INFO:tasks.workunit.client.0.smithi038.stdout:1/115: link d15/d1e/c1f d15/d22/c29 0 2023-12-16T20:11:23.885 INFO:tasks.workunit.client.0.smithi038.stdout:0/69: chown db/f11 0 1 2023-12-16T20:11:23.888 INFO:tasks.workunit.client.0.smithi038.stdout:8/38: truncate f1 3795434 0 2023-12-16T20:11:23.891 INFO:tasks.workunit.client.0.smithi038.stdout:2/128: link d1/df/d10/l1d d1/d5/d16/l25 0 2023-12-16T20:11:23.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/116: mknod d15/d1e/c2a 0 2023-12-16T20:11:23.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/117: chown d15/f1b 0 1 2023-12-16T20:11:23.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/118: fsync f10 0 2023-12-16T20:11:23.896 INFO:tasks.workunit.client.0.smithi038.stdout:1/119: mknod d15/d1e/d23/c2b 0 2023-12-16T20:11:23.896 INFO:tasks.workunit.client.0.smithi038.stdout:5/43: getdents d2 0 2023-12-16T20:11:23.900 INFO:tasks.workunit.client.0.smithi038.stdout:0/70: mknod db/c13 0 2023-12-16T20:11:23.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/42: dwrite f2 [0,4194304] 0 2023-12-16T20:11:23.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/43: readlink l8 0 2023-12-16T20:11:23.902 INFO:tasks.workunit.client.0.smithi038.stdout:1/120: symlink d15/d1e/l2c 0 2023-12-16T20:11:23.903 INFO:tasks.workunit.client.0.smithi038.stdout:5/44: creat d2/f7 x:0 0 0 2023-12-16T20:11:23.903 INFO:tasks.workunit.client.0.smithi038.stdout:5/45: chown d2 30944089 1 2023-12-16T20:11:23.904 INFO:tasks.workunit.client.0.smithi038.stdout:0/71: chown c9 1381276 1 2023-12-16T20:11:23.905 INFO:tasks.workunit.client.0.smithi038.stdout:1/121: creat d15/d1e/f2d x:0 0 0 2023-12-16T20:11:23.907 INFO:tasks.workunit.client.0.smithi038.stdout:7/42: dwrite f6 [0,4194304] 0 2023-12-16T20:11:23.908 INFO:tasks.workunit.client.0.smithi038.stdout:5/46: symlink d2/l8 0 2023-12-16T20:11:23.909 INFO:tasks.workunit.client.0.smithi038.stdout:0/72: creat db/f14 x:0 0 0 2023-12-16T20:11:23.911 INFO:tasks.workunit.client.0.smithi038.stdout:7/43: getdents da 0 2023-12-16T20:11:23.913 INFO:tasks.workunit.client.0.smithi038.stdout:4/35: dwrite f1 [4194304,4194304] 0 2023-12-16T20:11:23.913 INFO:tasks.workunit.client.0.smithi038.stdout:4/36: dread - f7 zero size 2023-12-16T20:11:23.919 INFO:tasks.workunit.client.0.smithi038.stdout:7/44: write f6 [3784428,106458] 0 2023-12-16T20:11:23.919 INFO:tasks.workunit.client.0.smithi038.stdout:8/39: dwrite f5 [0,4194304] 0 2023-12-16T20:11:23.919 INFO:tasks.workunit.client.0.smithi038.stdout:7/45: write f5 [152514,21840] 0 2023-12-16T20:11:23.921 INFO:tasks.workunit.client.0.smithi038.stdout:3/92: sync 2023-12-16T20:11:23.921 INFO:tasks.workunit.client.0.smithi038.stdout:4/37: mknod c8 0 2023-12-16T20:11:23.921 INFO:tasks.workunit.client.0.smithi038.stdout:4/38: creat f9 x:0 0 0 2023-12-16T20:11:23.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/40: rename c8 to ca 0 2023-12-16T20:11:23.926 INFO:tasks.workunit.client.0.smithi038.stdout:8/41: truncate f9 3917126 0 2023-12-16T20:11:23.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/46: symlink da/ld 0 2023-12-16T20:11:23.929 INFO:tasks.workunit.client.0.smithi038.stdout:0/73: rename f4 to db/f15 0 2023-12-16T20:11:23.930 INFO:tasks.workunit.client.0.smithi038.stdout:0/74: stat c9 0 2023-12-16T20:11:23.931 INFO:tasks.workunit.client.0.smithi038.stdout:7/47: fsync f6 0 2023-12-16T20:11:23.931 INFO:tasks.workunit.client.0.smithi038.stdout:3/93: readlink d4/d8/lb 0 2023-12-16T20:11:23.931 INFO:tasks.workunit.client.0.smithi038.stdout:3/94: fdatasync d4/d8/d15/d1e/f22 0 2023-12-16T20:11:23.935 INFO:tasks.workunit.client.0.smithi038.stdout:4/39: unlink f7 0 2023-12-16T20:11:23.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/44: truncate f2 2996313 0 2023-12-16T20:11:23.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/45: creat d9/fb x:0 0 0 2023-12-16T20:11:23.937 INFO:tasks.workunit.client.0.smithi038.stdout:5/47: rmdir d2 39 2023-12-16T20:11:23.940 INFO:tasks.workunit.client.0.smithi038.stdout:7/48: creat da/db/fe x:0 0 0 2023-12-16T20:11:23.940 INFO:tasks.workunit.client.0.smithi038.stdout:3/95: mknod d4/d27/d23/c29 0 2023-12-16T20:11:23.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/96: creat d4/d18/f2a x:0 0 0 2023-12-16T20:11:23.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/97: readlink d4/l12 0 2023-12-16T20:11:23.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/98: truncate d4/d18/f2a 849354 0 2023-12-16T20:11:23.942 INFO:tasks.workunit.client.0.smithi038.stdout:4/40: unlink l5 0 2023-12-16T20:11:23.942 INFO:tasks.workunit.client.0.smithi038.stdout:4/41: stat c8 0 2023-12-16T20:11:23.942 INFO:tasks.workunit.client.0.smithi038.stdout:4/42: creat fa x:0 0 0 2023-12-16T20:11:23.944 INFO:tasks.workunit.client.0.smithi038.stdout:9/46: symlink d9/lc 0 2023-12-16T20:11:23.945 INFO:tasks.workunit.client.0.smithi038.stdout:5/48: unlink c1 0 2023-12-16T20:11:23.946 INFO:tasks.workunit.client.0.smithi038.stdout:7/49: rmdir da 39 2023-12-16T20:11:23.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/50: write f6 [3006742,5584] 0 2023-12-16T20:11:23.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/51: write f6 [3958191,12396] 0 2023-12-16T20:11:23.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/52: creat da/db/ff x:0 0 0 2023-12-16T20:11:23.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/53: read f5 [391270,19882] 0 2023-12-16T20:11:23.947 INFO:tasks.workunit.client.0.smithi038.stdout:2/129: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:23.949 INFO:tasks.workunit.client.0.smithi038.stdout:8/42: dwrite f9 [0,4194304] 0 2023-12-16T20:11:23.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/49: creat d2/f9 x:0 0 0 2023-12-16T20:11:23.955 INFO:tasks.workunit.client.0.smithi038.stdout:7/54: creat da/dc/f10 x:0 0 0 2023-12-16T20:11:23.956 INFO:tasks.workunit.client.0.smithi038.stdout:2/130: getdents d1 0 2023-12-16T20:11:23.956 INFO:tasks.workunit.client.0.smithi038.stdout:3/99: dread d4/f5 [0,4194304] 0 2023-12-16T20:11:23.956 INFO:tasks.workunit.client.0.smithi038.stdout:1/122: dwrite d15/d22/f26 [0,4194304] 0 2023-12-16T20:11:23.959 INFO:tasks.workunit.client.0.smithi038.stdout:4/43: dwrite f9 [0,4194304] 0 2023-12-16T20:11:23.961 INFO:tasks.workunit.client.0.smithi038.stdout:7/55: dread f5 [0,4194304] 0 2023-12-16T20:11:23.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/75: write f6 [1464145,64809] 0 2023-12-16T20:11:23.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/47: dread f2 [0,4194304] 0 2023-12-16T20:11:23.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/48: creat d9/fd x:0 0 0 2023-12-16T20:11:23.968 INFO:tasks.workunit.client.0.smithi038.stdout:9/49: creat d9/fe x:0 0 0 2023-12-16T20:11:23.968 INFO:tasks.workunit.client.0.smithi038.stdout:3/100: mkdir d4/d27/d2b 0 2023-12-16T20:11:23.968 INFO:tasks.workunit.client.0.smithi038.stdout:3/101: chown d4/f28 12797590 1 2023-12-16T20:11:23.971 INFO:tasks.workunit.client.0.smithi038.stdout:1/123: mkdir d15/d1e/d23/d2e 0 2023-12-16T20:11:23.978 INFO:tasks.workunit.client.0.smithi038.stdout:7/56: mkdir da/db/d11 0 2023-12-16T20:11:23.978 INFO:tasks.workunit.client.0.smithi038.stdout:7/57: chown da/db/d11 902451 1 2023-12-16T20:11:23.978 INFO:tasks.workunit.client.0.smithi038.stdout:8/43: truncate f9 3184660 0 2023-12-16T20:11:23.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/124: mknod d15/d1e/d25/c2f 0 2023-12-16T20:11:23.986 INFO:tasks.workunit.client.0.smithi038.stdout:7/58: mkdir da/d12 0 2023-12-16T20:11:23.986 INFO:tasks.workunit.client.0.smithi038.stdout:7/59: fsync da/dc/f10 0 2023-12-16T20:11:23.986 INFO:tasks.workunit.client.0.smithi038.stdout:7/60: chown c3 24580009 1 2023-12-16T20:11:23.987 INFO:tasks.workunit.client.0.smithi038.stdout:8/44: symlink lb 0 2023-12-16T20:11:23.988 INFO:tasks.workunit.client.0.smithi038.stdout:0/76: mkdir db/d16 0 2023-12-16T20:11:23.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/61: unlink da/ld 0 2023-12-16T20:11:23.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/62: read f5 [205774,11714] 0 2023-12-16T20:11:23.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/63: fsync f6 0 2023-12-16T20:11:23.990 INFO:tasks.workunit.client.0.smithi038.stdout:0/77: creat db/d16/f17 x:0 0 0 2023-12-16T20:11:23.990 INFO:tasks.workunit.client.0.smithi038.stdout:0/78: creat db/d16/f18 x:0 0 0 2023-12-16T20:11:23.990 INFO:tasks.workunit.client.0.smithi038.stdout:0/79: dread - db/f15 zero size 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/64: symlink da/l13 0 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/65: rename da to da/d12/d14 22 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/66: chown da/d12 0 1 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/67: read - da/db/fe zero size 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/68: creat da/db/f15 x:0 0 0 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/69: creat da/db/f16 x:0 0 0 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/70: dread - da/db/fe zero size 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/71: chown f6 1104030 1 2023-12-16T20:11:23.991 INFO:tasks.workunit.client.0.smithi038.stdout:0/80: mkdir db/d16/d19 0 2023-12-16T20:11:23.993 INFO:tasks.workunit.client.0.smithi038.stdout:0/81: fdatasync f8 0 2023-12-16T20:11:23.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/45: write f5 [1496636,64135] 0 2023-12-16T20:11:23.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/46: creat fc x:0 0 0 2023-12-16T20:11:23.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/47: chown lb 462870738 1 2023-12-16T20:11:23.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/131: dwrite d1/d5/f7 [4194304,4194304] 0 2023-12-16T20:11:23.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/132: fdatasync d1/d5/f7 0 2023-12-16T20:11:23.994 INFO:tasks.workunit.client.0.smithi038.stdout:0/82: mkdir db/d1a 0 2023-12-16T20:11:23.995 INFO:tasks.workunit.client.0.smithi038.stdout:3/102: dwrite d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:23.996 INFO:tasks.workunit.client.0.smithi038.stdout:7/72: dread f6 [0,4194304] 0 2023-12-16T20:11:23.996 INFO:tasks.workunit.client.0.smithi038.stdout:7/73: readlink da/l13 0 2023-12-16T20:11:23.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/74: write f6 [173886,45662] 0 2023-12-16T20:11:23.997 INFO:tasks.workunit.client.0.smithi038.stdout:4/44: dwrite f1 [0,4194304] 0 2023-12-16T20:11:23.997 INFO:tasks.workunit.client.0.smithi038.stdout:4/45: creat fb x:0 0 0 2023-12-16T20:11:23.999 INFO:tasks.workunit.client.0.smithi038.stdout:8/48: symlink ld 0 2023-12-16T20:11:23.999 INFO:tasks.workunit.client.0.smithi038.stdout:1/125: dread d15/d22/f26 [0,4194304] 0 2023-12-16T20:11:23.999 INFO:tasks.workunit.client.0.smithi038.stdout:2/133: symlink d1/df/l26 0 2023-12-16T20:11:23.999 INFO:tasks.workunit.client.0.smithi038.stdout:6/56: sync 2023-12-16T20:11:23.999 INFO:tasks.workunit.client.0.smithi038.stdout:8/49: write f5 [4666796,53860] 0 2023-12-16T20:11:24.000 INFO:tasks.workunit.client.0.smithi038.stdout:0/83: creat db/d16/d19/f1b x:0 0 0 2023-12-16T20:11:24.001 INFO:tasks.workunit.client.0.smithi038.stdout:3/103: dread d4/d8/f1c [0,4194304] 0 2023-12-16T20:11:24.003 INFO:tasks.workunit.client.0.smithi038.stdout:9/50: getdents d9 0 2023-12-16T20:11:24.004 INFO:tasks.workunit.client.0.smithi038.stdout:1/126: stat l13 0 2023-12-16T20:11:24.010 INFO:tasks.workunit.client.0.smithi038.stdout:9/51: dread f2 [0,4194304] 0 2023-12-16T20:11:24.010 INFO:tasks.workunit.client.0.smithi038.stdout:9/52: write d9/fa [1802579,61675] 0 2023-12-16T20:11:24.010 INFO:tasks.workunit.client.0.smithi038.stdout:9/53: dread - d9/fe zero size 2023-12-16T20:11:24.010 INFO:tasks.workunit.client.0.smithi038.stdout:9/54: chown d9 299124 1 2023-12-16T20:11:24.010 INFO:tasks.workunit.client.0.smithi038.stdout:2/134: rename d1/d5/d16/d1b to d1/d1a/d27 0 2023-12-16T20:11:24.012 INFO:tasks.workunit.client.0.smithi038.stdout:0/84: mkdir db/d16/d1c 0 2023-12-16T20:11:24.014 INFO:tasks.workunit.client.0.smithi038.stdout:4/46: dread f9 [0,4194304] 0 2023-12-16T20:11:24.016 INFO:tasks.workunit.client.0.smithi038.stdout:1/127: rmdir d15/d22 39 2023-12-16T20:11:24.019 INFO:tasks.workunit.client.0.smithi038.stdout:2/135: rename d1/df/d10/l1d to d1/df/d21/l28 0 2023-12-16T20:11:24.019 INFO:tasks.workunit.client.0.smithi038.stdout:2/136: chown d1/c4 1 1 2023-12-16T20:11:24.020 INFO:tasks.workunit.client.0.smithi038.stdout:0/85: creat db/d16/d1c/f1d x:0 0 0 2023-12-16T20:11:24.022 INFO:tasks.workunit.client.0.smithi038.stdout:8/50: dwrite f9 [0,4194304] 0 2023-12-16T20:11:24.022 INFO:tasks.workunit.client.0.smithi038.stdout:8/51: rmdir - no directory 2023-12-16T20:11:24.022 INFO:tasks.workunit.client.0.smithi038.stdout:7/75: dwrite da/db/f15 [0,4194304] 0 2023-12-16T20:11:24.024 INFO:tasks.workunit.client.0.smithi038.stdout:3/104: rmdir d4 39 2023-12-16T20:11:24.026 INFO:tasks.workunit.client.0.smithi038.stdout:1/128: write f8 [840281,115083] 0 2023-12-16T20:11:24.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/47: rename c4 to cc 0 2023-12-16T20:11:24.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/48: dread - fb zero size 2023-12-16T20:11:24.029 INFO:tasks.workunit.client.0.smithi038.stdout:2/137: write d1/d5/f7 [8004543,87478] 0 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/49: rename c8 to cd 0 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/76: rmdir da/db 39 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/77: truncate f5 1513335 0 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/78: creat da/dc/f17 x:0 0 0 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/50: mknod ce 0 2023-12-16T20:11:24.039 INFO:tasks.workunit.client.0.smithi038.stdout:1/129: dread d15/f19 [0,4194304] 0 2023-12-16T20:11:24.044 INFO:tasks.workunit.client.0.smithi038.stdout:7/79: symlink da/dc/l18 0 2023-12-16T20:11:24.044 INFO:tasks.workunit.client.0.smithi038.stdout:1/130: mkdir d15/d1e/d30 0 2023-12-16T20:11:24.046 INFO:tasks.workunit.client.0.smithi038.stdout:7/80: creat da/f19 x:0 0 0 2023-12-16T20:11:24.048 INFO:tasks.workunit.client.0.smithi038.stdout:1/131: mknod d15/d1e/d30/c31 0 2023-12-16T20:11:24.049 INFO:tasks.workunit.client.0.smithi038.stdout:1/132: write d15/f1d [881213,101292] 0 2023-12-16T20:11:24.049 INFO:tasks.workunit.client.0.smithi038.stdout:1/133: readlink lb 0 2023-12-16T20:11:24.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/134: rmdir d15/d1e/d23/d2e 0 2023-12-16T20:11:24.055 INFO:tasks.workunit.client.0.smithi038.stdout:1/135: creat d15/d1e/d30/f32 x:0 0 0 2023-12-16T20:11:24.055 INFO:tasks.workunit.client.0.smithi038.stdout:1/136: truncate d15/f1a 708108 0 2023-12-16T20:11:24.057 INFO:tasks.workunit.client.0.smithi038.stdout:1/137: rmdir d15/d22 39 2023-12-16T20:11:24.079 INFO:tasks.workunit.client.0.smithi038.stdout:0/86: dwrite db/d16/f18 [0,4194304] 0 2023-12-16T20:11:24.085 INFO:tasks.workunit.client.0.smithi038.stdout:8/52: dwrite f1 [0,4194304] 0 2023-12-16T20:11:24.086 INFO:tasks.workunit.client.0.smithi038.stdout:8/53: mknod ce 0 2023-12-16T20:11:24.089 INFO:tasks.workunit.client.0.smithi038.stdout:0/87: read f3 [3621810,120636] 0 2023-12-16T20:11:24.090 INFO:tasks.workunit.client.0.smithi038.stdout:0/88: symlink db/l1e 0 2023-12-16T20:11:24.090 INFO:tasks.workunit.client.0.smithi038.stdout:0/89: write f3 [5104244,45824] 0 2023-12-16T20:11:24.092 INFO:tasks.workunit.client.0.smithi038.stdout:3/105: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:24.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/51: dwrite fb [0,4194304] 0 2023-12-16T20:11:24.093 INFO:tasks.workunit.client.0.smithi038.stdout:1/138: dwrite f7 [0,4194304] 0 2023-12-16T20:11:24.094 INFO:tasks.workunit.client.0.smithi038.stdout:3/106: mkdir d4/d8/d15/d2c 0 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:2/138: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/90: dread f5 [0,4194304] 0 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:2/139: chown d1/d5/d16 1526481 1 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/91: creat db/d16/d1c/f1f x:0 0 0 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:7/81: dwrite da/db/fe [0,4194304] 0 2023-12-16T20:11:24.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/92: fdatasync db/f11 0 2023-12-16T20:11:24.098 INFO:tasks.workunit.client.0.smithi038.stdout:4/52: symlink lf 0 2023-12-16T20:11:24.098 INFO:tasks.workunit.client.0.smithi038.stdout:8/54: dread f9 [0,4194304] 0 2023-12-16T20:11:24.100 INFO:tasks.workunit.client.0.smithi038.stdout:1/139: link d15/d1e/d30/c31 d15/d1e/d30/c33 0 2023-12-16T20:11:24.101 INFO:tasks.workunit.client.0.smithi038.stdout:1/140: write d15/d1e/d30/f32 [393502,67235] 0 2023-12-16T20:11:24.102 INFO:tasks.workunit.client.0.smithi038.stdout:3/107: mkdir d4/d27/d2b/d2d 0 2023-12-16T20:11:24.102 INFO:tasks.workunit.client.0.smithi038.stdout:3/108: dread - d4/d8/d15/f19 zero size 2023-12-16T20:11:24.105 INFO:tasks.workunit.client.0.smithi038.stdout:4/53: dread f6 [0,4194304] 0 2023-12-16T20:11:24.105 INFO:tasks.workunit.client.0.smithi038.stdout:1/141: dread d15/f21 [0,4194304] 0 2023-12-16T20:11:24.109 INFO:tasks.workunit.client.0.smithi038.stdout:2/140: mkdir d1/df/d10/d23/d29 0 2023-12-16T20:11:24.112 INFO:tasks.workunit.client.0.smithi038.stdout:7/82: rmdir da/d12 0 2023-12-16T20:11:24.112 INFO:tasks.workunit.client.0.smithi038.stdout:7/83: write da/dc/f17 [201359,75270] 0 2023-12-16T20:11:24.112 INFO:tasks.workunit.client.0.smithi038.stdout:7/84: dread - da/db/ff zero size 2023-12-16T20:11:24.112 INFO:tasks.workunit.client.0.smithi038.stdout:7/85: getdents da/db/d11 0 2023-12-16T20:11:24.113 INFO:tasks.workunit.client.0.smithi038.stdout:0/93: link db/f11 db/d16/d1c/f20 0 2023-12-16T20:11:24.113 INFO:tasks.workunit.client.0.smithi038.stdout:2/141: dread d1/d5/f7 [4194304,4194304] 0 2023-12-16T20:11:24.115 INFO:tasks.workunit.client.0.smithi038.stdout:3/109: truncate d4/f28 2398073 0 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:4/54: symlink l10 0 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:4/55: write f9 [4364984,41986] 0 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:4/56: readlink l10 0 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:9/55: sync 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:6/57: sync 2023-12-16T20:11:24.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/50: sync 2023-12-16T20:11:24.118 INFO:tasks.workunit.client.0.smithi038.stdout:7/86: truncate f6 343854 0 2023-12-16T20:11:24.119 INFO:tasks.workunit.client.0.smithi038.stdout:0/94: symlink db/d1a/l21 0 2023-12-16T20:11:24.119 INFO:tasks.workunit.client.0.smithi038.stdout:0/95: write db/d16/d1c/f20 [861241,112242] 0 2023-12-16T20:11:24.119 INFO:tasks.workunit.client.0.smithi038.stdout:2/142: mkdir d1/d5/d2a 0 2023-12-16T20:11:24.120 INFO:tasks.workunit.client.0.smithi038.stdout:8/55: truncate f9 700548 0 2023-12-16T20:11:24.124 INFO:tasks.workunit.client.0.smithi038.stdout:4/57: mknod c11 0 2023-12-16T20:11:24.126 INFO:tasks.workunit.client.0.smithi038.stdout:6/58: rename d1/l2 to d1/l10 0 2023-12-16T20:11:24.133 INFO:tasks.workunit.client.0.smithi038.stdout:7/87: link c8 da/db/d11/c1a 0 2023-12-16T20:11:24.133 INFO:tasks.workunit.client.0.smithi038.stdout:7/88: chown da/dc/f10 102057332 1 2023-12-16T20:11:24.134 INFO:tasks.workunit.client.0.smithi038.stdout:0/96: unlink db/d16/f17 0 2023-12-16T20:11:24.135 INFO:tasks.workunit.client.0.smithi038.stdout:6/59: symlink d1/l11 0 2023-12-16T20:11:24.135 INFO:tasks.workunit.client.0.smithi038.stdout:6/60: fsync d1/fe 0 2023-12-16T20:11:24.135 INFO:tasks.workunit.client.0.smithi038.stdout:6/61: creat d1/f12 x:0 0 0 2023-12-16T20:11:24.137 INFO:tasks.workunit.client.0.smithi038.stdout:6/62: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:24.137 INFO:tasks.workunit.client.0.smithi038.stdout:6/63: fsync d1/fc 0 2023-12-16T20:11:24.144 INFO:tasks.workunit.client.0.smithi038.stdout:5/51: link d2/c6 d2/d4/ca 0 2023-12-16T20:11:24.144 INFO:tasks.workunit.client.0.smithi038.stdout:2/143: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:24.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:23 smithi038 ceph-mon[80659]: pgmap v172: 65 pgs: 65 active+clean; 321 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 17 MiB/s wr, 488 op/s 2023-12-16T20:11:24.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/56: dwrite d9/fb [0,4194304] 0 2023-12-16T20:11:24.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/57: write d9/fd [1005673,5365] 0 2023-12-16T20:11:24.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/58: getdents d9 0 2023-12-16T20:11:24.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/110: truncate f1 1733377 0 2023-12-16T20:11:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/144: symlink d1/df/l2b 0 2023-12-16T20:11:24.152 INFO:tasks.workunit.client.0.smithi038.stdout:2/145: stat d1/d1a/c24 0 2023-12-16T20:11:24.152 INFO:tasks.workunit.client.0.smithi038.stdout:2/146: write d1/d5/f7 [8158646,86017] 0 2023-12-16T20:11:24.155 INFO:tasks.workunit.client.0.smithi038.stdout:5/52: rename d2/f3 to d2/d4/fb 0 2023-12-16T20:11:24.155 INFO:tasks.workunit.client.0.smithi038.stdout:5/53: read d2/d4/fb [3402777,100047] 0 2023-12-16T20:11:24.156 INFO:tasks.workunit.client.0.smithi038.stdout:9/59: write d9/fa [1235774,35149] 0 2023-12-16T20:11:24.157 INFO:tasks.workunit.client.0.smithi038.stdout:3/111: creat d4/d27/d23/f2e x:0 0 0 2023-12-16T20:11:24.158 INFO:tasks.workunit.client.0.smithi038.stdout:5/54: stat d2/l8 0 2023-12-16T20:11:24.159 INFO:tasks.workunit.client.0.smithi038.stdout:9/60: unlink f3 0 2023-12-16T20:11:24.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/112: truncate d4/d8/f16 3204067 0 2023-12-16T20:11:24.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/113: readlink d4/d8/lb 0 2023-12-16T20:11:24.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/58: dwrite f9 [0,4194304] 0 2023-12-16T20:11:24.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/59: fdatasync fa 0 2023-12-16T20:11:24.161 INFO:tasks.workunit.client.0.smithi038.stdout:3/114: getdents d4/d8 0 2023-12-16T20:11:24.161 INFO:tasks.workunit.client.0.smithi038.stdout:3/115: write d4/f14 [4446367,83039] 0 2023-12-16T20:11:24.162 INFO:tasks.workunit.client.0.smithi038.stdout:3/116: symlink d4/d8/d15/d2c/l2f 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/60: dread f1 [0,4194304] 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/61: write f9 [4567293,107285] 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/62: stat f1 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:3/117: link d4/d8/f1a d4/d8/f30 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/63: creat f12 x:0 0 0 2023-12-16T20:11:24.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/64: write fa [920160,113710] 0 2023-12-16T20:11:24.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/118: rmdir d4/d8/d15/d1e 39 2023-12-16T20:11:24.166 INFO:tasks.workunit.client.0.smithi038.stdout:3/119: mknod d4/d27/d2b/c31 0 2023-12-16T20:11:24.169 INFO:tasks.workunit.client.0.smithi038.stdout:3/120: write f3 [565497,74682] 0 2023-12-16T20:11:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/147: fsync d1/d5/f7 0 2023-12-16T20:11:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:0/97: dwrite f3 [0,4194304] 0 2023-12-16T20:11:24.174 INFO:tasks.workunit.client.0.smithi038.stdout:6/64: dwrite d1/d4/fd [0,4194304] 0 2023-12-16T20:11:24.174 INFO:tasks.workunit.client.0.smithi038.stdout:6/65: chown d1/d4 8618915 1 2023-12-16T20:11:24.175 INFO:tasks.workunit.client.0.smithi038.stdout:8/56: dwrite f9 [0,4194304] 0 2023-12-16T20:11:24.175 INFO:tasks.workunit.client.0.smithi038.stdout:8/57: write fc [901737,86204] 0 2023-12-16T20:11:24.175 INFO:tasks.workunit.client.0.smithi038.stdout:2/148: symlink d1/d5/d16/l2c 0 2023-12-16T20:11:24.179 INFO:tasks.workunit.client.0.smithi038.stdout:0/98: mknod db/d16/d19/c22 0 2023-12-16T20:11:24.183 INFO:tasks.workunit.client.0.smithi038.stdout:6/66: symlink d1/d4/l13 0 2023-12-16T20:11:24.184 INFO:tasks.workunit.client.0.smithi038.stdout:0/99: dread f5 [0,4194304] 0 2023-12-16T20:11:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:8/58: link ce cf 0 2023-12-16T20:11:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:8/59: creat f10 x:0 0 0 2023-12-16T20:11:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:2/149: stat d1/c1c 0 2023-12-16T20:11:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:2/150: fsync d1/d5/f7 0 2023-12-16T20:11:24.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/67: mknod d1/c14 0 2023-12-16T20:11:24.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/68: write d1/f12 [208084,104223] 0 2023-12-16T20:11:24.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/69: readlink d1/d4/l13 0 2023-12-16T20:11:24.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/70: rename d1/l11 to d1/d4/da/l15 0 2023-12-16T20:11:24.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/71: read d1/d4/f8 [67464,41828] 0 2023-12-16T20:11:24.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/72: readlink d1/l3 0 2023-12-16T20:11:24.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/73: fsync d1/d4/f8 0 2023-12-16T20:11:24.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/74: read d1/d4/f8 [122071,100205] 0 2023-12-16T20:11:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:0/100: getdents db/d16 0 2023-12-16T20:11:24.194 INFO:tasks.workunit.client.0.smithi038.stdout:9/61: dwrite d9/fa [0,4194304] 0 2023-12-16T20:11:24.194 INFO:tasks.workunit.client.0.smithi038.stdout:9/62: truncate d9/fe 110361 0 2023-12-16T20:11:24.202 INFO:tasks.workunit.client.0.smithi038.stdout:8/60: write f1 [398545,61068] 0 2023-12-16T20:11:24.202 INFO:tasks.workunit.client.0.smithi038.stdout:8/61: readlink lb 0 2023-12-16T20:11:24.205 INFO:tasks.workunit.client.0.smithi038.stdout:2/151: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:24.207 INFO:tasks.workunit.client.0.smithi038.stdout:2/152: link d1/df/l26 d1/df/d21/l2d 0 2023-12-16T20:11:24.207 INFO:tasks.workunit.client.0.smithi038.stdout:2/153: fdatasync d1/d5/f7 0 2023-12-16T20:11:24.208 INFO:tasks.workunit.client.0.smithi038.stdout:6/75: write d1/d4/fd [3312338,19790] 0 2023-12-16T20:11:24.209 INFO:tasks.workunit.client.0.smithi038.stdout:6/76: write d1/d4/fd [4627455,25966] 0 2023-12-16T20:11:24.209 INFO:tasks.workunit.client.0.smithi038.stdout:2/154: creat d1/d5/d16/f2e x:0 0 0 2023-12-16T20:11:24.210 INFO:tasks.workunit.client.0.smithi038.stdout:8/62: dread f2 [0,4194304] 0 2023-12-16T20:11:24.213 INFO:tasks.workunit.client.0.smithi038.stdout:2/155: mkdir d1/df/d10/d2f 0 2023-12-16T20:11:24.214 INFO:tasks.workunit.client.0.smithi038.stdout:2/156: creat d1/d5/d2a/f30 x:0 0 0 2023-12-16T20:11:24.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/157: write d1/d5/d16/f2e [903667,14576] 0 2023-12-16T20:11:24.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/158: mkdir d1/d5/d2a/d31 0 2023-12-16T20:11:24.216 INFO:tasks.workunit.client.0.smithi038.stdout:2/159: truncate d1/d5/d16/f2e 1347966 0 2023-12-16T20:11:24.216 INFO:tasks.workunit.client.0.smithi038.stdout:2/160: stat d1/d5/c13 0 2023-12-16T20:11:24.217 INFO:tasks.workunit.client.0.smithi038.stdout:2/161: mknod d1/df/d10/c32 0 2023-12-16T20:11:24.217 INFO:tasks.workunit.client.0.smithi038.stdout:2/162: chown d1/l2 1 1 2023-12-16T20:11:24.217 INFO:tasks.workunit.client.0.smithi038.stdout:2/163: truncate d1/d5/d2a/f30 217876 0 2023-12-16T20:11:24.221 INFO:tasks.workunit.client.0.smithi038.stdout:2/164: read d1/d5/f7 [2930415,38444] 0 2023-12-16T20:11:24.222 INFO:tasks.workunit.client.0.smithi038.stdout:2/165: mknod d1/d5/d2a/c33 0 2023-12-16T20:11:24.223 INFO:tasks.workunit.client.0.smithi038.stdout:3/121: dwrite d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:24.223 INFO:tasks.workunit.client.0.smithi038.stdout:3/122: fsync d4/f6 0 2023-12-16T20:11:24.223 INFO:tasks.workunit.client.0.smithi038.stdout:0/101: dwrite db/d16/f18 [0,4194304] 0 2023-12-16T20:11:24.223 INFO:tasks.workunit.client.0.smithi038.stdout:0/102: creat db/d16/d19/f23 x:0 0 0 2023-12-16T20:11:24.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/166: dread d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/167: truncate d1/d5/f7 9409497 0 2023-12-16T20:11:24.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/168: write d1/d5/d16/f2e [1829338,55021] 0 2023-12-16T20:11:24.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/169: fdatasync d1/d5/d2a/f30 0 2023-12-16T20:11:24.225 INFO:tasks.workunit.client.0.smithi038.stdout:8/63: dwrite f2 [0,4194304] 0 2023-12-16T20:11:24.225 INFO:tasks.workunit.client.0.smithi038.stdout:3/123: creat d4/d27/d2b/f32 x:0 0 0 2023-12-16T20:11:24.227 INFO:tasks.workunit.client.0.smithi038.stdout:6/77: rename d1/d4/da to d1/d16 0 2023-12-16T20:11:24.228 INFO:tasks.workunit.client.0.smithi038.stdout:6/78: creat d1/f17 x:0 0 0 2023-12-16T20:11:24.231 INFO:tasks.workunit.client.0.smithi038.stdout:0/103: rmdir db/d16 39 2023-12-16T20:11:24.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/170: getdents d1/df 0 2023-12-16T20:11:24.234 INFO:tasks.workunit.client.0.smithi038.stdout:8/64: dread f9 [0,4194304] 0 2023-12-16T20:11:24.234 INFO:tasks.workunit.client.0.smithi038.stdout:3/124: creat d4/d18/f33 x:0 0 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:3/125: readlink d4/l12 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:8/65: write f1 [2401835,97333] 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:8/66: chown ce 0 1 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/171: dread d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/172: readlink d1/d5/d16/l25 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/173: stat d1/d5/d2a/d31 0 2023-12-16T20:11:24.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/174: truncate d1/d5/d2a/f30 555205 0 2023-12-16T20:11:24.238 INFO:tasks.workunit.client.0.smithi038.stdout:0/104: rename db/d16/d19/f1b to db/d16/d1c/f24 0 2023-12-16T20:11:24.238 INFO:tasks.workunit.client.0.smithi038.stdout:0/105: chown f8 0 1 2023-12-16T20:11:24.238 INFO:tasks.workunit.client.0.smithi038.stdout:0/106: chown db/l1e 230 1 2023-12-16T20:11:24.238 INFO:tasks.workunit.client.0.smithi038.stdout:0/107: read f5 [1538251,86584] 0 2023-12-16T20:11:24.239 INFO:tasks.workunit.client.0.smithi038.stdout:8/67: link c6 c11 0 2023-12-16T20:11:24.240 INFO:tasks.workunit.client.0.smithi038.stdout:2/175: symlink d1/d5/d2a/d31/l34 0 2023-12-16T20:11:24.241 INFO:tasks.workunit.client.0.smithi038.stdout:0/108: mknod db/d16/c25 0 2023-12-16T20:11:24.244 INFO:tasks.workunit.client.0.smithi038.stdout:8/68: unlink f2 0 2023-12-16T20:11:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:23 smithi141 ceph-mon[88165]: pgmap v172: 65 pgs: 65 active+clean; 321 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 17 MiB/s wr, 488 op/s 2023-12-16T20:11:24.245 INFO:tasks.workunit.client.0.smithi038.stdout:6/79: dwrite d1/f17 [0,4194304] 0 2023-12-16T20:11:24.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/69: symlink l12 0 2023-12-16T20:11:24.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/70: creat f13 x:0 0 0 2023-12-16T20:11:24.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/71: creat f14 x:0 0 0 2023-12-16T20:11:24.247 INFO:tasks.workunit.client.0.smithi038.stdout:8/72: chown f5 2820601 1 2023-12-16T20:11:24.247 INFO:tasks.workunit.client.0.smithi038.stdout:8/73: rmdir - no directory 2023-12-16T20:11:24.251 INFO:tasks.workunit.client.0.smithi038.stdout:8/74: symlink l15 0 2023-12-16T20:11:24.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/176: dread d1/d5/d16/f2e [0,4194304] 0 2023-12-16T20:11:24.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/177: read d1/d5/f7 [535120,116847] 0 2023-12-16T20:11:24.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/178: write d1/d5/f7 [9566688,56017] 0 2023-12-16T20:11:24.252 INFO:tasks.workunit.client.0.smithi038.stdout:1/142: sync 2023-12-16T20:11:24.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/179: creat d1/d5/d2a/f35 x:0 0 0 2023-12-16T20:11:24.253 INFO:tasks.workunit.client.0.smithi038.stdout:6/80: dread d1/f17 [0,4194304] 0 2023-12-16T20:11:24.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/126: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:24.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/127: chown d4/d27/d23/c29 15361193 1 2023-12-16T20:11:24.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/128: chown d4/d8/c21 12939 1 2023-12-16T20:11:24.256 INFO:tasks.workunit.client.0.smithi038.stdout:8/75: truncate f5 3218881 0 2023-12-16T20:11:24.258 INFO:tasks.workunit.client.0.smithi038.stdout:1/143: mkdir d15/d1e/d23/d34 0 2023-12-16T20:11:24.260 INFO:tasks.workunit.client.0.smithi038.stdout:2/180: getdents d1/df/d10 0 2023-12-16T20:11:24.262 INFO:tasks.workunit.client.0.smithi038.stdout:6/81: unlink d1/l10 0 2023-12-16T20:11:24.262 INFO:tasks.workunit.client.0.smithi038.stdout:6/82: fdatasync d1/d4/f8 0 2023-12-16T20:11:24.266 INFO:tasks.workunit.client.0.smithi038.stdout:2/181: rmdir d1/d1a/d27 0 2023-12-16T20:11:24.267 INFO:tasks.workunit.client.0.smithi038.stdout:3/129: dwrite d4/d8/d15/f19 [0,4194304] 0 2023-12-16T20:11:24.267 INFO:tasks.workunit.client.0.smithi038.stdout:3/130: dread - d4/d27/d2b/f32 zero size 2023-12-16T20:11:24.267 INFO:tasks.workunit.client.0.smithi038.stdout:3/131: write d4/d18/f33 [247348,127119] 0 2023-12-16T20:11:24.267 INFO:tasks.workunit.client.0.smithi038.stdout:3/132: chown d4/f14 584 1 2023-12-16T20:11:24.269 INFO:tasks.workunit.client.0.smithi038.stdout:8/76: truncate f9 3063145 0 2023-12-16T20:11:24.269 INFO:tasks.workunit.client.0.smithi038.stdout:8/77: creat f16 x:0 0 0 2023-12-16T20:11:24.273 INFO:tasks.workunit.client.0.smithi038.stdout:3/133: rmdir d4/d27/d2b/d2d 0 2023-12-16T20:11:24.274 INFO:tasks.workunit.client.0.smithi038.stdout:3/134: write d4/d8/d15/d1e/f1f [413622,70210] 0 2023-12-16T20:11:24.274 INFO:tasks.workunit.client.0.smithi038.stdout:3/135: fdatasync d4/d27/d2b/f32 0 2023-12-16T20:11:24.276 INFO:tasks.workunit.client.0.smithi038.stdout:8/78: mkdir d17 0 2023-12-16T20:11:24.276 INFO:tasks.workunit.client.0.smithi038.stdout:8/79: write f14 [119371,8773] 0 2023-12-16T20:11:24.278 INFO:tasks.workunit.client.0.smithi038.stdout:3/136: rename d4/d8/d15/f19 to d4/d18/f34 0 2023-12-16T20:11:24.278 INFO:tasks.workunit.client.0.smithi038.stdout:3/137: creat d4/d27/d2b/f35 x:0 0 0 2023-12-16T20:11:24.279 INFO:tasks.workunit.client.0.smithi038.stdout:6/83: dwrite d1/d4/fd [0,4194304] 0 2023-12-16T20:11:24.282 INFO:tasks.workunit.client.0.smithi038.stdout:3/138: symlink d4/d18/l36 0 2023-12-16T20:11:24.283 INFO:tasks.workunit.client.0.smithi038.stdout:6/84: rename d1/f17 to d1/d4/f18 0 2023-12-16T20:11:24.285 INFO:tasks.workunit.client.0.smithi038.stdout:3/139: rmdir d4/d27 39 2023-12-16T20:11:24.285 INFO:tasks.workunit.client.0.smithi038.stdout:3/140: rename d4/d27 to d4/d27/d37 22 2023-12-16T20:11:24.287 INFO:tasks.workunit.client.0.smithi038.stdout:2/182: truncate d1/d5/f7 8837669 0 2023-12-16T20:11:24.287 INFO:tasks.workunit.client.0.smithi038.stdout:2/183: write d1/d5/d2a/f35 [540416,86662] 0 2023-12-16T20:11:24.287 INFO:tasks.workunit.client.0.smithi038.stdout:2/184: chown d1/c4 30224 1 2023-12-16T20:11:24.288 INFO:tasks.workunit.client.0.smithi038.stdout:2/185: read d1/d5/d16/f2e [448693,65887] 0 2023-12-16T20:11:24.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/141: rename d4/d8/f13 to d4/d18/f38 0 2023-12-16T20:11:24.292 INFO:tasks.workunit.client.0.smithi038.stdout:3/142: symlink d4/d8/d15/d1e/l39 0 2023-12-16T20:11:24.292 INFO:tasks.workunit.client.0.smithi038.stdout:3/143: truncate d4/d18/f38 449494 0 2023-12-16T20:11:24.292 INFO:tasks.workunit.client.0.smithi038.stdout:3/144: fdatasync d4/f10 0 2023-12-16T20:11:24.293 INFO:tasks.workunit.client.0.smithi038.stdout:3/145: symlink d4/d18/l3a 0 2023-12-16T20:11:24.298 INFO:tasks.workunit.client.0.smithi038.stdout:8/80: dwrite f13 [0,4194304] 0 2023-12-16T20:11:24.298 INFO:tasks.workunit.client.0.smithi038.stdout:8/81: fdatasync f13 0 2023-12-16T20:11:24.302 INFO:tasks.workunit.client.0.smithi038.stdout:2/186: dread d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:24.307 INFO:tasks.workunit.client.0.smithi038.stdout:6/85: unlink d1/d4/f18 0 2023-12-16T20:11:24.307 INFO:tasks.workunit.client.0.smithi038.stdout:6/86: creat d1/f19 x:0 0 0 2023-12-16T20:11:24.309 INFO:tasks.workunit.client.0.smithi038.stdout:2/187: creat d1/d5/d2a/d31/f36 x:0 0 0 2023-12-16T20:11:24.309 INFO:tasks.workunit.client.0.smithi038.stdout:2/188: dread - d1/d5/d2a/d31/f36 zero size 2023-12-16T20:11:24.309 INFO:tasks.workunit.client.0.smithi038.stdout:2/189: fsync d1/d5/d2a/f35 0 2023-12-16T20:11:24.309 INFO:tasks.workunit.client.0.smithi038.stdout:2/190: write d1/d5/d2a/f35 [719612,88504] 0 2023-12-16T20:11:24.309 INFO:tasks.workunit.client.0.smithi038.stdout:6/87: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:24.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/191: mknod d1/df/d10/d2f/c37 0 2023-12-16T20:11:24.317 INFO:tasks.workunit.client.0.smithi038.stdout:8/82: dwrite f14 [0,4194304] 0 2023-12-16T20:11:24.317 INFO:tasks.workunit.client.0.smithi038.stdout:8/83: write f5 [2363916,30632] 0 2023-12-16T20:11:24.318 INFO:tasks.workunit.client.0.smithi038.stdout:5/55: sync 2023-12-16T20:11:24.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/89: sync 2023-12-16T20:11:24.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/90: write f6 [266730,130098] 0 2023-12-16T20:11:24.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/192: getdents d1/df/d10/d2f 0 2023-12-16T20:11:24.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/193: chown d1/df/d21/l2d 7408514 1 2023-12-16T20:11:24.324 INFO:tasks.workunit.client.0.smithi038.stdout:8/84: dread f5 [0,4194304] 0 2023-12-16T20:11:24.326 INFO:tasks.workunit.client.0.smithi038.stdout:5/56: dread f0 [0,4194304] 0 2023-12-16T20:11:24.327 INFO:tasks.workunit.client.0.smithi038.stdout:5/57: fdatasync d2/d4/fb 0 2023-12-16T20:11:24.327 INFO:tasks.workunit.client.0.smithi038.stdout:5/58: fsync d2/d4/fb 0 2023-12-16T20:11:24.327 INFO:tasks.workunit.client.0.smithi038.stdout:8/85: mkdir d17/d18 0 2023-12-16T20:11:24.328 INFO:tasks.workunit.client.0.smithi038.stdout:8/86: symlink d17/l19 0 2023-12-16T20:11:24.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/88: dwrite d1/d4/fd [0,4194304] 0 2023-12-16T20:11:24.332 INFO:tasks.workunit.client.0.smithi038.stdout:8/87: unlink f14 0 2023-12-16T20:11:24.332 INFO:tasks.workunit.client.0.smithi038.stdout:8/88: fsync f1 0 2023-12-16T20:11:24.332 INFO:tasks.workunit.client.0.smithi038.stdout:8/89: chown f13 357839594 1 2023-12-16T20:11:24.337 INFO:tasks.workunit.client.0.smithi038.stdout:8/90: dread f5 [0,4194304] 0 2023-12-16T20:11:24.337 INFO:tasks.workunit.client.0.smithi038.stdout:8/91: creat d17/d18/f1a x:0 0 0 2023-12-16T20:11:24.339 INFO:tasks.workunit.client.0.smithi038.stdout:7/91: dwrite da/db/f15 [4194304,4194304] 0 2023-12-16T20:11:24.339 INFO:tasks.workunit.client.0.smithi038.stdout:7/92: creat da/f1b x:0 0 0 2023-12-16T20:11:24.343 INFO:tasks.workunit.client.0.smithi038.stdout:6/89: truncate d1/d4/fd 3812855 0 2023-12-16T20:11:24.346 INFO:tasks.workunit.client.0.smithi038.stdout:5/59: dwrite f0 [4194304,4194304] 0 2023-12-16T20:11:24.348 INFO:tasks.workunit.client.0.smithi038.stdout:5/60: readlink d2/l5 0 2023-12-16T20:11:24.352 INFO:tasks.workunit.client.0.smithi038.stdout:5/61: mkdir d2/d4/dc 0 2023-12-16T20:11:24.352 INFO:tasks.workunit.client.0.smithi038.stdout:5/62: write d2/d4/fb [1566669,50619] 0 2023-12-16T20:11:24.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/90: dwrite d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:24.363 INFO:tasks.workunit.client.0.smithi038.stdout:6/91: symlink d1/d4/l1a 0 2023-12-16T20:11:24.373 INFO:tasks.workunit.client.0.smithi038.stdout:5/63: dwrite d2/f9 [0,4194304] 0 2023-12-16T20:11:24.374 INFO:tasks.workunit.client.0.smithi038.stdout:6/92: getdents d1/d4 0 2023-12-16T20:11:24.374 INFO:tasks.workunit.client.0.smithi038.stdout:6/93: dread - d1/f19 zero size 2023-12-16T20:11:24.374 INFO:tasks.workunit.client.0.smithi038.stdout:6/94: chown d1/f19 3689630 1 2023-12-16T20:11:24.375 INFO:tasks.workunit.client.0.smithi038.stdout:5/64: fsync d2/d4/fb 0 2023-12-16T20:11:24.375 INFO:tasks.workunit.client.0.smithi038.stdout:5/65: chown d2/f9 49568 1 2023-12-16T20:11:24.375 INFO:tasks.workunit.client.0.smithi038.stdout:5/66: fsync d2/f9 0 2023-12-16T20:11:24.376 INFO:tasks.workunit.client.0.smithi038.stdout:5/67: chown f0 25 1 2023-12-16T20:11:24.377 INFO:tasks.workunit.client.0.smithi038.stdout:5/68: truncate d2/f7 945672 0 2023-12-16T20:11:24.379 INFO:tasks.workunit.client.0.smithi038.stdout:9/63: sync 2023-12-16T20:11:24.381 INFO:tasks.workunit.client.0.smithi038.stdout:9/64: unlink d9/fd 0 2023-12-16T20:11:24.381 INFO:tasks.workunit.client.0.smithi038.stdout:4/65: sync 2023-12-16T20:11:24.382 INFO:tasks.workunit.client.0.smithi038.stdout:0/109: sync 2023-12-16T20:11:24.384 INFO:tasks.workunit.client.0.smithi038.stdout:9/65: rename c7 to d9/cf 0 2023-12-16T20:11:24.385 INFO:tasks.workunit.client.0.smithi038.stdout:0/110: write db/f10 [70914,106098] 0 2023-12-16T20:11:24.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/95: dread d1/d4/fd [0,4194304] 0 2023-12-16T20:11:24.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/96: write d1/f12 [1169639,79246] 0 2023-12-16T20:11:24.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/97: creat d1/f1b x:0 0 0 2023-12-16T20:11:24.386 INFO:tasks.workunit.client.0.smithi038.stdout:4/66: truncate f9 4231892 0 2023-12-16T20:11:24.387 INFO:tasks.workunit.client.0.smithi038.stdout:9/66: mknod d9/c10 0 2023-12-16T20:11:24.388 INFO:tasks.workunit.client.0.smithi038.stdout:6/98: write d1/f12 [535302,25468] 0 2023-12-16T20:11:24.388 INFO:tasks.workunit.client.0.smithi038.stdout:6/99: chown d1/d4/fd 2106 1 2023-12-16T20:11:24.389 INFO:tasks.workunit.client.0.smithi038.stdout:4/67: write f1 [1214351,64719] 0 2023-12-16T20:11:24.390 INFO:tasks.workunit.client.0.smithi038.stdout:9/67: symlink d9/l11 0 2023-12-16T20:11:24.392 INFO:tasks.workunit.client.0.smithi038.stdout:4/68: mkdir d13 0 2023-12-16T20:11:24.394 INFO:tasks.workunit.client.0.smithi038.stdout:9/68: write f2 [228926,36561] 0 2023-12-16T20:11:24.394 INFO:tasks.workunit.client.0.smithi038.stdout:4/69: mknod d13/c14 0 2023-12-16T20:11:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/70: truncate fb 672954 0 2023-12-16T20:11:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/71: stat f12 0 2023-12-16T20:11:24.398 INFO:tasks.workunit.client.0.smithi038.stdout:6/100: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:24.399 INFO:tasks.workunit.client.0.smithi038.stdout:6/101: creat d1/d4/f1c x:0 0 0 2023-12-16T20:11:24.402 INFO:tasks.workunit.client.0.smithi038.stdout:5/69: dwrite f0 [4194304,4194304] 0 2023-12-16T20:11:24.408 INFO:tasks.workunit.client.0.smithi038.stdout:4/72: fsync fb 0 2023-12-16T20:11:24.409 INFO:tasks.workunit.client.0.smithi038.stdout:4/73: mknod d13/c15 0 2023-12-16T20:11:24.410 INFO:tasks.workunit.client.0.smithi038.stdout:9/69: write d9/fa [3808959,21456] 0 2023-12-16T20:11:24.410 INFO:tasks.workunit.client.0.smithi038.stdout:4/74: symlink d13/l16 0 2023-12-16T20:11:24.412 INFO:tasks.workunit.client.0.smithi038.stdout:9/70: rename l6 to d9/l12 0 2023-12-16T20:11:24.413 INFO:tasks.workunit.client.0.smithi038.stdout:4/75: mkdir d13/d17 0 2023-12-16T20:11:24.413 INFO:tasks.workunit.client.0.smithi038.stdout:4/76: write fa [1367445,20076] 0 2023-12-16T20:11:24.414 INFO:tasks.workunit.client.0.smithi038.stdout:9/71: mknod d9/c13 0 2023-12-16T20:11:24.415 INFO:tasks.workunit.client.0.smithi038.stdout:5/70: dwrite d2/f7 [0,4194304] 0 2023-12-16T20:11:24.424 INFO:tasks.workunit.client.0.smithi038.stdout:3/146: sync 2023-12-16T20:11:24.424 INFO:tasks.workunit.client.0.smithi038.stdout:1/144: sync 2023-12-16T20:11:24.424 INFO:tasks.workunit.client.0.smithi038.stdout:3/147: chown d4/d8/d15 13485204 1 2023-12-16T20:11:24.429 INFO:tasks.workunit.client.0.smithi038.stdout:4/77: write f6 [8029782,82185] 0 2023-12-16T20:11:24.429 INFO:tasks.workunit.client.0.smithi038.stdout:4/78: fsync f12 0 2023-12-16T20:11:24.431 INFO:tasks.workunit.client.0.smithi038.stdout:4/79: creat d13/f18 x:0 0 0 2023-12-16T20:11:24.432 INFO:tasks.workunit.client.0.smithi038.stdout:5/71: dread d2/f9 [0,4194304] 0 2023-12-16T20:11:24.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/80: write f9 [4219826,57003] 0 2023-12-16T20:11:24.434 INFO:tasks.workunit.client.0.smithi038.stdout:9/72: dwrite f2 [0,4194304] 0 2023-12-16T20:11:24.436 INFO:tasks.workunit.client.0.smithi038.stdout:9/73: rmdir d9 39 2023-12-16T20:11:24.437 INFO:tasks.workunit.client.0.smithi038.stdout:9/74: truncate d9/fb 1224848 0 2023-12-16T20:11:24.439 INFO:tasks.workunit.client.0.smithi038.stdout:9/75: rename d9/c13 to d9/c14 0 2023-12-16T20:11:24.441 INFO:tasks.workunit.client.0.smithi038.stdout:9/76: link d9/cf d9/c15 0 2023-12-16T20:11:24.445 INFO:tasks.workunit.client.0.smithi038.stdout:5/72: write d2/f7 [1721442,120703] 0 2023-12-16T20:11:24.446 INFO:tasks.workunit.client.0.smithi038.stdout:5/73: symlink d2/d4/ld 0 2023-12-16T20:11:24.447 INFO:tasks.workunit.client.0.smithi038.stdout:5/74: mknod d2/d4/ce 0 2023-12-16T20:11:24.449 INFO:tasks.workunit.client.0.smithi038.stdout:4/81: dread f1 [0,4194304] 0 2023-12-16T20:11:24.449 INFO:tasks.workunit.client.0.smithi038.stdout:4/82: fsync f12 0 2023-12-16T20:11:24.450 INFO:tasks.workunit.client.0.smithi038.stdout:3/148: dwrite d4/d8/f24 [0,4194304] 0 2023-12-16T20:11:24.450 INFO:tasks.workunit.client.0.smithi038.stdout:3/149: chown d4/d18/f33 15438 1 2023-12-16T20:11:24.450 INFO:tasks.workunit.client.0.smithi038.stdout:1/145: dwrite f11 [0,4194304] 0 2023-12-16T20:11:24.457 INFO:tasks.workunit.client.0.smithi038.stdout:9/77: dread f2 [0,4194304] 0 2023-12-16T20:11:24.458 INFO:tasks.workunit.client.0.smithi038.stdout:1/146: creat d15/d1e/d23/f35 x:0 0 0 2023-12-16T20:11:24.458 INFO:tasks.workunit.client.0.smithi038.stdout:1/147: fdatasync f7 0 2023-12-16T20:11:24.458 INFO:tasks.workunit.client.0.smithi038.stdout:1/148: readlink d15/d1e/l2c 0 2023-12-16T20:11:24.460 INFO:tasks.workunit.client.0.smithi038.stdout:1/149: stat d15/l18 0 2023-12-16T20:11:24.460 INFO:tasks.workunit.client.0.smithi038.stdout:1/150: fdatasync f7 0 2023-12-16T20:11:24.465 INFO:tasks.workunit.client.0.smithi038.stdout:1/151: getdents d15/d1e/d30 0 2023-12-16T20:11:24.465 INFO:tasks.workunit.client.0.smithi038.stdout:1/152: readlink l13 0 2023-12-16T20:11:24.465 INFO:tasks.workunit.client.0.smithi038.stdout:1/153: chown f12 219 1 2023-12-16T20:11:24.469 INFO:tasks.workunit.client.0.smithi038.stdout:1/154: creat d15/d1e/d25/f36 x:0 0 0 2023-12-16T20:11:24.471 INFO:tasks.workunit.client.0.smithi038.stdout:1/155: dread f10 [0,4194304] 0 2023-12-16T20:11:24.473 INFO:tasks.workunit.client.0.smithi038.stdout:1/156: mkdir d15/d1e/d25/d37 0 2023-12-16T20:11:24.476 INFO:tasks.workunit.client.0.smithi038.stdout:1/157: creat d15/d1e/d23/d34/f38 x:0 0 0 2023-12-16T20:11:24.477 INFO:tasks.workunit.client.0.smithi038.stdout:2/194: sync 2023-12-16T20:11:24.477 INFO:tasks.workunit.client.0.smithi038.stdout:2/195: dread - d1/d5/d2a/d31/f36 zero size 2023-12-16T20:11:24.477 INFO:tasks.workunit.client.0.smithi038.stdout:3/150: dwrite d4/d8/d15/d1e/f1f [0,4194304] 0 2023-12-16T20:11:24.477 INFO:tasks.workunit.client.0.smithi038.stdout:3/151: chown d4/d18/l36 649628787 1 2023-12-16T20:11:24.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/196: unlink d1/l2 0 2023-12-16T20:11:24.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/197: fdatasync d1/d5/d2a/f30 0 2023-12-16T20:11:24.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/198: write d1/d5/d2a/d31/f36 [544076,72337] 0 2023-12-16T20:11:24.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/199: write d1/d5/f7 [4546877,77821] 0 2023-12-16T20:11:24.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/152: mknod d4/d27/c3b 0 2023-12-16T20:11:24.487 INFO:tasks.workunit.client.0.smithi038.stdout:5/75: dwrite d2/f7 [0,4194304] 0 2023-12-16T20:11:24.489 INFO:tasks.workunit.client.0.smithi038.stdout:5/76: mkdir d2/df 0 2023-12-16T20:11:24.490 INFO:tasks.workunit.client.0.smithi038.stdout:5/77: creat d2/f10 x:0 0 0 2023-12-16T20:11:24.490 INFO:tasks.workunit.client.0.smithi038.stdout:5/78: chown d2/df 15 1 2023-12-16T20:11:24.494 INFO:tasks.workunit.client.0.smithi038.stdout:4/83: dwrite f9 [0,4194304] 0 2023-12-16T20:11:24.494 INFO:tasks.workunit.client.0.smithi038.stdout:1/158: dwrite d15/d1e/d25/f36 [0,4194304] 0 2023-12-16T20:11:24.495 INFO:tasks.workunit.client.0.smithi038.stdout:9/78: dwrite d9/fa [0,4194304] 0 2023-12-16T20:11:24.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/84: rename f1 to d13/f19 0 2023-12-16T20:11:24.504 INFO:tasks.workunit.client.0.smithi038.stdout:1/159: getdents d15/d1e/d23 0 2023-12-16T20:11:24.504 INFO:tasks.workunit.client.0.smithi038.stdout:4/85: dread d13/f19 [0,4194304] 0 2023-12-16T20:11:24.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/79: getdents d9 0 2023-12-16T20:11:24.505 INFO:tasks.workunit.client.0.smithi038.stdout:1/160: unlink f12 0 2023-12-16T20:11:24.505 INFO:tasks.workunit.client.0.smithi038.stdout:9/80: link d9/cf d9/c16 0 2023-12-16T20:11:24.506 INFO:tasks.workunit.client.0.smithi038.stdout:4/86: mknod d13/d17/c1a 0 2023-12-16T20:11:24.506 INFO:tasks.workunit.client.0.smithi038.stdout:4/87: stat l10 0 2023-12-16T20:11:24.516 INFO:tasks.workunit.client.0.smithi038.stdout:3/153: dwrite d4/f14 [0,4194304] 0 2023-12-16T20:11:24.517 INFO:tasks.workunit.client.0.smithi038.stdout:2/200: dwrite d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:24.517 INFO:tasks.workunit.client.0.smithi038.stdout:5/79: dwrite d2/f7 [0,4194304] 0 2023-12-16T20:11:24.517 INFO:tasks.workunit.client.0.smithi038.stdout:5/80: write f0 [8965808,71470] 0 2023-12-16T20:11:24.517 INFO:tasks.workunit.client.0.smithi038.stdout:5/81: chown d2/d4/dc 8318636 1 2023-12-16T20:11:24.518 INFO:tasks.workunit.client.0.smithi038.stdout:9/81: write d9/fa [2116646,37985] 0 2023-12-16T20:11:24.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/154: mknod d4/d27/d23/d26/c3c 0 2023-12-16T20:11:24.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/155: write d4/d8/f24 [4760615,48481] 0 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:5/82: creat d2/f11 x:0 0 0 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:8/92: sync 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:6/102: sync 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:0/111: sync 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:7/93: sync 2023-12-16T20:11:24.523 INFO:tasks.workunit.client.0.smithi038.stdout:0/112: truncate db/f14 830316 0 2023-12-16T20:11:24.524 INFO:tasks.workunit.client.0.smithi038.stdout:9/82: truncate f2 362361 0 2023-12-16T20:11:24.527 INFO:tasks.workunit.client.0.smithi038.stdout:5/83: creat d2/f12 x:0 0 0 2023-12-16T20:11:24.529 INFO:tasks.workunit.client.0.smithi038.stdout:6/103: mkdir d1/d4/d1d 0 2023-12-16T20:11:24.531 INFO:tasks.workunit.client.0.smithi038.stdout:7/94: rename da/db/d11/c1a to da/c1c 0 2023-12-16T20:11:24.532 INFO:tasks.workunit.client.0.smithi038.stdout:0/113: creat db/f26 x:0 0 0 2023-12-16T20:11:24.533 INFO:tasks.workunit.client.0.smithi038.stdout:5/84: symlink d2/d4/l13 0 2023-12-16T20:11:24.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/156: write d4/f6 [340843,77947] 0 2023-12-16T20:11:24.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/157: stat d4/d18 0 2023-12-16T20:11:24.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/158: chown d4/d18/f2a 49784 1 2023-12-16T20:11:24.540 INFO:tasks.workunit.client.0.smithi038.stdout:0/114: unlink db/f15 0 2023-12-16T20:11:24.541 INFO:tasks.workunit.client.0.smithi038.stdout:0/115: readlink db/d1a/l21 0 2023-12-16T20:11:24.541 INFO:tasks.workunit.client.0.smithi038.stdout:0/116: truncate db/d16/d1c/f1d 363297 0 2023-12-16T20:11:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:3/159: link f1 d4/d8/d15/d1e/f3d 0 2023-12-16T20:11:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:0/117: mkdir db/d16/d19/d27 0 2023-12-16T20:11:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:5/85: mkdir d2/d14 0 2023-12-16T20:11:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:2/201: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:24.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/160: creat d4/d27/d23/d26/f3e x:0 0 0 2023-12-16T20:11:24.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/161: write d4/d18/f25 [732244,106203] 0 2023-12-16T20:11:24.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/162: truncate d4/d8/f1a 417340 0 2023-12-16T20:11:24.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/163: write d4/d27/d23/f2e [293175,107499] 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:0/118: mknod db/d16/d19/c28 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:0/119: dread db/d16/d1c/f1d [0,4194304] 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:3/164: creat d4/d8/d15/d1e/f3f x:0 0 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:0/120: write db/d16/d19/f23 [366187,91663] 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:1/161: dwrite f10 [0,4194304] 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:3/165: mkdir d4/d27/d40 0 2023-12-16T20:11:24.546 INFO:tasks.workunit.client.0.smithi038.stdout:3/166: write d4/f6 [3072190,48414] 0 2023-12-16T20:11:24.548 INFO:tasks.workunit.client.0.smithi038.stdout:9/83: fdatasync d9/fa 0 2023-12-16T20:11:24.548 INFO:tasks.workunit.client.0.smithi038.stdout:4/88: dwrite fa [0,4194304] 0 2023-12-16T20:11:24.549 INFO:tasks.workunit.client.0.smithi038.stdout:8/93: dwrite f9 [0,4194304] 0 2023-12-16T20:11:24.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/162: creat d15/d1e/d23/f39 x:0 0 0 2023-12-16T20:11:24.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/163: creat d15/d1e/d23/f3a x:0 0 0 2023-12-16T20:11:24.553 INFO:tasks.workunit.client.0.smithi038.stdout:0/121: rmdir db/d16/d1c 39 2023-12-16T20:11:24.556 INFO:tasks.workunit.client.0.smithi038.stdout:1/164: dread d15/d1e/d30/f32 [0,4194304] 0 2023-12-16T20:11:24.558 INFO:tasks.workunit.client.0.smithi038.stdout:4/89: unlink c0 0 2023-12-16T20:11:24.559 INFO:tasks.workunit.client.0.smithi038.stdout:4/90: fdatasync fa 0 2023-12-16T20:11:24.559 INFO:tasks.workunit.client.0.smithi038.stdout:4/91: write d13/f19 [9227181,68181] 0 2023-12-16T20:11:24.561 INFO:tasks.workunit.client.0.smithi038.stdout:8/94: mkdir d17/d1b 0 2023-12-16T20:11:24.562 INFO:tasks.workunit.client.0.smithi038.stdout:8/95: stat ld 0 2023-12-16T20:11:24.562 INFO:tasks.workunit.client.0.smithi038.stdout:8/96: getdents d17/d1b 0 2023-12-16T20:11:24.562 INFO:tasks.workunit.client.0.smithi038.stdout:6/104: rmdir d1 39 2023-12-16T20:11:24.563 INFO:tasks.workunit.client.0.smithi038.stdout:4/92: rmdir d13/d17 39 2023-12-16T20:11:24.563 INFO:tasks.workunit.client.0.smithi038.stdout:4/93: chown d13/d17 0 1 2023-12-16T20:11:24.564 INFO:tasks.workunit.client.0.smithi038.stdout:7/95: rmdir da 39 2023-12-16T20:11:24.567 INFO:tasks.workunit.client.0.smithi038.stdout:8/97: link lb d17/l1c 0 2023-12-16T20:11:24.569 INFO:tasks.workunit.client.0.smithi038.stdout:6/105: dread d1/fc [0,4194304] 0 2023-12-16T20:11:24.570 INFO:tasks.workunit.client.0.smithi038.stdout:7/96: creat da/f1d x:0 0 0 2023-12-16T20:11:24.571 INFO:tasks.workunit.client.0.smithi038.stdout:2/202: dwrite d1/d5/f7 [4194304,4194304] 0 2023-12-16T20:11:24.573 INFO:tasks.workunit.client.0.smithi038.stdout:1/165: dread d15/f1d [0,4194304] 0 2023-12-16T20:11:24.573 INFO:tasks.workunit.client.0.smithi038.stdout:1/166: fdatasync f11 0 2023-12-16T20:11:24.576 INFO:tasks.workunit.client.0.smithi038.stdout:7/97: rename da/db/d11 to da/db/d1e 0 2023-12-16T20:11:24.576 INFO:tasks.workunit.client.0.smithi038.stdout:7/98: stat da/db/fe 0 2023-12-16T20:11:24.576 INFO:tasks.workunit.client.0.smithi038.stdout:7/99: rename da/dc to da/dc/d1f 22 2023-12-16T20:11:24.576 INFO:tasks.workunit.client.0.smithi038.stdout:7/100: dread - da/db/f16 zero size 2023-12-16T20:11:24.583 INFO:tasks.workunit.client.0.smithi038.stdout:7/101: truncate da/db/f15 7370845 0 2023-12-16T20:11:24.584 INFO:tasks.workunit.client.0.smithi038.stdout:7/102: chown da/db 7864 1 2023-12-16T20:11:24.584 INFO:tasks.workunit.client.0.smithi038.stdout:1/167: getdents d15/d1e/d23/d34 0 2023-12-16T20:11:24.589 INFO:tasks.workunit.client.0.smithi038.stdout:7/103: symlink da/db/l20 0 2023-12-16T20:11:24.589 INFO:tasks.workunit.client.0.smithi038.stdout:7/104: dread - da/dc/f10 zero size 2023-12-16T20:11:24.590 INFO:tasks.workunit.client.0.smithi038.stdout:1/168: read - d15/f17 zero size 2023-12-16T20:11:24.592 INFO:tasks.workunit.client.0.smithi038.stdout:1/169: truncate d15/f1a 218846 0 2023-12-16T20:11:24.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/167: getdents d4/d27 0 2023-12-16T20:11:24.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/168: chown d4/d18/l36 1300 1 2023-12-16T20:11:24.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/169: chown d4/d8/d15/d1e/l39 553 1 2023-12-16T20:11:24.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/170: chown d4/d27/d2b 211251141 1 2023-12-16T20:11:24.594 INFO:tasks.workunit.client.0.smithi038.stdout:3/171: readlink d4/l1d 0 2023-12-16T20:11:24.594 INFO:tasks.workunit.client.0.smithi038.stdout:5/86: dwrite d2/d4/fb [4194304,4194304] 0 2023-12-16T20:11:24.594 INFO:tasks.workunit.client.0.smithi038.stdout:1/170: mkdir d15/d1e/d3b 0 2023-12-16T20:11:24.595 INFO:tasks.workunit.client.0.smithi038.stdout:3/172: symlink d4/d27/d23/l41 0 2023-12-16T20:11:24.598 INFO:tasks.workunit.client.0.smithi038.stdout:1/171: rmdir d15/d1e/d20 0 2023-12-16T20:11:24.598 INFO:tasks.workunit.client.0.smithi038.stdout:1/172: chown d15/d1e/d25/f36 4015694 1 2023-12-16T20:11:24.599 INFO:tasks.workunit.client.0.smithi038.stdout:3/173: creat d4/d8/f42 x:0 0 0 2023-12-16T20:11:24.599 INFO:tasks.workunit.client.0.smithi038.stdout:3/174: creat d4/d8/f43 x:0 0 0 2023-12-16T20:11:24.607 INFO:tasks.workunit.client.0.smithi038.stdout:5/87: write d2/d4/fb [5014380,89773] 0 2023-12-16T20:11:24.608 INFO:tasks.workunit.client.0.smithi038.stdout:1/173: read f11 [3870959,23837] 0 2023-12-16T20:11:24.608 INFO:tasks.workunit.client.0.smithi038.stdout:1/174: stat d15/d1e/d23/d34 0 2023-12-16T20:11:24.609 INFO:tasks.workunit.client.0.smithi038.stdout:1/175: creat d15/d1e/d25/d37/f3c x:0 0 0 2023-12-16T20:11:24.622 INFO:tasks.workunit.client.0.smithi038.stdout:1/176: write d15/f19 [1438322,16485] 0 2023-12-16T20:11:24.622 INFO:tasks.workunit.client.0.smithi038.stdout:1/177: chown d15/d1e/d23/d34/f38 890 1 2023-12-16T20:11:24.622 INFO:tasks.workunit.client.0.smithi038.stdout:5/88: read d2/f7 [1646357,88914] 0 2023-12-16T20:11:24.622 INFO:tasks.workunit.client.0.smithi038.stdout:5/89: truncate d2/f12 818764 0 2023-12-16T20:11:24.623 INFO:tasks.workunit.client.0.smithi038.stdout:1/178: mkdir d15/d1e/d25/d3d 0 2023-12-16T20:11:24.623 INFO:tasks.workunit.client.0.smithi038.stdout:1/179: chown d15/d1e 1111 1 2023-12-16T20:11:24.624 INFO:tasks.workunit.client.0.smithi038.stdout:5/90: link d2/d4/l13 d2/l15 0 2023-12-16T20:11:24.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/122: dwrite db/f10 [0,4194304] 0 2023-12-16T20:11:24.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/123: truncate db/d16/d1c/f1f 793178 0 2023-12-16T20:11:24.631 INFO:tasks.workunit.client.0.smithi038.stdout:9/84: dwrite f2 [0,4194304] 0 2023-12-16T20:11:24.631 INFO:tasks.workunit.client.0.smithi038.stdout:6/106: dwrite d1/f12 [0,4194304] 0 2023-12-16T20:11:24.632 INFO:tasks.workunit.client.0.smithi038.stdout:2/203: dwrite d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.632 INFO:tasks.workunit.client.0.smithi038.stdout:3/175: dwrite d4/d8/f42 [0,4194304] 0 2023-12-16T20:11:24.633 INFO:tasks.workunit.client.0.smithi038.stdout:7/105: dwrite da/dc/f10 [0,4194304] 0 2023-12-16T20:11:24.634 INFO:tasks.workunit.client.0.smithi038.stdout:8/98: dwrite fc [0,4194304] 0 2023-12-16T20:11:24.634 INFO:tasks.workunit.client.0.smithi038.stdout:4/94: dwrite f12 [0,4194304] 0 2023-12-16T20:11:24.634 INFO:tasks.workunit.client.0.smithi038.stdout:4/95: dread - d13/f18 zero size 2023-12-16T20:11:24.634 INFO:tasks.workunit.client.0.smithi038.stdout:0/124: link db/lc db/d16/d19/d27/l29 0 2023-12-16T20:11:24.635 INFO:tasks.workunit.client.0.smithi038.stdout:4/96: write d13/f19 [8959857,127527] 0 2023-12-16T20:11:24.636 INFO:tasks.workunit.client.0.smithi038.stdout:4/97: rename d13/d17 to d13/d17/d1b 22 2023-12-16T20:11:24.639 INFO:tasks.workunit.client.0.smithi038.stdout:2/204: symlink d1/d5/d16/l38 0 2023-12-16T20:11:24.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/205: fsync d1/d5/d2a/f35 0 2023-12-16T20:11:24.648 INFO:tasks.workunit.client.0.smithi038.stdout:2/206: write d1/d5/d2a/f35 [4079339,85430] 0 2023-12-16T20:11:24.649 INFO:tasks.workunit.client.0.smithi038.stdout:7/106: mkdir da/d21 0 2023-12-16T20:11:24.649 INFO:tasks.workunit.client.0.smithi038.stdout:7/107: stat da/dc/f10 0 2023-12-16T20:11:24.653 INFO:tasks.workunit.client.0.smithi038.stdout:8/99: dread fc [0,4194304] 0 2023-12-16T20:11:24.657 INFO:tasks.workunit.client.0.smithi038.stdout:7/108: dread f5 [0,4194304] 0 2023-12-16T20:11:24.657 INFO:tasks.workunit.client.0.smithi038.stdout:7/109: chown l7 605 1 2023-12-16T20:11:24.657 INFO:tasks.workunit.client.0.smithi038.stdout:0/125: creat db/d16/d1c/f2a x:0 0 0 2023-12-16T20:11:24.660 INFO:tasks.workunit.client.0.smithi038.stdout:3/176: getdents d4/d18 0 2023-12-16T20:11:24.662 INFO:tasks.workunit.client.0.smithi038.stdout:8/100: mkdir d17/d1d 0 2023-12-16T20:11:24.662 INFO:tasks.workunit.client.0.smithi038.stdout:8/101: chown f13 0 1 2023-12-16T20:11:24.664 INFO:tasks.workunit.client.0.smithi038.stdout:0/126: truncate db/f11 105395 0 2023-12-16T20:11:24.664 INFO:tasks.workunit.client.0.smithi038.stdout:0/127: dread - db/d16/d1c/f2a zero size 2023-12-16T20:11:24.666 INFO:tasks.workunit.client.0.smithi038.stdout:4/98: truncate fa 789041 0 2023-12-16T20:11:24.668 INFO:tasks.workunit.client.0.smithi038.stdout:3/177: mknod d4/d8/c44 0 2023-12-16T20:11:24.669 INFO:tasks.workunit.client.0.smithi038.stdout:8/102: symlink d17/d18/l1e 0 2023-12-16T20:11:24.670 INFO:tasks.workunit.client.0.smithi038.stdout:3/178: rename d4/d8/f30 to d4/d8/f45 0 2023-12-16T20:11:24.671 INFO:tasks.workunit.client.0.smithi038.stdout:3/179: mkdir d4/d27/d2b/d46 0 2023-12-16T20:11:24.675 INFO:tasks.workunit.client.0.smithi038.stdout:3/180: dread d4/d8/d15/d1e/f3d [0,4194304] 0 2023-12-16T20:11:24.675 INFO:tasks.workunit.client.0.smithi038.stdout:3/181: fdatasync d4/f5 0 2023-12-16T20:11:24.701 INFO:tasks.workunit.client.0.smithi038.stdout:1/180: dwrite fe [0,4194304] 0 2023-12-16T20:11:24.701 INFO:tasks.workunit.client.0.smithi038.stdout:6/107: dwrite d1/d4/fd [0,4194304] 0 2023-12-16T20:11:24.701 INFO:tasks.workunit.client.0.smithi038.stdout:9/85: dwrite d9/fe [0,4194304] 0 2023-12-16T20:11:24.702 INFO:tasks.workunit.client.0.smithi038.stdout:5/91: dwrite d2/f9 [0,4194304] 0 2023-12-16T20:11:24.702 INFO:tasks.workunit.client.0.smithi038.stdout:5/92: write d2/f7 [1499321,59999] 0 2023-12-16T20:11:24.702 INFO:tasks.workunit.client.0.smithi038.stdout:2/207: dwrite d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/99: fsync d13/f19 0 2023-12-16T20:11:24.703 INFO:tasks.workunit.client.0.smithi038.stdout:7/110: dwrite da/dc/f17 [0,4194304] 0 2023-12-16T20:11:24.703 INFO:tasks.workunit.client.0.smithi038.stdout:7/111: write f6 [961939,105026] 0 2023-12-16T20:11:24.706 INFO:tasks.workunit.client.0.smithi038.stdout:6/108: rename d1/f12 to d1/d4/d1d/f1e 0 2023-12-16T20:11:24.706 INFO:tasks.workunit.client.0.smithi038.stdout:6/109: write d1/f19 [1044541,71556] 0 2023-12-16T20:11:24.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/93: creat d2/d14/f16 x:0 0 0 2023-12-16T20:11:24.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/94: dread - d2/f10 zero size 2023-12-16T20:11:24.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/95: getdents d2/d4/dc 0 2023-12-16T20:11:24.724 INFO:tasks.workunit.client.0.smithi038.stdout:4/100: write fa [1181006,77308] 0 2023-12-16T20:11:24.725 INFO:tasks.workunit.client.0.smithi038.stdout:4/101: write f12 [5034702,17533] 0 2023-12-16T20:11:24.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/112: mknod da/dc/c22 0 2023-12-16T20:11:24.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/113: creat da/f23 x:0 0 0 2023-12-16T20:11:24.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/114: fsync da/db/fe 0 2023-12-16T20:11:24.730 INFO:tasks.workunit.client.0.smithi038.stdout:5/96: dread d2/f9 [0,4194304] 0 2023-12-16T20:11:24.737 INFO:tasks.workunit.client.0.smithi038.stdout:1/181: dwrite d15/d22/f26 [0,4194304] 0 2023-12-16T20:11:24.737 INFO:tasks.workunit.client.0.smithi038.stdout:1/182: write d15/d1e/f2d [672353,59915] 0 2023-12-16T20:11:24.738 INFO:tasks.workunit.client.0.smithi038.stdout:6/110: link d1/c14 d1/d16/c1f 0 2023-12-16T20:11:24.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/111: write d1/f19 [1338568,89035] 0 2023-12-16T20:11:24.741 INFO:tasks.workunit.client.0.smithi038.stdout:7/115: read da/db/fe [621620,34853] 0 2023-12-16T20:11:24.741 INFO:tasks.workunit.client.0.smithi038.stdout:2/208: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:24.741 INFO:tasks.workunit.client.0.smithi038.stdout:9/86: dwrite f2 [0,4194304] 0 2023-12-16T20:11:24.741 INFO:tasks.workunit.client.0.smithi038.stdout:2/209: chown d1/d5/d16/f2e 97 1 2023-12-16T20:11:24.741 INFO:tasks.workunit.client.0.smithi038.stdout:9/87: fsync d9/fe 0 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:4/102: mkdir d13/d1c 0 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/97: mkdir d2/d4/dc/d17 0 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/98: write d2/d4/fb [4185879,122177] 0 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/99: dread - d2/f11 zero size 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/100: dread - d2/d14/f16 zero size 2023-12-16T20:11:24.746 INFO:tasks.workunit.client.0.smithi038.stdout:2/210: rename d1/c1c to d1/df/d10/d23/c39 0 2023-12-16T20:11:24.747 INFO:tasks.workunit.client.0.smithi038.stdout:9/88: mknod d9/c17 0 2023-12-16T20:11:24.747 INFO:tasks.workunit.client.0.smithi038.stdout:9/89: fdatasync f2 0 2023-12-16T20:11:24.748 INFO:tasks.workunit.client.0.smithi038.stdout:5/101: creat d2/df/f18 x:0 0 0 2023-12-16T20:11:24.749 INFO:tasks.workunit.client.0.smithi038.stdout:5/102: dread - d2/df/f18 zero size 2023-12-16T20:11:24.749 INFO:tasks.workunit.client.0.smithi038.stdout:5/103: readlink d2/d4/l13 0 2023-12-16T20:11:24.751 INFO:tasks.workunit.client.0.smithi038.stdout:9/90: creat d9/f18 x:0 0 0 2023-12-16T20:11:24.751 INFO:tasks.workunit.client.0.smithi038.stdout:9/91: chown l5 518609789 1 2023-12-16T20:11:24.751 INFO:tasks.workunit.client.0.smithi038.stdout:9/92: stat l8 0 2023-12-16T20:11:24.752 INFO:tasks.workunit.client.0.smithi038.stdout:5/104: creat d2/d4/dc/d17/f19 x:0 0 0 2023-12-16T20:11:24.752 INFO:tasks.workunit.client.0.smithi038.stdout:5/105: dread - d2/d4/dc/d17/f19 zero size 2023-12-16T20:11:24.752 INFO:tasks.workunit.client.0.smithi038.stdout:5/106: read - d2/d4/dc/d17/f19 zero size 2023-12-16T20:11:24.753 INFO:tasks.workunit.client.0.smithi038.stdout:9/93: unlink d9/fa 0 2023-12-16T20:11:24.753 INFO:tasks.workunit.client.0.smithi038.stdout:9/94: creat d9/f19 x:0 0 0 2023-12-16T20:11:24.754 INFO:tasks.workunit.client.0.smithi038.stdout:2/211: dread d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:24.754 INFO:tasks.workunit.client.0.smithi038.stdout:6/112: dread d1/d4/d1d/f1e [0,4194304] 0 2023-12-16T20:11:24.756 INFO:tasks.workunit.client.0.smithi038.stdout:9/95: truncate d9/fb 87007 0 2023-12-16T20:11:24.756 INFO:tasks.workunit.client.0.smithi038.stdout:9/96: dread - d9/f19 zero size 2023-12-16T20:11:24.760 INFO:tasks.workunit.client.0.smithi038.stdout:2/212: truncate d1/d5/d2a/f30 3410063 0 2023-12-16T20:11:24.767 INFO:tasks.workunit.client.0.smithi038.stdout:7/116: dwrite da/db/fe [4194304,4194304] 0 2023-12-16T20:11:24.770 INFO:tasks.workunit.client.0.smithi038.stdout:6/113: write d1/d4/fd [3736551,11892] 0 2023-12-16T20:11:24.770 INFO:tasks.workunit.client.0.smithi038.stdout:1/183: dwrite d15/f1d [0,4194304] 0 2023-12-16T20:11:24.773 INFO:tasks.workunit.client.0.smithi038.stdout:1/184: mknod d15/d1e/d25/d3d/c3e 0 2023-12-16T20:11:24.773 INFO:tasks.workunit.client.0.smithi038.stdout:1/185: dread - d15/d1e/d23/f39 zero size 2023-12-16T20:11:24.773 INFO:tasks.workunit.client.0.smithi038.stdout:1/186: write f7 [4504938,13379] 0 2023-12-16T20:11:24.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/103: dwrite fb [0,4194304] 0 2023-12-16T20:11:24.780 INFO:tasks.workunit.client.0.smithi038.stdout:5/107: dwrite d2/f11 [0,4194304] 0 2023-12-16T20:11:24.780 INFO:tasks.workunit.client.0.smithi038.stdout:5/108: write d2/f7 [973650,121600] 0 2023-12-16T20:11:24.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/117: dread da/dc/f17 [0,4194304] 0 2023-12-16T20:11:24.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/118: stat c3 0 2023-12-16T20:11:24.788 INFO:tasks.workunit.client.0.smithi038.stdout:4/104: symlink d13/l1d 0 2023-12-16T20:11:24.788 INFO:tasks.workunit.client.0.smithi038.stdout:4/105: fdatasync d13/f18 0 2023-12-16T20:11:24.790 INFO:tasks.workunit.client.0.smithi038.stdout:5/109: mkdir d2/df/d1a 0 2023-12-16T20:11:24.790 INFO:tasks.workunit.client.0.smithi038.stdout:4/106: mknod d13/d1c/c1e 0 2023-12-16T20:11:24.791 INFO:tasks.workunit.client.0.smithi038.stdout:4/107: readlink lf 0 2023-12-16T20:11:24.795 INFO:tasks.workunit.client.0.smithi038.stdout:5/110: dread d2/f9 [0,4194304] 0 2023-12-16T20:11:24.795 INFO:tasks.workunit.client.0.smithi038.stdout:7/119: read da/db/f15 [3940442,16751] 0 2023-12-16T20:11:24.797 INFO:tasks.workunit.client.0.smithi038.stdout:6/114: dwrite d1/fc [0,4194304] 0 2023-12-16T20:11:24.797 INFO:tasks.workunit.client.0.smithi038.stdout:6/115: dread - d1/fe zero size 2023-12-16T20:11:24.797 INFO:tasks.workunit.client.0.smithi038.stdout:1/187: dwrite f11 [0,4194304] 0 2023-12-16T20:11:24.797 INFO:tasks.workunit.client.0.smithi038.stdout:5/111: link d2/d4/l13 d2/d4/dc/l1b 0 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:2/213: dread d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:2/214: write d1/d5/d2a/f35 [191572,38892] 0 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:2/215: readlink d1/l11 0 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:2/216: fsync d1/d5/d2a/d31/f36 0 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:2/217: chown d1/c6 1581 1 2023-12-16T20:11:24.798 INFO:tasks.workunit.client.0.smithi038.stdout:7/120: truncate da/db/f15 2683603 0 2023-12-16T20:11:24.800 INFO:tasks.workunit.client.0.smithi038.stdout:6/116: rename d1/d4/fd to d1/d4/f20 0 2023-12-16T20:11:24.800 INFO:tasks.workunit.client.0.smithi038.stdout:6/117: write d1/fc [5024007,33360] 0 2023-12-16T20:11:24.800 INFO:tasks.workunit.client.0.smithi038.stdout:6/118: readlink d1/d4/l13 0 2023-12-16T20:11:24.802 INFO:tasks.workunit.client.0.smithi038.stdout:1/188: rename d15/d1e/d25/c2f to d15/d1e/d25/d37/c3f 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/112: creat d2/d4/f1c x:0 0 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/113: creat d2/df/f1d x:0 0 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/114: creat d2/d14/f1e x:0 0 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/115: readlink d2/l8 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/116: write d2/df/f18 [124690,53062] 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:5/117: readlink d2/d4/l13 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:7/121: mkdir da/d24 0 2023-12-16T20:11:24.805 INFO:tasks.workunit.client.0.smithi038.stdout:7/122: dread - da/f1b zero size 2023-12-16T20:11:24.806 INFO:tasks.workunit.client.0.smithi038.stdout:7/123: read f5 [1088404,44390] 0 2023-12-16T20:11:24.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/218: rename d1/d1a to d1/df/d10/d23/d3a 0 2023-12-16T20:11:24.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/219: write d1/d5/d16/f2e [2546468,55849] 0 2023-12-16T20:11:24.810 INFO:tasks.workunit.client.0.smithi038.stdout:5/118: mkdir d2/df/d1a/d1f 0 2023-12-16T20:11:24.811 INFO:tasks.workunit.client.0.smithi038.stdout:7/124: getdents da/dc 0 2023-12-16T20:11:24.813 INFO:tasks.workunit.client.0.smithi038.stdout:7/125: creat da/d21/f25 x:0 0 0 2023-12-16T20:11:24.813 INFO:tasks.workunit.client.0.smithi038.stdout:7/126: fdatasync da/db/ff 0 2023-12-16T20:11:24.814 INFO:tasks.workunit.client.0.smithi038.stdout:7/127: mknod da/dc/c26 0 2023-12-16T20:11:24.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/128: creat da/db/f27 x:0 0 0 2023-12-16T20:11:24.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/129: chown c3 1957889 1 2023-12-16T20:11:24.816 INFO:tasks.workunit.client.0.smithi038.stdout:7/130: creat da/d21/f28 x:0 0 0 2023-12-16T20:11:24.819 INFO:tasks.workunit.client.0.smithi038.stdout:7/131: unlink da/dc/c22 0 2023-12-16T20:11:24.819 INFO:tasks.workunit.client.0.smithi038.stdout:7/132: fdatasync da/dc/f10 0 2023-12-16T20:11:24.819 INFO:tasks.workunit.client.0.smithi038.stdout:2/220: dread d1/d5/f7 [4194304,4194304] 0 2023-12-16T20:11:24.819 INFO:tasks.workunit.client.0.smithi038.stdout:2/221: creat d1/d5/d16/f3b x:0 0 0 2023-12-16T20:11:24.819 INFO:tasks.workunit.client.0.smithi038.stdout:7/133: creat da/d21/f29 x:0 0 0 2023-12-16T20:11:24.822 INFO:tasks.workunit.client.0.smithi038.stdout:2/222: write d1/d5/f7 [7800801,56071] 0 2023-12-16T20:11:24.824 INFO:tasks.workunit.client.0.smithi038.stdout:6/119: link d1/d4/f20 d1/d16/f21 0 2023-12-16T20:11:24.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/128: sync 2023-12-16T20:11:24.826 INFO:tasks.workunit.client.0.smithi038.stdout:3/182: sync 2023-12-16T20:11:24.826 INFO:tasks.workunit.client.0.smithi038.stdout:8/103: sync 2023-12-16T20:11:24.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/129: creat db/d16/d19/f2b x:0 0 0 2023-12-16T20:11:24.826 INFO:tasks.workunit.client.0.smithi038.stdout:2/223: creat d1/df/d21/f3c x:0 0 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:4/108: dwrite fa [0,4194304] 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:4/109: write d13/f19 [7028241,77686] 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:1/189: dwrite d15/d1e/d30/f32 [0,4194304] 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:1/190: creat d15/d1e/d25/d37/f40 x:0 0 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:1/191: creat d15/d1e/d25/d37/f41 x:0 0 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:5/119: dwrite d2/df/f1d [0,4194304] 0 2023-12-16T20:11:24.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/104: symlink d17/d1b/l1f 0 2023-12-16T20:11:24.833 INFO:tasks.workunit.client.0.smithi038.stdout:0/130: getdents db/d16 0 2023-12-16T20:11:24.835 INFO:tasks.workunit.client.0.smithi038.stdout:2/224: dread d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.835 INFO:tasks.workunit.client.0.smithi038.stdout:4/110: truncate fb 2174571 0 2023-12-16T20:11:24.835 INFO:tasks.workunit.client.0.smithi038.stdout:4/111: fsync fa 0 2023-12-16T20:11:24.839 INFO:tasks.workunit.client.0.smithi038.stdout:1/192: mkdir d15/d1e/d23/d42 0 2023-12-16T20:11:24.842 INFO:tasks.workunit.client.0.smithi038.stdout:7/134: rmdir da/dc 39 2023-12-16T20:11:24.843 INFO:tasks.workunit.client.0.smithi038.stdout:6/120: dwrite d1/d4/f8 [4194304,4194304] 0 2023-12-16T20:11:24.844 INFO:tasks.workunit.client.0.smithi038.stdout:6/121: write d1/d16/f21 [2482264,4979] 0 2023-12-16T20:11:24.844 INFO:tasks.workunit.client.0.smithi038.stdout:6/122: write d1/f1b [690600,68328] 0 2023-12-16T20:11:24.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/120: mknod d2/d14/c20 0 2023-12-16T20:11:24.848 INFO:tasks.workunit.client.0.smithi038.stdout:8/105: link f13 d17/f20 0 2023-12-16T20:11:24.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/131: rmdir db/d16 39 2023-12-16T20:11:24.852 INFO:tasks.workunit.client.0.smithi038.stdout:4/112: mkdir d13/d1f 0 2023-12-16T20:11:24.853 INFO:tasks.workunit.client.0.smithi038.stdout:7/135: getdents da/dc 0 2023-12-16T20:11:24.857 INFO:tasks.workunit.client.0.smithi038.stdout:3/183: write d4/f17 [3010031,81513] 0 2023-12-16T20:11:24.857 INFO:tasks.workunit.client.0.smithi038.stdout:3/184: fsync d4/d27/d23/f2e 0 2023-12-16T20:11:24.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/123: creat d1/f22 x:0 0 0 2023-12-16T20:11:24.862 INFO:tasks.workunit.client.0.smithi038.stdout:6/124: chown d1/fe 0 1 2023-12-16T20:11:24.871 INFO:tasks.workunit.client.0.smithi038.stdout:4/113: mkdir d13/d1f/d20 0 2023-12-16T20:11:24.872 INFO:tasks.workunit.client.0.smithi038.stdout:7/136: link da/db/f27 da/dc/f2a 0 2023-12-16T20:11:24.872 INFO:tasks.workunit.client.0.smithi038.stdout:6/125: mkdir d1/d16/d23 0 2023-12-16T20:11:24.872 INFO:tasks.workunit.client.0.smithi038.stdout:0/132: getdents db/d16/d19 0 2023-12-16T20:11:24.873 INFO:tasks.workunit.client.0.smithi038.stdout:4/114: symlink d13/d17/l21 0 2023-12-16T20:11:24.883 INFO:tasks.workunit.client.0.smithi038.stdout:5/121: dwrite d2/f11 [0,4194304] 0 2023-12-16T20:11:24.884 INFO:tasks.workunit.client.0.smithi038.stdout:8/106: dwrite f10 [0,4194304] 0 2023-12-16T20:11:24.884 INFO:tasks.workunit.client.0.smithi038.stdout:8/107: write d17/d18/f1a [336487,31235] 0 2023-12-16T20:11:24.884 INFO:tasks.workunit.client.0.smithi038.stdout:8/108: chown d17/d1d 18598156 1 2023-12-16T20:11:24.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/185: dwrite d4/d18/f33 [0,4194304] 0 2023-12-16T20:11:24.885 INFO:tasks.workunit.client.0.smithi038.stdout:2/225: truncate d1/d5/d2a/f35 1236299 0 2023-12-16T20:11:24.885 INFO:tasks.workunit.client.0.smithi038.stdout:5/122: truncate d2/df/f1d 2849021 0 2023-12-16T20:11:24.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/137: write da/dc/f17 [1093687,127944] 0 2023-12-16T20:11:24.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/138: creat da/db/f2b x:0 0 0 2023-12-16T20:11:24.895 INFO:tasks.workunit.client.0.smithi038.stdout:3/186: rmdir d4/d27/d2b/d46 0 2023-12-16T20:11:24.896 INFO:tasks.workunit.client.0.smithi038.stdout:5/123: symlink d2/d4/l21 0 2023-12-16T20:11:24.897 INFO:tasks.workunit.client.0.smithi038.stdout:5/124: fsync d2/df/f18 0 2023-12-16T20:11:24.900 INFO:tasks.workunit.client.0.smithi038.stdout:8/109: write d17/f20 [3266847,108124] 0 2023-12-16T20:11:24.900 INFO:tasks.workunit.client.0.smithi038.stdout:8/110: write f13 [1011290,89438] 0 2023-12-16T20:11:24.909 INFO:tasks.workunit.client.0.smithi038.stdout:3/187: dread d4/d8/f16 [0,4194304] 0 2023-12-16T20:11:24.909 INFO:tasks.workunit.client.0.smithi038.stdout:3/188: creat d4/d27/d23/f47 x:0 0 0 2023-12-16T20:11:24.910 INFO:tasks.workunit.client.0.smithi038.stdout:3/189: chown d4/d27/d23/f2e 184 1 2023-12-16T20:11:24.910 INFO:tasks.workunit.client.0.smithi038.stdout:3/190: symlink d4/d8/d15/d1e/l48 0 2023-12-16T20:11:24.910 INFO:tasks.workunit.client.0.smithi038.stdout:3/191: chown d4/f6 8697432 1 2023-12-16T20:11:24.911 INFO:tasks.workunit.client.0.smithi038.stdout:9/97: sync 2023-12-16T20:11:24.912 INFO:tasks.workunit.client.0.smithi038.stdout:9/98: creat d9/f1a x:0 0 0 2023-12-16T20:11:24.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/192: dread d4/d8/d15/d1e/f1f [0,4194304] 0 2023-12-16T20:11:24.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/193: read - d4/d27/d2b/f32 zero size 2023-12-16T20:11:24.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/194: chown d4/d8/d15/d2c 436415 1 2023-12-16T20:11:24.920 INFO:tasks.workunit.client.0.smithi038.stdout:3/195: rename d4/d27/d23/d26/c3c to d4/d27/d40/c49 0 2023-12-16T20:11:24.921 INFO:tasks.workunit.client.0.smithi038.stdout:3/196: rename d4/f10 to d4/f4a 0 2023-12-16T20:11:24.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/197: write d4/f17 [4313190,129588] 0 2023-12-16T20:11:24.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/198: creat d4/d18/f4b x:0 0 0 2023-12-16T20:11:24.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/199: write d4/d27/d2b/f35 [441793,82797] 0 2023-12-16T20:11:24.924 INFO:tasks.workunit.client.0.smithi038.stdout:3/200: mkdir d4/d8/d15/d2c/d4c 0 2023-12-16T20:11:24.924 INFO:tasks.workunit.client.0.smithi038.stdout:9/99: write d9/fe [1594186,38211] 0 2023-12-16T20:11:24.927 INFO:tasks.workunit.client.0.smithi038.stdout:9/100: unlink d9/f19 0 2023-12-16T20:11:24.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/201: dread d4/f4a [0,4194304] 0 2023-12-16T20:11:24.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/202: fdatasync d4/d8/d15/d1e/f3d 0 2023-12-16T20:11:24.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/203: write d4/f6 [4879371,19821] 0 2023-12-16T20:11:24.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/204: creat d4/d27/d2b/f4d x:0 0 0 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/126: dwrite d1/d4/f20 [0,4194304] 0 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/127: chown d1/d4/f20 102222268 1 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/128: rename d1/d4 to d1/d4/d24 22 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/129: creat d1/f25 x:0 0 0 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/115: dwrite fb [0,4194304] 0 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/226: dwrite d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/116: chown cd 108 1 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/117: chown d13/d1c 27058427 1 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/118: chown d13/d1f 39510 1 2023-12-16T20:11:24.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/227: stat d1/d5/c15 0 2023-12-16T20:11:24.929 INFO:tasks.workunit.client.0.smithi038.stdout:7/139: dwrite da/d21/f28 [0,4194304] 0 2023-12-16T20:11:24.929 INFO:tasks.workunit.client.0.smithi038.stdout:5/125: dwrite d2/d14/f1e [0,4194304] 0 2023-12-16T20:11:24.929 INFO:tasks.workunit.client.0.smithi038.stdout:5/126: creat d2/d14/f22 x:0 0 0 2023-12-16T20:11:24.929 INFO:tasks.workunit.client.0.smithi038.stdout:9/101: symlink d9/l1b 0 2023-12-16T20:11:24.929 INFO:tasks.workunit.client.0.smithi038.stdout:9/102: creat d9/f1c x:0 0 0 2023-12-16T20:11:24.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/103: write d9/f1a [236185,27762] 0 2023-12-16T20:11:24.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/104: readlink d9/l12 0 2023-12-16T20:11:24.931 INFO:tasks.workunit.client.0.smithi038.stdout:3/205: creat d4/d8/d15/f4e x:0 0 0 2023-12-16T20:11:24.931 INFO:tasks.workunit.client.0.smithi038.stdout:3/206: dread - d4/d27/d2b/f32 zero size 2023-12-16T20:11:24.933 INFO:tasks.workunit.client.0.smithi038.stdout:6/130: creat d1/d16/d23/f26 x:0 0 0 2023-12-16T20:11:24.936 INFO:tasks.workunit.client.0.smithi038.stdout:4/119: mkdir d13/d1f/d22 0 2023-12-16T20:11:24.936 INFO:tasks.workunit.client.0.smithi038.stdout:4/120: fsync f9 0 2023-12-16T20:11:24.936 INFO:tasks.workunit.client.0.smithi038.stdout:2/228: mkdir d1/d5/d3d 0 2023-12-16T20:11:24.939 INFO:tasks.workunit.client.0.smithi038.stdout:2/229: dread d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:24.944 INFO:tasks.workunit.client.0.smithi038.stdout:7/140: unlink da/dc/f17 0 2023-12-16T20:11:24.950 INFO:tasks.workunit.client.0.smithi038.stdout:8/111: dwrite f10 [4194304,4194304] 0 2023-12-16T20:11:24.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/127: link d2/l15 d2/d4/dc/d17/l23 0 2023-12-16T20:11:24.954 INFO:tasks.workunit.client.0.smithi038.stdout:9/105: link d9/l11 d9/l1d 0 2023-12-16T20:11:24.954 INFO:tasks.workunit.client.0.smithi038.stdout:9/106: chown l5 738 1 2023-12-16T20:11:24.957 INFO:tasks.workunit.client.0.smithi038.stdout:6/131: symlink d1/d4/d1d/l27 0 2023-12-16T20:11:24.957 INFO:tasks.workunit.client.0.smithi038.stdout:8/112: dread f1 [0,4194304] 0 2023-12-16T20:11:24.958 INFO:tasks.workunit.client.0.smithi038.stdout:4/121: link d13/d1c/c1e d13/d1f/d22/c23 0 2023-12-16T20:11:24.958 INFO:tasks.workunit.client.0.smithi038.stdout:4/122: write d13/f18 [203342,90559] 0 2023-12-16T20:11:24.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/230: mknod d1/df/d10/d23/c3e 0 2023-12-16T20:11:24.960 INFO:tasks.workunit.client.0.smithi038.stdout:7/141: mkdir da/d21/d2c 0 2023-12-16T20:11:24.960 INFO:tasks.workunit.client.0.smithi038.stdout:7/142: write da/f19 [358382,125432] 0 2023-12-16T20:11:24.960 INFO:tasks.workunit.client.0.smithi038.stdout:7/143: creat da/db/f2d x:0 0 0 2023-12-16T20:11:24.960 INFO:tasks.workunit.client.0.smithi038.stdout:7/144: fdatasync f5 0 2023-12-16T20:11:24.962 INFO:tasks.workunit.client.0.smithi038.stdout:3/207: unlink d4/d8/d15/f4e 0 2023-12-16T20:11:24.963 INFO:tasks.workunit.client.0.smithi038.stdout:3/208: creat d4/d27/d23/f4f x:0 0 0 2023-12-16T20:11:24.963 INFO:tasks.workunit.client.0.smithi038.stdout:3/209: chown d4/d8/d15/d2c 887603 1 2023-12-16T20:11:24.964 INFO:tasks.workunit.client.0.smithi038.stdout:6/132: truncate d1/f19 990948 0 2023-12-16T20:11:24.964 INFO:tasks.workunit.client.0.smithi038.stdout:6/133: truncate d1/d4/f1c 203482 0 2023-12-16T20:11:24.965 INFO:tasks.workunit.client.0.smithi038.stdout:1/193: sync 2023-12-16T20:11:24.965 INFO:tasks.workunit.client.0.smithi038.stdout:8/113: creat d17/d1d/f21 x:0 0 0 2023-12-16T20:11:24.966 INFO:tasks.workunit.client.0.smithi038.stdout:4/123: truncate f6 5828605 0 2023-12-16T20:11:24.968 INFO:tasks.workunit.client.0.smithi038.stdout:2/231: mknod d1/df/d10/d23/d29/c3f 0 2023-12-16T20:11:24.972 INFO:tasks.workunit.client.0.smithi038.stdout:9/107: fsync d9/f1c 0 2023-12-16T20:11:24.972 INFO:tasks.workunit.client.0.smithi038.stdout:9/108: dread - d9/f1c zero size 2023-12-16T20:11:24.977 INFO:tasks.workunit.client.0.smithi038.stdout:5/128: mknod d2/c24 0 2023-12-16T20:11:24.977 INFO:tasks.workunit.client.0.smithi038.stdout:5/129: write d2/f10 [546919,72823] 0 2023-12-16T20:11:24.977 INFO:tasks.workunit.client.0.smithi038.stdout:7/145: dwrite da/d21/f28 [0,4194304] 0 2023-12-16T20:11:24.977 INFO:tasks.workunit.client.0.smithi038.stdout:7/146: write da/f1d [283464,126280] 0 2023-12-16T20:11:24.978 INFO:tasks.workunit.client.0.smithi038.stdout:3/210: link d4/d18/l36 d4/d8/d15/d1e/l50 0 2023-12-16T20:11:24.980 INFO:tasks.workunit.client.0.smithi038.stdout:6/134: mkdir d1/d4/d1d/d28 0 2023-12-16T20:11:24.980 INFO:tasks.workunit.client.0.smithi038.stdout:6/135: creat d1/d16/d23/f29 x:0 0 0 2023-12-16T20:11:24.980 INFO:tasks.workunit.client.0.smithi038.stdout:5/130: dread d2/d4/fb [8388608,4194304] 0 2023-12-16T20:11:24.981 INFO:tasks.workunit.client.0.smithi038.stdout:5/131: write d2/d4/f1c [364087,56424] 0 2023-12-16T20:11:24.982 INFO:tasks.workunit.client.0.smithi038.stdout:1/194: symlink d15/d1e/d25/d37/l43 0 2023-12-16T20:11:24.986 INFO:tasks.workunit.client.0.smithi038.stdout:8/114: unlink d17/d18/l1e 0 2023-12-16T20:11:24.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/232: link d1/d5/d2a/c33 d1/d5/d2a/d31/c40 0 2023-12-16T20:11:24.989 INFO:tasks.workunit.client.0.smithi038.stdout:2/233: fdatasync d1/d5/d2a/f30 0 2023-12-16T20:11:24.990 INFO:tasks.workunit.client.0.smithi038.stdout:9/109: unlink c4 0 2023-12-16T20:11:24.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/133: sync 2023-12-16T20:11:24.995 INFO:tasks.workunit.client.0.smithi038.stdout:3/211: rename d4/d8/lb to d4/d27/d23/l51 0 2023-12-16T20:11:24.995 INFO:tasks.workunit.client.0.smithi038.stdout:3/212: chown d4/d8/d15 709 1 2023-12-16T20:11:24.998 INFO:tasks.workunit.client.0.smithi038.stdout:6/136: creat d1/d4/d1d/f2a x:0 0 0 2023-12-16T20:11:24.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/147: dwrite da/f1b [0,4194304] 0 2023-12-16T20:11:24.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/148: truncate da/db/ff 1027724 0 2023-12-16T20:11:25.002 INFO:tasks.workunit.client.0.smithi038.stdout:5/132: mkdir d2/d14/d25 0 2023-12-16T20:11:25.002 INFO:tasks.workunit.client.0.smithi038.stdout:5/133: write d2/d14/f1e [5192266,77980] 0 2023-12-16T20:11:25.003 INFO:tasks.workunit.client.0.smithi038.stdout:1/195: rmdir d15/d22 39 2023-12-16T20:11:25.004 INFO:tasks.workunit.client.0.smithi038.stdout:2/234: mknod d1/df/d12/c41 0 2023-12-16T20:11:25.006 INFO:tasks.workunit.client.0.smithi038.stdout:3/213: mkdir d4/d27/d52 0 2023-12-16T20:11:25.006 INFO:tasks.workunit.client.0.smithi038.stdout:3/214: write d4/f6 [1162332,3601] 0 2023-12-16T20:11:25.007 INFO:tasks.workunit.client.0.smithi038.stdout:6/137: rmdir d1/d4 39 2023-12-16T20:11:25.011 INFO:tasks.workunit.client.0.smithi038.stdout:0/134: rmdir db 39 2023-12-16T20:11:25.012 INFO:tasks.workunit.client.0.smithi038.stdout:0/135: truncate db/d16/d1c/f20 459074 0 2023-12-16T20:11:25.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/136: rename db/d16/d1c/f20 to db/d16/d1c/f2c 0 2023-12-16T20:11:25.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/137: rmdir db/d16 39 2023-12-16T20:11:25.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/138: chown db/lc 150985136 1 2023-12-16T20:11:25.026 INFO:tasks.workunit.client.0.smithi038.stdout:8/115: dwrite d17/f20 [0,4194304] 0 2023-12-16T20:11:25.026 INFO:tasks.workunit.client.0.smithi038.stdout:9/110: dwrite f2 [0,4194304] 0 2023-12-16T20:11:25.026 INFO:tasks.workunit.client.0.smithi038.stdout:9/111: chown d9/l1d 1 1 2023-12-16T20:11:25.029 INFO:tasks.workunit.client.0.smithi038.stdout:7/149: rename da/db to da/d21/d2c/d2e 0 2023-12-16T20:11:25.030 INFO:tasks.workunit.client.0.smithi038.stdout:1/196: dwrite d15/d1e/d23/f39 [0,4194304] 0 2023-12-16T20:11:25.030 INFO:tasks.workunit.client.0.smithi038.stdout:1/197: chown d15/d1e/d23/d34/f38 171386 1 2023-12-16T20:11:25.031 INFO:tasks.workunit.client.0.smithi038.stdout:5/134: rename d2/d4/dc/l1b to d2/df/l26 0 2023-12-16T20:11:25.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/116: write fc [594903,5072] 0 2023-12-16T20:11:25.032 INFO:tasks.workunit.client.0.smithi038.stdout:5/135: write d2/d4/f1c [92276,92118] 0 2023-12-16T20:11:25.032 INFO:tasks.workunit.client.0.smithi038.stdout:5/136: write d2/f12 [1189785,115925] 0 2023-12-16T20:11:25.032 INFO:tasks.workunit.client.0.smithi038.stdout:7/150: dread f5 [0,4194304] 0 2023-12-16T20:11:25.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/215: dwrite d4/f28 [0,4194304] 0 2023-12-16T20:11:25.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/216: fsync d4/d27/d2b/f32 0 2023-12-16T20:11:25.035 INFO:tasks.workunit.client.0.smithi038.stdout:1/198: symlink d15/d1e/d25/d3d/l44 0 2023-12-16T20:11:25.035 INFO:tasks.workunit.client.0.smithi038.stdout:1/199: write d15/d1e/d23/f35 [685644,130998] 0 2023-12-16T20:11:25.038 INFO:tasks.workunit.client.0.smithi038.stdout:2/235: rename d1/df/d10/d23/d29 to d1/df/d42 0 2023-12-16T20:11:25.038 INFO:tasks.workunit.client.0.smithi038.stdout:6/138: rename d1/d4 to d1/d4/d1d/d2b 22 2023-12-16T20:11:25.038 INFO:tasks.workunit.client.0.smithi038.stdout:0/139: rename db/d16/d19 to db/d16/d19/d2d 22 2023-12-16T20:11:25.039 INFO:tasks.workunit.client.0.smithi038.stdout:5/137: creat d2/df/d1a/f27 x:0 0 0 2023-12-16T20:11:25.043 INFO:tasks.workunit.client.0.smithi038.stdout:1/200: mknod d15/d1e/d25/d3d/c45 0 2023-12-16T20:11:25.043 INFO:tasks.workunit.client.0.smithi038.stdout:1/201: chown d15/d1e/d25/d3d/c45 4379 1 2023-12-16T20:11:25.044 INFO:tasks.workunit.client.0.smithi038.stdout:9/112: dwrite d9/f1c [0,4194304] 0 2023-12-16T20:11:25.044 INFO:tasks.workunit.client.0.smithi038.stdout:6/139: rename d1/fc to d1/f2c 0 2023-12-16T20:11:25.044 INFO:tasks.workunit.client.0.smithi038.stdout:8/117: dread d17/f20 [0,4194304] 0 2023-12-16T20:11:25.045 INFO:tasks.workunit.client.0.smithi038.stdout:7/151: rename da/c1c to da/d21/d2c/d2e/c2f 0 2023-12-16T20:11:25.047 INFO:tasks.workunit.client.0.smithi038.stdout:0/140: creat db/d16/d19/f2e x:0 0 0 2023-12-16T20:11:25.047 INFO:tasks.workunit.client.0.smithi038.stdout:3/217: dread d4/f5 [0,4194304] 0 2023-12-16T20:11:25.047 INFO:tasks.workunit.client.0.smithi038.stdout:3/218: dread - d4/d27/d2b/f4d zero size 2023-12-16T20:11:25.048 INFO:tasks.workunit.client.0.smithi038.stdout:5/138: symlink d2/d4/l28 0 2023-12-16T20:11:25.048 INFO:tasks.workunit.client.0.smithi038.stdout:1/202: mkdir d15/d1e/d23/d46 0 2023-12-16T20:11:25.053 INFO:tasks.workunit.client.0.smithi038.stdout:9/113: mkdir d9/d1e 0 2023-12-16T20:11:25.054 INFO:tasks.workunit.client.0.smithi038.stdout:6/140: getdents d1/d4 0 2023-12-16T20:11:25.055 INFO:tasks.workunit.client.0.smithi038.stdout:8/118: dread d17/f20 [0,4194304] 0 2023-12-16T20:11:25.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/152: creat da/d21/d2c/f30 x:0 0 0 2023-12-16T20:11:25.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/153: fsync da/f1b 0 2023-12-16T20:11:25.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/154: chown da/d21/d2c/d2e/f15 3704251 1 2023-12-16T20:11:25.059 INFO:tasks.workunit.client.0.smithi038.stdout:3/219: rmdir d4/d27/d52 0 2023-12-16T20:11:25.061 INFO:tasks.workunit.client.0.smithi038.stdout:2/236: dwrite d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:25.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/203: link f7 d15/d1e/d25/d37/f47 0 2023-12-16T20:11:25.063 INFO:tasks.workunit.client.0.smithi038.stdout:9/114: mkdir d9/d1f 0 2023-12-16T20:11:25.063 INFO:tasks.workunit.client.0.smithi038.stdout:9/115: creat d9/f20 x:0 0 0 2023-12-16T20:11:25.064 INFO:tasks.workunit.client.0.smithi038.stdout:6/141: rename d1/c14 to d1/d4/d1d/d28/c2d 0 2023-12-16T20:11:25.064 INFO:tasks.workunit.client.0.smithi038.stdout:6/142: dread - d1/fe zero size 2023-12-16T20:11:25.065 INFO:tasks.workunit.client.0.smithi038.stdout:3/220: write d4/f28 [580873,50400] 0 2023-12-16T20:11:25.066 INFO:tasks.workunit.client.0.smithi038.stdout:8/119: creat d17/d1b/f22 x:0 0 0 2023-12-16T20:11:25.066 INFO:tasks.workunit.client.0.smithi038.stdout:8/120: fsync d17/f20 0 2023-12-16T20:11:25.068 INFO:tasks.workunit.client.0.smithi038.stdout:0/141: truncate f1 178160 0 2023-12-16T20:11:25.068 INFO:tasks.workunit.client.0.smithi038.stdout:0/142: fdatasync db/f14 0 2023-12-16T20:11:25.069 INFO:tasks.workunit.client.0.smithi038.stdout:5/139: mknod d2/c29 0 2023-12-16T20:11:25.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/237: mkdir d1/df/d42/d43 0 2023-12-16T20:11:25.080 INFO:tasks.workunit.client.0.smithi038.stdout:9/116: mkdir d9/d1f/d21 0 2023-12-16T20:11:25.082 INFO:tasks.workunit.client.0.smithi038.stdout:6/143: mkdir d1/d2e 0 2023-12-16T20:11:25.084 INFO:tasks.workunit.client.0.smithi038.stdout:7/155: rmdir da/d21/d2c 39 2023-12-16T20:11:25.084 INFO:tasks.workunit.client.0.smithi038.stdout:7/156: stat da/f23 0 2023-12-16T20:11:25.089 INFO:tasks.workunit.client.0.smithi038.stdout:5/140: unlink d2/d14/f16 0 2023-12-16T20:11:25.089 INFO:tasks.workunit.client.0.smithi038.stdout:2/238: creat d1/df/d10/f44 x:0 0 0 2023-12-16T20:11:25.089 INFO:tasks.workunit.client.0.smithi038.stdout:9/117: creat d9/d1f/f22 x:0 0 0 2023-12-16T20:11:25.090 INFO:tasks.workunit.client.0.smithi038.stdout:9/118: creat d9/d1f/f23 x:0 0 0 2023-12-16T20:11:25.090 INFO:tasks.workunit.client.0.smithi038.stdout:9/119: write d9/fe [4085302,117758] 0 2023-12-16T20:11:25.090 INFO:tasks.workunit.client.0.smithi038.stdout:9/120: truncate d9/d1f/f23 593679 0 2023-12-16T20:11:25.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/144: mkdir d1/d4/d1d/d28/d2f 0 2023-12-16T20:11:25.092 INFO:tasks.workunit.client.0.smithi038.stdout:8/121: rmdir d17/d1d 39 2023-12-16T20:11:25.092 INFO:tasks.workunit.client.0.smithi038.stdout:8/122: fsync f16 0 2023-12-16T20:11:25.092 INFO:tasks.workunit.client.0.smithi038.stdout:8/123: stat fc 0 2023-12-16T20:11:25.094 INFO:tasks.workunit.client.0.smithi038.stdout:0/143: symlink db/l2f 0 2023-12-16T20:11:25.095 INFO:tasks.workunit.client.0.smithi038.stdout:4/124: sync 2023-12-16T20:11:25.096 INFO:tasks.workunit.client.0.smithi038.stdout:5/141: mkdir d2/df/d1a/d2a 0 2023-12-16T20:11:25.096 INFO:tasks.workunit.client.0.smithi038.stdout:5/142: write f0 [2264412,112791] 0 2023-12-16T20:11:25.096 INFO:tasks.workunit.client.0.smithi038.stdout:5/143: dread - d2/d14/f22 zero size 2023-12-16T20:11:25.098 INFO:tasks.workunit.client.0.smithi038.stdout:9/121: symlink d9/d1e/l24 0 2023-12-16T20:11:25.098 INFO:tasks.workunit.client.0.smithi038.stdout:9/122: chown d9/l12 9320318 1 2023-12-16T20:11:25.101 INFO:tasks.workunit.client.0.smithi038.stdout:1/204: rename d15/d1e/d25 to d15/d1e/d3b/d48 0 2023-12-16T20:11:25.103 INFO:tasks.workunit.client.0.smithi038.stdout:6/145: symlink d1/d2e/l30 0 2023-12-16T20:11:25.105 INFO:tasks.workunit.client.0.smithi038.stdout:8/124: mknod d17/c23 0 2023-12-16T20:11:25.108 INFO:tasks.workunit.client.0.smithi038.stdout:0/144: mknod db/d16/d19/d27/c30 0 2023-12-16T20:11:25.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/239: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:25.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/144: symlink d2/d14/l2b 0 2023-12-16T20:11:25.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/145: stat d2/f12 0 2023-12-16T20:11:25.111 INFO:tasks.workunit.client.0.smithi038.stdout:4/125: truncate f9 508113 0 2023-12-16T20:11:25.115 INFO:tasks.workunit.client.0.smithi038.stdout:3/221: rename d4/d27/d23/f47 to d4/d8/d15/d2c/f53 0 2023-12-16T20:11:25.115 INFO:tasks.workunit.client.0.smithi038.stdout:1/205: symlink d15/d1e/l49 0 2023-12-16T20:11:25.115 INFO:tasks.workunit.client.0.smithi038.stdout:7/157: rmdir da/d21/d2c/d2e/d1e 0 2023-12-16T20:11:25.117 INFO:tasks.workunit.client.0.smithi038.stdout:8/125: creat d17/f24 x:0 0 0 2023-12-16T20:11:25.117 INFO:tasks.workunit.client.0.smithi038.stdout:8/126: chown ce 27 1 2023-12-16T20:11:25.117 INFO:tasks.workunit.client.0.smithi038.stdout:8/127: truncate d17/d1b/f22 365145 0 2023-12-16T20:11:25.120 INFO:tasks.workunit.client.0.smithi038.stdout:3/222: unlink d4/d18/f25 0 2023-12-16T20:11:25.120 INFO:tasks.workunit.client.0.smithi038.stdout:3/223: creat d4/d8/d15/f54 x:0 0 0 2023-12-16T20:11:25.122 INFO:tasks.workunit.client.0.smithi038.stdout:8/128: mkdir d17/d1b/d25 0 2023-12-16T20:11:25.123 INFO:tasks.workunit.client.0.smithi038.stdout:8/129: creat d17/d18/f26 x:0 0 0 2023-12-16T20:11:25.124 INFO:tasks.workunit.client.0.smithi038.stdout:3/224: mknod d4/d8/d15/c55 0 2023-12-16T20:11:25.124 INFO:tasks.workunit.client.0.smithi038.stdout:3/225: stat d4/d8/d15/c55 0 2023-12-16T20:11:25.125 INFO:tasks.workunit.client.0.smithi038.stdout:1/206: mkdir d15/d4a 0 2023-12-16T20:11:25.128 INFO:tasks.workunit.client.0.smithi038.stdout:3/226: getdents d4/d27 0 2023-12-16T20:11:25.130 INFO:tasks.workunit.client.0.smithi038.stdout:4/126: write fa [321303,56722] 0 2023-12-16T20:11:25.130 INFO:tasks.workunit.client.0.smithi038.stdout:9/123: dwrite f2 [4194304,4194304] 0 2023-12-16T20:11:25.130 INFO:tasks.workunit.client.0.smithi038.stdout:4/127: fdatasync f6 0 2023-12-16T20:11:25.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/207: rmdir d15/d1e/d23/d34 39 2023-12-16T20:11:25.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/208: readlink l5 0 2023-12-16T20:11:25.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/130: dread f10 [4194304,4194304] 0 2023-12-16T20:11:25.138 INFO:tasks.workunit.client.0.smithi038.stdout:4/128: mknod d13/d17/c24 0 2023-12-16T20:11:25.139 INFO:tasks.workunit.client.0.smithi038.stdout:4/129: chown d13/d1c/c1e 87 1 2023-12-16T20:11:25.139 INFO:tasks.workunit.client.0.smithi038.stdout:9/124: symlink d9/l25 0 2023-12-16T20:11:25.139 INFO:tasks.workunit.client.0.smithi038.stdout:9/125: chown d9/d1f/f23 202437 1 2023-12-16T20:11:25.140 INFO:tasks.workunit.client.0.smithi038.stdout:8/131: truncate fc 1283242 0 2023-12-16T20:11:25.140 INFO:tasks.workunit.client.0.smithi038.stdout:8/132: truncate d17/d1b/f22 1187886 0 2023-12-16T20:11:25.141 INFO:tasks.workunit.client.0.smithi038.stdout:4/130: symlink d13/d1c/l25 0 2023-12-16T20:11:25.142 INFO:tasks.workunit.client.0.smithi038.stdout:9/126: symlink d9/d1e/l26 0 2023-12-16T20:11:25.142 INFO:tasks.workunit.client.0.smithi038.stdout:9/127: stat d9/f1c 0 2023-12-16T20:11:25.142 INFO:tasks.workunit.client.0.smithi038.stdout:9/128: write d9/f1a [693699,129483] 0 2023-12-16T20:11:25.143 INFO:tasks.workunit.client.0.smithi038.stdout:8/133: rename d17/l19 to d17/d1b/l27 0 2023-12-16T20:11:25.143 INFO:tasks.workunit.client.0.smithi038.stdout:8/134: fsync d17/f20 0 2023-12-16T20:11:25.146 INFO:tasks.workunit.client.0.smithi038.stdout:9/129: creat d9/d1e/f27 x:0 0 0 2023-12-16T20:11:25.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/135: dread f13 [0,4194304] 0 2023-12-16T20:11:25.148 INFO:tasks.workunit.client.0.smithi038.stdout:9/130: write d9/d1f/f23 [231412,96691] 0 2023-12-16T20:11:25.149 INFO:tasks.workunit.client.0.smithi038.stdout:8/136: getdents d17/d1d 0 2023-12-16T20:11:25.149 INFO:tasks.workunit.client.0.smithi038.stdout:8/137: fdatasync d17/d18/f1a 0 2023-12-16T20:11:25.154 INFO:tasks.workunit.client.0.smithi038.stdout:9/131: creat d9/d1f/d21/f28 x:0 0 0 2023-12-16T20:11:25.154 INFO:tasks.workunit.client.0.smithi038.stdout:9/132: creat d9/d1f/f29 x:0 0 0 2023-12-16T20:11:25.155 INFO:tasks.workunit.client.0.smithi038.stdout:9/133: readlink d9/l11 0 2023-12-16T20:11:25.155 INFO:tasks.workunit.client.0.smithi038.stdout:9/134: chown d9/d1f/f23 4 1 2023-12-16T20:11:25.155 INFO:tasks.workunit.client.0.smithi038.stdout:8/138: mknod d17/d1b/d25/c28 0 2023-12-16T20:11:25.155 INFO:tasks.workunit.client.0.smithi038.stdout:8/139: chown d17/d1b/d25 11851 1 2023-12-16T20:11:25.155 INFO:tasks.workunit.client.0.smithi038.stdout:8/140: dread f9 [0,4194304] 0 2023-12-16T20:11:25.156 INFO:tasks.workunit.client.0.smithi038.stdout:8/141: mknod d17/d1b/c29 0 2023-12-16T20:11:25.156 INFO:tasks.workunit.client.0.smithi038.stdout:8/142: creat d17/d18/f2a x:0 0 0 2023-12-16T20:11:25.158 INFO:tasks.workunit.client.0.smithi038.stdout:0/145: dwrite db/d16/d19/f2e [0,4194304] 0 2023-12-16T20:11:25.158 INFO:tasks.workunit.client.0.smithi038.stdout:8/143: read d17/d1b/f22 [1014855,75774] 0 2023-12-16T20:11:25.160 INFO:tasks.workunit.client.0.smithi038.stdout:0/146: mkdir db/d31 0 2023-12-16T20:11:25.160 INFO:tasks.workunit.client.0.smithi038.stdout:2/240: dwrite d1/df/d10/f44 [0,4194304] 0 2023-12-16T20:11:25.160 INFO:tasks.workunit.client.0.smithi038.stdout:2/241: creat d1/df/d21/f45 x:0 0 0 2023-12-16T20:11:25.161 INFO:tasks.workunit.client.0.smithi038.stdout:2/242: creat d1/df/d10/f46 x:0 0 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:7/158: dwrite f6 [0,4194304] 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/209: dwrite d15/f19 [0,4194304] 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/210: getdents d15/d4a 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/211: write f8 [4147515,56906] 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/212: readlink d15/d1e/l49 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:0/147: creat db/d16/d1c/f32 x:0 0 0 2023-12-16T20:11:25.162 INFO:tasks.workunit.client.0.smithi038.stdout:5/146: dwrite d2/df/d1a/f27 [0,4194304] 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:5/147: chown d2/f11 73639 1 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:3/227: dwrite d4/d8/f42 [0,4194304] 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:3/228: creat d4/d8/d15/f56 x:0 0 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:3/229: chown d4/d8/d15/d1e/l39 55068 1 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:9/135: fsync d9/d1f/f23 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:3/230: creat d4/d27/d23/f57 x:0 0 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:3/231: readlink d4/d27/d23/l51 0 2023-12-16T20:11:25.163 INFO:tasks.workunit.client.0.smithi038.stdout:9/136: creat d9/f2a x:0 0 0 2023-12-16T20:11:25.171 INFO:tasks.workunit.client.0.smithi038.stdout:2/243: creat d1/d5/d3d/f47 x:0 0 0 2023-12-16T20:11:25.171 INFO:tasks.workunit.client.0.smithi038.stdout:2/244: chown d1/df/d42 28658447 1 2023-12-16T20:11:25.171 INFO:tasks.workunit.client.0.smithi038.stdout:2/245: truncate d1/d5/d16/f2e 2851436 0 2023-12-16T20:11:25.172 INFO:tasks.workunit.client.0.smithi038.stdout:1/213: truncate d15/d1e/d23/f39 2042267 0 2023-12-16T20:11:25.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/148: creat db/d1a/f33 x:0 0 0 2023-12-16T20:11:25.177 INFO:tasks.workunit.client.0.smithi038.stdout:5/148: unlink d2/df/f18 0 2023-12-16T20:11:25.180 INFO:tasks.workunit.client.0.smithi038.stdout:8/144: dwrite d17/d18/f1a [0,4194304] 0 2023-12-16T20:11:25.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/246: dread d1/df/d10/f44 [0,4194304] 0 2023-12-16T20:11:25.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/247: write d1/d5/d2a/d31/f36 [1614660,111277] 0 2023-12-16T20:11:25.184 INFO:tasks.workunit.client.0.smithi038.stdout:9/137: rename d9/d1f/f23 to d9/d1e/f2b 0 2023-12-16T20:11:25.184 INFO:tasks.workunit.client.0.smithi038.stdout:9/138: creat d9/f2c x:0 0 0 2023-12-16T20:11:25.184 INFO:tasks.workunit.client.0.smithi038.stdout:3/232: dwrite f1 [4194304,4194304] 0 2023-12-16T20:11:25.186 INFO:tasks.workunit.client.0.smithi038.stdout:8/145: dread f1 [0,4194304] 0 2023-12-16T20:11:25.186 INFO:tasks.workunit.client.0.smithi038.stdout:7/159: mkdir da/dc/d31 0 2023-12-16T20:11:25.186 INFO:tasks.workunit.client.0.smithi038.stdout:1/214: creat d15/d22/f4b x:0 0 0 2023-12-16T20:11:25.187 INFO:tasks.workunit.client.0.smithi038.stdout:0/149: creat db/d16/d19/d27/f34 x:0 0 0 2023-12-16T20:11:25.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/149: creat d2/d4/dc/f2c x:0 0 0 2023-12-16T20:11:25.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/215: dread d15/d1e/f2d [0,4194304] 0 2023-12-16T20:11:25.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/216: chown f8 155034 1 2023-12-16T20:11:25.189 INFO:tasks.workunit.client.0.smithi038.stdout:0/150: dread f1 [0,4194304] 0 2023-12-16T20:11:25.191 INFO:tasks.workunit.client.0.smithi038.stdout:4/131: getdents d13/d1c 0 2023-12-16T20:11:25.192 INFO:tasks.workunit.client.0.smithi038.stdout:4/132: creat d13/f26 x:0 0 0 2023-12-16T20:11:25.192 INFO:tasks.workunit.client.0.smithi038.stdout:0/151: write db/d16/d1c/f1d [189983,124902] 0 2023-12-16T20:11:25.194 INFO:tasks.workunit.client.0.smithi038.stdout:2/248: symlink d1/d5/d3d/l48 0 2023-12-16T20:11:25.202 INFO:tasks.workunit.client.0.smithi038.stdout:1/217: write d15/d22/f26 [983031,41158] 0 2023-12-16T20:11:25.202 INFO:tasks.workunit.client.0.smithi038.stdout:1/218: write d15/d1e/d3b/d48/d37/f3c [1047233,45015] 0 2023-12-16T20:11:25.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/219: creat d15/d1e/f4c x:0 0 0 2023-12-16T20:11:25.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/220: write d15/d1e/d23/f3a [257211,85543] 0 2023-12-16T20:11:25.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/221: chown d15/d1e/d3b/d48/d3d/c45 1377466305 1 2023-12-16T20:11:25.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/222: fdatasync fe 0 2023-12-16T20:11:25.206 INFO:tasks.workunit.client.0.smithi038.stdout:3/233: mkdir d4/d8/d15/d2c/d4c/d58 0 2023-12-16T20:11:25.206 INFO:tasks.workunit.client.0.smithi038.stdout:7/160: dwrite da/d21/f25 [0,4194304] 0 2023-12-16T20:11:25.207 INFO:tasks.workunit.client.0.smithi038.stdout:7/161: fsync da/d21/f29 0 2023-12-16T20:11:25.208 INFO:tasks.workunit.client.0.smithi038.stdout:4/133: mknod d13/d1f/d22/c27 0 2023-12-16T20:11:25.209 INFO:tasks.workunit.client.0.smithi038.stdout:8/146: dwrite f5 [0,4194304] 0 2023-12-16T20:11:25.211 INFO:tasks.workunit.client.0.smithi038.stdout:9/139: dwrite d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:25.211 INFO:tasks.workunit.client.0.smithi038.stdout:9/140: truncate d9/f20 949978 0 2023-12-16T20:11:25.212 INFO:tasks.workunit.client.0.smithi038.stdout:0/152: rmdir db/d31 0 2023-12-16T20:11:25.213 INFO:tasks.workunit.client.0.smithi038.stdout:2/249: mkdir d1/df/d10/d49 0 2023-12-16T20:11:25.215 INFO:tasks.workunit.client.0.smithi038.stdout:1/223: mknod d15/d1e/d3b/d48/d3d/c4d 0 2023-12-16T20:11:25.217 INFO:tasks.workunit.client.0.smithi038.stdout:5/150: getdents d2/d4/dc/d17 0 2023-12-16T20:11:25.218 INFO:tasks.workunit.client.0.smithi038.stdout:5/151: read d2/f10 [400866,107402] 0 2023-12-16T20:11:25.221 INFO:tasks.workunit.client.0.smithi038.stdout:7/162: unlink da/d21/d2c/d2e/f2b 0 2023-12-16T20:11:25.224 INFO:tasks.workunit.client.0.smithi038.stdout:9/141: mknod d9/d1e/c2d 0 2023-12-16T20:11:25.224 INFO:tasks.workunit.client.0.smithi038.stdout:3/234: dwrite d4/d8/d15/d1e/f3d [4194304,4194304] 0 2023-12-16T20:11:25.226 INFO:tasks.workunit.client.0.smithi038.stdout:0/153: rename db/lc to db/d16/d19/d27/l35 0 2023-12-16T20:11:25.229 INFO:tasks.workunit.client.0.smithi038.stdout:2/250: creat d1/df/d10/d23/d3a/f4a x:0 0 0 2023-12-16T20:11:25.232 INFO:tasks.workunit.client.0.smithi038.stdout:1/224: getdents d15/d1e/d3b 0 2023-12-16T20:11:25.232 INFO:tasks.workunit.client.0.smithi038.stdout:1/225: readlink d15/d1e/l2c 0 2023-12-16T20:11:25.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/251: dread d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:25.238 INFO:tasks.workunit.client.0.smithi038.stdout:7/163: unlink l7 0 2023-12-16T20:11:25.239 INFO:tasks.workunit.client.0.smithi038.stdout:9/142: rename d9/c10 to d9/c2e 0 2023-12-16T20:11:25.240 INFO:tasks.workunit.client.0.smithi038.stdout:3/235: symlink d4/d8/d15/l59 0 2023-12-16T20:11:25.241 INFO:tasks.workunit.client.0.smithi038.stdout:0/154: mknod db/d16/d19/d27/c36 0 2023-12-16T20:11:25.243 INFO:tasks.workunit.client.0.smithi038.stdout:1/226: mknod d15/d1e/d23/d34/c4e 0 2023-12-16T20:11:25.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/152: getdents d2/df 0 2023-12-16T20:11:25.245 INFO:tasks.workunit.client.0.smithi038.stdout:6/146: sync 2023-12-16T20:11:25.245 INFO:tasks.workunit.client.0.smithi038.stdout:7/164: symlink da/l32 0 2023-12-16T20:11:25.246 INFO:tasks.workunit.client.0.smithi038.stdout:3/236: mknod d4/c5a 0 2023-12-16T20:11:25.246 INFO:tasks.workunit.client.0.smithi038.stdout:3/237: chown d4/d18 0 1 2023-12-16T20:11:25.246 INFO:tasks.workunit.client.0.smithi038.stdout:0/155: dread - db/ff zero size 2023-12-16T20:11:25.248 INFO:tasks.workunit.client.0.smithi038.stdout:1/227: symlink d15/d1e/d23/d46/l4f 0 2023-12-16T20:11:25.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/252: getdents d1/d5/d2a 0 2023-12-16T20:11:25.252 INFO:tasks.workunit.client.0.smithi038.stdout:5/153: dread d2/f7 [0,4194304] 0 2023-12-16T20:11:25.252 INFO:tasks.workunit.client.0.smithi038.stdout:0/156: mknod db/d16/c37 0 2023-12-16T20:11:25.255 INFO:tasks.workunit.client.0.smithi038.stdout:1/228: creat d15/d1e/d30/f50 x:0 0 0 2023-12-16T20:11:25.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/253: symlink d1/d5/d2a/d31/l4b 0 2023-12-16T20:11:25.260 INFO:tasks.workunit.client.0.smithi038.stdout:2/254: mknod d1/df/d10/d49/c4c 0 2023-12-16T20:11:25.262 INFO:tasks.workunit.client.0.smithi038.stdout:1/229: getdents d15/d22 0 2023-12-16T20:11:25.264 INFO:tasks.workunit.client.0.smithi038.stdout:6/147: dwrite d1/d4/d1d/f2a [0,4194304] 0 2023-12-16T20:11:25.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/238: dwrite f3 [0,4194304] 0 2023-12-16T20:11:25.265 INFO:tasks.workunit.client.0.smithi038.stdout:5/154: rename d2/d4/dc to d2/d14/d25/d2d 0 2023-12-16T20:11:25.265 INFO:tasks.workunit.client.0.smithi038.stdout:0/157: rename db/d1a to db/d1a/d38 22 2023-12-16T20:11:25.266 INFO:tasks.workunit.client.0.smithi038.stdout:5/155: dread - d2/d14/d25/d2d/d17/f19 zero size 2023-12-16T20:11:25.266 INFO:tasks.workunit.client.0.smithi038.stdout:5/156: chown d2/c6 0 1 2023-12-16T20:11:25.266 INFO:tasks.workunit.client.0.smithi038.stdout:5/157: write d2/d14/d25/d2d/d17/f19 [94951,46516] 0 2023-12-16T20:11:25.266 INFO:tasks.workunit.client.0.smithi038.stdout:3/239: write d4/d18/f2a [805057,111651] 0 2023-12-16T20:11:25.269 INFO:tasks.workunit.client.0.smithi038.stdout:0/158: chown db/ce 1470695 1 2023-12-16T20:11:25.271 INFO:tasks.workunit.client.0.smithi038.stdout:5/158: dread f0 [4194304,4194304] 0 2023-12-16T20:11:25.271 INFO:tasks.workunit.client.0.smithi038.stdout:1/230: rename d15/f1b to d15/d22/f51 0 2023-12-16T20:11:25.273 INFO:tasks.workunit.client.0.smithi038.stdout:3/240: unlink d4/d27/d2b/f4d 0 2023-12-16T20:11:25.273 INFO:tasks.workunit.client.0.smithi038.stdout:3/241: fdatasync d4/d8/d15/d1e/f22 0 2023-12-16T20:11:25.273 INFO:tasks.workunit.client.0.smithi038.stdout:3/242: chown d4/d27/d23/f4f 6 1 2023-12-16T20:11:25.275 INFO:tasks.workunit.client.0.smithi038.stdout:1/231: mkdir d15/d22/d52 0 2023-12-16T20:11:25.275 INFO:tasks.workunit.client.0.smithi038.stdout:1/232: fdatasync d15/d22/f26 0 2023-12-16T20:11:25.278 INFO:tasks.workunit.client.0.smithi038.stdout:5/159: mknod d2/df/d1a/c2e 0 2023-12-16T20:11:25.278 INFO:tasks.workunit.client.0.smithi038.stdout:5/160: truncate d2/f9 4467568 0 2023-12-16T20:11:25.278 INFO:tasks.workunit.client.0.smithi038.stdout:6/148: read d1/d4/f20 [776023,124756] 0 2023-12-16T20:11:25.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/243: rename d4/d18/f33 to d4/d27/d2b/f5b 0 2023-12-16T20:11:25.282 INFO:tasks.workunit.client.0.smithi038.stdout:1/233: creat d15/d22/f53 x:0 0 0 2023-12-16T20:11:25.284 INFO:tasks.workunit.client.0.smithi038.stdout:5/161: mkdir d2/d14/d25/d2d/d2f 0 2023-12-16T20:11:25.286 INFO:tasks.workunit.client.0.smithi038.stdout:3/244: symlink d4/d8/l5c 0 2023-12-16T20:11:25.288 INFO:tasks.workunit.client.0.smithi038.stdout:1/234: creat d15/d1e/d3b/d48/d3d/f54 x:0 0 0 2023-12-16T20:11:25.288 INFO:tasks.workunit.client.0.smithi038.stdout:5/162: mknod d2/d14/c30 0 2023-12-16T20:11:25.289 INFO:tasks.workunit.client.0.smithi038.stdout:1/235: mknod d15/d1e/d3b/d48/d37/c55 0 2023-12-16T20:11:25.290 INFO:tasks.workunit.client.0.smithi038.stdout:5/163: creat d2/d14/d25/d2d/f31 x:0 0 0 2023-12-16T20:11:25.290 INFO:tasks.workunit.client.0.smithi038.stdout:5/164: read - d2/d14/d25/d2d/f2c zero size 2023-12-16T20:11:25.291 INFO:tasks.workunit.client.0.smithi038.stdout:2/255: rmdir d1/d5/d2a/d31 39 2023-12-16T20:11:25.293 INFO:tasks.workunit.client.0.smithi038.stdout:2/256: creat d1/d5/f4d x:0 0 0 2023-12-16T20:11:25.293 INFO:tasks.workunit.client.0.smithi038.stdout:2/257: chown d1/df/d10/d49 2778680 1 2023-12-16T20:11:25.296 INFO:tasks.workunit.client.0.smithi038.stdout:6/149: dwrite d1/d4/d1d/f1e [0,4194304] 0 2023-12-16T20:11:25.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/150: mknod d1/d4/d1d/d28/c31 0 2023-12-16T20:11:25.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/151: readlink d1/d16/l15 0 2023-12-16T20:11:25.303 INFO:tasks.workunit.client.0.smithi038.stdout:6/152: getdents d1/d4/d1d 0 2023-12-16T20:11:25.305 INFO:tasks.workunit.client.0.smithi038.stdout:6/153: truncate d1/d4/f20 1222797 0 2023-12-16T20:11:25.308 INFO:tasks.workunit.client.0.smithi038.stdout:1/236: fsync d15/d1e/d3b/d48/d3d/f54 0 2023-12-16T20:11:25.310 INFO:tasks.workunit.client.0.smithi038.stdout:3/245: dwrite d4/d27/d2b/f32 [0,4194304] 0 2023-12-16T20:11:25.310 INFO:tasks.workunit.client.0.smithi038.stdout:1/237: rename ld to d15/d1e/d3b/d48/l56 0 2023-12-16T20:11:25.310 INFO:tasks.workunit.client.0.smithi038.stdout:1/238: truncate d15/f24 555413 0 2023-12-16T20:11:25.312 INFO:tasks.workunit.client.0.smithi038.stdout:5/165: dwrite d2/d4/f1c [0,4194304] 0 2023-12-16T20:11:25.313 INFO:tasks.workunit.client.0.smithi038.stdout:1/239: symlink d15/d22/d52/l57 0 2023-12-16T20:11:25.314 INFO:tasks.workunit.client.0.smithi038.stdout:1/240: write d15/d1e/d3b/d48/d37/f41 [828489,102730] 0 2023-12-16T20:11:25.314 INFO:tasks.workunit.client.0.smithi038.stdout:1/241: creat d15/d1e/d3b/d48/d3d/f58 x:0 0 0 2023-12-16T20:11:25.314 INFO:tasks.workunit.client.0.smithi038.stdout:1/242: chown d15/d1e/d23/f3a 9800974 1 2023-12-16T20:11:25.314 INFO:tasks.workunit.client.0.smithi038.stdout:6/154: truncate d1/d4/d1d/f1e 622035 0 2023-12-16T20:11:25.317 INFO:tasks.workunit.client.0.smithi038.stdout:3/246: getdents d4/d27/d2b 0 2023-12-16T20:11:25.322 INFO:tasks.workunit.client.0.smithi038.stdout:5/166: dread f0 [0,4194304] 0 2023-12-16T20:11:25.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/258: dwrite d1/df/d10/f46 [0,4194304] 0 2023-12-16T20:11:25.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/259: creat d1/d5/f4e x:0 0 0 2023-12-16T20:11:25.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/260: dread - d1/df/d21/f3c zero size 2023-12-16T20:11:25.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/261: chown d1/d5/d2a/d31/l34 710 1 2023-12-16T20:11:25.323 INFO:tasks.workunit.client.0.smithi038.stdout:6/155: write d1/d4/d1d/f1e [1044370,107645] 0 2023-12-16T20:11:25.325 INFO:tasks.workunit.client.0.smithi038.stdout:1/243: dread f11 [0,4194304] 0 2023-12-16T20:11:25.327 INFO:tasks.workunit.client.0.smithi038.stdout:3/247: read d4/d27/d2b/f32 [1552138,102264] 0 2023-12-16T20:11:25.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/156: creat d1/d4/d1d/f32 x:0 0 0 2023-12-16T20:11:25.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/157: truncate d1/d4/d1d/f32 834186 0 2023-12-16T20:11:25.330 INFO:tasks.workunit.client.0.smithi038.stdout:1/244: write f11 [2820868,39441] 0 2023-12-16T20:11:25.330 INFO:tasks.workunit.client.0.smithi038.stdout:1/245: getdents d15/d1e/d23/d42 0 2023-12-16T20:11:25.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/248: getdents d4/d8/d15/d2c 0 2023-12-16T20:11:25.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/249: creat d4/d8/d15/f5d x:0 0 0 2023-12-16T20:11:25.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/250: write d4/d27/d2b/f5b [4558929,107624] 0 2023-12-16T20:11:25.331 INFO:tasks.workunit.client.0.smithi038.stdout:6/158: getdents d1/d4/d1d/d28 0 2023-12-16T20:11:25.331 INFO:tasks.workunit.client.0.smithi038.stdout:6/159: creat d1/d16/d23/f33 x:0 0 0 2023-12-16T20:11:25.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/246: rename d15/d1e/d23/f3a to d15/d1e/d30/f59 0 2023-12-16T20:11:25.337 INFO:tasks.workunit.client.0.smithi038.stdout:3/251: mknod d4/d8/d15/d2c/d4c/d58/c5e 0 2023-12-16T20:11:25.339 INFO:tasks.workunit.client.0.smithi038.stdout:1/247: mkdir d15/d1e/d3b/d5a 0 2023-12-16T20:11:25.339 INFO:tasks.workunit.client.0.smithi038.stdout:1/248: chown d15/d1e/f2d 15 1 2023-12-16T20:11:25.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/252: creat d4/d27/d40/f5f x:0 0 0 2023-12-16T20:11:25.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/253: chown d4/d8/d15/d2c/d4c/d58 0 1 2023-12-16T20:11:25.342 INFO:tasks.workunit.client.0.smithi038.stdout:4/134: sync 2023-12-16T20:11:25.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/147: sync 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:3/254: mkdir d4/d27/d60 0 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:3/255: chown d4/d8/l5c 14312 1 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:3/256: fsync d4/d18/f38 0 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:3/257: chown d4/d27 9890 1 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/249: getdents d15/d1e/d3b/d48/d3d 0 2023-12-16T20:11:25.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/250: creat d15/d1e/d30/f5b x:0 0 0 2023-12-16T20:11:25.344 INFO:tasks.workunit.client.0.smithi038.stdout:3/258: symlink d4/d8/d15/d2c/d4c/d58/l61 0 2023-12-16T20:11:25.345 INFO:tasks.workunit.client.0.smithi038.stdout:5/167: dwrite d2/f7 [0,4194304] 0 2023-12-16T20:11:25.346 INFO:tasks.workunit.client.0.smithi038.stdout:2/262: dwrite d1/d5/d3d/f47 [0,4194304] 0 2023-12-16T20:11:25.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/259: rmdir d4/d27/d60 0 2023-12-16T20:11:25.347 INFO:tasks.workunit.client.0.smithi038.stdout:4/135: dread d13/f18 [0,4194304] 0 2023-12-16T20:11:25.347 INFO:tasks.workunit.client.0.smithi038.stdout:4/136: creat d13/f28 x:0 0 0 2023-12-16T20:11:25.358 INFO:tasks.workunit.client.0.smithi038.stdout:3/260: link d4/c5a d4/c62 0 2023-12-16T20:11:25.358 INFO:tasks.workunit.client.0.smithi038.stdout:3/261: write d4/d8/d15/d1e/f22 [5239591,114499] 0 2023-12-16T20:11:25.361 INFO:tasks.workunit.client.0.smithi038.stdout:2/263: write d1/df/d10/f46 [653500,106713] 0 2023-12-16T20:11:25.361 INFO:tasks.workunit.client.0.smithi038.stdout:4/137: symlink d13/d1f/d22/l29 0 2023-12-16T20:11:25.363 INFO:tasks.workunit.client.0.smithi038.stdout:3/262: creat d4/d27/d2b/f63 x:0 0 0 2023-12-16T20:11:25.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/263: mkdir d4/d27/d2b/d64 0 2023-12-16T20:11:25.366 INFO:tasks.workunit.client.0.smithi038.stdout:3/264: creat d4/d8/d15/d2c/f65 x:0 0 0 2023-12-16T20:11:25.369 INFO:tasks.workunit.client.0.smithi038.stdout:4/138: dread f9 [0,4194304] 0 2023-12-16T20:11:25.369 INFO:tasks.workunit.client.0.smithi038.stdout:4/139: chown d13/d1f/d22/l29 121963 1 2023-12-16T20:11:25.370 INFO:tasks.workunit.client.0.smithi038.stdout:4/140: symlink d13/d17/l2a 0 2023-12-16T20:11:25.371 INFO:tasks.workunit.client.0.smithi038.stdout:4/141: truncate d13/f26 924179 0 2023-12-16T20:11:25.372 INFO:tasks.workunit.client.0.smithi038.stdout:4/142: dread d13/f18 [0,4194304] 0 2023-12-16T20:11:25.372 INFO:tasks.workunit.client.0.smithi038.stdout:4/143: write fb [4804838,126062] 0 2023-12-16T20:11:25.373 INFO:tasks.workunit.client.0.smithi038.stdout:4/144: symlink d13/d1c/l2b 0 2023-12-16T20:11:25.373 INFO:tasks.workunit.client.0.smithi038.stdout:4/145: chown d13/d17/l2a 117 1 2023-12-16T20:11:25.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/148: dwrite d17/f20 [4194304,4194304] 0 2023-12-16T20:11:25.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/149: readlink d17/d1b/l1f 0 2023-12-16T20:11:25.380 INFO:tasks.workunit.client.0.smithi038.stdout:1/251: dwrite d15/d1e/d23/f35 [0,4194304] 0 2023-12-16T20:11:25.380 INFO:tasks.workunit.client.0.smithi038.stdout:1/252: stat d15/d1e/d23/d42 0 2023-12-16T20:11:25.381 INFO:tasks.workunit.client.0.smithi038.stdout:1/253: fsync d15/d1e/d3b/d48/d37/f41 0 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/264: dwrite d1/d5/d16/f2e [0,4194304] 0 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/265: chown d1/d5 33283 1 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/266: creat d1/df/d10/f4f x:0 0 0 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/267: read - d1/df/d10/d23/d3a/f4a zero size 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/268: readlink d1/df/d10/d23/d3a/l1e 0 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/269: chown d1/d5 87105684 1 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:2/270: fsync d1/d5/d16/f2e 0 2023-12-16T20:11:25.382 INFO:tasks.workunit.client.0.smithi038.stdout:5/168: dwrite d2/f12 [0,4194304] 0 2023-12-16T20:11:25.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/150: mknod d17/d18/c2b 0 2023-12-16T20:11:25.386 INFO:tasks.workunit.client.0.smithi038.stdout:1/254: symlink d15/d1e/d30/l5c 0 2023-12-16T20:11:25.386 INFO:tasks.workunit.client.0.smithi038.stdout:1/255: dread - d15/d22/f4b zero size 2023-12-16T20:11:25.389 INFO:tasks.workunit.client.0.smithi038.stdout:2/271: dread d1/df/d10/f44 [0,4194304] 0 2023-12-16T20:11:25.389 INFO:tasks.workunit.client.0.smithi038.stdout:2/272: stat d1/df/d42/c3f 0 2023-12-16T20:11:25.391 INFO:tasks.workunit.client.0.smithi038.stdout:5/169: creat d2/df/d1a/d1f/f32 x:0 0 0 2023-12-16T20:11:25.392 INFO:tasks.workunit.client.0.smithi038.stdout:1/256: creat d15/d1e/d23/d34/f5d x:0 0 0 2023-12-16T20:11:25.395 INFO:tasks.workunit.client.0.smithi038.stdout:1/257: mkdir d15/d1e/d3b/d48/d5e 0 2023-12-16T20:11:25.396 INFO:tasks.workunit.client.0.smithi038.stdout:1/258: fdatasync d15/d1e/f2d 0 2023-12-16T20:11:25.398 INFO:tasks.workunit.client.0.smithi038.stdout:4/146: dwrite d13/f26 [0,4194304] 0 2023-12-16T20:11:25.399 INFO:tasks.workunit.client.0.smithi038.stdout:1/259: link d15/d1e/c1f d15/d1e/d23/d46/c5f 0 2023-12-16T20:11:25.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/265: rmdir d4/d27/d2b 39 2023-12-16T20:11:25.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/266: chown d4/d27/d23/f57 293414 1 2023-12-16T20:11:25.407 INFO:tasks.workunit.client.0.smithi038.stdout:8/151: dwrite f16 [0,4194304] 0 2023-12-16T20:11:25.407 INFO:tasks.workunit.client.0.smithi038.stdout:8/152: chown d17/d1d/f21 105 1 2023-12-16T20:11:25.407 INFO:tasks.workunit.client.0.smithi038.stdout:1/260: dread d15/f19 [0,4194304] 0 2023-12-16T20:11:25.410 INFO:tasks.workunit.client.0.smithi038.stdout:4/147: rename d13/d1f/d22/c27 to d13/d1f/c2c 0 2023-12-16T20:11:25.413 INFO:tasks.workunit.client.0.smithi038.stdout:8/153: symlink d17/d1b/d25/l2c 0 2023-12-16T20:11:25.415 INFO:tasks.workunit.client.0.smithi038.stdout:1/261: truncate d15/d1e/d23/f39 1110744 0 2023-12-16T20:11:25.415 INFO:tasks.workunit.client.0.smithi038.stdout:1/262: dread - d15/d1e/d30/f5b zero size 2023-12-16T20:11:25.415 INFO:tasks.workunit.client.0.smithi038.stdout:1/263: truncate d15/d1e/d23/d34/f5d 203505 0 2023-12-16T20:11:25.415 INFO:tasks.workunit.client.0.smithi038.stdout:8/154: unlink d17/d18/c2b 0 2023-12-16T20:11:25.418 INFO:tasks.workunit.client.0.smithi038.stdout:1/264: dread d15/f19 [0,4194304] 0 2023-12-16T20:11:25.418 INFO:tasks.workunit.client.0.smithi038.stdout:8/155: rename d17/d1b/d25/l2c to d17/d18/l2d 0 2023-12-16T20:11:25.421 INFO:tasks.workunit.client.0.smithi038.stdout:1/265: link d15/d1e/d23/d46/l4f d15/d1e/d3b/d48/d37/l60 0 2023-12-16T20:11:25.421 INFO:tasks.workunit.client.0.smithi038.stdout:1/266: dread - d15/d1e/d3b/d48/d3d/f58 zero size 2023-12-16T20:11:25.421 INFO:tasks.workunit.client.0.smithi038.stdout:1/267: fdatasync d15/d1e/d3b/d48/f36 0 2023-12-16T20:11:25.422 INFO:tasks.workunit.client.0.smithi038.stdout:2/273: dwrite d1/d5/d16/f2e [0,4194304] 0 2023-12-16T20:11:25.422 INFO:tasks.workunit.client.0.smithi038.stdout:2/274: creat d1/df/d10/f50 x:0 0 0 2023-12-16T20:11:25.422 INFO:tasks.workunit.client.0.smithi038.stdout:2/275: readlink d1/df/d10/l19 0 2023-12-16T20:11:25.422 INFO:tasks.workunit.client.0.smithi038.stdout:2/276: dread - d1/df/d21/f3c zero size 2023-12-16T20:11:25.422 INFO:tasks.workunit.client.0.smithi038.stdout:2/277: write d1/df/d10/d23/d3a/f4a [764737,129745] 0 2023-12-16T20:11:25.426 INFO:tasks.workunit.client.0.smithi038.stdout:5/170: dwrite d2/f11 [0,4194304] 0 2023-12-16T20:11:25.426 INFO:tasks.workunit.client.0.smithi038.stdout:5/171: readlink d2/df/l26 0 2023-12-16T20:11:25.426 INFO:tasks.workunit.client.0.smithi038.stdout:5/172: creat d2/d14/f33 x:0 0 0 2023-12-16T20:11:25.435 INFO:tasks.workunit.client.0.smithi038.stdout:9/143: sync 2023-12-16T20:11:25.435 INFO:tasks.workunit.client.0.smithi038.stdout:7/165: sync 2023-12-16T20:11:25.435 INFO:tasks.workunit.client.0.smithi038.stdout:0/159: sync 2023-12-16T20:11:25.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/160: chown db/d16/c37 6038 1 2023-12-16T20:11:25.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/161: write db/d16/d19/f23 [839319,50573] 0 2023-12-16T20:11:25.436 INFO:tasks.workunit.client.0.smithi038.stdout:7/166: symlink da/l33 0 2023-12-16T20:11:25.437 INFO:tasks.workunit.client.0.smithi038.stdout:0/162: symlink db/d1a/l39 0 2023-12-16T20:11:25.442 INFO:tasks.workunit.client.0.smithi038.stdout:7/167: dread da/f19 [0,4194304] 0 2023-12-16T20:11:25.447 INFO:tasks.workunit.client.0.smithi038.stdout:3/267: dwrite d4/d27/d2b/f63 [0,4194304] 0 2023-12-16T20:11:25.448 INFO:tasks.workunit.client.0.smithi038.stdout:3/268: creat d4/d18/f66 x:0 0 0 2023-12-16T20:11:25.448 INFO:tasks.workunit.client.0.smithi038.stdout:4/148: dwrite f12 [0,4194304] 0 2023-12-16T20:11:25.448 INFO:tasks.workunit.client.0.smithi038.stdout:4/149: chown c11 196 1 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:3/269: mkdir d4/d67 0 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:7/168: dread da/d21/d2c/d2e/fe [0,4194304] 0 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:3/270: write d4/d18/f4b [208005,75479] 0 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:7/169: creat da/d21/f34 x:0 0 0 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:7/170: stat c3 0 2023-12-16T20:11:25.452 INFO:tasks.workunit.client.0.smithi038.stdout:4/150: rmdir d13/d1c 39 2023-12-16T20:11:25.454 INFO:tasks.workunit.client.0.smithi038.stdout:7/171: symlink da/d21/l35 0 2023-12-16T20:11:25.454 INFO:tasks.workunit.client.0.smithi038.stdout:7/172: write da/dc/f2a [461790,36547] 0 2023-12-16T20:11:25.455 INFO:tasks.workunit.client.0.smithi038.stdout:4/151: symlink d13/d1f/d22/l2d 0 2023-12-16T20:11:25.455 INFO:tasks.workunit.client.0.smithi038.stdout:7/173: creat da/d21/d2c/f36 x:0 0 0 2023-12-16T20:11:25.457 INFO:tasks.workunit.client.0.smithi038.stdout:7/174: symlink da/dc/l37 0 2023-12-16T20:11:25.458 INFO:tasks.workunit.client.0.smithi038.stdout:7/175: dread da/f1d [0,4194304] 0 2023-12-16T20:11:25.458 INFO:tasks.workunit.client.0.smithi038.stdout:7/176: truncate da/f23 777560 0 2023-12-16T20:11:25.468 INFO:tasks.workunit.client.0.smithi038.stdout:8/156: dwrite fc [0,4194304] 0 2023-12-16T20:11:25.470 INFO:tasks.workunit.client.0.smithi038.stdout:2/278: dwrite d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:25.471 INFO:tasks.workunit.client.0.smithi038.stdout:2/279: mknod d1/df/d12/c51 0 2023-12-16T20:11:25.472 INFO:tasks.workunit.client.0.smithi038.stdout:2/280: symlink d1/d5/d3d/l52 0 2023-12-16T20:11:25.474 INFO:tasks.workunit.client.0.smithi038.stdout:2/281: mknod d1/df/d42/c53 0 2023-12-16T20:11:25.475 INFO:tasks.workunit.client.0.smithi038.stdout:2/282: write d1/df/d10/f46 [2919410,34523] 0 2023-12-16T20:11:25.475 INFO:tasks.workunit.client.0.smithi038.stdout:2/283: mkdir d1/d5/d16/d54 0 2023-12-16T20:11:25.477 INFO:tasks.workunit.client.0.smithi038.stdout:5/173: dwrite f0 [4194304,4194304] 0 2023-12-16T20:11:25.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/144: dwrite d9/d1e/f27 [0,4194304] 0 2023-12-16T20:11:25.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/284: creat d1/df/d42/d43/f55 x:0 0 0 2023-12-16T20:11:25.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/285: chown d1/df/d10/d2f/c37 15 1 2023-12-16T20:11:25.479 INFO:tasks.workunit.client.0.smithi038.stdout:8/157: read d17/f20 [4619212,57115] 0 2023-12-16T20:11:25.479 INFO:tasks.workunit.client.0.smithi038.stdout:8/158: fsync f10 0 2023-12-16T20:11:25.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/159: dread d17/d1b/f22 [0,4194304] 0 2023-12-16T20:11:25.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/160: creat d17/d1b/f2e x:0 0 0 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:8/161: dread - d17/d1b/f2e zero size 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:8/162: fsync d17/f24 0 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/271: dwrite d4/f6 [0,4194304] 0 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/272: write d4/d18/f34 [5097936,74558] 0 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/273: creat d4/d27/d23/d26/f68 x:0 0 0 2023-12-16T20:11:25.482 INFO:tasks.workunit.client.0.smithi038.stdout:1/268: dwrite d15/d1e/d23/f39 [0,4194304] 0 2023-12-16T20:11:25.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/174: mknod d2/df/d1a/d2a/c34 0 2023-12-16T20:11:25.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/175: readlink d2/d14/l2b 0 2023-12-16T20:11:25.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/176: creat d2/df/d1a/d1f/f35 x:0 0 0 2023-12-16T20:11:25.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/177: dread - d2/d14/f33 zero size 2023-12-16T20:11:25.488 INFO:tasks.workunit.client.0.smithi038.stdout:6/160: sync 2023-12-16T20:11:25.490 INFO:tasks.workunit.client.0.smithi038.stdout:7/177: getdents da 0 2023-12-16T20:11:25.492 INFO:tasks.workunit.client.0.smithi038.stdout:9/145: stat d9/l12 0 2023-12-16T20:11:25.492 INFO:tasks.workunit.client.0.smithi038.stdout:9/146: write d9/d1f/d21/f28 [748857,59542] 0 2023-12-16T20:11:25.492 INFO:tasks.workunit.client.0.smithi038.stdout:2/286: write d1/d5/d3d/f47 [573203,121665] 0 2023-12-16T20:11:25.494 INFO:tasks.workunit.client.0.smithi038.stdout:4/152: dwrite fb [0,4194304] 0 2023-12-16T20:11:25.494 INFO:tasks.workunit.client.0.smithi038.stdout:4/153: getdents d13/d1f/d20 0 2023-12-16T20:11:25.495 INFO:tasks.workunit.client.0.smithi038.stdout:8/163: symlink d17/d18/l2f 0 2023-12-16T20:11:25.495 INFO:tasks.workunit.client.0.smithi038.stdout:8/164: readlink l12 0 2023-12-16T20:11:25.496 INFO:tasks.workunit.client.0.smithi038.stdout:3/274: read d4/d8/f1c [136609,64660] 0 2023-12-16T20:11:25.499 INFO:tasks.workunit.client.0.smithi038.stdout:1/269: getdents d15/d1e/d3b/d48 0 2023-12-16T20:11:25.501 INFO:tasks.workunit.client.0.smithi038.stdout:5/178: symlink d2/d14/d25/d2d/l36 0 2023-12-16T20:11:25.501 INFO:tasks.workunit.client.0.smithi038.stdout:5/179: readlink d2/d4/ld 0 2023-12-16T20:11:25.501 INFO:tasks.workunit.client.0.smithi038.stdout:5/180: write d2/f10 [154588,19169] 0 2023-12-16T20:11:25.502 INFO:tasks.workunit.client.0.smithi038.stdout:6/161: mkdir d1/d2e/d34 0 2023-12-16T20:11:25.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/147: mknod d9/d1f/d21/c2f 0 2023-12-16T20:11:25.509 INFO:tasks.workunit.client.0.smithi038.stdout:2/287: rmdir d1/d5/d16/d54 0 2023-12-16T20:11:25.509 INFO:tasks.workunit.client.0.smithi038.stdout:2/288: creat d1/df/d10/d23/d3a/f56 x:0 0 0 2023-12-16T20:11:25.509 INFO:tasks.workunit.client.0.smithi038.stdout:2/289: truncate d1/df/d10/d23/d3a/f4a 1747842 0 2023-12-16T20:11:25.509 INFO:tasks.workunit.client.0.smithi038.stdout:8/165: symlink d17/l30 0 2023-12-16T20:11:25.510 INFO:tasks.workunit.client.0.smithi038.stdout:8/166: truncate d17/d1b/f2e 701725 0 2023-12-16T20:11:25.510 INFO:tasks.workunit.client.0.smithi038.stdout:3/275: dread d4/f6 [0,4194304] 0 2023-12-16T20:11:25.512 INFO:tasks.workunit.client.0.smithi038.stdout:1/270: unlink d15/d1e/d30/l5c 0 2023-12-16T20:11:25.514 INFO:tasks.workunit.client.0.smithi038.stdout:6/162: symlink d1/d16/l35 0 2023-12-16T20:11:25.514 INFO:tasks.workunit.client.0.smithi038.stdout:7/178: dwrite da/d21/d2c/d2e/ff [0,4194304] 0 2023-12-16T20:11:25.514 INFO:tasks.workunit.client.0.smithi038.stdout:7/179: read da/f19 [232257,121836] 0 2023-12-16T20:11:25.516 INFO:tasks.workunit.client.0.smithi038.stdout:9/148: rename d9/l25 to d9/d1f/l30 0 2023-12-16T20:11:25.519 INFO:tasks.workunit.client.0.smithi038.stdout:2/290: mkdir d1/df/d42/d43/d57 0 2023-12-16T20:11:25.520 INFO:tasks.workunit.client.0.smithi038.stdout:9/149: read d9/fb [31752,52650] 0 2023-12-16T20:11:25.520 INFO:tasks.workunit.client.0.smithi038.stdout:8/167: creat d17/d1d/f31 x:0 0 0 2023-12-16T20:11:25.521 INFO:tasks.workunit.client.0.smithi038.stdout:3/276: getdents d4/d27/d2b 0 2023-12-16T20:11:25.521 INFO:tasks.workunit.client.0.smithi038.stdout:3/277: readlink d4/d8/d15/d1e/l50 0 2023-12-16T20:11:25.521 INFO:tasks.workunit.client.0.smithi038.stdout:3/278: creat d4/d18/f69 x:0 0 0 2023-12-16T20:11:25.523 INFO:tasks.workunit.client.0.smithi038.stdout:1/271: link d15/f1a d15/d22/f61 0 2023-12-16T20:11:25.523 INFO:tasks.workunit.client.0.smithi038.stdout:1/272: fdatasync d15/d1e/d23/d34/f5d 0 2023-12-16T20:11:25.523 INFO:tasks.workunit.client.0.smithi038.stdout:1/273: chown d15/d1e/d23/f35 60612 1 2023-12-16T20:11:25.523 INFO:tasks.workunit.client.0.smithi038.stdout:1/274: stat d15/d22/d52 0 2023-12-16T20:11:25.527 INFO:tasks.workunit.client.0.smithi038.stdout:6/163: rename d1/d16/d23/f26 to d1/d4/d1d/d28/f36 0 2023-12-16T20:11:25.527 INFO:tasks.workunit.client.0.smithi038.stdout:6/164: chown d1/f2c 779576174 1 2023-12-16T20:11:25.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/291: creat d1/df/d10/d2f/f58 x:0 0 0 2023-12-16T20:11:25.528 INFO:tasks.workunit.client.0.smithi038.stdout:9/150: symlink d9/l31 0 2023-12-16T20:11:25.530 INFO:tasks.workunit.client.0.smithi038.stdout:1/275: mkdir d15/d22/d62 0 2023-12-16T20:11:25.530 INFO:tasks.workunit.client.0.smithi038.stdout:1/276: chown d15/d22/f53 55240620 1 2023-12-16T20:11:25.532 INFO:tasks.workunit.client.0.smithi038.stdout:3/279: rename f3 to d4/d8/d15/f6a 0 2023-12-16T20:11:25.532 INFO:tasks.workunit.client.0.smithi038.stdout:3/280: chown d4/f17 7 1 2023-12-16T20:11:25.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/165: creat d1/d4/d1d/d28/f37 x:0 0 0 2023-12-16T20:11:25.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/166: creat d1/f38 x:0 0 0 2023-12-16T20:11:25.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/167: truncate d1/d4/d1d/f1e 1242837 0 2023-12-16T20:11:25.534 INFO:tasks.workunit.client.0.smithi038.stdout:6/168: rmdir d1/d2e 39 2023-12-16T20:11:25.534 INFO:tasks.workunit.client.0.smithi038.stdout:6/169: stat d1/d16/d23 0 2023-12-16T20:11:25.549 INFO:tasks.workunit.client.0.smithi038.stdout:3/281: dwrite d4/d8/d15/d1e/f3f [0,4194304] 0 2023-12-16T20:11:25.647 INFO:tasks.workunit.client.0.smithi038.stdout:8/168: read d17/d1b/f2e [152994,125434] 0 2023-12-16T20:11:25.648 INFO:tasks.workunit.client.0.smithi038.stdout:2/292: fdatasync d1/d5/d3d/f47 0 2023-12-16T20:11:25.653 INFO:tasks.workunit.client.0.smithi038.stdout:2/293: creat d1/df/d42/f59 x:0 0 0 2023-12-16T20:11:25.653 INFO:tasks.workunit.client.0.smithi038.stdout:2/294: truncate d1/d5/d16/f2e 4474731 0 2023-12-16T20:11:25.656 INFO:tasks.workunit.client.0.smithi038.stdout:2/295: dread d1/df/d10/d23/d3a/f4a [0,4194304] 0 2023-12-16T20:11:25.656 INFO:tasks.workunit.client.0.smithi038.stdout:2/296: write d1/d5/f4e [913355,23982] 0 2023-12-16T20:11:25.657 INFO:tasks.workunit.client.0.smithi038.stdout:8/169: write f9 [1061300,70396] 0 2023-12-16T20:11:25.657 INFO:tasks.workunit.client.0.smithi038.stdout:8/170: truncate d17/d1b/f2e 1575470 0 2023-12-16T20:11:25.657 INFO:tasks.workunit.client.0.smithi038.stdout:2/297: creat d1/df/d42/d43/d57/f5a x:0 0 0 2023-12-16T20:11:25.659 INFO:tasks.workunit.client.0.smithi038.stdout:2/298: mkdir d1/df/d42/d43/d57/d5b 0 2023-12-16T20:11:25.660 INFO:tasks.workunit.client.0.smithi038.stdout:2/299: mknod d1/df/d10/d23/c5c 0 2023-12-16T20:11:25.663 INFO:tasks.workunit.client.0.smithi038.stdout:2/300: unlink d1/df/d10/d2f/c37 0 2023-12-16T20:11:25.664 INFO:tasks.workunit.client.0.smithi038.stdout:2/301: mkdir d1/d5/d2a/d5d 0 2023-12-16T20:11:25.665 INFO:tasks.workunit.client.0.smithi038.stdout:8/171: dread f16 [0,4194304] 0 2023-12-16T20:11:25.665 INFO:tasks.workunit.client.0.smithi038.stdout:8/172: fdatasync f16 0 2023-12-16T20:11:25.667 INFO:tasks.workunit.client.0.smithi038.stdout:6/170: unlink d1/d4/d1d/d28/f36 0 2023-12-16T20:11:25.667 INFO:tasks.workunit.client.0.smithi038.stdout:6/171: fsync d1/d4/f20 0 2023-12-16T20:11:25.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/172: creat d1/f39 x:0 0 0 2023-12-16T20:11:25.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/173: write d1/d4/f1c [544358,11402] 0 2023-12-16T20:11:25.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/174: dread - d1/fe zero size 2023-12-16T20:11:25.671 INFO:tasks.workunit.client.0.smithi038.stdout:4/154: dwrite fb [4194304,4194304] 0 2023-12-16T20:11:25.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/180: dwrite da/d21/f25 [0,4194304] 0 2023-12-16T20:11:25.671 INFO:tasks.workunit.client.0.smithi038.stdout:1/277: dwrite d15/d1e/d30/f5b [0,4194304] 0 2023-12-16T20:11:25.671 INFO:tasks.workunit.client.0.smithi038.stdout:1/278: chown d15/d1e/d3b/d48/d37/f47 26084051 1 2023-12-16T20:11:25.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/279: chown f11 7526325 1 2023-12-16T20:11:25.672 INFO:tasks.workunit.client.0.smithi038.stdout:5/181: dwrite d2/f9 [0,4194304] 0 2023-12-16T20:11:25.672 INFO:tasks.workunit.client.0.smithi038.stdout:6/175: mknod d1/d4/c3a 0 2023-12-16T20:11:25.672 INFO:tasks.workunit.client.0.smithi038.stdout:6/176: creat d1/d4/d1d/f3b x:0 0 0 2023-12-16T20:11:25.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/280: dread d15/d22/f61 [0,4194304] 0 2023-12-16T20:11:25.674 INFO:tasks.workunit.client.0.smithi038.stdout:4/155: mkdir d13/d17/d2e 0 2023-12-16T20:11:25.680 INFO:tasks.workunit.client.0.smithi038.stdout:9/151: dwrite d9/d1f/f29 [0,4194304] 0 2023-12-16T20:11:25.683 INFO:tasks.workunit.client.0.smithi038.stdout:5/182: rmdir d2/df/d1a/d2a 39 2023-12-16T20:11:25.683 INFO:tasks.workunit.client.0.smithi038.stdout:5/183: dread - d2/d14/d25/d2d/f2c zero size 2023-12-16T20:11:25.684 INFO:tasks.workunit.client.0.smithi038.stdout:6/177: rmdir d1/d2e 39 2023-12-16T20:11:25.684 INFO:tasks.workunit.client.0.smithi038.stdout:6/178: write d1/d4/d1d/f32 [1263747,84952] 0 2023-12-16T20:11:25.684 INFO:tasks.workunit.client.0.smithi038.stdout:6/179: stat d1/d4/d1d/l27 0 2023-12-16T20:11:25.686 INFO:tasks.workunit.client.0.smithi038.stdout:6/180: dread d1/f19 [0,4194304] 0 2023-12-16T20:11:25.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/281: creat d15/d1e/d23/d46/f63 x:0 0 0 2023-12-16T20:11:25.687 INFO:tasks.workunit.client.0.smithi038.stdout:1/282: stat d15/d1e/c2a 0 2023-12-16T20:11:25.687 INFO:tasks.workunit.client.0.smithi038.stdout:5/184: dread d2/d14/d25/d2d/d17/f19 [0,4194304] 0 2023-12-16T20:11:25.688 INFO:tasks.workunit.client.0.smithi038.stdout:4/156: unlink f12 0 2023-12-16T20:11:25.688 INFO:tasks.workunit.client.0.smithi038.stdout:4/157: creat d13/f2f x:0 0 0 2023-12-16T20:11:25.692 INFO:tasks.workunit.client.0.smithi038.stdout:9/152: truncate d9/d1e/f27 269823 0 2023-12-16T20:11:25.692 INFO:tasks.workunit.client.0.smithi038.stdout:9/153: fsync d9/f1a 0 2023-12-16T20:11:25.692 INFO:tasks.workunit.client.0.smithi038.stdout:9/154: write d9/fb [1081422,29555] 0 2023-12-16T20:11:25.692 INFO:tasks.workunit.client.0.smithi038.stdout:9/155: fdatasync f2 0 2023-12-16T20:11:25.693 INFO:tasks.workunit.client.0.smithi038.stdout:1/283: mknod d15/d1e/d3b/c64 0 2023-12-16T20:11:25.695 INFO:tasks.workunit.client.0.smithi038.stdout:5/185: mknod d2/d4/c37 0 2023-12-16T20:11:25.695 INFO:tasks.workunit.client.0.smithi038.stdout:5/186: dread - d2/d14/d25/d2d/f2c zero size 2023-12-16T20:11:25.697 INFO:tasks.workunit.client.0.smithi038.stdout:4/158: symlink d13/l30 0 2023-12-16T20:11:25.699 INFO:tasks.workunit.client.0.smithi038.stdout:9/156: rename d9/d1f/d21/c2f to d9/d1f/d21/c32 0 2023-12-16T20:11:25.701 INFO:tasks.workunit.client.0.smithi038.stdout:1/284: rename d15/d1e/d3b/d48/d3d/c45 to d15/d1e/d3b/d48/d37/c65 0 2023-12-16T20:11:25.701 INFO:tasks.workunit.client.0.smithi038.stdout:8/173: dwrite d17/d18/f1a [0,4194304] 0 2023-12-16T20:11:25.703 INFO:tasks.workunit.client.0.smithi038.stdout:5/187: mknod d2/df/d1a/c38 0 2023-12-16T20:11:25.703 INFO:tasks.workunit.client.0.smithi038.stdout:5/188: chown d2/d14 113121509 1 2023-12-16T20:11:25.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/159: link cd d13/d1f/c31 0 2023-12-16T20:11:25.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/285: link l4 d15/d22/d52/l66 0 2023-12-16T20:11:25.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/286: creat d15/d1e/f67 x:0 0 0 2023-12-16T20:11:25.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/287: fsync d15/d1e/d3b/d48/d37/f47 0 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/302: dwrite d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/303: dread - d1/df/d21/f3c zero size 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/304: chown d1/df/d21 46078384 1 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/305: dread - d1/df/d10/d2f/f58 zero size 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/306: stat d1/df/d42 0 2023-12-16T20:11:25.707 INFO:tasks.workunit.client.0.smithi038.stdout:2/307: fdatasync d1/d5/d2a/f30 0 2023-12-16T20:11:25.710 INFO:tasks.workunit.client.0.smithi038.stdout:8/174: rename d17/d1b/f2e to d17/d1b/d25/f32 0 2023-12-16T20:11:25.713 INFO:tasks.workunit.client.0.smithi038.stdout:6/181: dwrite d1/f19 [0,4194304] 0 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/157: dread f2 [4194304,4194304] 0 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/158: chown d9/d1f 1945 1 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:6/182: read - d1/d4/d1d/f3b zero size 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/159: dread - d9/f18 zero size 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:6/183: chown d1/d4/d1d/d28/f37 0 1 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/160: write d9/f2c [634142,118222] 0 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/161: write d9/d1f/f22 [4347371,78660] 0 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:2/308: unlink d1/df/d10/d2f/f58 0 2023-12-16T20:11:25.714 INFO:tasks.workunit.client.0.smithi038.stdout:2/309: truncate d1/df/d21/f45 302130 0 2023-12-16T20:11:25.715 INFO:tasks.workunit.client.0.smithi038.stdout:5/189: rename d2/d4/c37 to d2/df/d1a/c39 0 2023-12-16T20:11:25.715 INFO:tasks.workunit.client.0.smithi038.stdout:7/181: dwrite da/f19 [0,4194304] 0 2023-12-16T20:11:25.715 INFO:tasks.workunit.client.0.smithi038.stdout:8/175: mknod d17/d1b/c33 0 2023-12-16T20:11:25.716 INFO:tasks.workunit.client.0.smithi038.stdout:9/162: dread d9/f1a [0,4194304] 0 2023-12-16T20:11:25.721 INFO:tasks.workunit.client.0.smithi038.stdout:6/184: link d1/d4/l13 d1/d4/d1d/d28/d2f/l3c 0 2023-12-16T20:11:25.722 INFO:tasks.workunit.client.0.smithi038.stdout:0/163: sync 2023-12-16T20:11:25.722 INFO:tasks.workunit.client.0.smithi038.stdout:0/164: creat db/d1a/f3a x:0 0 0 2023-12-16T20:11:25.722 INFO:tasks.workunit.client.0.smithi038.stdout:0/165: creat db/d16/d19/d27/f3b x:0 0 0 2023-12-16T20:11:25.722 INFO:tasks.workunit.client.0.smithi038.stdout:8/176: dread f9 [0,4194304] 0 2023-12-16T20:11:25.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/288: dwrite f11 [0,4194304] 0 2023-12-16T20:11:25.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/190: creat d2/df/d1a/d2a/f3a x:0 0 0 2023-12-16T20:11:25.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/191: fdatasync d2/d14/f33 0 2023-12-16T20:11:25.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/192: chown d2/f7 935139 1 2023-12-16T20:11:25.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/193: chown d2 12674472 1 2023-12-16T20:11:25.730 INFO:tasks.workunit.client.0.smithi038.stdout:7/182: unlink da/d21/d2c/d2e/c2f 0 2023-12-16T20:11:25.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/185: mkdir d1/d4/d1d/d28/d2f/d3d 0 2023-12-16T20:11:25.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/186: write d1/d16/d23/f29 [549755,71313] 0 2023-12-16T20:11:25.738 INFO:tasks.workunit.client.0.smithi038.stdout:0/166: unlink db/d16/c37 0 2023-12-16T20:11:25.740 INFO:tasks.workunit.client.0.smithi038.stdout:8/177: unlink ce 0 2023-12-16T20:11:25.741 INFO:tasks.workunit.client.0.smithi038.stdout:2/310: dwrite d1/df/d42/d43/f55 [0,4194304] 0 2023-12-16T20:11:25.741 INFO:tasks.workunit.client.0.smithi038.stdout:2/311: fsync d1/df/d10/d23/d3a/f4a 0 2023-12-16T20:11:25.741 INFO:tasks.workunit.client.0.smithi038.stdout:1/289: truncate d15/d1e/d30/f32 3377363 0 2023-12-16T20:11:25.741 INFO:tasks.workunit.client.0.smithi038.stdout:1/290: chown d15/d22/d52/l66 87597339 1 2023-12-16T20:11:25.747 INFO:tasks.workunit.client.0.smithi038.stdout:9/163: rmdir d9 39 2023-12-16T20:11:25.749 INFO:tasks.workunit.client.0.smithi038.stdout:5/194: dwrite d2/d14/f33 [0,4194304] 0 2023-12-16T20:11:25.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/291: dread d15/d1e/d30/f59 [0,4194304] 0 2023-12-16T20:11:25.749 INFO:tasks.workunit.client.0.smithi038.stdout:6/187: unlink d1/d4/d1d/l27 0 2023-12-16T20:11:25.749 INFO:tasks.workunit.client.0.smithi038.stdout:6/188: chown d1/d4/f1c 1039694663 1 2023-12-16T20:11:25.749 INFO:tasks.workunit.client.0.smithi038.stdout:6/189: chown d1/l3 0 1 2023-12-16T20:11:25.751 INFO:tasks.workunit.client.0.smithi038.stdout:0/167: unlink db/d16/d19/f2e 0 2023-12-16T20:11:25.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/183: dwrite da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:25.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/184: read da/dc/f2a [73217,104831] 0 2023-12-16T20:11:25.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/185: read - da/d21/d2c/f30 zero size 2023-12-16T20:11:25.756 INFO:tasks.workunit.client.0.smithi038.stdout:2/312: unlink d1/d5/d2a/d31/l34 0 2023-12-16T20:11:25.759 INFO:tasks.workunit.client.0.smithi038.stdout:5/195: mknod d2/d14/c3b 0 2023-12-16T20:11:25.759 INFO:tasks.workunit.client.0.smithi038.stdout:5/196: write d2/d14/f22 [70474,80900] 0 2023-12-16T20:11:25.760 INFO:tasks.workunit.client.0.smithi038.stdout:1/292: link l5 d15/d1e/d3b/d48/d3d/l68 0 2023-12-16T20:11:25.760 INFO:tasks.workunit.client.0.smithi038.stdout:1/293: creat d15/d1e/d23/d34/f69 x:0 0 0 2023-12-16T20:11:25.761 INFO:tasks.workunit.client.0.smithi038.stdout:6/190: symlink d1/d4/d1d/d28/d2f/l3e 0 2023-12-16T20:11:25.765 INFO:tasks.workunit.client.0.smithi038.stdout:0/168: creat db/f3c x:0 0 0 2023-12-16T20:11:25.766 INFO:tasks.workunit.client.0.smithi038.stdout:3/282: sync 2023-12-16T20:11:25.766 INFO:tasks.workunit.client.0.smithi038.stdout:8/178: getdents d17 0 2023-12-16T20:11:25.766 INFO:tasks.workunit.client.0.smithi038.stdout:9/164: dwrite d9/f2c [0,4194304] 0 2023-12-16T20:11:25.767 INFO:tasks.workunit.client.0.smithi038.stdout:9/165: stat d9/d1e 0 2023-12-16T20:11:25.769 INFO:tasks.workunit.client.0.smithi038.stdout:2/313: unlink d1/d5/c1f 0 2023-12-16T20:11:25.769 INFO:tasks.workunit.client.0.smithi038.stdout:2/314: creat d1/df/d10/f5e x:0 0 0 2023-12-16T20:11:25.770 INFO:tasks.workunit.client.0.smithi038.stdout:5/197: write d2/d4/fb [5609308,25901] 0 2023-12-16T20:11:25.770 INFO:tasks.workunit.client.0.smithi038.stdout:5/198: write f0 [9564164,36552] 0 2023-12-16T20:11:25.772 INFO:tasks.workunit.client.0.smithi038.stdout:2/315: dread d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:25.772 INFO:tasks.workunit.client.0.smithi038.stdout:2/316: write d1/df/d21/f45 [1243592,99336] 0 2023-12-16T20:11:25.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/294: creat d15/d1e/d3b/d48/d37/f6a x:0 0 0 2023-12-16T20:11:25.776 INFO:tasks.workunit.client.0.smithi038.stdout:6/191: unlink d1/d4/l6 0 2023-12-16T20:11:25.776 INFO:tasks.workunit.client.0.smithi038.stdout:6/192: truncate d1/f22 665054 0 2023-12-16T20:11:25.776 INFO:tasks.workunit.client.0.smithi038.stdout:5/199: write d2/f7 [3013521,79896] 0 2023-12-16T20:11:25.778 INFO:tasks.workunit.client.0.smithi038.stdout:0/169: creat db/f3d x:0 0 0 2023-12-16T20:11:25.778 INFO:tasks.workunit.client.0.smithi038.stdout:0/170: write db/f26 [227809,13134] 0 2023-12-16T20:11:25.781 INFO:tasks.workunit.client.0.smithi038.stdout:8/179: mkdir d17/d34 0 2023-12-16T20:11:25.790 INFO:tasks.workunit.client.0.smithi038.stdout:7/186: rmdir da/d21 39 2023-12-16T20:11:25.791 INFO:tasks.workunit.client.0.smithi038.stdout:7/187: dread - da/d21/d2c/f36 zero size 2023-12-16T20:11:25.791 INFO:tasks.workunit.client.0.smithi038.stdout:7/188: chown da/d21/d2c/f30 262197858 1 2023-12-16T20:11:25.793 INFO:tasks.workunit.client.0.smithi038.stdout:2/317: mkdir d1/df/d21/d5f 0 2023-12-16T20:11:25.794 INFO:tasks.workunit.client.0.smithi038.stdout:0/171: link db/f3d db/d16/d19/d27/f3e 0 2023-12-16T20:11:25.796 INFO:tasks.workunit.client.0.smithi038.stdout:8/180: truncate f5 3785591 0 2023-12-16T20:11:25.802 INFO:tasks.workunit.client.0.smithi038.stdout:7/189: read da/d21/d2c/d2e/f16 [454039,74986] 0 2023-12-16T20:11:25.804 INFO:tasks.workunit.client.0.smithi038.stdout:8/181: truncate f10 6886096 0 2023-12-16T20:11:25.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/283: dwrite d4/d18/f38 [0,4194304] 0 2023-12-16T20:11:25.818 INFO:tasks.workunit.client.0.smithi038.stdout:8/182: dread d17/d18/f1a [0,4194304] 0 2023-12-16T20:11:25.821 INFO:tasks.workunit.client.0.smithi038.stdout:3/284: write d4/d18/f34 [3014780,21779] 0 2023-12-16T20:11:25.821 INFO:tasks.workunit.client.0.smithi038.stdout:3/285: truncate d4/d27/d23/d26/f3e 456341 0 2023-12-16T20:11:25.823 INFO:tasks.workunit.client.0.smithi038.stdout:3/286: symlink d4/d8/d15/d2c/d4c/d58/l6b 0 2023-12-16T20:11:25.824 INFO:tasks.workunit.client.0.smithi038.stdout:3/287: getdents d4/d8 0 2023-12-16T20:11:25.824 INFO:tasks.workunit.client.0.smithi038.stdout:3/288: chown d4/d27/d2b/f63 1628 1 2023-12-16T20:11:25.825 INFO:tasks.workunit.client.0.smithi038.stdout:3/289: mkdir d4/d6c 0 2023-12-16T20:11:25.825 INFO:tasks.workunit.client.0.smithi038.stdout:3/290: chown d4/d27/d2b/f32 5512 1 2023-12-16T20:11:25.826 INFO:tasks.workunit.client.0.smithi038.stdout:3/291: mkdir d4/d8/d15/d6d 0 2023-12-16T20:11:25.827 INFO:tasks.workunit.client.0.smithi038.stdout:9/166: dwrite d9/fe [0,4194304] 0 2023-12-16T20:11:25.828 INFO:tasks.workunit.client.0.smithi038.stdout:6/193: dwrite d1/f38 [0,4194304] 0 2023-12-16T20:11:25.828 INFO:tasks.workunit.client.0.smithi038.stdout:6/194: truncate d1/f25 584383 0 2023-12-16T20:11:25.829 INFO:tasks.workunit.client.0.smithi038.stdout:9/167: rename d9/d1e/f27 to d9/d1e/f33 0 2023-12-16T20:11:25.829 INFO:tasks.workunit.client.0.smithi038.stdout:5/200: dwrite d2/df/d1a/d1f/f35 [0,4194304] 0 2023-12-16T20:11:25.829 INFO:tasks.workunit.client.0.smithi038.stdout:2/318: dwrite d1/d5/d2a/f35 [4194304,4194304] 0 2023-12-16T20:11:25.831 INFO:tasks.workunit.client.0.smithi038.stdout:7/190: dwrite da/d21/d2c/d2e/fe [0,4194304] 0 2023-12-16T20:11:25.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/172: dwrite f6 [0,4194304] 0 2023-12-16T20:11:25.832 INFO:tasks.workunit.client.0.smithi038.stdout:7/191: truncate da/dc/f2a 1501665 0 2023-12-16T20:11:25.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/168: symlink d9/d1e/l34 0 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/195: write d1/f19 [2930856,101874] 0 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/196: chown d1/d16/l15 133433 1 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/197: dread - d1/d4/d1d/d28/f37 zero size 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/198: dread - d1/d16/d23/f33 zero size 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/199: dread - d1/f39 zero size 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:2/319: mkdir d1/d5/d2a/d31/d60 0 2023-12-16T20:11:25.849 INFO:tasks.workunit.client.0.smithi038.stdout:2/320: chown d1/df/d10/d49 1421413 1 2023-12-16T20:11:25.850 INFO:tasks.workunit.client.0.smithi038.stdout:3/292: dwrite d4/d27/d2b/f63 [0,4194304] 0 2023-12-16T20:11:25.850 INFO:tasks.workunit.client.0.smithi038.stdout:3/293: read d4/d27/d2b/f32 [3194069,98647] 0 2023-12-16T20:11:25.853 INFO:tasks.workunit.client.0.smithi038.stdout:7/192: mkdir da/dc/d31/d38 0 2023-12-16T20:11:25.854 INFO:tasks.workunit.client.0.smithi038.stdout:7/193: dread - da/d21/d2c/f30 zero size 2023-12-16T20:11:25.854 INFO:tasks.workunit.client.0.smithi038.stdout:7/194: chown da/d21/f25 18305 1 2023-12-16T20:11:25.854 INFO:tasks.workunit.client.0.smithi038.stdout:5/201: dwrite d2/d14/f33 [0,4194304] 0 2023-12-16T20:11:25.854 INFO:tasks.workunit.client.0.smithi038.stdout:5/202: getdents d2/df 0 2023-12-16T20:11:25.855 INFO:tasks.workunit.client.0.smithi038.stdout:5/203: stat d2/d14/f22 0 2023-12-16T20:11:25.855 INFO:tasks.workunit.client.0.smithi038.stdout:9/169: getdents d9/d1f/d21 0 2023-12-16T20:11:25.859 INFO:tasks.workunit.client.0.smithi038.stdout:2/321: unlink d1/df/d10/d49/c4c 0 2023-12-16T20:11:25.859 INFO:tasks.workunit.client.0.smithi038.stdout:2/322: fdatasync d1/df/d10/f44 0 2023-12-16T20:11:25.859 INFO:tasks.workunit.client.0.smithi038.stdout:2/323: readlink d1/d5/d16/l22 0 2023-12-16T20:11:25.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/294: mkdir d4/d27/d23/d6e 0 2023-12-16T20:11:25.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/295: fdatasync d4/d18/f38 0 2023-12-16T20:11:25.860 INFO:tasks.workunit.client.0.smithi038.stdout:9/170: write d9/f1c [2684110,130143] 0 2023-12-16T20:11:25.862 INFO:tasks.workunit.client.0.smithi038.stdout:0/173: rename db/d16/d19/d27/c30 to db/c3f 0 2023-12-16T20:11:25.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/171: dread d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:25.878 INFO:tasks.workunit.client.0.smithi038.stdout:0/174: dwrite f5 [0,4194304] 0 2023-12-16T20:11:25.880 INFO:tasks.workunit.client.0.smithi038.stdout:8/183: link cf d17/d1d/c35 0 2023-12-16T20:11:25.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/200: getdents d1/d4/d1d/d28 0 2023-12-16T20:11:25.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/201: dread - d1/d4/d1d/f3b zero size 2023-12-16T20:11:25.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/202: stat d1/d4/f20 0 2023-12-16T20:11:25.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/203: write d1/f2c [5928162,67979] 0 2023-12-16T20:11:25.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/204: readlink d1/d2e/l30 0 2023-12-16T20:11:25.883 INFO:tasks.workunit.client.0.smithi038.stdout:2/324: mkdir d1/d5/d2a/d5d/d61 0 2023-12-16T20:11:25.885 INFO:tasks.workunit.client.0.smithi038.stdout:4/160: sync 2023-12-16T20:11:25.888 INFO:tasks.workunit.client.0.smithi038.stdout:9/172: unlink d9/d1e/l34 0 2023-12-16T20:11:25.888 INFO:tasks.workunit.client.0.smithi038.stdout:9/173: chown d9/f20 10520306 1 2023-12-16T20:11:25.889 INFO:tasks.workunit.client.0.smithi038.stdout:0/175: write f6 [3388328,8108] 0 2023-12-16T20:11:25.889 INFO:tasks.workunit.client.0.smithi038.stdout:0/176: chown f6 20947 1 2023-12-16T20:11:25.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/204: link d2/d4/ca d2/c3c 0 2023-12-16T20:11:25.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/205: stat d2/d14/l2b 0 2023-12-16T20:11:25.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/206: write d2/d14/f1e [6210823,35603] 0 2023-12-16T20:11:25.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/207: creat d2/df/d1a/d1f/f3d x:0 0 0 2023-12-16T20:11:25.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/208: chown d2/d4/l21 201163 1 2023-12-16T20:11:25.895 INFO:tasks.workunit.client.0.smithi038.stdout:2/325: dwrite d1/df/d10/f44 [0,4194304] 0 2023-12-16T20:11:25.896 INFO:tasks.workunit.client.0.smithi038.stdout:1/295: sync 2023-12-16T20:11:25.898 INFO:tasks.workunit.client.0.smithi038.stdout:8/184: creat d17/d34/f36 x:0 0 0 2023-12-16T20:11:25.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/205: rmdir d1/d2e 39 2023-12-16T20:11:25.902 INFO:tasks.workunit.client.0.smithi038.stdout:7/195: rename da/dc/f10 to da/dc/d31/f39 0 2023-12-16T20:11:25.904 INFO:tasks.workunit.client.0.smithi038.stdout:0/177: dwrite db/d16/d1c/f2a [0,4194304] 0 2023-12-16T20:11:25.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/174: creat d9/d1f/f35 x:0 0 0 2023-12-16T20:11:25.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/175: write d9/d1e/f33 [1195043,67604] 0 2023-12-16T20:11:25.911 INFO:tasks.workunit.client.0.smithi038.stdout:5/209: creat d2/d14/d25/d2d/f3e x:0 0 0 2023-12-16T20:11:25.913 INFO:tasks.workunit.client.0.smithi038.stdout:1/296: getdents d15/d22/d52 0 2023-12-16T20:11:25.915 INFO:tasks.workunit.client.0.smithi038.stdout:8/185: chown l7 1982149 1 2023-12-16T20:11:25.916 INFO:tasks.workunit.client.0.smithi038.stdout:8/186: dread - d17/d34/f36 zero size 2023-12-16T20:11:25.916 INFO:tasks.workunit.client.0.smithi038.stdout:7/196: unlink da/f23 0 2023-12-16T20:11:25.918 INFO:tasks.workunit.client.0.smithi038.stdout:6/206: dwrite d1/d16/f21 [0,4194304] 0 2023-12-16T20:11:25.918 INFO:tasks.workunit.client.0.smithi038.stdout:4/161: getdents d13 0 2023-12-16T20:11:25.920 INFO:tasks.workunit.client.0.smithi038.stdout:5/210: write d2/df/d1a/d1f/f35 [126512,86298] 0 2023-12-16T20:11:25.920 INFO:tasks.workunit.client.0.smithi038.stdout:5/211: stat d2/df/d1a/d2a 0 2023-12-16T20:11:25.922 INFO:tasks.workunit.client.0.smithi038.stdout:0/178: mknod db/d16/d19/c40 0 2023-12-16T20:11:25.926 INFO:tasks.workunit.client.0.smithi038.stdout:1/297: mknod d15/d1e/d3b/d48/c6b 0 2023-12-16T20:11:25.926 INFO:tasks.workunit.client.0.smithi038.stdout:1/298: chown d15/d4a 406651 1 2023-12-16T20:11:25.927 INFO:tasks.workunit.client.0.smithi038.stdout:8/187: symlink d17/d18/l37 0 2023-12-16T20:11:25.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/207: dread d1/d4/f20 [0,4194304] 0 2023-12-16T20:11:25.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/162: mkdir d13/d17/d2e/d32 0 2023-12-16T20:11:25.933 INFO:tasks.workunit.client.0.smithi038.stdout:1/299: getdents d15/d1e/d3b 0 2023-12-16T20:11:25.934 INFO:tasks.workunit.client.0.smithi038.stdout:8/188: write f1 [4751173,35164] 0 2023-12-16T20:11:25.935 INFO:tasks.workunit.client.0.smithi038.stdout:6/208: mknod d1/d4/d1d/d28/c3f 0 2023-12-16T20:11:25.937 INFO:tasks.workunit.client.0.smithi038.stdout:4/163: creat d13/d1c/f33 x:0 0 0 2023-12-16T20:11:25.937 INFO:tasks.workunit.client.0.smithi038.stdout:4/164: truncate d13/f2f 1023252 0 2023-12-16T20:11:25.937 INFO:tasks.workunit.client.0.smithi038.stdout:4/165: chown d13/d1f/d20 92056 1 2023-12-16T20:11:25.938 INFO:tasks.workunit.client.0.smithi038.stdout:5/212: rmdir d2/d14 39 2023-12-16T20:11:25.939 INFO:tasks.workunit.client.0.smithi038.stdout:8/189: read d17/d18/f1a [1352616,83883] 0 2023-12-16T20:11:25.939 INFO:tasks.workunit.client.0.smithi038.stdout:7/197: dwrite da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:25.939 INFO:tasks.workunit.client.0.smithi038.stdout:7/198: chown da/d21/d2c/d2e/f27 95087893 1 2023-12-16T20:11:25.940 INFO:tasks.workunit.client.0.smithi038.stdout:0/179: rename db/d16/d19/d27/c36 to db/c41 0 2023-12-16T20:11:25.941 INFO:tasks.workunit.client.0.smithi038.stdout:2/326: creat d1/df/f62 x:0 0 0 2023-12-16T20:11:25.941 INFO:tasks.workunit.client.0.smithi038.stdout:2/327: chown d1/df/d21 323 1 2023-12-16T20:11:25.942 INFO:tasks.workunit.client.0.smithi038.stdout:1/300: mknod d15/d1e/d23/d46/c6c 0 2023-12-16T20:11:25.942 INFO:tasks.workunit.client.0.smithi038.stdout:1/301: creat d15/d22/f6d x:0 0 0 2023-12-16T20:11:25.946 INFO:tasks.workunit.client.0.smithi038.stdout:5/213: creat d2/d14/d25/f3f x:0 0 0 2023-12-16T20:11:25.949 INFO:tasks.workunit.client.0.smithi038.stdout:0/180: truncate f3 3020269 0 2023-12-16T20:11:25.950 INFO:tasks.workunit.client.0.smithi038.stdout:0/181: fsync db/d16/d1c/f2c 0 2023-12-16T20:11:25.951 INFO:tasks.workunit.client.0.smithi038.stdout:2/328: truncate d1/df/d42/d43/f55 3223162 0 2023-12-16T20:11:25.951 INFO:tasks.workunit.client.0.smithi038.stdout:2/329: stat d1/d5/d2a/d31/d60 0 2023-12-16T20:11:25.952 INFO:tasks.workunit.client.0.smithi038.stdout:8/190: write d17/f20 [1093466,23015] 0 2023-12-16T20:11:25.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/209: dwrite d1/f22 [0,4194304] 0 2023-12-16T20:11:25.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/210: stat d1/l3 0 2023-12-16T20:11:25.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/211: write d1/d4/d1d/f2a [4886612,35585] 0 2023-12-16T20:11:25.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/212: fdatasync d1/d16/f21 0 2023-12-16T20:11:25.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/213: fdatasync d1/d16/f21 0 2023-12-16T20:11:25.955 INFO:tasks.workunit.client.0.smithi038.stdout:5/214: getdents d2/d14 0 2023-12-16T20:11:25.955 INFO:tasks.workunit.client.0.smithi038.stdout:7/199: unlink da/dc/c26 0 2023-12-16T20:11:25.956 INFO:tasks.workunit.client.0.smithi038.stdout:7/200: write f5 [1057993,9379] 0 2023-12-16T20:11:25.956 INFO:tasks.workunit.client.0.smithi038.stdout:7/201: dread - da/d21/d2c/d2e/f2d zero size 2023-12-16T20:11:25.956 INFO:tasks.workunit.client.0.smithi038.stdout:1/302: write fe [2180835,90263] 0 2023-12-16T20:11:25.956 INFO:tasks.workunit.client.0.smithi038.stdout:1/303: truncate d15/d1e/d3b/d48/f36 4451603 0 2023-12-16T20:11:25.956 INFO:tasks.workunit.client.0.smithi038.stdout:4/166: fsync d13/d1c/f33 0 2023-12-16T20:11:25.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/330: mknod d1/df/d42/d43/c63 0 2023-12-16T20:11:25.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/331: truncate d1/df/d10/f5e 966823 0 2023-12-16T20:11:25.958 INFO:tasks.workunit.client.0.smithi038.stdout:8/191: fsync f5 0 2023-12-16T20:11:25.960 INFO:tasks.workunit.client.0.smithi038.stdout:2/332: write d1/df/d21/f45 [245167,43456] 0 2023-12-16T20:11:25.960 INFO:tasks.workunit.client.0.smithi038.stdout:2/333: write d1/df/d42/d43/d57/f5a [960675,106623] 0 2023-12-16T20:11:25.963 INFO:tasks.workunit.client.0.smithi038.stdout:7/202: dread da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:25.969 INFO:tasks.workunit.client.0.smithi038.stdout:5/215: creat d2/d14/f40 x:0 0 0 2023-12-16T20:11:25.972 INFO:tasks.workunit.client.0.smithi038.stdout:0/182: link l7 db/d16/d19/d27/l42 0 2023-12-16T20:11:25.972 INFO:tasks.workunit.client.0.smithi038.stdout:0/183: dread - db/f3d zero size 2023-12-16T20:11:25.972 INFO:tasks.workunit.client.0.smithi038.stdout:0/184: stat f3 0 2023-12-16T20:11:25.973 INFO:tasks.workunit.client.0.smithi038.stdout:8/192: creat d17/f38 x:0 0 0 2023-12-16T20:11:25.975 INFO:tasks.workunit.client.0.smithi038.stdout:2/334: creat d1/df/d10/d23/f64 x:0 0 0 2023-12-16T20:11:25.975 INFO:tasks.workunit.client.0.smithi038.stdout:2/335: chown d1/d5/d2a/c33 1 1 2023-12-16T20:11:25.976 INFO:tasks.workunit.client.0.smithi038.stdout:5/216: link d2/f11 d2/df/d1a/d2a/f41 0 2023-12-16T20:11:25.979 INFO:tasks.workunit.client.0.smithi038.stdout:0/185: link db/d16/d1c/f2c db/d16/d19/f43 0 2023-12-16T20:11:25.980 INFO:tasks.workunit.client.0.smithi038.stdout:8/193: stat l15 0 2023-12-16T20:11:25.981 INFO:tasks.workunit.client.0.smithi038.stdout:7/203: rename da/d21/d2c/d2e/fe to da/dc/f3a 0 2023-12-16T20:11:25.983 INFO:tasks.workunit.client.0.smithi038.stdout:6/214: dwrite d1/f22 [0,4194304] 0 2023-12-16T20:11:25.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/217: creat d2/d14/d25/d2d/d17/f42 x:0 0 0 2023-12-16T20:11:25.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/218: write d2/df/d1a/d2a/f3a [93237,118994] 0 2023-12-16T20:11:25.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/219: fsync d2/d14/f1e 0 2023-12-16T20:11:25.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/220: dread - d2/df/d1a/d1f/f32 zero size 2023-12-16T20:11:25.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/304: dwrite d15/d1e/d23/d46/f63 [0,4194304] 0 2023-12-16T20:11:25.985 INFO:tasks.workunit.client.0.smithi038.stdout:4/167: rmdir d13/d1f/d20 0 2023-12-16T20:11:25.986 INFO:tasks.workunit.client.0.smithi038.stdout:0/186: creat db/f44 x:0 0 0 2023-12-16T20:11:25.987 INFO:tasks.workunit.client.0.smithi038.stdout:6/215: mkdir d1/d4/d1d/d28/d2f/d3d/d40 0 2023-12-16T20:11:25.989 INFO:tasks.workunit.client.0.smithi038.stdout:5/221: link d2/d14/c3b d2/d14/d25/c43 0 2023-12-16T20:11:25.992 INFO:tasks.workunit.client.0.smithi038.stdout:4/168: mkdir d13/d1f/d22/d34 0 2023-12-16T20:11:25.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/336: dwrite d1/d5/f4d [0,4194304] 0 2023-12-16T20:11:25.995 INFO:tasks.workunit.client.0.smithi038.stdout:6/216: rename d1/d4/d1d/f32 to d1/d4/d1d/d28/f41 0 2023-12-16T20:11:25.996 INFO:tasks.workunit.client.0.smithi038.stdout:6/217: chown d1/d4/d1d/d28/c3f 0 1 2023-12-16T20:11:25.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/222: mkdir d2/d14/d44 0 2023-12-16T20:11:25.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/223: fsync d2/d14/d25/d2d/d17/f19 0 2023-12-16T20:11:25.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/224: dread - d2/d14/d25/f3f zero size 2023-12-16T20:11:25.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/225: chown d2/d14/f1e 5 1 2023-12-16T20:11:25.998 INFO:tasks.workunit.client.0.smithi038.stdout:8/194: dwrite d17/d1d/f21 [0,4194304] 0 2023-12-16T20:11:25.998 INFO:tasks.workunit.client.0.smithi038.stdout:0/187: symlink db/l45 0 2023-12-16T20:11:25.998 INFO:tasks.workunit.client.0.smithi038.stdout:1/305: dread f11 [0,4194304] 0 2023-12-16T20:11:25.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/188: creat db/d16/d19/f46 x:0 0 0 2023-12-16T20:11:26.004 INFO:tasks.workunit.client.0.smithi038.stdout:6/218: dread d1/d4/d1d/f1e [0,4194304] 0 2023-12-16T20:11:26.007 INFO:tasks.workunit.client.0.smithi038.stdout:7/204: dwrite da/dc/d31/f39 [0,4194304] 0 2023-12-16T20:11:26.010 INFO:tasks.workunit.client.0.smithi038.stdout:6/219: write d1/f2c [1761158,28727] 0 2023-12-16T20:11:26.011 INFO:tasks.workunit.client.0.smithi038.stdout:2/337: rename d1/df/l26 to d1/df/d10/d49/l65 0 2023-12-16T20:11:26.014 INFO:tasks.workunit.client.0.smithi038.stdout:1/306: symlink d15/d1e/d23/l6e 0 2023-12-16T20:11:26.015 INFO:tasks.workunit.client.0.smithi038.stdout:7/205: getdents da/d21/d2c/d2e 0 2023-12-16T20:11:26.016 INFO:tasks.workunit.client.0.smithi038.stdout:5/226: dwrite f0 [8388608,4194304] 0 2023-12-16T20:11:26.016 INFO:tasks.workunit.client.0.smithi038.stdout:5/227: chown d2/d14/c3b 18398 1 2023-12-16T20:11:26.017 INFO:tasks.workunit.client.0.smithi038.stdout:2/338: mkdir d1/d5/d2a/d5d/d61/d66 0 2023-12-16T20:11:26.017 INFO:tasks.workunit.client.0.smithi038.stdout:8/195: unlink f9 0 2023-12-16T20:11:26.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/189: symlink db/l47 0 2023-12-16T20:11:26.022 INFO:tasks.workunit.client.0.smithi038.stdout:1/307: creat d15/d1e/d3b/d48/f6f x:0 0 0 2023-12-16T20:11:26.025 INFO:tasks.workunit.client.0.smithi038.stdout:8/196: dread d17/f20 [0,4194304] 0 2023-12-16T20:11:26.025 INFO:tasks.workunit.client.0.smithi038.stdout:8/197: truncate d17/f20 9267933 0 2023-12-16T20:11:26.025 INFO:tasks.workunit.client.0.smithi038.stdout:5/228: getdents d2/d14/d25 0 2023-12-16T20:11:26.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/308: symlink d15/l70 0 2023-12-16T20:11:26.027 INFO:tasks.workunit.client.0.smithi038.stdout:8/198: chown ca 133 1 2023-12-16T20:11:26.031 INFO:tasks.workunit.client.0.smithi038.stdout:3/296: sync 2023-12-16T20:11:26.035 INFO:tasks.workunit.client.0.smithi038.stdout:8/199: unlink d17/d1b/c29 0 2023-12-16T20:11:26.039 INFO:tasks.workunit.client.0.smithi038.stdout:3/297: symlink d4/d27/l6f 0 2023-12-16T20:11:26.042 INFO:tasks.workunit.client.0.smithi038.stdout:3/298: mkdir d4/d8/d15/d2c/d4c/d70 0 2023-12-16T20:11:26.043 INFO:tasks.workunit.client.0.smithi038.stdout:8/200: dread d17/f20 [4194304,4194304] 0 2023-12-16T20:11:26.043 INFO:tasks.workunit.client.0.smithi038.stdout:8/201: stat d17/d18/f1a 0 2023-12-16T20:11:26.043 INFO:tasks.workunit.client.0.smithi038.stdout:8/202: chown d17/d1d/c35 245147 1 2023-12-16T20:11:26.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/206: dwrite da/dc/f3a [4194304,4194304] 0 2023-12-16T20:11:26.045 INFO:tasks.workunit.client.0.smithi038.stdout:9/176: sync 2023-12-16T20:11:26.045 INFO:tasks.workunit.client.0.smithi038.stdout:8/203: rename d17/d1b/c33 to d17/d1d/c39 0 2023-12-16T20:11:26.047 INFO:tasks.workunit.client.0.smithi038.stdout:7/207: mkdir da/d3b 0 2023-12-16T20:11:26.047 INFO:tasks.workunit.client.0.smithi038.stdout:9/177: symlink d9/d1f/d21/l36 0 2023-12-16T20:11:26.048 INFO:tasks.workunit.client.0.smithi038.stdout:9/178: chown d9/l31 5325099 1 2023-12-16T20:11:26.048 INFO:tasks.workunit.client.0.smithi038.stdout:8/204: mknod d17/d34/c3a 0 2023-12-16T20:11:26.049 INFO:tasks.workunit.client.0.smithi038.stdout:7/208: rmdir da/d21/d2c 39 2023-12-16T20:11:26.049 INFO:tasks.workunit.client.0.smithi038.stdout:9/179: creat d9/d1e/f37 x:0 0 0 2023-12-16T20:11:26.050 INFO:tasks.workunit.client.0.smithi038.stdout:8/205: creat d17/f3b x:0 0 0 2023-12-16T20:11:26.055 INFO:tasks.workunit.client.0.smithi038.stdout:7/209: write da/f19 [915283,17862] 0 2023-12-16T20:11:26.057 INFO:tasks.workunit.client.0.smithi038.stdout:0/190: dwrite db/d16/d19/f43 [0,4194304] 0 2023-12-16T20:11:26.057 INFO:tasks.workunit.client.0.smithi038.stdout:0/191: creat db/d16/d1c/f48 x:0 0 0 2023-12-16T20:11:26.057 INFO:tasks.workunit.client.0.smithi038.stdout:2/339: dwrite d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:2/340: truncate d1/d5/f7 9458631 0 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:1/309: dwrite d15/f19 [0,4194304] 0 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/229: dwrite d2/df/d1a/d1f/f32 [0,4194304] 0 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/230: fdatasync d2/d4/fb 0 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/231: chown d2/d4/f1c 4477 1 2023-12-16T20:11:26.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/232: readlink d2/l8 0 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/310: dread f11 [0,4194304] 0 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/311: chown d15/c1c 28928 1 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/312: readlink l4 0 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/313: getdents d15/d1e/d3b/d48/d5e 0 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/314: write d15/d1e/d3b/d48/d37/f41 [1246889,11653] 0 2023-12-16T20:11:26.062 INFO:tasks.workunit.client.0.smithi038.stdout:1/315: write f10 [4439899,69629] 0 2023-12-16T20:11:26.063 INFO:tasks.workunit.client.0.smithi038.stdout:0/192: truncate f6 2503913 0 2023-12-16T20:11:26.063 INFO:tasks.workunit.client.0.smithi038.stdout:0/193: dread - db/d16/d19/d27/f3b zero size 2023-12-16T20:11:26.066 INFO:tasks.workunit.client.0.smithi038.stdout:9/180: getdents d9/d1f/d21 0 2023-12-16T20:11:26.067 INFO:tasks.workunit.client.0.smithi038.stdout:9/181: fdatasync d9/f18 0 2023-12-16T20:11:26.067 INFO:tasks.workunit.client.0.smithi038.stdout:9/182: creat d9/d1f/f38 x:0 0 0 2023-12-16T20:11:26.067 INFO:tasks.workunit.client.0.smithi038.stdout:2/341: symlink d1/df/d42/l67 0 2023-12-16T20:11:26.070 INFO:tasks.workunit.client.0.smithi038.stdout:5/233: unlink d2/d14/c20 0 2023-12-16T20:11:26.071 INFO:tasks.workunit.client.0.smithi038.stdout:1/316: mkdir d15/d22/d71 0 2023-12-16T20:11:26.071 INFO:tasks.workunit.client.0.smithi038.stdout:1/317: creat d15/d1e/d23/d46/f72 x:0 0 0 2023-12-16T20:11:26.073 INFO:tasks.workunit.client.0.smithi038.stdout:0/194: unlink db/ff 0 2023-12-16T20:11:26.073 INFO:tasks.workunit.client.0.smithi038.stdout:0/195: chown db/c13 5155303 1 2023-12-16T20:11:26.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/210: dwrite da/f1b [0,4194304] 0 2023-12-16T20:11:26.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/211: chown da/l32 953608678 1 2023-12-16T20:11:26.076 INFO:tasks.workunit.client.0.smithi038.stdout:9/183: symlink d9/l39 0 2023-12-16T20:11:26.077 INFO:tasks.workunit.client.0.smithi038.stdout:7/212: dread da/d21/d2c/d2e/f27 [0,4194304] 0 2023-12-16T20:11:26.077 INFO:tasks.workunit.client.0.smithi038.stdout:2/342: link d1/df/d21/l2d d1/l68 0 2023-12-16T20:11:26.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/234: link d2/f9 d2/d14/d25/d2d/f45 0 2023-12-16T20:11:26.089 INFO:tasks.workunit.client.0.smithi038.stdout:0/196: getdents db/d1a 0 2023-12-16T20:11:26.089 INFO:tasks.workunit.client.0.smithi038.stdout:0/197: fdatasync db/d1a/f33 0 2023-12-16T20:11:26.090 INFO:tasks.workunit.client.0.smithi038.stdout:1/318: dwrite f7 [0,4194304] 0 2023-12-16T20:11:26.090 INFO:tasks.workunit.client.0.smithi038.stdout:1/319: chown d15/f17 1199293 1 2023-12-16T20:11:26.091 INFO:tasks.workunit.client.0.smithi038.stdout:1/320: dread - d15/d22/f6d zero size 2023-12-16T20:11:26.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/198: mkdir db/d49 0 2023-12-16T20:11:26.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/199: fdatasync db/d16/d19/f23 0 2023-12-16T20:11:26.096 INFO:tasks.workunit.client.0.smithi038.stdout:1/321: getdents d15/d1e/d23 0 2023-12-16T20:11:26.099 INFO:tasks.workunit.client.0.smithi038.stdout:0/200: rmdir db/d16/d1c 39 2023-12-16T20:11:26.101 INFO:tasks.workunit.client.0.smithi038.stdout:0/201: unlink db/d16/d1c/f1d 0 2023-12-16T20:11:26.101 INFO:tasks.workunit.client.0.smithi038.stdout:0/202: dread - db/d16/d19/d27/f3b zero size 2023-12-16T20:11:26.101 INFO:tasks.workunit.client.0.smithi038.stdout:0/203: truncate db/f3d 517351 0 2023-12-16T20:11:26.104 INFO:tasks.workunit.client.0.smithi038.stdout:1/322: dread f8 [0,4194304] 0 2023-12-16T20:11:26.104 INFO:tasks.workunit.client.0.smithi038.stdout:0/204: link ca db/d1a/c4a 0 2023-12-16T20:11:26.104 INFO:tasks.workunit.client.0.smithi038.stdout:0/205: creat db/d16/d19/f4b x:0 0 0 2023-12-16T20:11:26.115 INFO:tasks.workunit.client.0.smithi038.stdout:2/343: dwrite d1/df/d21/f3c [0,4194304] 0 2023-12-16T20:11:26.116 INFO:tasks.workunit.client.0.smithi038.stdout:2/344: dread - d1/df/d42/f59 zero size 2023-12-16T20:11:26.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/235: dwrite d2/d14/d25/f3f [0,4194304] 0 2023-12-16T20:11:26.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/236: creat d2/df/d1a/f46 x:0 0 0 2023-12-16T20:11:26.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/237: creat d2/df/d1a/f47 x:0 0 0 2023-12-16T20:11:26.117 INFO:tasks.workunit.client.0.smithi038.stdout:4/169: sync 2023-12-16T20:11:26.117 INFO:tasks.workunit.client.0.smithi038.stdout:7/213: dwrite da/d21/f34 [0,4194304] 0 2023-12-16T20:11:26.123 INFO:tasks.workunit.client.0.smithi038.stdout:4/170: mkdir d13/d1f/d35 0 2023-12-16T20:11:26.125 INFO:tasks.workunit.client.0.smithi038.stdout:7/214: creat da/d21/d2c/d2e/f3c x:0 0 0 2023-12-16T20:11:26.126 INFO:tasks.workunit.client.0.smithi038.stdout:5/238: mknod d2/c48 0 2023-12-16T20:11:26.126 INFO:tasks.workunit.client.0.smithi038.stdout:4/171: creat d13/d17/f36 x:0 0 0 2023-12-16T20:11:26.127 INFO:tasks.workunit.client.0.smithi038.stdout:4/172: stat d13/c14 0 2023-12-16T20:11:26.127 INFO:tasks.workunit.client.0.smithi038.stdout:4/173: write fa [2990033,1876] 0 2023-12-16T20:11:26.128 INFO:tasks.workunit.client.0.smithi038.stdout:7/215: unlink da/dc/l18 0 2023-12-16T20:11:26.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/323: dwrite d15/d22/f53 [0,4194304] 0 2023-12-16T20:11:26.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/324: truncate d15/d22/f4b 797615 0 2023-12-16T20:11:26.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/325: fsync d15/f1d 0 2023-12-16T20:11:26.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/326: fsync d15/d1e/d3b/d48/d37/f47 0 2023-12-16T20:11:26.134 INFO:tasks.workunit.client.0.smithi038.stdout:1/327: write d15/d1e/f4c [801421,90414] 0 2023-12-16T20:11:26.136 INFO:tasks.workunit.client.0.smithi038.stdout:4/174: dread d13/f19 [0,4194304] 0 2023-12-16T20:11:26.136 INFO:tasks.workunit.client.0.smithi038.stdout:2/345: dwrite d1/df/d10/f50 [0,4194304] 0 2023-12-16T20:11:26.136 INFO:tasks.workunit.client.0.smithi038.stdout:2/346: fsync d1/df/d10/f44 0 2023-12-16T20:11:26.136 INFO:tasks.workunit.client.0.smithi038.stdout:0/206: dwrite db/d16/d19/f43 [0,4194304] 0 2023-12-16T20:11:26.141 INFO:tasks.workunit.client.0.smithi038.stdout:1/328: symlink d15/d22/d71/l73 0 2023-12-16T20:11:26.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:25 smithi038 ceph-mon[80659]: pgmap v173: 65 pgs: 65 active+clean; 360 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 22 MiB/s wr, 331 op/s 2023-12-16T20:11:26.145 INFO:tasks.workunit.client.0.smithi038.stdout:4/175: creat d13/f37 x:0 0 0 2023-12-16T20:11:26.147 INFO:tasks.workunit.client.0.smithi038.stdout:1/329: mkdir d15/d1e/d23/d42/d74 0 2023-12-16T20:11:26.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/176: rename f9 to d13/d1f/d35/f38 0 2023-12-16T20:11:26.152 INFO:tasks.workunit.client.0.smithi038.stdout:1/330: rename d15/d1e/d23/d42/d74 to d15/d1e/d23/d42/d75 0 2023-12-16T20:11:26.154 INFO:tasks.workunit.client.0.smithi038.stdout:4/177: unlink d13/d17/c1a 0 2023-12-16T20:11:26.154 INFO:tasks.workunit.client.0.smithi038.stdout:5/239: dwrite d2/d14/f22 [0,4194304] 0 2023-12-16T20:11:26.155 INFO:tasks.workunit.client.0.smithi038.stdout:1/331: unlink d15/d1e/d30/c33 0 2023-12-16T20:11:26.155 INFO:tasks.workunit.client.0.smithi038.stdout:1/332: fsync d15/f1a 0 2023-12-16T20:11:26.156 INFO:tasks.workunit.client.0.smithi038.stdout:4/178: creat d13/d17/d2e/d32/f39 x:0 0 0 2023-12-16T20:11:26.156 INFO:tasks.workunit.client.0.smithi038.stdout:4/179: chown d13/d17/f36 3569 1 2023-12-16T20:11:26.156 INFO:tasks.workunit.client.0.smithi038.stdout:4/180: read f6 [2252886,129569] 0 2023-12-16T20:11:26.157 INFO:tasks.workunit.client.0.smithi038.stdout:1/333: link d15/d22/d52/l57 d15/d1e/d23/d42/l76 0 2023-12-16T20:11:26.161 INFO:tasks.workunit.client.0.smithi038.stdout:7/216: dwrite da/dc/f2a [0,4194304] 0 2023-12-16T20:11:26.161 INFO:tasks.workunit.client.0.smithi038.stdout:0/207: dwrite db/d1a/f33 [0,4194304] 0 2023-12-16T20:11:26.164 INFO:tasks.workunit.client.0.smithi038.stdout:1/334: dread d15/d1e/d3b/d48/f36 [0,4194304] 0 2023-12-16T20:11:26.168 INFO:tasks.workunit.client.0.smithi038.stdout:5/240: dread f0 [0,4194304] 0 2023-12-16T20:11:26.169 INFO:tasks.workunit.client.0.smithi038.stdout:1/335: creat d15/d1e/d3b/f77 x:0 0 0 2023-12-16T20:11:26.173 INFO:tasks.workunit.client.0.smithi038.stdout:4/181: rmdir d13 39 2023-12-16T20:11:26.174 INFO:tasks.workunit.client.0.smithi038.stdout:0/208: dread f5 [0,4194304] 0 2023-12-16T20:11:26.175 INFO:tasks.workunit.client.0.smithi038.stdout:4/182: creat d13/d1f/f3a x:0 0 0 2023-12-16T20:11:26.176 INFO:tasks.workunit.client.0.smithi038.stdout:5/241: dread d2/d4/f1c [0,4194304] 0 2023-12-16T20:11:26.177 INFO:tasks.workunit.client.0.smithi038.stdout:4/183: mknod d13/d1c/c3b 0 2023-12-16T20:11:26.178 INFO:tasks.workunit.client.0.smithi038.stdout:5/242: truncate d2/df/d1a/f27 2720941 0 2023-12-16T20:11:26.179 INFO:tasks.workunit.client.0.smithi038.stdout:5/243: truncate d2/d14/d25/d2d/d17/f42 551776 0 2023-12-16T20:11:26.179 INFO:tasks.workunit.client.0.smithi038.stdout:7/217: dwrite da/f19 [0,4194304] 0 2023-12-16T20:11:26.180 INFO:tasks.workunit.client.0.smithi038.stdout:5/244: getdents d2/d4 0 2023-12-16T20:11:26.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/245: mknod d2/d14/d25/d2d/c49 0 2023-12-16T20:11:26.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/246: write d2/d14/d25/d2d/f31 [935134,69093] 0 2023-12-16T20:11:26.182 INFO:tasks.workunit.client.0.smithi038.stdout:6/220: sync 2023-12-16T20:11:26.184 INFO:tasks.workunit.client.0.smithi038.stdout:5/247: mkdir d2/df/d1a/d1f/d4a 0 2023-12-16T20:11:26.184 INFO:tasks.workunit.client.0.smithi038.stdout:5/248: write d2/d14/f22 [4304814,49482] 0 2023-12-16T20:11:26.185 INFO:tasks.workunit.client.0.smithi038.stdout:6/221: symlink d1/d2e/l42 0 2023-12-16T20:11:26.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/249: mkdir d2/d14/d25/d2d/d4b 0 2023-12-16T20:11:26.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/250: truncate d2/df/d1a/f46 69998 0 2023-12-16T20:11:26.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/251: truncate d2/d14/d25/d2d/f2c 117934 0 2023-12-16T20:11:26.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/252: readlink d2/d14/d25/d2d/d17/l23 0 2023-12-16T20:11:26.188 INFO:tasks.workunit.client.0.smithi038.stdout:5/253: write d2/d14/d25/d2d/d17/f19 [918139,63815] 0 2023-12-16T20:11:26.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/336: dwrite d15/d1e/d23/d34/f5d [0,4194304] 0 2023-12-16T20:11:26.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/337: chown d15/d1e/d30 98127425 1 2023-12-16T20:11:26.190 INFO:tasks.workunit.client.0.smithi038.stdout:6/222: unlink d1/f1b 0 2023-12-16T20:11:26.190 INFO:tasks.workunit.client.0.smithi038.stdout:6/223: write d1/d16/f21 [4950339,95358] 0 2023-12-16T20:11:26.195 INFO:tasks.workunit.client.0.smithi038.stdout:1/338: dread f11 [0,4194304] 0 2023-12-16T20:11:26.200 INFO:tasks.workunit.client.0.smithi038.stdout:6/224: creat d1/d2e/f43 x:0 0 0 2023-12-16T20:11:26.200 INFO:tasks.workunit.client.0.smithi038.stdout:6/225: truncate d1/fe 1024136 0 2023-12-16T20:11:26.201 INFO:tasks.workunit.client.0.smithi038.stdout:1/339: creat d15/d1e/d23/f78 x:0 0 0 2023-12-16T20:11:26.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/226: creat d1/d16/f44 x:0 0 0 2023-12-16T20:11:26.202 INFO:tasks.workunit.client.0.smithi038.stdout:7/218: write da/dc/d31/f39 [3902528,6585] 0 2023-12-16T20:11:26.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/227: creat d1/f45 x:0 0 0 2023-12-16T20:11:26.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/340: mkdir d15/d1e/d23/d34/d79 0 2023-12-16T20:11:26.205 INFO:tasks.workunit.client.0.smithi038.stdout:6/228: link d1/f2c d1/d4/d1d/d28/d2f/d3d/f46 0 2023-12-16T20:11:26.206 INFO:tasks.workunit.client.0.smithi038.stdout:6/229: creat d1/d2e/f47 x:0 0 0 2023-12-16T20:11:26.206 INFO:tasks.workunit.client.0.smithi038.stdout:1/341: truncate d15/d1e/f4c 507137 0 2023-12-16T20:11:26.206 INFO:tasks.workunit.client.0.smithi038.stdout:1/342: creat d15/d1e/d23/d34/f7a x:0 0 0 2023-12-16T20:11:26.214 INFO:tasks.workunit.client.0.smithi038.stdout:1/343: write d15/f19 [4004660,2502] 0 2023-12-16T20:11:26.215 INFO:tasks.workunit.client.0.smithi038.stdout:0/209: dwrite db/d16/d19/d27/f34 [0,4194304] 0 2023-12-16T20:11:26.215 INFO:tasks.workunit.client.0.smithi038.stdout:0/210: chown db/d16/d19/c22 28 1 2023-12-16T20:11:26.215 INFO:tasks.workunit.client.0.smithi038.stdout:4/184: dwrite f6 [0,4194304] 0 2023-12-16T20:11:26.215 INFO:tasks.workunit.client.0.smithi038.stdout:5/254: dwrite d2/d14/d25/d2d/f31 [0,4194304] 0 2023-12-16T20:11:26.215 INFO:tasks.workunit.client.0.smithi038.stdout:0/211: dread f1 [0,4194304] 0 2023-12-16T20:11:26.216 INFO:tasks.workunit.client.0.smithi038.stdout:0/212: dread db/d16/d19/d27/f3e [0,4194304] 0 2023-12-16T20:11:26.219 INFO:tasks.workunit.client.0.smithi038.stdout:1/344: mkdir d15/d22/d7b 0 2023-12-16T20:11:26.219 INFO:tasks.workunit.client.0.smithi038.stdout:1/345: chown d15/d1e/f4c 915985 1 2023-12-16T20:11:26.220 INFO:tasks.workunit.client.0.smithi038.stdout:4/185: rename f6 to d13/f3c 0 2023-12-16T20:11:26.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/255: creat d2/d4/f4c x:0 0 0 2023-12-16T20:11:26.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/256: chown d2/df/d1a/d1f/d4a 395831 1 2023-12-16T20:11:26.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/346: dread d15/d1e/d23/f35 [0,4194304] 0 2023-12-16T20:11:26.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/347: write d15/d1e/d3b/d48/d37/f3c [1303185,102854] 0 2023-12-16T20:11:26.230 INFO:tasks.workunit.client.0.smithi038.stdout:0/213: rename db/d16/d19/d27/f3e to db/d16/d19/d27/f4c 0 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:1/348: mknod d15/d22/d62/c7c 0 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:3/299: sync 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:9/184: sync 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/206: sync 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:3/300: fdatasync d4/d8/d15/d2c/f53 0 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:9/185: write d9/f1c [1984950,69966] 0 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:9/186: readlink d9/l12 0 2023-12-16T20:11:26.232 INFO:tasks.workunit.client.0.smithi038.stdout:9/187: write d9/d1e/f2b [1098964,48171] 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:4/186: write d13/f26 [1665270,41357] 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/349: unlink f8 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/350: chown d15/d22/f53 0 1 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/351: fsync d15/d1e/d3b/d48/f36 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:9/188: dread d9/f1a [0,4194304] 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:8/207: creat d17/d1b/d25/f3c x:0 0 0 2023-12-16T20:11:26.236 INFO:tasks.workunit.client.0.smithi038.stdout:3/301: mkdir d4/d8/d15/d2c/d4c/d70/d71 0 2023-12-16T20:11:26.239 INFO:tasks.workunit.client.0.smithi038.stdout:4/187: creat d13/d17/d2e/f3d x:0 0 0 2023-12-16T20:11:26.241 INFO:tasks.workunit.client.0.smithi038.stdout:1/352: mkdir d15/d1e/d23/d7d 0 2023-12-16T20:11:26.241 INFO:tasks.workunit.client.0.smithi038.stdout:6/230: dwrite d1/d16/f21 [0,4194304] 0 2023-12-16T20:11:26.241 INFO:tasks.workunit.client.0.smithi038.stdout:3/302: dread d4/d18/f34 [0,4194304] 0 2023-12-16T20:11:26.242 INFO:tasks.workunit.client.0.smithi038.stdout:9/189: truncate d9/d1f/f22 888288 0 2023-12-16T20:11:26.244 INFO:tasks.workunit.client.0.smithi038.stdout:8/208: mkdir d17/d34/d3d 0 2023-12-16T20:11:26.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:25 smithi141 ceph-mon[88165]: pgmap v173: 65 pgs: 65 active+clean; 360 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 22 MiB/s wr, 331 op/s 2023-12-16T20:11:26.245 INFO:tasks.workunit.client.0.smithi038.stdout:5/257: dwrite d2/d14/d25/d2d/d17/f19 [0,4194304] 0 2023-12-16T20:11:26.246 INFO:tasks.workunit.client.0.smithi038.stdout:3/303: dread d4/d27/d2b/f35 [0,4194304] 0 2023-12-16T20:11:26.247 INFO:tasks.workunit.client.0.smithi038.stdout:6/231: creat d1/d4/d1d/d28/d2f/d3d/f48 x:0 0 0 2023-12-16T20:11:26.251 INFO:tasks.workunit.client.0.smithi038.stdout:5/258: creat d2/d14/d44/f4d x:0 0 0 2023-12-16T20:11:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:0/214: dwrite db/d16/d1c/f48 [0,4194304] 0 2023-12-16T20:11:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:0/215: chown db/d1a/l39 117135 1 2023-12-16T20:11:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:0/216: fdatasync db/f14 0 2023-12-16T20:11:26.253 INFO:tasks.workunit.client.0.smithi038.stdout:3/304: rename d4/d8/d15/f6a to d4/d27/d2b/d64/f72 0 2023-12-16T20:11:26.255 INFO:tasks.workunit.client.0.smithi038.stdout:6/232: creat d1/d4/f49 x:0 0 0 2023-12-16T20:11:26.259 INFO:tasks.workunit.client.0.smithi038.stdout:1/353: dread d15/d1e/d23/f39 [0,4194304] 0 2023-12-16T20:11:26.259 INFO:tasks.workunit.client.0.smithi038.stdout:1/354: chown d15/d1e/d3b/d48/d37/f47 167486 1 2023-12-16T20:11:26.262 INFO:tasks.workunit.client.0.smithi038.stdout:2/347: sync 2023-12-16T20:11:26.262 INFO:tasks.workunit.client.0.smithi038.stdout:2/348: fdatasync d1/d5/d16/f2e 0 2023-12-16T20:11:26.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/305: symlink d4/d8/d15/d6d/l73 0 2023-12-16T20:11:26.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/306: truncate d4/d27/d23/f2e 622968 0 2023-12-16T20:11:26.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/307: readlink d4/d8/d15/d2c/d4c/d58/l61 0 2023-12-16T20:11:26.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/308: dread - d4/d18/f66 zero size 2023-12-16T20:11:26.266 INFO:tasks.workunit.client.0.smithi038.stdout:9/190: write d9/fe [3410545,84558] 0 2023-12-16T20:11:26.267 INFO:tasks.workunit.client.0.smithi038.stdout:9/191: chown d9/d1e 22 1 2023-12-16T20:11:26.267 INFO:tasks.workunit.client.0.smithi038.stdout:9/192: chown d9/d1f/f38 60892 1 2023-12-16T20:11:26.267 INFO:tasks.workunit.client.0.smithi038.stdout:4/188: dwrite d13/f3c [0,4194304] 0 2023-12-16T20:11:26.267 INFO:tasks.workunit.client.0.smithi038.stdout:1/355: mknod d15/d1e/d23/d34/c7e 0 2023-12-16T20:11:26.268 INFO:tasks.workunit.client.0.smithi038.stdout:5/259: write d2/d14/f22 [3276107,79512] 0 2023-12-16T20:11:26.269 INFO:tasks.workunit.client.0.smithi038.stdout:0/217: rmdir db/d16 39 2023-12-16T20:11:26.271 INFO:tasks.workunit.client.0.smithi038.stdout:0/218: dread db/d16/d19/d27/f4c [0,4194304] 0 2023-12-16T20:11:26.271 INFO:tasks.workunit.client.0.smithi038.stdout:6/233: dread d1/d4/d1d/f2a [0,4194304] 0 2023-12-16T20:11:26.271 INFO:tasks.workunit.client.0.smithi038.stdout:2/349: truncate d1/d5/d2a/d31/f36 1394306 0 2023-12-16T20:11:26.275 INFO:tasks.workunit.client.0.smithi038.stdout:4/189: creat d13/d1c/f3e x:0 0 0 2023-12-16T20:11:26.275 INFO:tasks.workunit.client.0.smithi038.stdout:4/190: chown d13/d1f/d22/l2d 0 1 2023-12-16T20:11:26.276 INFO:tasks.workunit.client.0.smithi038.stdout:1/356: mkdir d15/d22/d52/d7f 0 2023-12-16T20:11:26.281 INFO:tasks.workunit.client.0.smithi038.stdout:5/260: unlink d2/d4/f1c 0 2023-12-16T20:11:26.281 INFO:tasks.workunit.client.0.smithi038.stdout:5/261: chown d2/df/d1a/d1f/f3d 277467 1 2023-12-16T20:11:26.281 INFO:tasks.workunit.client.0.smithi038.stdout:5/262: stat d2/c48 0 2023-12-16T20:11:26.283 INFO:tasks.workunit.client.0.smithi038.stdout:6/234: mknod d1/d16/c4a 0 2023-12-16T20:11:26.284 INFO:tasks.workunit.client.0.smithi038.stdout:2/350: creat d1/df/d21/d5f/f69 x:0 0 0 2023-12-16T20:11:26.284 INFO:tasks.workunit.client.0.smithi038.stdout:2/351: dread - d1/df/d42/f59 zero size 2023-12-16T20:11:26.285 INFO:tasks.workunit.client.0.smithi038.stdout:4/191: symlink d13/d1c/l3f 0 2023-12-16T20:11:26.285 INFO:tasks.workunit.client.0.smithi038.stdout:5/263: mknod d2/d14/d25/c4e 0 2023-12-16T20:11:26.287 INFO:tasks.workunit.client.0.smithi038.stdout:6/235: mknod d1/d16/c4b 0 2023-12-16T20:11:26.287 INFO:tasks.workunit.client.0.smithi038.stdout:6/236: truncate d1/d4/f49 813285 0 2023-12-16T20:11:26.287 INFO:tasks.workunit.client.0.smithi038.stdout:6/237: stat d1/d16/d23/f29 0 2023-12-16T20:11:26.287 INFO:tasks.workunit.client.0.smithi038.stdout:6/238: truncate d1/d4/d1d/f2a 5805990 0 2023-12-16T20:11:26.290 INFO:tasks.workunit.client.0.smithi038.stdout:6/239: link d1/d4/f20 d1/d4/d1d/d28/d2f/d3d/f4c 0 2023-12-16T20:11:26.292 INFO:tasks.workunit.client.0.smithi038.stdout:1/357: dread d15/d22/f53 [0,4194304] 0 2023-12-16T20:11:26.292 INFO:tasks.workunit.client.0.smithi038.stdout:1/358: read - d15/f17 zero size 2023-12-16T20:11:26.294 INFO:tasks.workunit.client.0.smithi038.stdout:9/193: dwrite d9/d1f/f29 [0,4194304] 0 2023-12-16T20:11:26.294 INFO:tasks.workunit.client.0.smithi038.stdout:9/194: chown d9/d1e/c2d 466655684 1 2023-12-16T20:11:26.294 INFO:tasks.workunit.client.0.smithi038.stdout:6/240: symlink d1/d16/d23/l4d 0 2023-12-16T20:11:26.294 INFO:tasks.workunit.client.0.smithi038.stdout:1/359: symlink d15/d1e/d23/d34/d79/l80 0 2023-12-16T20:11:26.295 INFO:tasks.workunit.client.0.smithi038.stdout:1/360: truncate d15/d1e/d3b/f77 773858 0 2023-12-16T20:11:26.295 INFO:tasks.workunit.client.0.smithi038.stdout:1/361: truncate d15/d1e/d30/f59 1027188 0 2023-12-16T20:11:26.295 INFO:tasks.workunit.client.0.smithi038.stdout:1/362: fdatasync d15/d22/f4b 0 2023-12-16T20:11:26.295 INFO:tasks.workunit.client.0.smithi038.stdout:2/352: rename d1/df/d42 to d1/df/d6a 0 2023-12-16T20:11:26.297 INFO:tasks.workunit.client.0.smithi038.stdout:3/309: dwrite d4/d8/d15/d1e/f3d [8388608,4194304] 0 2023-12-16T20:11:26.297 INFO:tasks.workunit.client.0.smithi038.stdout:3/310: truncate d4/d8/f1c 5892452 0 2023-12-16T20:11:26.297 INFO:tasks.workunit.client.0.smithi038.stdout:3/311: creat d4/d27/d40/f74 x:0 0 0 2023-12-16T20:11:26.297 INFO:tasks.workunit.client.0.smithi038.stdout:3/312: truncate d4/d8/d15/d1e/f3f 4395643 0 2023-12-16T20:11:26.297 INFO:tasks.workunit.client.0.smithi038.stdout:0/219: dwrite f6 [0,4194304] 0 2023-12-16T20:11:26.298 INFO:tasks.workunit.client.0.smithi038.stdout:9/195: getdents d9 0 2023-12-16T20:11:26.301 INFO:tasks.workunit.client.0.smithi038.stdout:1/363: creat d15/d22/d52/f81 x:0 0 0 2023-12-16T20:11:26.303 INFO:tasks.workunit.client.0.smithi038.stdout:2/353: mknod d1/df/d21/c6b 0 2023-12-16T20:11:26.305 INFO:tasks.workunit.client.0.smithi038.stdout:3/313: mknod d4/d8/d15/d2c/d4c/d58/c75 0 2023-12-16T20:11:26.309 INFO:tasks.workunit.client.0.smithi038.stdout:0/220: unlink db/d16/d1c/f1f 0 2023-12-16T20:11:26.310 INFO:tasks.workunit.client.0.smithi038.stdout:9/196: creat d9/d1f/d21/f3a x:0 0 0 2023-12-16T20:11:26.310 INFO:tasks.workunit.client.0.smithi038.stdout:9/197: chown d9/d1f/d21/f3a 259221529 1 2023-12-16T20:11:26.310 INFO:tasks.workunit.client.0.smithi038.stdout:9/198: write d9/f1a [121994,126244] 0 2023-12-16T20:11:26.311 INFO:tasks.workunit.client.0.smithi038.stdout:1/364: unlink c9 0 2023-12-16T20:11:26.314 INFO:tasks.workunit.client.0.smithi038.stdout:3/314: creat d4/d67/f76 x:0 0 0 2023-12-16T20:11:26.314 INFO:tasks.workunit.client.0.smithi038.stdout:4/192: dwrite d13/d17/d2e/f3d [0,4194304] 0 2023-12-16T20:11:26.315 INFO:tasks.workunit.client.0.smithi038.stdout:1/365: dread d15/d1e/d3b/d48/d37/f41 [0,4194304] 0 2023-12-16T20:11:26.315 INFO:tasks.workunit.client.0.smithi038.stdout:1/366: creat d15/d22/d52/f82 x:0 0 0 2023-12-16T20:11:26.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/315: creat d4/d27/d2b/d64/f77 x:0 0 0 2023-12-16T20:11:26.318 INFO:tasks.workunit.client.0.smithi038.stdout:6/241: dwrite d1/f22 [4194304,4194304] 0 2023-12-16T20:11:26.318 INFO:tasks.workunit.client.0.smithi038.stdout:6/242: chown d1/d4/d1d/f1e 22 1 2023-12-16T20:11:26.319 INFO:tasks.workunit.client.0.smithi038.stdout:5/264: dwrite d2/f12 [0,4194304] 0 2023-12-16T20:11:26.319 INFO:tasks.workunit.client.0.smithi038.stdout:0/221: rename db/d16/d19/d27/l35 to db/l4d 0 2023-12-16T20:11:26.324 INFO:tasks.workunit.client.0.smithi038.stdout:3/316: creat d4/d8/d15/d2c/d4c/f78 x:0 0 0 2023-12-16T20:11:26.329 INFO:tasks.workunit.client.0.smithi038.stdout:2/354: getdents d1/df/d21 0 2023-12-16T20:11:26.332 INFO:tasks.workunit.client.0.smithi038.stdout:3/317: dread d4/d8/d15/d1e/f1f [0,4194304] 0 2023-12-16T20:11:26.332 INFO:tasks.workunit.client.0.smithi038.stdout:3/318: fsync f1 0 2023-12-16T20:11:26.332 INFO:tasks.workunit.client.0.smithi038.stdout:3/319: write d4/d27/d2b/d64/f77 [391158,104600] 0 2023-12-16T20:11:26.338 INFO:tasks.workunit.client.0.smithi038.stdout:5/265: mknod d2/df/d1a/d1f/c4f 0 2023-12-16T20:11:26.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/193: rename cc to d13/d1f/c40 0 2023-12-16T20:11:26.341 INFO:tasks.workunit.client.0.smithi038.stdout:6/243: rmdir d1/d4/d1d/d28/d2f/d3d 39 2023-12-16T20:11:26.341 INFO:tasks.workunit.client.0.smithi038.stdout:0/222: dwrite f1 [0,4194304] 0 2023-12-16T20:11:26.341 INFO:tasks.workunit.client.0.smithi038.stdout:0/223: write db/f3c [523637,105507] 0 2023-12-16T20:11:26.341 INFO:tasks.workunit.client.0.smithi038.stdout:0/224: dread - db/d1a/f3a zero size 2023-12-16T20:11:26.343 INFO:tasks.workunit.client.0.smithi038.stdout:2/355: mkdir d1/d5/d6c 0 2023-12-16T20:11:26.344 INFO:tasks.workunit.client.0.smithi038.stdout:5/266: unlink d2/d14/f1e 0 2023-12-16T20:11:26.344 INFO:tasks.workunit.client.0.smithi038.stdout:5/267: fdatasync d2/d14/d25/f3f 0 2023-12-16T20:11:26.344 INFO:tasks.workunit.client.0.smithi038.stdout:5/268: creat d2/df/d1a/d2a/f50 x:0 0 0 2023-12-16T20:11:26.346 INFO:tasks.workunit.client.0.smithi038.stdout:1/367: rename d15/d1e/d3b/d48/d37/f41 to d15/d1e/d23/d34/d79/f83 0 2023-12-16T20:11:26.348 INFO:tasks.workunit.client.0.smithi038.stdout:4/194: link d13/d1f/f3a d13/d1f/d22/f41 0 2023-12-16T20:11:26.348 INFO:tasks.workunit.client.0.smithi038.stdout:4/195: write d13/d17/d2e/f3d [4537768,116990] 0 2023-12-16T20:11:26.351 INFO:tasks.workunit.client.0.smithi038.stdout:4/196: write d13/d1f/d35/f38 [448563,58316] 0 2023-12-16T20:11:26.355 INFO:tasks.workunit.client.0.smithi038.stdout:6/244: rename d1/d4/d1d/d28/d2f/d3d/d40 to d1/d2e/d34/d4e 0 2023-12-16T20:11:26.355 INFO:tasks.workunit.client.0.smithi038.stdout:6/245: stat d1/d4/c9 0 2023-12-16T20:11:26.355 INFO:tasks.workunit.client.0.smithi038.stdout:6/246: dread d1/d4/f49 [0,4194304] 0 2023-12-16T20:11:26.358 INFO:tasks.workunit.client.0.smithi038.stdout:0/225: read db/f11 [2559915,122173] 0 2023-12-16T20:11:26.359 INFO:tasks.workunit.client.0.smithi038.stdout:0/226: fsync db/d16/d19/d27/f34 0 2023-12-16T20:11:26.365 INFO:tasks.workunit.client.0.smithi038.stdout:6/247: mknod d1/d16/c4f 0 2023-12-16T20:11:26.366 INFO:tasks.workunit.client.0.smithi038.stdout:6/248: write d1/d4/d1d/d28/d2f/d3d/f48 [778130,110898] 0 2023-12-16T20:11:26.366 INFO:tasks.workunit.client.0.smithi038.stdout:6/249: fsync d1/d4/d1d/f2a 0 2023-12-16T20:11:26.366 INFO:tasks.workunit.client.0.smithi038.stdout:0/227: mkdir db/d16/d19/d4e 0 2023-12-16T20:11:26.366 INFO:tasks.workunit.client.0.smithi038.stdout:0/228: chown db/c41 291 1 2023-12-16T20:11:26.367 INFO:tasks.workunit.client.0.smithi038.stdout:2/356: rename d1/df/d21/d5f to d1/df/d6d 0 2023-12-16T20:11:26.367 INFO:tasks.workunit.client.0.smithi038.stdout:2/357: rmdir d1/df/d12 39 2023-12-16T20:11:26.384 INFO:tasks.workunit.client.0.smithi038.stdout:3/320: dwrite d4/d18/f38 [0,4194304] 0 2023-12-16T20:11:26.384 INFO:tasks.workunit.client.0.smithi038.stdout:6/250: write d1/f38 [1594889,25409] 0 2023-12-16T20:11:26.384 INFO:tasks.workunit.client.0.smithi038.stdout:8/209: sync 2023-12-16T20:11:26.384 INFO:tasks.workunit.client.0.smithi038.stdout:7/219: sync 2023-12-16T20:11:26.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/251: symlink d1/d4/d1d/l50 0 2023-12-16T20:11:26.386 INFO:tasks.workunit.client.0.smithi038.stdout:8/210: mknod d17/d34/d3d/c3e 0 2023-12-16T20:11:26.386 INFO:tasks.workunit.client.0.smithi038.stdout:8/211: write d17/d18/f1a [2581562,87439] 0 2023-12-16T20:11:26.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/220: symlink da/d24/l3d 0 2023-12-16T20:11:26.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/221: truncate da/d21/d2c/f36 483050 0 2023-12-16T20:11:26.388 INFO:tasks.workunit.client.0.smithi038.stdout:5/269: dwrite d2/df/d1a/d2a/f50 [0,4194304] 0 2023-12-16T20:11:26.388 INFO:tasks.workunit.client.0.smithi038.stdout:8/212: rmdir d17/d1d 39 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/358: write d1/d5/d2a/f35 [5042239,107970] 0 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:1/368: dwrite d15/d1e/d30/f50 [0,4194304] 0 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/359: readlink d1/df/l2b 0 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/360: dread - d1/df/d10/f4f zero size 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/361: chown d1/d5/d16/f3b 83739 1 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/362: chown d1/l11 70070 1 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/363: stat d1/df/d12 0 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/197: dwrite fb [4194304,4194304] 0 2023-12-16T20:11:26.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/198: fdatasync d13/f28 0 2023-12-16T20:11:26.392 INFO:tasks.workunit.client.0.smithi038.stdout:3/321: dread d4/f5 [0,4194304] 0 2023-12-16T20:11:26.393 INFO:tasks.workunit.client.0.smithi038.stdout:5/270: unlink d2/d14/d25/d2d/f3e 0 2023-12-16T20:11:26.396 INFO:tasks.workunit.client.0.smithi038.stdout:7/222: dread da/d21/f25 [0,4194304] 0 2023-12-16T20:11:26.399 INFO:tasks.workunit.client.0.smithi038.stdout:1/369: rename d15/d1e/d3b/d48/d37/c65 to d15/d22/d62/c84 0 2023-12-16T20:11:26.400 INFO:tasks.workunit.client.0.smithi038.stdout:2/364: mknod d1/d5/d3d/c6e 0 2023-12-16T20:11:26.401 INFO:tasks.workunit.client.0.smithi038.stdout:2/365: creat d1/df/d10/d2f/f6f x:0 0 0 2023-12-16T20:11:26.402 INFO:tasks.workunit.client.0.smithi038.stdout:3/322: symlink d4/d27/d2b/l79 0 2023-12-16T20:11:26.402 INFO:tasks.workunit.client.0.smithi038.stdout:3/323: write d4/d27/d40/f5f [241226,62077] 0 2023-12-16T20:11:26.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/252: dwrite d1/fe [0,4194304] 0 2023-12-16T20:11:26.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/253: stat d1/d4/d1d/f3b 0 2023-12-16T20:11:26.404 INFO:tasks.workunit.client.0.smithi038.stdout:5/271: mkdir d2/d14/d25/d2d/d17/d51 0 2023-12-16T20:11:26.406 INFO:tasks.workunit.client.0.smithi038.stdout:0/229: getdents db/d16/d19 0 2023-12-16T20:11:26.411 INFO:tasks.workunit.client.0.smithi038.stdout:4/199: rename d13/d1c/l25 to d13/d1f/l42 0 2023-12-16T20:11:26.413 INFO:tasks.workunit.client.0.smithi038.stdout:1/370: creat d15/d1e/d3b/d5a/f85 x:0 0 0 2023-12-16T20:11:26.415 INFO:tasks.workunit.client.0.smithi038.stdout:2/366: symlink d1/d5/d2a/d5d/l70 0 2023-12-16T20:11:26.415 INFO:tasks.workunit.client.0.smithi038.stdout:2/367: creat d1/df/d10/f71 x:0 0 0 2023-12-16T20:11:26.416 INFO:tasks.workunit.client.0.smithi038.stdout:2/368: read d1/df/d10/f5e [771460,123966] 0 2023-12-16T20:11:26.416 INFO:tasks.workunit.client.0.smithi038.stdout:3/324: mkdir d4/d8/d15/d6d/d7a 0 2023-12-16T20:11:26.421 INFO:tasks.workunit.client.0.smithi038.stdout:6/254: creat d1/d4/d1d/d28/d2f/d3d/f51 x:0 0 0 2023-12-16T20:11:26.422 INFO:tasks.workunit.client.0.smithi038.stdout:5/272: unlink d2/l8 0 2023-12-16T20:11:26.424 INFO:tasks.workunit.client.0.smithi038.stdout:0/230: mkdir db/d16/d1c/d4f 0 2023-12-16T20:11:26.424 INFO:tasks.workunit.client.0.smithi038.stdout:0/231: fsync db/f10 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/200: rmdir d13 39 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/201: dread - d13/d1c/f33 zero size 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/202: truncate d13/f28 113412 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/203: creat d13/d1c/f43 x:0 0 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:1/371: dwrite d15/d1e/d3b/d48/d37/f3c [0,4194304] 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/204: write d13/f28 [401396,25200] 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:1/372: chown d15/d1e/d23/d42 37 1 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/205: truncate d13/d1f/d22/f41 601690 0 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/206: chown ce 652840 1 2023-12-16T20:11:26.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/207: read - d13/d1c/f33 zero size 2023-12-16T20:11:26.434 INFO:tasks.workunit.client.0.smithi038.stdout:2/369: mkdir d1/df/d6d/d72 0 2023-12-16T20:11:26.435 INFO:tasks.workunit.client.0.smithi038.stdout:3/325: symlink d4/d8/d15/d1e/l7b 0 2023-12-16T20:11:26.437 INFO:tasks.workunit.client.0.smithi038.stdout:6/255: getdents d1/d2e/d34 0 2023-12-16T20:11:26.437 INFO:tasks.workunit.client.0.smithi038.stdout:6/256: chown d1/d4/d1d/d28/d2f/d3d/f46 631258 1 2023-12-16T20:11:26.438 INFO:tasks.workunit.client.0.smithi038.stdout:6/257: read d1/d4/d1d/d28/d2f/d3d/f48 [302789,58753] 0 2023-12-16T20:11:26.438 INFO:tasks.workunit.client.0.smithi038.stdout:6/258: chown d1/d4/c3a 31 1 2023-12-16T20:11:26.438 INFO:tasks.workunit.client.0.smithi038.stdout:0/232: creat db/d16/d19/d27/f50 x:0 0 0 2023-12-16T20:11:26.439 INFO:tasks.workunit.client.0.smithi038.stdout:7/223: rename da/dc to da/d3e 0 2023-12-16T20:11:26.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/224: dread - da/d21/f29 zero size 2023-12-16T20:11:26.442 INFO:tasks.workunit.client.0.smithi038.stdout:5/273: dwrite d2/f12 [4194304,4194304] 0 2023-12-16T20:11:26.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/233: dread db/f11 [0,4194304] 0 2023-12-16T20:11:26.447 INFO:tasks.workunit.client.0.smithi038.stdout:1/373: mkdir d15/d1e/d23/d34/d86 0 2023-12-16T20:11:26.447 INFO:tasks.workunit.client.0.smithi038.stdout:1/374: creat d15/d1e/d3b/d48/f87 x:0 0 0 2023-12-16T20:11:26.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/225: mknod da/d21/d2c/c3f 0 2023-12-16T20:11:26.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/234: chown db/cd 6141764 1 2023-12-16T20:11:26.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/235: truncate db/f11 4732315 0 2023-12-16T20:11:26.453 INFO:tasks.workunit.client.0.smithi038.stdout:7/226: dread da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:26.457 INFO:tasks.workunit.client.0.smithi038.stdout:0/236: truncate db/d16/f18 2750950 0 2023-12-16T20:11:26.458 INFO:tasks.workunit.client.0.smithi038.stdout:7/227: creat da/d3e/f40 x:0 0 0 2023-12-16T20:11:26.460 INFO:tasks.workunit.client.0.smithi038.stdout:1/375: link d15/d1e/d3b/d48/f87 d15/d1e/d3b/d48/d37/f88 0 2023-12-16T20:11:26.460 INFO:tasks.workunit.client.0.smithi038.stdout:1/376: readlink d15/d1e/l49 0 2023-12-16T20:11:26.460 INFO:tasks.workunit.client.0.smithi038.stdout:1/377: write d15/d1e/d3b/d48/d37/f40 [1041685,122837] 0 2023-12-16T20:11:26.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/228: mkdir da/d21/d41 0 2023-12-16T20:11:26.463 INFO:tasks.workunit.client.0.smithi038.stdout:7/229: rmdir da/d3b 0 2023-12-16T20:11:26.468 INFO:tasks.workunit.client.0.smithi038.stdout:2/370: dwrite d1/df/d10/d23/d3a/f56 [0,4194304] 0 2023-12-16T20:11:26.468 INFO:tasks.workunit.client.0.smithi038.stdout:6/259: dwrite d1/f22 [4194304,4194304] 0 2023-12-16T20:11:26.468 INFO:tasks.workunit.client.0.smithi038.stdout:4/208: dwrite fa [0,4194304] 0 2023-12-16T20:11:26.469 INFO:tasks.workunit.client.0.smithi038.stdout:5/274: dwrite d2/df/d1a/f46 [0,4194304] 0 2023-12-16T20:11:26.470 INFO:tasks.workunit.client.0.smithi038.stdout:1/378: dread d15/d1e/d23/d34/f5d [0,4194304] 0 2023-12-16T20:11:26.474 INFO:tasks.workunit.client.0.smithi038.stdout:2/371: mkdir d1/d73 0 2023-12-16T20:11:26.474 INFO:tasks.workunit.client.0.smithi038.stdout:2/372: write d1/df/d10/f46 [3585126,84422] 0 2023-12-16T20:11:26.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/260: mknod d1/d2e/c52 0 2023-12-16T20:11:26.476 INFO:tasks.workunit.client.0.smithi038.stdout:4/209: creat d13/d1f/d22/f44 x:0 0 0 2023-12-16T20:11:26.476 INFO:tasks.workunit.client.0.smithi038.stdout:4/210: readlink d13/d17/l2a 0 2023-12-16T20:11:26.484 INFO:tasks.workunit.client.0.smithi038.stdout:5/275: creat d2/df/d1a/d1f/d4a/f52 x:0 0 0 2023-12-16T20:11:26.485 INFO:tasks.workunit.client.0.smithi038.stdout:5/276: fdatasync d2/d14/d25/d2d/d17/f19 0 2023-12-16T20:11:26.486 INFO:tasks.workunit.client.0.smithi038.stdout:7/230: dwrite da/d21/f29 [0,4194304] 0 2023-12-16T20:11:26.486 INFO:tasks.workunit.client.0.smithi038.stdout:1/379: rename d15/d22/f4b to d15/d22/d52/f89 0 2023-12-16T20:11:26.486 INFO:tasks.workunit.client.0.smithi038.stdout:1/380: chown d15/d1e/d3b/d48/l56 113 1 2023-12-16T20:11:26.488 INFO:tasks.workunit.client.0.smithi038.stdout:6/261: rmdir d1/d2e/d34/d4e 0 2023-12-16T20:11:26.490 INFO:tasks.workunit.client.0.smithi038.stdout:4/211: truncate d13/f3c 3016445 0 2023-12-16T20:11:26.495 INFO:tasks.workunit.client.0.smithi038.stdout:7/231: rename c4 to da/d3e/d31/c42 0 2023-12-16T20:11:26.497 INFO:tasks.workunit.client.0.smithi038.stdout:1/381: unlink d15/d1e/d23/d34/c7e 0 2023-12-16T20:11:26.498 INFO:tasks.workunit.client.0.smithi038.stdout:7/232: unlink c9 0 2023-12-16T20:11:26.499 INFO:tasks.workunit.client.0.smithi038.stdout:1/382: truncate d15/f19 1222341 0 2023-12-16T20:11:26.499 INFO:tasks.workunit.client.0.smithi038.stdout:1/383: readlink d15/d1e/l49 0 2023-12-16T20:11:26.499 INFO:tasks.workunit.client.0.smithi038.stdout:1/384: write d15/d1e/d30/f32 [3594203,66116] 0 2023-12-16T20:11:26.500 INFO:tasks.workunit.client.0.smithi038.stdout:7/233: creat da/d3e/d31/f43 x:0 0 0 2023-12-16T20:11:26.502 INFO:tasks.workunit.client.0.smithi038.stdout:1/385: rmdir d15/d1e/d23/d42 39 2023-12-16T20:11:26.503 INFO:tasks.workunit.client.0.smithi038.stdout:7/234: truncate da/d3e/d31/f39 2414296 0 2023-12-16T20:11:26.505 INFO:tasks.workunit.client.0.smithi038.stdout:1/386: creat d15/d4a/f8a x:0 0 0 2023-12-16T20:11:26.506 INFO:tasks.workunit.client.0.smithi038.stdout:1/387: dread - d15/d1e/d23/f78 zero size 2023-12-16T20:11:26.506 INFO:tasks.workunit.client.0.smithi038.stdout:6/262: dread d1/d4/d1d/d28/d2f/d3d/f4c [0,4194304] 0 2023-12-16T20:11:26.506 INFO:tasks.workunit.client.0.smithi038.stdout:7/235: symlink da/l44 0 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:1/388: getdents d15/d1e/d23/d42 0 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:1/389: creat d15/d1e/d23/d34/f8b x:0 0 0 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:1/390: chown d15/d1e/c1f 159 1 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:2/373: dwrite d1/df/d6a/d43/f55 [0,4194304] 0 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:5/277: dwrite d2/df/d1a/d2a/f41 [4194304,4194304] 0 2023-12-16T20:11:26.508 INFO:tasks.workunit.client.0.smithi038.stdout:5/278: truncate d2/d14/f22 5073960 0 2023-12-16T20:11:26.509 INFO:tasks.workunit.client.0.smithi038.stdout:6/263: mknod d1/c53 0 2023-12-16T20:11:26.515 INFO:tasks.workunit.client.0.smithi038.stdout:6/264: dread d1/d4/f20 [0,4194304] 0 2023-12-16T20:11:26.515 INFO:tasks.workunit.client.0.smithi038.stdout:6/265: creat d1/f54 x:0 0 0 2023-12-16T20:11:26.516 INFO:tasks.workunit.client.0.smithi038.stdout:2/374: symlink d1/d5/d2a/d5d/d61/l74 0 2023-12-16T20:11:26.519 INFO:tasks.workunit.client.0.smithi038.stdout:5/279: mkdir d2/df/d1a/d1f/d4a/d53 0 2023-12-16T20:11:26.519 INFO:tasks.workunit.client.0.smithi038.stdout:7/236: dread da/d21/d2c/d2e/f27 [0,4194304] 0 2023-12-16T20:11:26.519 INFO:tasks.workunit.client.0.smithi038.stdout:5/280: chown d2/d14/d25/d2d/l36 1055 1 2023-12-16T20:11:26.522 INFO:tasks.workunit.client.0.smithi038.stdout:6/266: mknod d1/d2e/c55 0 2023-12-16T20:11:26.523 INFO:tasks.workunit.client.0.smithi038.stdout:2/375: truncate d1/df/d10/f50 580858 0 2023-12-16T20:11:26.524 INFO:tasks.workunit.client.0.smithi038.stdout:0/237: truncate db/d16/d19/f43 2025268 0 2023-12-16T20:11:26.525 INFO:tasks.workunit.client.0.smithi038.stdout:5/281: mknod d2/d14/c54 0 2023-12-16T20:11:26.526 INFO:tasks.workunit.client.0.smithi038.stdout:5/282: truncate d2/f10 939161 0 2023-12-16T20:11:26.526 INFO:tasks.workunit.client.0.smithi038.stdout:6/267: unlink d1/d16/l35 0 2023-12-16T20:11:26.527 INFO:tasks.workunit.client.0.smithi038.stdout:6/268: fdatasync d1/d16/d23/f29 0 2023-12-16T20:11:26.528 INFO:tasks.workunit.client.0.smithi038.stdout:2/376: rmdir d1/df/d6d 39 2023-12-16T20:11:26.529 INFO:tasks.workunit.client.0.smithi038.stdout:2/377: stat d1/d5/d16/f3b 0 2023-12-16T20:11:26.529 INFO:tasks.workunit.client.0.smithi038.stdout:6/269: link d1/d4/d1d/d28/d2f/d3d/f51 d1/f56 0 2023-12-16T20:11:26.530 INFO:tasks.workunit.client.0.smithi038.stdout:6/270: chown d1/d4/d1d/d28/f41 3272392 1 2023-12-16T20:11:26.530 INFO:tasks.workunit.client.0.smithi038.stdout:6/271: truncate d1/d16/d23/f33 283003 0 2023-12-16T20:11:26.531 INFO:tasks.workunit.client.0.smithi038.stdout:2/378: mkdir d1/d5/d2a/d5d/d61/d75 0 2023-12-16T20:11:26.531 INFO:tasks.workunit.client.0.smithi038.stdout:2/379: chown d1/d5/d2a/f30 1295611 1 2023-12-16T20:11:26.532 INFO:tasks.workunit.client.0.smithi038.stdout:0/238: rmdir db/d16/d1c 39 2023-12-16T20:11:26.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/283: dread d2/f9 [0,4194304] 0 2023-12-16T20:11:26.535 INFO:tasks.workunit.client.0.smithi038.stdout:2/380: unlink d1/df/d6a/d43/f55 0 2023-12-16T20:11:26.536 INFO:tasks.workunit.client.0.smithi038.stdout:5/284: mkdir d2/d14/d25/d2d/d17/d55 0 2023-12-16T20:11:26.536 INFO:tasks.workunit.client.0.smithi038.stdout:5/285: readlink d2/d4/l13 0 2023-12-16T20:11:26.536 INFO:tasks.workunit.client.0.smithi038.stdout:5/286: readlink d2/d14/d25/d2d/d17/l23 0 2023-12-16T20:11:26.537 INFO:tasks.workunit.client.0.smithi038.stdout:2/381: getdents d1/d5/d2a 0 2023-12-16T20:11:26.537 INFO:tasks.workunit.client.0.smithi038.stdout:2/382: readlink d1/df/d21/l2d 0 2023-12-16T20:11:26.537 INFO:tasks.workunit.client.0.smithi038.stdout:0/239: dread f5 [0,4194304] 0 2023-12-16T20:11:26.538 INFO:tasks.workunit.client.0.smithi038.stdout:0/240: creat db/d16/d19/d27/f51 x:0 0 0 2023-12-16T20:11:26.541 INFO:tasks.workunit.client.0.smithi038.stdout:0/241: rmdir db/d49 0 2023-12-16T20:11:26.551 INFO:tasks.workunit.client.0.smithi038.stdout:6/272: rmdir d1/d2e/d34 0 2023-12-16T20:11:26.551 INFO:tasks.workunit.client.0.smithi038.stdout:6/273: readlink d1/d4/d1d/d28/d2f/l3c 0 2023-12-16T20:11:26.551 INFO:tasks.workunit.client.0.smithi038.stdout:6/274: fsync d1/d4/d1d/f1e 0 2023-12-16T20:11:26.551 INFO:tasks.workunit.client.0.smithi038.stdout:6/275: creat d1/d16/d23/f57 x:0 0 0 2023-12-16T20:11:26.557 INFO:tasks.workunit.client.0.smithi038.stdout:7/237: fsync da/d3e/d31/f43 0 2023-12-16T20:11:26.557 INFO:tasks.workunit.client.0.smithi038.stdout:6/276: dread d1/f2c [0,4194304] 0 2023-12-16T20:11:26.557 INFO:tasks.workunit.client.0.smithi038.stdout:6/277: chown d1/d4/d1d 5810714 1 2023-12-16T20:11:26.558 INFO:tasks.workunit.client.0.smithi038.stdout:7/238: mkdir da/d21/d2c/d2e/d45 0 2023-12-16T20:11:26.563 INFO:tasks.workunit.client.0.smithi038.stdout:9/199: sync 2023-12-16T20:11:26.563 INFO:tasks.workunit.client.0.smithi038.stdout:9/200: chown d9/c2e 38896602 1 2023-12-16T20:11:26.565 INFO:tasks.workunit.client.0.smithi038.stdout:9/201: dread d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:26.565 INFO:tasks.workunit.client.0.smithi038.stdout:9/202: fsync d9/d1f/d21/f28 0 2023-12-16T20:11:26.565 INFO:tasks.workunit.client.0.smithi038.stdout:9/203: truncate d9/d1e/f2b 1822267 0 2023-12-16T20:11:26.569 INFO:tasks.workunit.client.0.smithi038.stdout:0/242: getdents db/d16/d19/d27 0 2023-12-16T20:11:26.571 INFO:tasks.workunit.client.0.smithi038.stdout:0/243: rmdir db/d16/d19/d27 39 2023-12-16T20:11:26.571 INFO:tasks.workunit.client.0.smithi038.stdout:0/244: write db/d1a/f3a [601378,109387] 0 2023-12-16T20:11:26.572 INFO:tasks.workunit.client.0.smithi038.stdout:0/245: write db/f3c [75433,116821] 0 2023-12-16T20:11:26.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/246: write db/d16/d19/f4b [1032707,64090] 0 2023-12-16T20:11:26.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/247: readlink db/d1a/l21 0 2023-12-16T20:11:26.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/248: symlink db/d16/d19/d4e/l52 0 2023-12-16T20:11:26.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/287: dwrite d2/df/d1a/d1f/f32 [0,4194304] 0 2023-12-16T20:11:26.586 INFO:tasks.workunit.client.0.smithi038.stdout:2/383: dwrite d1/d5/d2a/f35 [4194304,4194304] 0 2023-12-16T20:11:26.586 INFO:tasks.workunit.client.0.smithi038.stdout:4/212: dwrite d13/f19 [0,4194304] 0 2023-12-16T20:11:26.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/213: chown d13/d17/d2e/d32 400 1 2023-12-16T20:11:26.587 INFO:tasks.workunit.client.0.smithi038.stdout:9/204: dwrite d9/f1a [0,4194304] 0 2023-12-16T20:11:26.592 INFO:tasks.workunit.client.0.smithi038.stdout:5/288: read d2/d14/d25/d2d/f45 [258129,75012] 0 2023-12-16T20:11:26.592 INFO:tasks.workunit.client.0.smithi038.stdout:7/239: dwrite da/d3e/f2a [4194304,4194304] 0 2023-12-16T20:11:26.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/214: rename d13/f28 to d13/d17/f45 0 2023-12-16T20:11:26.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/215: fsync d13/f26 0 2023-12-16T20:11:26.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/216: read - d13/d17/d2e/d32/f39 zero size 2023-12-16T20:11:26.596 INFO:tasks.workunit.client.0.smithi038.stdout:4/217: write d13/d1f/d22/f44 [267782,1534] 0 2023-12-16T20:11:26.597 INFO:tasks.workunit.client.0.smithi038.stdout:9/205: unlink d9/f20 0 2023-12-16T20:11:26.598 INFO:tasks.workunit.client.0.smithi038.stdout:2/384: dread d1/df/d10/f46 [0,4194304] 0 2023-12-16T20:11:26.606 INFO:tasks.workunit.client.0.smithi038.stdout:4/218: symlink d13/d1f/l46 0 2023-12-16T20:11:26.606 INFO:tasks.workunit.client.0.smithi038.stdout:4/219: write d13/f26 [3404473,97231] 0 2023-12-16T20:11:26.612 INFO:tasks.workunit.client.0.smithi038.stdout:9/206: mknod d9/d1e/c3b 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/385: symlink d1/df/d10/d2f/l76 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/207: creat d9/d1e/f3c x:0 0 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/386: creat d1/df/d10/f77 x:0 0 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/208: chown d9/f1c 1736 1 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/209: stat d9/f1c 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/210: chown d9/d1f/f29 303 1 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/211: chown d9/d1f/d21/c32 137178 1 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/391: truncate d15/f19 43287 0 2023-12-16T20:11:26.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/392: dread - d15/d1e/d23/d34/f38 zero size 2023-12-16T20:11:26.614 INFO:tasks.workunit.client.0.smithi038.stdout:4/220: unlink d13/l1d 0 2023-12-16T20:11:26.615 INFO:tasks.workunit.client.0.smithi038.stdout:4/221: readlink d13/d1f/d22/l29 0 2023-12-16T20:11:26.615 INFO:tasks.workunit.client.0.smithi038.stdout:2/387: dread d1/df/d10/f50 [0,4194304] 0 2023-12-16T20:11:26.618 INFO:tasks.workunit.client.0.smithi038.stdout:2/388: unlink d1/d5/d2a/d5d/l70 0 2023-12-16T20:11:26.618 INFO:tasks.workunit.client.0.smithi038.stdout:2/389: readlink d1/df/l2b 0 2023-12-16T20:11:26.619 INFO:tasks.workunit.client.0.smithi038.stdout:4/222: rmdir d13/d17/d2e 39 2023-12-16T20:11:26.620 INFO:tasks.workunit.client.0.smithi038.stdout:2/390: unlink d1/df/d10/c32 0 2023-12-16T20:11:26.621 INFO:tasks.workunit.client.0.smithi038.stdout:4/223: rename d13/c15 to d13/d1c/c47 0 2023-12-16T20:11:26.623 INFO:tasks.workunit.client.0.smithi038.stdout:2/391: unlink d1/df/d10/d23/c5c 0 2023-12-16T20:11:26.623 INFO:tasks.workunit.client.0.smithi038.stdout:2/392: write d1/df/d6a/f59 [286124,65544] 0 2023-12-16T20:11:26.624 INFO:tasks.workunit.client.0.smithi038.stdout:4/224: creat d13/f48 x:0 0 0 2023-12-16T20:11:26.627 INFO:tasks.workunit.client.0.smithi038.stdout:1/393: dread d15/d1e/d30/f50 [0,4194304] 0 2023-12-16T20:11:26.627 INFO:tasks.workunit.client.0.smithi038.stdout:1/394: write d15/d22/f26 [2317858,100677] 0 2023-12-16T20:11:26.628 INFO:tasks.workunit.client.0.smithi038.stdout:1/395: write d15/d1e/d3b/d48/d37/f6a [964352,45483] 0 2023-12-16T20:11:26.628 INFO:tasks.workunit.client.0.smithi038.stdout:1/396: read - d15/f17 zero size 2023-12-16T20:11:26.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/249: dwrite db/d16/d19/f4b [0,4194304] 0 2023-12-16T20:11:26.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/250: dread - db/f44 zero size 2023-12-16T20:11:26.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/251: chown db/d16/d19/d27/l29 148 1 2023-12-16T20:11:26.634 INFO:tasks.workunit.client.0.smithi038.stdout:1/397: fdatasync d15/d1e/d3b/d48/d37/f6a 0 2023-12-16T20:11:26.634 INFO:tasks.workunit.client.0.smithi038.stdout:1/398: fdatasync d15/d1e/d23/d46/f72 0 2023-12-16T20:11:26.634 INFO:tasks.workunit.client.0.smithi038.stdout:1/399: fdatasync d15/d1e/f4c 0 2023-12-16T20:11:26.634 INFO:tasks.workunit.client.0.smithi038.stdout:1/400: fdatasync f7 0 2023-12-16T20:11:26.634 INFO:tasks.workunit.client.0.smithi038.stdout:0/252: symlink db/d16/d19/l53 0 2023-12-16T20:11:26.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/401: symlink d15/d1e/d3b/d5a/l8c 0 2023-12-16T20:11:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:1/402: dread d15/f24 [0,4194304] 0 2023-12-16T20:11:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/289: dwrite d2/df/f1d [0,4194304] 0 2023-12-16T20:11:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/290: creat d2/df/d1a/d1f/d4a/f56 x:0 0 0 2023-12-16T20:11:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:2/393: write d1/d5/f7 [3606976,46875] 0 2023-12-16T20:11:26.639 INFO:tasks.workunit.client.0.smithi038.stdout:7/240: dwrite da/d3e/f40 [0,4194304] 0 2023-12-16T20:11:26.639 INFO:tasks.workunit.client.0.smithi038.stdout:7/241: write da/d21/d2c/f30 [979760,24658] 0 2023-12-16T20:11:26.640 INFO:tasks.workunit.client.0.smithi038.stdout:1/403: rename d15/d1e/l49 to d15/d22/d7b/l8d 0 2023-12-16T20:11:26.642 INFO:tasks.workunit.client.0.smithi038.stdout:9/212: getdents d9 0 2023-12-16T20:11:26.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/394: dread d1/d5/d3d/f47 [0,4194304] 0 2023-12-16T20:11:26.649 INFO:tasks.workunit.client.0.smithi038.stdout:7/242: rmdir da/d21/d2c 39 2023-12-16T20:11:26.652 INFO:tasks.workunit.client.0.smithi038.stdout:0/253: dwrite db/d16/d1c/f2a [0,4194304] 0 2023-12-16T20:11:26.652 INFO:tasks.workunit.client.0.smithi038.stdout:1/404: read d15/d1e/d30/f5b [514589,103685] 0 2023-12-16T20:11:26.654 INFO:tasks.workunit.client.0.smithi038.stdout:1/405: write d15/d1e/f4c [325035,119510] 0 2023-12-16T20:11:26.655 INFO:tasks.workunit.client.0.smithi038.stdout:5/291: rename d2/df/d1a/f47 to d2/d14/d25/d2d/d17/d55/f57 0 2023-12-16T20:11:26.655 INFO:tasks.workunit.client.0.smithi038.stdout:5/292: truncate d2/df/d1a/d1f/d4a/f56 548932 0 2023-12-16T20:11:26.656 INFO:tasks.workunit.client.0.smithi038.stdout:9/213: mkdir d9/d1e/d3d 0 2023-12-16T20:11:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/326: sync 2023-12-16T20:11:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:8/213: sync 2023-12-16T20:11:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/327: getdents d4/d8 0 2023-12-16T20:11:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:8/214: creat d17/d1b/f3f x:0 0 0 2023-12-16T20:11:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/328: chown d4/d8/d15/d1e/f1f 2118 1 2023-12-16T20:11:26.658 INFO:tasks.workunit.client.0.smithi038.stdout:2/395: mknod d1/d5/d2a/d5d/c78 0 2023-12-16T20:11:26.659 INFO:tasks.workunit.client.0.smithi038.stdout:7/243: creat da/d24/f46 x:0 0 0 2023-12-16T20:11:26.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/406: mknod d15/d1e/d3b/d48/d37/c8e 0 2023-12-16T20:11:26.665 INFO:tasks.workunit.client.0.smithi038.stdout:0/254: rename db/f11 to db/d16/f54 0 2023-12-16T20:11:26.666 INFO:tasks.workunit.client.0.smithi038.stdout:9/214: mkdir d9/d1f/d21/d3e 0 2023-12-16T20:11:26.669 INFO:tasks.workunit.client.0.smithi038.stdout:8/215: creat d17/f40 x:0 0 0 2023-12-16T20:11:26.669 INFO:tasks.workunit.client.0.smithi038.stdout:8/216: creat d17/d1b/d25/f41 x:0 0 0 2023-12-16T20:11:26.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/217: dread d17/d1b/f22 [0,4194304] 0 2023-12-16T20:11:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:2/396: creat d1/d5/d2a/f79 x:0 0 0 2023-12-16T20:11:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:5/293: dwrite d2/df/f1d [0,4194304] 0 2023-12-16T20:11:26.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/244: creat da/d21/d2c/f47 x:0 0 0 2023-12-16T20:11:26.674 INFO:tasks.workunit.client.0.smithi038.stdout:1/407: link d15/d1e/d23/d34/f8b d15/d1e/d3b/d48/d37/f8f 0 2023-12-16T20:11:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:1/408: write d15/d1e/d3b/d48/d37/f6a [1692917,2020] 0 2023-12-16T20:11:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:1/409: chown d15/d1e/d3b/d48/d5e 1293345 1 2023-12-16T20:11:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:3/329: rename d4/d27/c3b to d4/d27/d23/d26/c7c 0 2023-12-16T20:11:26.676 INFO:tasks.workunit.client.0.smithi038.stdout:5/294: dread d2/f7 [0,4194304] 0 2023-12-16T20:11:26.676 INFO:tasks.workunit.client.0.smithi038.stdout:5/295: truncate d2/df/d1a/d2a/f3a 1046775 0 2023-12-16T20:11:26.676 INFO:tasks.workunit.client.0.smithi038.stdout:5/296: dread - d2/d4/f4c zero size 2023-12-16T20:11:26.676 INFO:tasks.workunit.client.0.smithi038.stdout:5/297: creat d2/d4/f58 x:0 0 0 2023-12-16T20:11:26.681 INFO:tasks.workunit.client.0.smithi038.stdout:2/397: truncate d1/d5/d2a/f35 1233905 0 2023-12-16T20:11:26.686 INFO:tasks.workunit.client.0.smithi038.stdout:7/245: rmdir da/d21/d2c/d2e/d45 0 2023-12-16T20:11:26.687 INFO:tasks.workunit.client.0.smithi038.stdout:1/410: truncate d15/d1e/d30/f32 1185107 0 2023-12-16T20:11:26.688 INFO:tasks.workunit.client.0.smithi038.stdout:1/411: chown d15/d1e/d3b/d48/d37/f40 0 1 2023-12-16T20:11:26.688 INFO:tasks.workunit.client.0.smithi038.stdout:3/330: dwrite d4/d8/f43 [0,4194304] 0 2023-12-16T20:11:26.688 INFO:tasks.workunit.client.0.smithi038.stdout:3/331: fsync d4/d8/d15/d2c/d4c/f78 0 2023-12-16T20:11:26.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/298: mkdir d2/df/d1a/d2a/d59 0 2023-12-16T20:11:26.693 INFO:tasks.workunit.client.0.smithi038.stdout:8/218: rmdir d17/d18 39 2023-12-16T20:11:26.697 INFO:tasks.workunit.client.0.smithi038.stdout:2/398: rename d1/df/d6a/d43/d57/d5b to d1/df/d6a/d7a 0 2023-12-16T20:11:26.699 INFO:tasks.workunit.client.0.smithi038.stdout:7/246: creat da/d21/d41/f48 x:0 0 0 2023-12-16T20:11:26.701 INFO:tasks.workunit.client.0.smithi038.stdout:3/332: mkdir d4/d8/d15/d2c/d7d 0 2023-12-16T20:11:26.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/333: write d4/d27/d2b/d64/f77 [169352,46669] 0 2023-12-16T20:11:26.704 INFO:tasks.workunit.client.0.smithi038.stdout:3/334: dread d4/d27/d2b/f35 [0,4194304] 0 2023-12-16T20:11:26.704 INFO:tasks.workunit.client.0.smithi038.stdout:3/335: stat d4/d8/d15/d1e/f22 0 2023-12-16T20:11:26.704 INFO:tasks.workunit.client.0.smithi038.stdout:9/215: rmdir d9/d1f/d21 39 2023-12-16T20:11:26.704 INFO:tasks.workunit.client.0.smithi038.stdout:9/216: readlink d9/d1f/l30 0 2023-12-16T20:11:26.705 INFO:tasks.workunit.client.0.smithi038.stdout:1/412: dwrite d15/d1e/d30/f5b [0,4194304] 0 2023-12-16T20:11:26.705 INFO:tasks.workunit.client.0.smithi038.stdout:1/413: truncate d15/d4a/f8a 364416 0 2023-12-16T20:11:26.706 INFO:tasks.workunit.client.0.smithi038.stdout:2/399: truncate d1/d5/f7 3764731 0 2023-12-16T20:11:26.708 INFO:tasks.workunit.client.0.smithi038.stdout:8/219: unlink fc 0 2023-12-16T20:11:26.710 INFO:tasks.workunit.client.0.smithi038.stdout:3/336: getdents d4/d27 0 2023-12-16T20:11:26.710 INFO:tasks.workunit.client.0.smithi038.stdout:3/337: dread - d4/d67/f76 zero size 2023-12-16T20:11:26.711 INFO:tasks.workunit.client.0.smithi038.stdout:9/217: creat d9/d1e/d3d/f3f x:0 0 0 2023-12-16T20:11:26.712 INFO:tasks.workunit.client.0.smithi038.stdout:9/218: chown d9 31054659 1 2023-12-16T20:11:26.712 INFO:tasks.workunit.client.0.smithi038.stdout:9/219: write d9/d1f/d21/f28 [950242,106267] 0 2023-12-16T20:11:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/414: creat d15/d1e/d23/d42/d75/f90 x:0 0 0 2023-12-16T20:11:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/415: fdatasync d15/d1e/d3b/f77 0 2023-12-16T20:11:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/416: truncate d15/d1e/d3b/d48/f87 587033 0 2023-12-16T20:11:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/417: creat d15/d22/d52/f91 x:0 0 0 2023-12-16T20:11:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:6/278: sync 2023-12-16T20:11:26.717 INFO:tasks.workunit.client.0.smithi038.stdout:6/279: write d1/d4/d1d/d28/d2f/d3d/f46 [3823311,2840] 0 2023-12-16T20:11:26.717 INFO:tasks.workunit.client.0.smithi038.stdout:6/280: chown d1/fe 15 1 2023-12-16T20:11:26.717 INFO:tasks.workunit.client.0.smithi038.stdout:2/400: mknod d1/df/c7b 0 2023-12-16T20:11:26.722 INFO:tasks.workunit.client.0.smithi038.stdout:8/220: rename d17/d1d/c35 to d17/d18/c42 0 2023-12-16T20:11:26.724 INFO:tasks.workunit.client.0.smithi038.stdout:3/338: mknod d4/d8/d15/d6d/c7e 0 2023-12-16T20:11:26.724 INFO:tasks.workunit.client.0.smithi038.stdout:3/339: fsync d4/d8/d15/f54 0 2023-12-16T20:11:26.724 INFO:tasks.workunit.client.0.smithi038.stdout:3/340: creat d4/d27/d40/f7f x:0 0 0 2023-12-16T20:11:26.724 INFO:tasks.workunit.client.0.smithi038.stdout:3/341: write d4/d27/d23/f4f [833980,47624] 0 2023-12-16T20:11:26.724 INFO:tasks.workunit.client.0.smithi038.stdout:7/247: rmdir da 39 2023-12-16T20:11:26.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/220: mkdir d9/d1e/d40 0 2023-12-16T20:11:26.727 INFO:tasks.workunit.client.0.smithi038.stdout:2/401: write d1/d5/d16/f2e [1371482,725] 0 2023-12-16T20:11:26.727 INFO:tasks.workunit.client.0.smithi038.stdout:6/281: truncate d1/d16/d23/f33 235810 0 2023-12-16T20:11:26.730 INFO:tasks.workunit.client.0.smithi038.stdout:7/248: dread f6 [0,4194304] 0 2023-12-16T20:11:26.732 INFO:tasks.workunit.client.0.smithi038.stdout:9/221: creat d9/d1e/d40/f41 x:0 0 0 2023-12-16T20:11:26.734 INFO:tasks.workunit.client.0.smithi038.stdout:2/402: rename d1/df/d10/f44 to d1/d73/f7c 0 2023-12-16T20:11:26.735 INFO:tasks.workunit.client.0.smithi038.stdout:6/282: mknod d1/c58 0 2023-12-16T20:11:26.735 INFO:tasks.workunit.client.0.smithi038.stdout:6/283: readlink d1/d16/l15 0 2023-12-16T20:11:26.737 INFO:tasks.workunit.client.0.smithi038.stdout:8/221: link l12 d17/d18/l43 0 2023-12-16T20:11:26.738 INFO:tasks.workunit.client.0.smithi038.stdout:7/249: symlink da/d21/l49 0 2023-12-16T20:11:26.738 INFO:tasks.workunit.client.0.smithi038.stdout:2/403: dread d1/df/d21/f45 [0,4194304] 0 2023-12-16T20:11:26.739 INFO:tasks.workunit.client.0.smithi038.stdout:3/342: rmdir d4/d8/d15/d2c/d4c 39 2023-12-16T20:11:26.742 INFO:tasks.workunit.client.0.smithi038.stdout:9/222: write d9/f1a [513203,65792] 0 2023-12-16T20:11:26.746 INFO:tasks.workunit.client.0.smithi038.stdout:8/222: mknod d17/d18/c44 0 2023-12-16T20:11:26.746 INFO:tasks.workunit.client.0.smithi038.stdout:8/223: dread - d17/d1b/f3f zero size 2023-12-16T20:11:26.748 INFO:tasks.workunit.client.0.smithi038.stdout:7/250: creat da/d3e/d31/f4a x:0 0 0 2023-12-16T20:11:26.750 INFO:tasks.workunit.client.0.smithi038.stdout:9/223: mkdir d9/d1e/d3d/d42 0 2023-12-16T20:11:26.751 INFO:tasks.workunit.client.0.smithi038.stdout:7/251: symlink da/d3e/d31/d38/l4b 0 2023-12-16T20:11:26.753 INFO:tasks.workunit.client.0.smithi038.stdout:9/224: mkdir d9/d43 0 2023-12-16T20:11:26.757 INFO:tasks.workunit.client.0.smithi038.stdout:7/252: symlink da/d21/d2c/l4c 0 2023-12-16T20:11:26.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/225: symlink d9/d1f/d21/l44 0 2023-12-16T20:11:26.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/226: dread - d9/d1e/f37 zero size 2023-12-16T20:11:26.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/227: truncate d9/d1f/f29 2872696 0 2023-12-16T20:11:26.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/228: read - d9/d1f/d21/f3a zero size 2023-12-16T20:11:26.761 INFO:tasks.workunit.client.0.smithi038.stdout:9/229: mkdir d9/d1e/d45 0 2023-12-16T20:11:26.761 INFO:tasks.workunit.client.0.smithi038.stdout:9/230: write d9/d1e/d3d/f3f [742875,13029] 0 2023-12-16T20:11:26.761 INFO:tasks.workunit.client.0.smithi038.stdout:9/231: chown l8 255 1 2023-12-16T20:11:26.763 INFO:tasks.workunit.client.0.smithi038.stdout:9/232: getdents d9/d1f 0 2023-12-16T20:11:26.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/233: getdents d9/d1e/d40 0 2023-12-16T20:11:26.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/234: dread - d9/d1f/f38 zero size 2023-12-16T20:11:26.770 INFO:tasks.workunit.client.0.smithi038.stdout:4/225: sync 2023-12-16T20:11:26.773 INFO:tasks.workunit.client.0.smithi038.stdout:2/404: dwrite d1/d73/f7c [0,4194304] 0 2023-12-16T20:11:26.773 INFO:tasks.workunit.client.0.smithi038.stdout:6/284: dwrite d1/d4/d1d/d28/d2f/d3d/f51 [0,4194304] 0 2023-12-16T20:11:26.773 INFO:tasks.workunit.client.0.smithi038.stdout:8/224: dwrite d17/d1b/d25/f3c [0,4194304] 0 2023-12-16T20:11:26.774 INFO:tasks.workunit.client.0.smithi038.stdout:2/405: rmdir d1/d73 39 2023-12-16T20:11:26.774 INFO:tasks.workunit.client.0.smithi038.stdout:2/406: creat d1/df/f7d x:0 0 0 2023-12-16T20:11:26.774 INFO:tasks.workunit.client.0.smithi038.stdout:2/407: readlink d1/l11 0 2023-12-16T20:11:26.775 INFO:tasks.workunit.client.0.smithi038.stdout:7/253: dwrite da/d21/f25 [0,4194304] 0 2023-12-16T20:11:26.775 INFO:tasks.workunit.client.0.smithi038.stdout:3/343: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:26.782 INFO:tasks.workunit.client.0.smithi038.stdout:8/225: mkdir d17/d34/d3d/d45 0 2023-12-16T20:11:26.783 INFO:tasks.workunit.client.0.smithi038.stdout:2/408: symlink d1/d5/d2a/d31/d60/l7e 0 2023-12-16T20:11:26.785 INFO:tasks.workunit.client.0.smithi038.stdout:7/254: mkdir da/d24/d4d 0 2023-12-16T20:11:26.787 INFO:tasks.workunit.client.0.smithi038.stdout:2/409: dread d1/df/d6a/f59 [0,4194304] 0 2023-12-16T20:11:26.788 INFO:tasks.workunit.client.0.smithi038.stdout:3/344: unlink d4/d8/d15/d1e/l7b 0 2023-12-16T20:11:26.788 INFO:tasks.workunit.client.0.smithi038.stdout:3/345: stat d4/d8/d15/d2c/l2f 0 2023-12-16T20:11:26.789 INFO:tasks.workunit.client.0.smithi038.stdout:6/285: getdents d1/d4/d1d/d28/d2f/d3d 0 2023-12-16T20:11:26.793 INFO:tasks.workunit.client.0.smithi038.stdout:9/235: dwrite d9/f18 [0,4194304] 0 2023-12-16T20:11:26.793 INFO:tasks.workunit.client.0.smithi038.stdout:8/226: symlink d17/d34/d3d/l46 0 2023-12-16T20:11:26.793 INFO:tasks.workunit.client.0.smithi038.stdout:4/226: dwrite d13/d1f/d22/f41 [0,4194304] 0 2023-12-16T20:11:26.794 INFO:tasks.workunit.client.0.smithi038.stdout:2/410: rename d1/df/d6a/l67 to d1/d5/d6c/l7f 0 2023-12-16T20:11:26.795 INFO:tasks.workunit.client.0.smithi038.stdout:2/411: dread - d1/df/d6d/f69 zero size 2023-12-16T20:11:26.796 INFO:tasks.workunit.client.0.smithi038.stdout:3/346: mkdir d4/d6c/d80 0 2023-12-16T20:11:26.798 INFO:tasks.workunit.client.0.smithi038.stdout:8/227: mknod d17/d1b/d25/c47 0 2023-12-16T20:11:26.798 INFO:tasks.workunit.client.0.smithi038.stdout:8/228: stat d17/d18/l2f 0 2023-12-16T20:11:26.798 INFO:tasks.workunit.client.0.smithi038.stdout:8/229: write d17/d1b/f22 [1091757,120457] 0 2023-12-16T20:11:26.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/286: rename d1/d16/d23/f33 to d1/d4/d1d/f59 0 2023-12-16T20:11:26.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/287: fsync d1/d16/f21 0 2023-12-16T20:11:26.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/288: creat d1/d16/f5a x:0 0 0 2023-12-16T20:11:26.804 INFO:tasks.workunit.client.0.smithi038.stdout:2/412: symlink d1/d5/d16/l80 0 2023-12-16T20:11:26.805 INFO:tasks.workunit.client.0.smithi038.stdout:2/413: truncate d1/df/d10/f71 733381 0 2023-12-16T20:11:26.805 INFO:tasks.workunit.client.0.smithi038.stdout:2/414: write d1/d5/d2a/f79 [183557,84375] 0 2023-12-16T20:11:26.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/347: mknod d4/d27/d2b/d64/c81 0 2023-12-16T20:11:26.807 INFO:tasks.workunit.client.0.smithi038.stdout:4/227: rmdir d13/d1c 39 2023-12-16T20:11:26.810 INFO:tasks.workunit.client.0.smithi038.stdout:9/236: dwrite d9/d1f/f29 [0,4194304] 0 2023-12-16T20:11:26.810 INFO:tasks.workunit.client.0.smithi038.stdout:9/237: readlink d9/l11 0 2023-12-16T20:11:26.810 INFO:tasks.workunit.client.0.smithi038.stdout:6/289: mkdir d1/d5b 0 2023-12-16T20:11:26.815 INFO:tasks.workunit.client.0.smithi038.stdout:2/415: creat d1/d73/f81 x:0 0 0 2023-12-16T20:11:26.818 INFO:tasks.workunit.client.0.smithi038.stdout:3/348: rename d4/l12 to d4/d27/l82 0 2023-12-16T20:11:26.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/228: truncate fb 7184192 0 2023-12-16T20:11:26.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/229: truncate d13/f37 639406 0 2023-12-16T20:11:26.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/230: readlink d13/d1c/l3f 0 2023-12-16T20:11:26.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/238: creat d9/d1f/d21/f46 x:0 0 0 2023-12-16T20:11:26.824 INFO:tasks.workunit.client.0.smithi038.stdout:4/231: mknod d13/d1f/d22/c49 0 2023-12-16T20:11:26.824 INFO:tasks.workunit.client.0.smithi038.stdout:4/232: write d13/f18 [244073,125359] 0 2023-12-16T20:11:26.825 INFO:tasks.workunit.client.0.smithi038.stdout:9/239: rmdir d9/d43 0 2023-12-16T20:11:26.825 INFO:tasks.workunit.client.0.smithi038.stdout:9/240: readlink d9/d1f/d21/l36 0 2023-12-16T20:11:26.827 INFO:tasks.workunit.client.0.smithi038.stdout:9/241: write d9/d1e/f33 [708938,128310] 0 2023-12-16T20:11:26.833 INFO:tasks.workunit.client.0.smithi038.stdout:3/349: write d4/f28 [12455448,110813] 0 2023-12-16T20:11:26.834 INFO:tasks.workunit.client.0.smithi038.stdout:9/242: write d9/f2c [1511835,103210] 0 2023-12-16T20:11:26.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/243: chown d9/l1b 1 1 2023-12-16T20:11:26.836 INFO:tasks.workunit.client.0.smithi038.stdout:9/244: creat d9/d1e/d3d/f47 x:0 0 0 2023-12-16T20:11:26.836 INFO:tasks.workunit.client.0.smithi038.stdout:8/230: dwrite f1 [0,4194304] 0 2023-12-16T20:11:26.836 INFO:tasks.workunit.client.0.smithi038.stdout:9/245: creat d9/d1e/d3d/d42/f48 x:0 0 0 2023-12-16T20:11:26.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/246: write d9/d1e/d3d/d42/f48 [727670,107802] 0 2023-12-16T20:11:26.837 INFO:tasks.workunit.client.0.smithi038.stdout:6/290: dwrite d1/d4/d1d/f59 [0,4194304] 0 2023-12-16T20:11:26.842 INFO:tasks.workunit.client.0.smithi038.stdout:9/247: creat d9/d1f/d21/d3e/f49 x:0 0 0 2023-12-16T20:11:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:9/248: readlink d9/l11 0 2023-12-16T20:11:26.850 INFO:tasks.workunit.client.0.smithi038.stdout:6/291: symlink d1/d4/d1d/l5c 0 2023-12-16T20:11:26.851 INFO:tasks.workunit.client.0.smithi038.stdout:6/292: write d1/d4/d1d/f2a [4801135,62454] 0 2023-12-16T20:11:26.851 INFO:tasks.workunit.client.0.smithi038.stdout:6/293: chown d1/d16/d23/f57 16946169 1 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/299: sync 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:0/255: sync 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:0/256: read - db/d16/d1c/f24 zero size 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:0/257: fdatasync f8 0 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/300: creat d2/d14/f5a x:0 0 0 2023-12-16T20:11:26.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/249: creat d9/d1e/d45/f4a x:0 0 0 2023-12-16T20:11:26.855 INFO:tasks.workunit.client.0.smithi038.stdout:6/294: rename d1/d16/c4b to d1/d4/c5d 0 2023-12-16T20:11:26.855 INFO:tasks.workunit.client.0.smithi038.stdout:6/295: creat d1/d4/f5e x:0 0 0 2023-12-16T20:11:26.857 INFO:tasks.workunit.client.0.smithi038.stdout:6/296: unlink d1/d16/f5a 0 2023-12-16T20:11:26.859 INFO:tasks.workunit.client.0.smithi038.stdout:6/297: mkdir d1/d16/d23/d5f 0 2023-12-16T20:11:26.859 INFO:tasks.workunit.client.0.smithi038.stdout:6/298: write d1/d16/d23/f29 [1593274,90429] 0 2023-12-16T20:11:26.860 INFO:tasks.workunit.client.0.smithi038.stdout:6/299: creat d1/d4/d1d/f60 x:0 0 0 2023-12-16T20:11:26.860 INFO:tasks.workunit.client.0.smithi038.stdout:6/300: truncate d1/f38 3353963 0 2023-12-16T20:11:26.862 INFO:tasks.workunit.client.0.smithi038.stdout:6/301: truncate d1/d4/f20 1556192 0 2023-12-16T20:11:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/350: dwrite d4/d8/f1c [0,4194304] 0 2023-12-16T20:11:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/351: chown d4 3 1 2023-12-16T20:11:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/352: stat d4/l1d 0 2023-12-16T20:11:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/353: chown d4/f28 69 1 2023-12-16T20:11:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/354: read d4/d18/f34 [1541063,116456] 0 2023-12-16T20:11:26.872 INFO:tasks.workunit.client.0.smithi038.stdout:3/355: creat d4/d6c/d80/f83 x:0 0 0 2023-12-16T20:11:26.872 INFO:tasks.workunit.client.0.smithi038.stdout:3/356: fsync d4/d8/f16 0 2023-12-16T20:11:26.873 INFO:tasks.workunit.client.0.smithi038.stdout:3/357: truncate d4/d8/d15/d1e/f3f 679672 0 2023-12-16T20:11:26.875 INFO:tasks.workunit.client.0.smithi038.stdout:5/301: write d2/df/d1a/d2a/f50 [2862646,87016] 0 2023-12-16T20:11:26.877 INFO:tasks.workunit.client.0.smithi038.stdout:5/302: creat d2/d14/d25/f5b x:0 0 0 2023-12-16T20:11:26.877 INFO:tasks.workunit.client.0.smithi038.stdout:5/303: dread - d2/d4/f58 zero size 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/304: mknod d2/df/d1a/d1f/c5c 0 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/305: fdatasync d2/d14/d25/d2d/d17/d55/f57 0 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/306: write d2/df/d1a/d1f/f35 [4081394,76591] 0 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/307: write d2/d14/f22 [2887339,73011] 0 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/308: fdatasync d2/f12 0 2023-12-16T20:11:26.878 INFO:tasks.workunit.client.0.smithi038.stdout:5/309: dread - d2/d14/d25/d2d/d17/d55/f57 zero size 2023-12-16T20:11:26.879 INFO:tasks.workunit.client.0.smithi038.stdout:5/310: link d2/d14/c54 d2/df/d1a/d1f/d4a/d53/c5d 0 2023-12-16T20:11:26.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/311: rename d2/d14/d44/f4d to d2/df/d1a/d1f/d4a/d53/f5e 0 2023-12-16T20:11:26.883 INFO:tasks.workunit.client.0.smithi038.stdout:4/233: dwrite d13/f18 [0,4194304] 0 2023-12-16T20:11:26.883 INFO:tasks.workunit.client.0.smithi038.stdout:4/234: creat d13/f4a x:0 0 0 2023-12-16T20:11:26.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/358: read d4/d8/d15/d1e/f3d [5449755,51533] 0 2023-12-16T20:11:26.885 INFO:tasks.workunit.client.0.smithi038.stdout:9/250: dwrite d9/d1f/d21/f3a [0,4194304] 0 2023-12-16T20:11:26.885 INFO:tasks.workunit.client.0.smithi038.stdout:8/231: dwrite f13 [0,4194304] 0 2023-12-16T20:11:26.886 INFO:tasks.workunit.client.0.smithi038.stdout:0/258: dwrite db/f44 [0,4194304] 0 2023-12-16T20:11:26.887 INFO:tasks.workunit.client.0.smithi038.stdout:9/251: dread d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:26.888 INFO:tasks.workunit.client.0.smithi038.stdout:4/235: rename d13/d1c to d13/d17/d4b 0 2023-12-16T20:11:26.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/359: creat d4/d8/f84 x:0 0 0 2023-12-16T20:11:26.892 INFO:tasks.workunit.client.0.smithi038.stdout:3/360: dread d4/f4a [0,4194304] 0 2023-12-16T20:11:26.903 INFO:tasks.workunit.client.0.smithi038.stdout:9/252: unlink d9/c16 0 2023-12-16T20:11:26.904 INFO:tasks.workunit.client.0.smithi038.stdout:9/253: chown d9/d1e/f3c 63757 1 2023-12-16T20:11:26.905 INFO:tasks.workunit.client.0.smithi038.stdout:3/361: write d4/d27/d2b/d64/f72 [367709,88501] 0 2023-12-16T20:11:26.906 INFO:tasks.workunit.client.0.smithi038.stdout:9/254: dread d9/fb [0,4194304] 0 2023-12-16T20:11:26.907 INFO:tasks.workunit.client.0.smithi038.stdout:3/362: write d4/d18/f34 [4809981,99536] 0 2023-12-16T20:11:26.909 INFO:tasks.workunit.client.0.smithi038.stdout:9/255: unlink l8 0 2023-12-16T20:11:26.911 INFO:tasks.workunit.client.0.smithi038.stdout:0/259: dwrite db/d16/d19/d27/f34 [0,4194304] 0 2023-12-16T20:11:26.912 INFO:tasks.workunit.client.0.smithi038.stdout:4/236: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:26.915 INFO:tasks.workunit.client.0.smithi038.stdout:0/260: creat db/d16/d1c/d4f/f55 x:0 0 0 2023-12-16T20:11:26.919 INFO:tasks.workunit.client.0.smithi038.stdout:0/261: mkdir db/d16/d19/d27/d56 0 2023-12-16T20:11:26.920 INFO:tasks.workunit.client.0.smithi038.stdout:0/262: mknod db/d1a/c57 0 2023-12-16T20:11:26.921 INFO:tasks.workunit.client.0.smithi038.stdout:0/263: mknod db/d16/d19/c58 0 2023-12-16T20:11:26.923 INFO:tasks.workunit.client.0.smithi038.stdout:4/237: write fb [6401944,46461] 0 2023-12-16T20:11:26.923 INFO:tasks.workunit.client.0.smithi038.stdout:4/238: chown d13/d1f/d22/d34 834729690 1 2023-12-16T20:11:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/239: rename d13/d17/d4b/l2b to d13/d1f/d22/l4c 0 2023-12-16T20:11:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:0/264: dread db/d16/d19/f23 [0,4194304] 0 2023-12-16T20:11:26.926 INFO:tasks.workunit.client.0.smithi038.stdout:4/240: unlink d13/d1f/f3a 0 2023-12-16T20:11:26.926 INFO:tasks.workunit.client.0.smithi038.stdout:4/241: readlink l10 0 2023-12-16T20:11:26.926 INFO:tasks.workunit.client.0.smithi038.stdout:4/242: dread - d13/d17/d4b/f33 zero size 2023-12-16T20:11:26.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/418: sync 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:0/265: creat db/d1a/f59 x:0 0 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:3/363: dwrite d4/d18/f66 [0,4194304] 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:3/364: write d4/d8/d15/d1e/f3f [914903,38670] 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:3/365: stat d4/d8/d15/d2c/d4c 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:3/366: dread - d4/d27/d40/f7f zero size 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:3/367: write d4/d8/d15/f56 [604665,98687] 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:9/256: dwrite d9/f1c [0,4194304] 0 2023-12-16T20:11:26.928 INFO:tasks.workunit.client.0.smithi038.stdout:9/257: chown d9/d1e 1357741 1 2023-12-16T20:11:26.929 INFO:tasks.workunit.client.0.smithi038.stdout:4/243: rmdir d13/d17/d2e/d32 39 2023-12-16T20:11:26.929 INFO:tasks.workunit.client.0.smithi038.stdout:4/244: getdents d13/d1f/d22/d34 0 2023-12-16T20:11:26.929 INFO:tasks.workunit.client.0.smithi038.stdout:1/419: creat d15/d1e/d23/d42/f92 x:0 0 0 2023-12-16T20:11:26.931 INFO:tasks.workunit.client.0.smithi038.stdout:0/266: mkdir db/d16/d5a 0 2023-12-16T20:11:26.934 INFO:tasks.workunit.client.0.smithi038.stdout:4/245: mkdir d13/d17/d2e/d32/d4d 0 2023-12-16T20:11:26.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/420: mknod d15/d1e/d23/d7d/c93 0 2023-12-16T20:11:26.939 INFO:tasks.workunit.client.0.smithi038.stdout:0/267: creat db/f5b x:0 0 0 2023-12-16T20:11:26.939 INFO:tasks.workunit.client.0.smithi038.stdout:0/268: dread - db/d16/d19/d27/f3b zero size 2023-12-16T20:11:26.939 INFO:tasks.workunit.client.0.smithi038.stdout:9/258: write d9/f18 [351432,76192] 0 2023-12-16T20:11:26.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/246: mkdir d13/d17/d2e/d32/d4e 0 2023-12-16T20:11:26.941 INFO:tasks.workunit.client.0.smithi038.stdout:4/247: dread d13/f37 [0,4194304] 0 2023-12-16T20:11:26.943 INFO:tasks.workunit.client.0.smithi038.stdout:1/421: creat d15/d22/d62/f94 x:0 0 0 2023-12-16T20:11:26.943 INFO:tasks.workunit.client.0.smithi038.stdout:3/368: dwrite d4/f14 [0,4194304] 0 2023-12-16T20:11:26.943 INFO:tasks.workunit.client.0.smithi038.stdout:0/269: truncate db/d16/d19/f43 776603 0 2023-12-16T20:11:26.943 INFO:tasks.workunit.client.0.smithi038.stdout:1/422: dread f7 [4194304,4194304] 0 2023-12-16T20:11:26.946 INFO:tasks.workunit.client.0.smithi038.stdout:9/259: rename d9/d1e/f2b to d9/d1e/d3d/f4b 0 2023-12-16T20:11:26.949 INFO:tasks.workunit.client.0.smithi038.stdout:4/248: unlink d13/d1f/l42 0 2023-12-16T20:11:26.954 INFO:tasks.workunit.client.0.smithi038.stdout:3/369: mkdir d4/d8/d15/d2c/d4c/d70/d71/d85 0 2023-12-16T20:11:26.956 INFO:tasks.workunit.client.0.smithi038.stdout:0/270: rename db/l4d to db/d16/d19/l5c 0 2023-12-16T20:11:26.956 INFO:tasks.workunit.client.0.smithi038.stdout:0/271: stat db/d16/d19/d27/f51 0 2023-12-16T20:11:26.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/260: rename d9/d1e/c3b to d9/d1e/c4c 0 2023-12-16T20:11:26.957 INFO:tasks.workunit.client.0.smithi038.stdout:1/423: dwrite f11 [0,4194304] 0 2023-12-16T20:11:26.957 INFO:tasks.workunit.client.0.smithi038.stdout:1/424: truncate d15/d1e/d3b/d48/f87 1344165 0 2023-12-16T20:11:26.958 INFO:tasks.workunit.client.0.smithi038.stdout:4/249: mkdir d13/d17/d2e/d32/d4d/d4f 0 2023-12-16T20:11:26.959 INFO:tasks.workunit.client.0.smithi038.stdout:4/250: dread d13/f2f [0,4194304] 0 2023-12-16T20:11:26.964 INFO:tasks.workunit.client.0.smithi038.stdout:3/370: rename d4/d27/d2b/f63 to d4/d8/d15/d6d/d7a/f86 0 2023-12-16T20:11:26.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/261: getdents d9/d1f/d21/d3e 0 2023-12-16T20:11:26.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/262: stat d9/f1c 0 2023-12-16T20:11:26.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/425: dread d15/f21 [0,4194304] 0 2023-12-16T20:11:26.971 INFO:tasks.workunit.client.0.smithi038.stdout:9/263: symlink d9/d1e/d3d/l4d 0 2023-12-16T20:11:26.972 INFO:tasks.workunit.client.0.smithi038.stdout:1/426: mkdir d15/d1e/d30/d95 0 2023-12-16T20:11:26.973 INFO:tasks.workunit.client.0.smithi038.stdout:9/264: mkdir d9/d1f/d21/d3e/d4e 0 2023-12-16T20:11:26.973 INFO:tasks.workunit.client.0.smithi038.stdout:9/265: fdatasync d9/d1e/d3d/d42/f48 0 2023-12-16T20:11:26.974 INFO:tasks.workunit.client.0.smithi038.stdout:9/266: chown d9/fb 496 1 2023-12-16T20:11:26.974 INFO:tasks.workunit.client.0.smithi038.stdout:9/267: fdatasync d9/d1f/f35 0 2023-12-16T20:11:26.978 INFO:tasks.workunit.client.0.smithi038.stdout:9/268: dread d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:26.983 INFO:tasks.workunit.client.0.smithi038.stdout:0/272: dwrite f1 [0,4194304] 0 2023-12-16T20:11:26.983 INFO:tasks.workunit.client.0.smithi038.stdout:3/371: dwrite d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:27.017 INFO:tasks.workunit.client.0.smithi038.stdout:1/427: creat d15/d22/d52/d7f/f96 x:0 0 0 2023-12-16T20:11:27.017 INFO:tasks.workunit.client.0.smithi038.stdout:9/269: symlink d9/d1f/d21/d3e/d4e/l4f 0 2023-12-16T20:11:27.018 INFO:tasks.workunit.client.0.smithi038.stdout:7/255: sync 2023-12-16T20:11:27.027 INFO:tasks.workunit.client.0.smithi038.stdout:4/251: rename d13/d1f/d22/c49 to d13/d17/d2e/d32/c50 0 2023-12-16T20:11:27.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/273: mkdir db/d16/d1c/d5d 0 2023-12-16T20:11:27.031 INFO:tasks.workunit.client.0.smithi038.stdout:9/270: creat d9/d1f/d21/d3e/f50 x:0 0 0 2023-12-16T20:11:27.031 INFO:tasks.workunit.client.0.smithi038.stdout:9/271: dread - d9/d1e/d3d/f47 zero size 2023-12-16T20:11:27.032 INFO:tasks.workunit.client.0.smithi038.stdout:7/256: symlink da/d21/d2c/d2e/l4e 0 2023-12-16T20:11:27.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/372: rename d4/d27/d40/f74 to d4/d27/d23/d6e/f87 0 2023-12-16T20:11:27.035 INFO:tasks.workunit.client.0.smithi038.stdout:7/257: mknod da/d24/d4d/c4f 0 2023-12-16T20:11:27.035 INFO:tasks.workunit.client.0.smithi038.stdout:0/274: dread f3 [0,4194304] 0 2023-12-16T20:11:27.036 INFO:tasks.workunit.client.0.smithi038.stdout:3/373: rmdir d4/d27/d23/d6e 39 2023-12-16T20:11:27.038 INFO:tasks.workunit.client.0.smithi038.stdout:4/252: dread d13/d17/d2e/f3d [0,4194304] 0 2023-12-16T20:11:27.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/258: creat da/d21/f50 x:0 0 0 2023-12-16T20:11:27.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/259: dread - da/d21/d2c/f47 zero size 2023-12-16T20:11:27.039 INFO:tasks.workunit.client.0.smithi038.stdout:7/260: stat da/d21/d41/f48 0 2023-12-16T20:11:27.039 INFO:tasks.workunit.client.0.smithi038.stdout:0/275: truncate db/f3d 264394 0 2023-12-16T20:11:27.040 INFO:tasks.workunit.client.0.smithi038.stdout:2/416: sync 2023-12-16T20:11:27.041 INFO:tasks.workunit.client.0.smithi038.stdout:5/312: sync 2023-12-16T20:11:27.041 INFO:tasks.workunit.client.0.smithi038.stdout:6/302: sync 2023-12-16T20:11:27.041 INFO:tasks.workunit.client.0.smithi038.stdout:2/417: chown d1/d5/d16/c20 264037927 1 2023-12-16T20:11:27.041 INFO:tasks.workunit.client.0.smithi038.stdout:8/232: sync 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:3/374: symlink d4/d8/d15/d6d/l88 0 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:7/261: dread f5 [0,4194304] 0 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:1/428: dwrite d15/d1e/f2d [0,4194304] 0 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:1/429: chown d15/d1e/d30/f59 8157 1 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:1/430: write d15/d1e/f67 [554384,48074] 0 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:1/431: truncate d15/d22/f6d 541649 0 2023-12-16T20:11:27.042 INFO:tasks.workunit.client.0.smithi038.stdout:0/276: mknod db/d16/d19/d27/c5e 0 2023-12-16T20:11:27.045 INFO:tasks.workunit.client.0.smithi038.stdout:5/313: unlink d2/df/d1a/d1f/d4a/f56 0 2023-12-16T20:11:27.045 INFO:tasks.workunit.client.0.smithi038.stdout:5/314: chown d2/d4/f58 122980 1 2023-12-16T20:11:27.045 INFO:tasks.workunit.client.0.smithi038.stdout:5/315: write d2/df/d1a/d1f/d4a/f52 [252233,44971] 0 2023-12-16T20:11:27.046 INFO:tasks.workunit.client.0.smithi038.stdout:5/316: write d2/df/d1a/d1f/d4a/d53/f5e [570016,19509] 0 2023-12-16T20:11:27.046 INFO:tasks.workunit.client.0.smithi038.stdout:5/317: read d2/df/d1a/d1f/d4a/f52 [284581,60062] 0 2023-12-16T20:11:27.048 INFO:tasks.workunit.client.0.smithi038.stdout:6/303: mkdir d1/d4/d1d/d61 0 2023-12-16T20:11:27.048 INFO:tasks.workunit.client.0.smithi038.stdout:6/304: creat d1/d4/f62 x:0 0 0 2023-12-16T20:11:27.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/432: write d15/d1e/d23/f39 [3560370,62717] 0 2023-12-16T20:11:27.053 INFO:tasks.workunit.client.0.smithi038.stdout:0/277: dread db/d16/f54 [0,4194304] 0 2023-12-16T20:11:27.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/262: mkdir da/d24/d4d/d51 0 2023-12-16T20:11:27.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/318: mkdir d2/df/d1a/d2a/d5f 0 2023-12-16T20:11:27.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/319: fdatasync d2/d4/fb 0 2023-12-16T20:11:27.062 INFO:tasks.workunit.client.0.smithi038.stdout:8/233: mkdir d17/d48 0 2023-12-16T20:11:27.063 INFO:tasks.workunit.client.0.smithi038.stdout:3/375: truncate d4/d8/f16 1944619 0 2023-12-16T20:11:27.064 INFO:tasks.workunit.client.0.smithi038.stdout:7/263: truncate da/d3e/f40 1385853 0 2023-12-16T20:11:27.065 INFO:tasks.workunit.client.0.smithi038.stdout:5/320: mknod d2/df/d1a/d2a/d59/c60 0 2023-12-16T20:11:27.066 INFO:tasks.workunit.client.0.smithi038.stdout:2/418: rename d1/df/d10/d49 to d1/df/d21/d82 0 2023-12-16T20:11:27.066 INFO:tasks.workunit.client.0.smithi038.stdout:2/419: fdatasync d1/d5/f4e 0 2023-12-16T20:11:27.066 INFO:tasks.workunit.client.0.smithi038.stdout:5/321: dread d2/d14/d25/d2d/d17/f42 [0,4194304] 0 2023-12-16T20:11:27.067 INFO:tasks.workunit.client.0.smithi038.stdout:5/322: readlink d2/l5 0 2023-12-16T20:11:27.067 INFO:tasks.workunit.client.0.smithi038.stdout:2/420: write d1/df/d21/f45 [2104791,117337] 0 2023-12-16T20:11:27.071 INFO:tasks.workunit.client.0.smithi038.stdout:0/278: rename db/f3c to db/d16/d19/f5f 0 2023-12-16T20:11:27.071 INFO:tasks.workunit.client.0.smithi038.stdout:2/421: creat d1/d5/d2a/d5d/d61/d66/f83 x:0 0 0 2023-12-16T20:11:27.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/422: symlink d1/df/d12/l84 0 2023-12-16T20:11:27.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/423: fdatasync d1/d5/f7 0 2023-12-16T20:11:27.219 INFO:tasks.workunit.client.0.smithi038.stdout:6/305: dwrite d1/d4/d1d/d28/d2f/d3d/f51 [0,4194304] 0 2023-12-16T20:11:27.221 INFO:tasks.workunit.client.0.smithi038.stdout:5/323: dread d2/f11 [4194304,4194304] 0 2023-12-16T20:11:27.222 INFO:tasks.workunit.client.0.smithi038.stdout:4/253: dwrite d13/d17/d4b/f33 [0,4194304] 0 2023-12-16T20:11:27.226 INFO:tasks.workunit.client.0.smithi038.stdout:5/324: mknod d2/df/d1a/d2a/c61 0 2023-12-16T20:11:27.233 INFO:tasks.workunit.client.0.smithi038.stdout:5/325: dread f0 [4194304,4194304] 0 2023-12-16T20:11:27.234 INFO:tasks.workunit.client.0.smithi038.stdout:5/326: dread d2/d14/d25/d2d/f2c [0,4194304] 0 2023-12-16T20:11:27.235 INFO:tasks.workunit.client.0.smithi038.stdout:5/327: mkdir d2/d4/d62 0 2023-12-16T20:11:27.242 INFO:tasks.workunit.client.0.smithi038.stdout:0/279: dwrite db/d16/d1c/d4f/f55 [0,4194304] 0 2023-12-16T20:11:27.251 INFO:tasks.workunit.client.0.smithi038.stdout:0/280: dread db/d16/d1c/d4f/f55 [0,4194304] 0 2023-12-16T20:11:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:8/234: dwrite f16 [4194304,4194304] 0 2023-12-16T20:11:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/433: dwrite d15/d22/d52/f81 [0,4194304] 0 2023-12-16T20:11:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/434: fdatasync d15/d1e/d30/f59 0 2023-12-16T20:11:27.261 INFO:tasks.workunit.client.0.smithi038.stdout:0/281: write f6 [3036772,96994] 0 2023-12-16T20:11:27.262 INFO:tasks.workunit.client.0.smithi038.stdout:0/282: symlink db/d16/d1c/d5d/l60 0 2023-12-16T20:11:27.264 INFO:tasks.workunit.client.0.smithi038.stdout:7/264: dwrite da/d21/f28 [0,4194304] 0 2023-12-16T20:11:27.264 INFO:tasks.workunit.client.0.smithi038.stdout:3/376: dwrite d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:27.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/377: chown d4/d8/d15/d6d 50 1 2023-12-16T20:11:27.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/378: stat d4/d8/d15/f54 0 2023-12-16T20:11:27.265 INFO:tasks.workunit.client.0.smithi038.stdout:4/254: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:27.265 INFO:tasks.workunit.client.0.smithi038.stdout:5/328: dwrite d2/f9 [4194304,4194304] 0 2023-12-16T20:11:27.266 INFO:tasks.workunit.client.0.smithi038.stdout:7/265: symlink da/d24/l52 0 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:7/266: chown da/d3e/l37 86 1 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:6/306: dwrite d1/d4/d1d/f2a [0,4194304] 0 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:7/267: write da/d21/f50 [5114,72999] 0 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:7/268: fsync da/d3e/f40 0 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:6/307: stat d1/d16/d23/f29 0 2023-12-16T20:11:27.267 INFO:tasks.workunit.client.0.smithi038.stdout:6/308: truncate d1/d4/f5e 440034 0 2023-12-16T20:11:27.271 INFO:tasks.workunit.client.0.smithi038.stdout:1/435: read d15/d1e/f2d [1128081,70730] 0 2023-12-16T20:11:27.274 INFO:tasks.workunit.client.0.smithi038.stdout:8/235: dwrite d17/d1b/d25/f3c [0,4194304] 0 2023-12-16T20:11:27.274 INFO:tasks.workunit.client.0.smithi038.stdout:8/236: truncate d17/f38 289705 0 2023-12-16T20:11:27.274 INFO:tasks.workunit.client.0.smithi038.stdout:8/237: write d17/d34/f36 [400431,7564] 0 2023-12-16T20:11:27.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/379: symlink d4/d18/l89 0 2023-12-16T20:11:27.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/380: chown d4/d8/d15/d6d/l88 72627797 1 2023-12-16T20:11:27.275 INFO:tasks.workunit.client.0.smithi038.stdout:7/269: write da/d21/f28 [3615745,108774] 0 2023-12-16T20:11:27.277 INFO:tasks.workunit.client.0.smithi038.stdout:4/255: symlink d13/d17/d2e/l51 0 2023-12-16T20:11:27.277 INFO:tasks.workunit.client.0.smithi038.stdout:4/256: write fa [4844551,41590] 0 2023-12-16T20:11:27.277 INFO:tasks.workunit.client.0.smithi038.stdout:4/257: chown d13/d17/d2e/d32/d4d/d4f 134 1 2023-12-16T20:11:27.278 INFO:tasks.workunit.client.0.smithi038.stdout:4/258: write fa [4325292,33608] 0 2023-12-16T20:11:27.281 INFO:tasks.workunit.client.0.smithi038.stdout:1/436: unlink d15/d1e/d30/c31 0 2023-12-16T20:11:27.283 INFO:tasks.workunit.client.0.smithi038.stdout:3/381: rmdir d4/d8/d15 39 2023-12-16T20:11:27.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/270: symlink da/d21/l53 0 2023-12-16T20:11:27.288 INFO:tasks.workunit.client.0.smithi038.stdout:1/437: link d15/f1d d15/d1e/d3b/d48/f97 0 2023-12-16T20:11:27.288 INFO:tasks.workunit.client.0.smithi038.stdout:1/438: creat d15/d22/f98 x:0 0 0 2023-12-16T20:11:27.290 INFO:tasks.workunit.client.0.smithi038.stdout:4/259: write fa [1097432,36382] 0 2023-12-16T20:11:27.291 INFO:tasks.workunit.client.0.smithi038.stdout:1/439: mkdir d15/d1e/d23/d34/d86/d99 0 2023-12-16T20:11:27.292 INFO:tasks.workunit.client.0.smithi038.stdout:4/260: rmdir d13/d17/d2e/d32 39 2023-12-16T20:11:27.295 INFO:tasks.workunit.client.0.smithi038.stdout:1/440: rename d15/d1e/d3b/d48/d5e to d15/d1e/d23/d34/d86/d9a 0 2023-12-16T20:11:27.301 INFO:tasks.workunit.client.0.smithi038.stdout:7/271: read da/d21/d2c/d2e/f16 [1547552,88266] 0 2023-12-16T20:11:27.301 INFO:tasks.workunit.client.0.smithi038.stdout:5/329: dwrite d2/d14/d25/d2d/d17/d55/f57 [0,4194304] 0 2023-12-16T20:11:27.301 INFO:tasks.workunit.client.0.smithi038.stdout:5/330: write d2/df/d1a/d1f/f35 [2065771,32763] 0 2023-12-16T20:11:27.301 INFO:tasks.workunit.client.0.smithi038.stdout:7/272: write da/d21/f50 [517348,7548] 0 2023-12-16T20:11:27.301 INFO:tasks.workunit.client.0.smithi038.stdout:7/273: fdatasync da/d24/f46 0 2023-12-16T20:11:27.302 INFO:tasks.workunit.client.0.smithi038.stdout:5/331: write d2/d14/d25/d2d/f2c [692789,81178] 0 2023-12-16T20:11:27.302 INFO:tasks.workunit.client.0.smithi038.stdout:5/332: write d2/d14/d25/d2d/d17/f42 [1587240,122258] 0 2023-12-16T20:11:27.307 INFO:tasks.workunit.client.0.smithi038.stdout:5/333: creat d2/d14/d25/d2d/f63 x:0 0 0 2023-12-16T20:11:27.308 INFO:tasks.workunit.client.0.smithi038.stdout:5/334: mkdir d2/df/d1a/d2a/d59/d64 0 2023-12-16T20:11:27.309 INFO:tasks.workunit.client.0.smithi038.stdout:9/272: sync 2023-12-16T20:11:27.310 INFO:tasks.workunit.client.0.smithi038.stdout:3/382: dwrite d4/d8/f42 [4194304,4194304] 0 2023-12-16T20:11:27.310 INFO:tasks.workunit.client.0.smithi038.stdout:3/383: stat d4/d27/d23 0 2023-12-16T20:11:27.311 INFO:tasks.workunit.client.0.smithi038.stdout:9/273: rmdir d9 39 2023-12-16T20:11:27.311 INFO:tasks.workunit.client.0.smithi038.stdout:9/274: write d9/d1f/d21/d3e/f49 [95045,62834] 0 2023-12-16T20:11:27.312 INFO:tasks.workunit.client.0.smithi038.stdout:6/309: dwrite d1/d4/f49 [0,4194304] 0 2023-12-16T20:11:27.312 INFO:tasks.workunit.client.0.smithi038.stdout:4/261: write d13/d17/d4b/f33 [4132319,110042] 0 2023-12-16T20:11:27.312 INFO:tasks.workunit.client.0.smithi038.stdout:4/262: fsync d13/f4a 0 2023-12-16T20:11:27.313 INFO:tasks.workunit.client.0.smithi038.stdout:4/263: truncate d13/f3c 4673803 0 2023-12-16T20:11:27.313 INFO:tasks.workunit.client.0.smithi038.stdout:4/264: chown d13 15635 1 2023-12-16T20:11:27.313 INFO:tasks.workunit.client.0.smithi038.stdout:9/275: creat d9/d1e/d40/f51 x:0 0 0 2023-12-16T20:11:27.314 INFO:tasks.workunit.client.0.smithi038.stdout:9/276: write d9/d1f/d21/d3e/f49 [314289,19837] 0 2023-12-16T20:11:27.314 INFO:tasks.workunit.client.0.smithi038.stdout:4/265: write d13/d17/f45 [192383,122049] 0 2023-12-16T20:11:27.318 INFO:tasks.workunit.client.0.smithi038.stdout:4/266: link d13/f3c d13/d17/d2e/f52 0 2023-12-16T20:11:27.319 INFO:tasks.workunit.client.0.smithi038.stdout:7/274: dwrite da/d21/d2c/d2e/f3c [0,4194304] 0 2023-12-16T20:11:27.321 INFO:tasks.workunit.client.0.smithi038.stdout:6/310: getdents d1/d4 0 2023-12-16T20:11:27.322 INFO:tasks.workunit.client.0.smithi038.stdout:4/267: fdatasync d13/d1f/d22/f44 0 2023-12-16T20:11:27.323 INFO:tasks.workunit.client.0.smithi038.stdout:5/335: dread d2/df/f1d [0,4194304] 0 2023-12-16T20:11:27.324 INFO:tasks.workunit.client.0.smithi038.stdout:6/311: dread d1/d4/d1d/d28/d2f/d3d/f4c [0,4194304] 0 2023-12-16T20:11:27.326 INFO:tasks.workunit.client.0.smithi038.stdout:7/275: rename da/d21/d2c/d2e/l20 to da/d21/l54 0 2023-12-16T20:11:27.327 INFO:tasks.workunit.client.0.smithi038.stdout:7/276: creat da/d21/f55 x:0 0 0 2023-12-16T20:11:27.327 INFO:tasks.workunit.client.0.smithi038.stdout:4/268: creat d13/d17/d2e/d32/d4d/d4f/f53 x:0 0 0 2023-12-16T20:11:27.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/277: dwrite d9/d1e/d3d/f4b [0,4194304] 0 2023-12-16T20:11:27.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/278: dread - d9/d1f/f38 zero size 2023-12-16T20:11:27.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/279: truncate d9/fb 1385405 0 2023-12-16T20:11:27.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/280: readlink d9/l1d 0 2023-12-16T20:11:27.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/312: creat d1/d5b/f63 x:0 0 0 2023-12-16T20:11:27.335 INFO:tasks.workunit.client.0.smithi038.stdout:4/269: unlink d13/d17/d4b/c1e 0 2023-12-16T20:11:27.335 INFO:tasks.workunit.client.0.smithi038.stdout:4/270: fdatasync fb 0 2023-12-16T20:11:27.338 INFO:tasks.workunit.client.0.smithi038.stdout:9/281: unlink d9/fb 0 2023-12-16T20:11:27.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/336: write d2/df/d1a/d1f/f32 [2559021,57838] 0 2023-12-16T20:11:27.342 INFO:tasks.workunit.client.0.smithi038.stdout:9/282: mkdir d9/d1f/d21/d52 0 2023-12-16T20:11:27.342 INFO:tasks.workunit.client.0.smithi038.stdout:9/283: read - d9/d1e/d45/f4a zero size 2023-12-16T20:11:27.342 INFO:tasks.workunit.client.0.smithi038.stdout:9/284: creat d9/d1e/d3d/d42/f53 x:0 0 0 2023-12-16T20:11:27.343 INFO:tasks.workunit.client.0.smithi038.stdout:5/337: symlink d2/df/d1a/d2a/l65 0 2023-12-16T20:11:27.343 INFO:tasks.workunit.client.0.smithi038.stdout:6/313: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:27.343 INFO:tasks.workunit.client.0.smithi038.stdout:6/314: chown d1/d4/d1d/d28/c2d 6555 1 2023-12-16T20:11:27.344 INFO:tasks.workunit.client.0.smithi038.stdout:4/271: link d13/d1f/d22/l4c d13/d17/d2e/d32/d4e/l54 0 2023-12-16T20:11:27.346 INFO:tasks.workunit.client.0.smithi038.stdout:9/285: mknod d9/d1f/d21/d3e/d4e/c54 0 2023-12-16T20:11:27.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/277: dwrite da/d21/d2c/f47 [0,4194304] 0 2023-12-16T20:11:27.347 INFO:tasks.workunit.client.0.smithi038.stdout:6/315: link d1/d2e/l42 d1/d4/l64 0 2023-12-16T20:11:27.348 INFO:tasks.workunit.client.0.smithi038.stdout:4/272: symlink d13/d17/d2e/d32/l55 0 2023-12-16T20:11:27.348 INFO:tasks.workunit.client.0.smithi038.stdout:4/273: truncate d13/d17/d4b/f43 984815 0 2023-12-16T20:11:27.353 INFO:tasks.workunit.client.0.smithi038.stdout:7/278: rename c8 to da/d21/d41/c56 0 2023-12-16T20:11:27.353 INFO:tasks.workunit.client.0.smithi038.stdout:7/279: fdatasync da/d21/d2c/d2e/f16 0 2023-12-16T20:11:27.354 INFO:tasks.workunit.client.0.smithi038.stdout:5/338: write d2/f12 [3437746,834] 0 2023-12-16T20:11:27.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/316: rename d1/d4/d1d/l50 to d1/d4/d1d/d28/d2f/l65 0 2023-12-16T20:11:27.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/317: creat d1/d4/d1d/f66 x:0 0 0 2023-12-16T20:11:27.357 INFO:tasks.workunit.client.0.smithi038.stdout:7/280: rmdir da/d21/d2c 39 2023-12-16T20:11:27.366 INFO:tasks.workunit.client.0.smithi038.stdout:6/318: mkdir d1/d4/d1d/d67 0 2023-12-16T20:11:27.368 INFO:tasks.workunit.client.0.smithi038.stdout:9/286: dwrite d9/d1e/d3d/f4b [0,4194304] 0 2023-12-16T20:11:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:9/287: write d9/fe [1086278,31490] 0 2023-12-16T20:11:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:7/281: symlink da/d3e/d31/l57 0 2023-12-16T20:11:27.370 INFO:tasks.workunit.client.0.smithi038.stdout:9/288: dread d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:27.370 INFO:tasks.workunit.client.0.smithi038.stdout:9/289: truncate d9/d1f/d21/d3e/f50 319240 0 2023-12-16T20:11:27.371 INFO:tasks.workunit.client.0.smithi038.stdout:9/290: read d9/d1e/d3d/d42/f48 [143946,127079] 0 2023-12-16T20:11:27.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/319: symlink d1/d2e/l68 0 2023-12-16T20:11:27.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/320: dread - d1/d4/d1d/d28/f37 zero size 2023-12-16T20:11:27.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/321: write d1/d4/d1d/d28/d2f/d3d/f46 [2631672,87840] 0 2023-12-16T20:11:27.381 INFO:tasks.workunit.client.0.smithi038.stdout:7/282: mknod da/d3e/d31/d38/c58 0 2023-12-16T20:11:27.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/322: getdents d1/d5b 0 2023-12-16T20:11:27.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/323: write d1/d4/f1c [938630,50183] 0 2023-12-16T20:11:27.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/324: chown d1/d4/f5e 33 1 2023-12-16T20:11:27.384 INFO:tasks.workunit.client.0.smithi038.stdout:6/325: creat d1/d4/d1d/d28/f69 x:0 0 0 2023-12-16T20:11:27.386 INFO:tasks.workunit.client.0.smithi038.stdout:4/274: dwrite d13/f19 [0,4194304] 0 2023-12-16T20:11:27.388 INFO:tasks.workunit.client.0.smithi038.stdout:4/275: creat d13/d17/d2e/d32/f56 x:0 0 0 2023-12-16T20:11:27.389 INFO:tasks.workunit.client.0.smithi038.stdout:4/276: symlink d13/d1f/d35/l57 0 2023-12-16T20:11:27.390 INFO:tasks.workunit.client.0.smithi038.stdout:5/339: dwrite f0 [4194304,4194304] 0 2023-12-16T20:11:27.391 INFO:tasks.workunit.client.0.smithi038.stdout:5/340: mknod d2/d14/d25/d2d/c66 0 2023-12-16T20:11:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:5/341: mkdir d2/df/d67 0 2023-12-16T20:11:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/277: dread fa [4194304,4194304] 0 2023-12-16T20:11:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/278: chown d13/d17/d2e/d32/d4d 76994320 1 2023-12-16T20:11:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/279: stat d13/l16 0 2023-12-16T20:11:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:5/342: creat d2/df/d1a/d2a/f68 x:0 0 0 2023-12-16T20:11:27.395 INFO:tasks.workunit.client.0.smithi038.stdout:5/343: creat d2/d4/d62/f69 x:0 0 0 2023-12-16T20:11:27.399 INFO:tasks.workunit.client.0.smithi038.stdout:6/326: dread d1/f22 [0,4194304] 0 2023-12-16T20:11:27.399 INFO:tasks.workunit.client.0.smithi038.stdout:7/283: dwrite da/d24/f46 [0,4194304] 0 2023-12-16T20:11:27.399 INFO:tasks.workunit.client.0.smithi038.stdout:7/284: fsync f5 0 2023-12-16T20:11:27.399 INFO:tasks.workunit.client.0.smithi038.stdout:7/285: write da/d21/d2c/d2e/f2d [864112,110739] 0 2023-12-16T20:11:27.400 INFO:tasks.workunit.client.0.smithi038.stdout:6/327: creat d1/d4/d1d/d28/d2f/d3d/f6a x:0 0 0 2023-12-16T20:11:27.401 INFO:tasks.workunit.client.0.smithi038.stdout:7/286: getdents da 0 2023-12-16T20:11:27.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/328: mknod d1/d4/d1d/d67/c6b 0 2023-12-16T20:11:27.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/329: stat d1/d4/c3a 0 2023-12-16T20:11:27.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/330: truncate d1/d4/f20 2371603 0 2023-12-16T20:11:27.407 INFO:tasks.workunit.client.0.smithi038.stdout:7/287: rmdir da/d3e 39 2023-12-16T20:11:27.409 INFO:tasks.workunit.client.0.smithi038.stdout:7/288: creat da/d21/d2c/f59 x:0 0 0 2023-12-16T20:11:27.413 INFO:tasks.workunit.client.0.smithi038.stdout:5/344: dwrite d2/d4/fb [0,4194304] 0 2023-12-16T20:11:27.416 INFO:tasks.workunit.client.0.smithi038.stdout:5/345: getdents d2/d4/d62 0 2023-12-16T20:11:27.416 INFO:tasks.workunit.client.0.smithi038.stdout:5/346: dread - d2/d4/f58 zero size 2023-12-16T20:11:27.416 INFO:tasks.workunit.client.0.smithi038.stdout:5/347: creat d2/df/d1a/d1f/f6a x:0 0 0 2023-12-16T20:11:27.418 INFO:tasks.workunit.client.0.smithi038.stdout:5/348: unlink d2/f7 0 2023-12-16T20:11:27.421 INFO:tasks.workunit.client.0.smithi038.stdout:5/349: rename d2/df/d1a/d2a/d59/d64 to d2/d14/d25/d2d/d17/d55/d6b 0 2023-12-16T20:11:27.421 INFO:tasks.workunit.client.0.smithi038.stdout:5/350: creat d2/df/d1a/d2a/f6c x:0 0 0 2023-12-16T20:11:27.422 INFO:tasks.workunit.client.0.smithi038.stdout:5/351: getdents d2/df/d1a/d1f/d4a/d53 0 2023-12-16T20:11:27.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/289: dwrite da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:27.433 INFO:tasks.workunit.client.0.smithi038.stdout:7/290: mknod da/d21/d2c/c5a 0 2023-12-16T20:11:27.435 INFO:tasks.workunit.client.0.smithi038.stdout:5/352: dwrite d2/df/d1a/d1f/d4a/d53/f5e [0,4194304] 0 2023-12-16T20:11:27.435 INFO:tasks.workunit.client.0.smithi038.stdout:7/291: symlink da/d24/l5b 0 2023-12-16T20:11:27.435 INFO:tasks.workunit.client.0.smithi038.stdout:7/292: chown da/d21/d2c/c3f 797563 1 2023-12-16T20:11:27.437 INFO:tasks.workunit.client.0.smithi038.stdout:5/353: symlink d2/d14/l6d 0 2023-12-16T20:11:27.437 INFO:tasks.workunit.client.0.smithi038.stdout:5/354: chown d2/d14/f40 1364 1 2023-12-16T20:11:27.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/293: link da/d3e/d31/f39 da/d3e/f5c 0 2023-12-16T20:11:27.461 INFO:tasks.workunit.client.0.smithi038.stdout:5/355: dwrite d2/f10 [0,4194304] 0 2023-12-16T20:11:27.461 INFO:tasks.workunit.client.0.smithi038.stdout:5/356: dread - d2/df/d1a/d1f/f3d zero size 2023-12-16T20:11:27.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/294: dwrite da/d21/d2c/f36 [0,4194304] 0 2023-12-16T20:11:27.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/295: creat da/f5d x:0 0 0 2023-12-16T20:11:27.471 INFO:tasks.workunit.client.0.smithi038.stdout:7/296: dread f6 [0,4194304] 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:7/297: creat da/f5e x:0 0 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:5/357: dread d2/f9 [4194304,4194304] 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:7/298: creat da/d21/d2c/d2e/f5f x:0 0 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:7/299: truncate da/d21/d2c/d2e/f5f 638874 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:5/358: mkdir d2/df/d1a/d1f/d4a/d53/d6e 0 2023-12-16T20:11:27.472 INFO:tasks.workunit.client.0.smithi038.stdout:5/359: fdatasync d2/df/d1a/d2a/f68 0 2023-12-16T20:11:27.473 INFO:tasks.workunit.client.0.smithi038.stdout:7/300: unlink da/d24/f46 0 2023-12-16T20:11:27.474 INFO:tasks.workunit.client.0.smithi038.stdout:7/301: link da/d21/d2c/d2e/f2d da/d24/d4d/d51/f60 0 2023-12-16T20:11:27.475 INFO:tasks.workunit.client.0.smithi038.stdout:7/302: chown da/d21/f34 264993 1 2023-12-16T20:11:27.478 INFO:tasks.workunit.client.0.smithi038.stdout:2/424: sync 2023-12-16T20:11:27.478 INFO:tasks.workunit.client.0.smithi038.stdout:0/283: sync 2023-12-16T20:11:27.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/425: rmdir d1/df/d6a 39 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:2/426: dread - d1/d73/f81 zero size 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:2/427: fdatasync d1/df/d10/f77 0 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:0/284: dread db/f14 [0,4194304] 0 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:0/285: write db/d16/d19/d27/f34 [4332627,59212] 0 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:5/360: dread d2/d14/d25/d2d/f31 [0,4194304] 0 2023-12-16T20:11:27.480 INFO:tasks.workunit.client.0.smithi038.stdout:5/361: chown d2/d14/d25/d2d/d17/d51 2305 1 2023-12-16T20:11:27.481 INFO:tasks.workunit.client.0.smithi038.stdout:0/286: truncate f3 2554390 0 2023-12-16T20:11:27.482 INFO:tasks.workunit.client.0.smithi038.stdout:5/362: creat d2/df/d1a/d2a/d59/f6f x:0 0 0 2023-12-16T20:11:27.483 INFO:tasks.workunit.client.0.smithi038.stdout:0/287: fsync db/d16/d19/d27/f34 0 2023-12-16T20:11:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/288: chown db/d16/d19/d27/f34 83 1 2023-12-16T20:11:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/289: write f5 [4786868,118246] 0 2023-12-16T20:11:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/290: chown db/ce 263401157 1 2023-12-16T20:11:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/291: fdatasync db/d16/d1c/d4f/f55 0 2023-12-16T20:11:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:2/428: dread d1/df/d10/f46 [0,4194304] 0 2023-12-16T20:11:27.485 INFO:tasks.workunit.client.0.smithi038.stdout:0/292: creat db/d16/d1c/d5d/f61 x:0 0 0 2023-12-16T20:11:27.485 INFO:tasks.workunit.client.0.smithi038.stdout:0/293: write db/d16/d19/f46 [933259,128253] 0 2023-12-16T20:11:27.486 INFO:tasks.workunit.client.0.smithi038.stdout:0/294: creat db/d16/d1c/f62 x:0 0 0 2023-12-16T20:11:27.487 INFO:tasks.workunit.client.0.smithi038.stdout:0/295: truncate db/f44 1069458 0 2023-12-16T20:11:27.490 INFO:tasks.workunit.client.0.smithi038.stdout:0/296: getdents db 0 2023-12-16T20:11:27.492 INFO:tasks.workunit.client.0.smithi038.stdout:0/297: mknod db/d16/d1c/c63 0 2023-12-16T20:11:27.492 INFO:tasks.workunit.client.0.smithi038.stdout:5/363: read d2/d14/f33 [3055868,121520] 0 2023-12-16T20:11:27.493 INFO:tasks.workunit.client.0.smithi038.stdout:0/298: mkdir db/d16/d1c/d5d/d64 0 2023-12-16T20:11:27.497 INFO:tasks.workunit.client.0.smithi038.stdout:5/364: link d2/df/d1a/d2a/d59/c60 d2/c70 0 2023-12-16T20:11:27.498 INFO:tasks.workunit.client.0.smithi038.stdout:5/365: rmdir d2/d4/d62 39 2023-12-16T20:11:27.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/366: link d2/df/d1a/d2a/c34 d2/df/d1a/d1f/d4a/d53/d6e/c71 0 2023-12-16T20:11:27.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/367: chown d2/f11 0 1 2023-12-16T20:11:27.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/368: truncate d2/f9 1741392 0 2023-12-16T20:11:27.501 INFO:tasks.workunit.client.0.smithi038.stdout:0/299: write db/f44 [662868,66996] 0 2023-12-16T20:11:27.502 INFO:tasks.workunit.client.0.smithi038.stdout:5/369: unlink d2/df/d1a/d1f/f35 0 2023-12-16T20:11:27.502 INFO:tasks.workunit.client.0.smithi038.stdout:5/370: chown d2/df/d1a/c38 164524 1 2023-12-16T20:11:27.504 INFO:tasks.workunit.client.0.smithi038.stdout:5/371: creat d2/d14/d25/d2d/d17/d55/f72 x:0 0 0 2023-12-16T20:11:27.505 INFO:tasks.workunit.client.0.smithi038.stdout:5/372: truncate d2/d14/d25/d2d/d17/f19 4130679 0 2023-12-16T20:11:27.506 INFO:tasks.workunit.client.0.smithi038.stdout:2/429: dwrite d1/d5/d2a/f35 [0,4194304] 0 2023-12-16T20:11:27.507 INFO:tasks.workunit.client.0.smithi038.stdout:5/373: rmdir d2/df/d67 0 2023-12-16T20:11:27.510 INFO:tasks.workunit.client.0.smithi038.stdout:2/430: rename d1/df/c7b to d1/d5/d2a/d5d/c85 0 2023-12-16T20:11:27.510 INFO:tasks.workunit.client.0.smithi038.stdout:2/431: write d1/df/d10/f4f [90505,90393] 0 2023-12-16T20:11:27.512 INFO:tasks.workunit.client.0.smithi038.stdout:5/374: symlink d2/d14/d25/d2d/d17/d51/l73 0 2023-12-16T20:11:27.512 INFO:tasks.workunit.client.0.smithi038.stdout:5/375: creat d2/df/d1a/d2a/f74 x:0 0 0 2023-12-16T20:11:27.512 INFO:tasks.workunit.client.0.smithi038.stdout:2/432: symlink d1/df/d6a/d43/d57/l86 0 2023-12-16T20:11:27.514 INFO:tasks.workunit.client.0.smithi038.stdout:0/300: dwrite f3 [0,4194304] 0 2023-12-16T20:11:27.515 INFO:tasks.workunit.client.1.smithi141.stdout:5/47: sync 2023-12-16T20:11:27.515 INFO:tasks.workunit.client.1.smithi141.stdout:2/16: sync 2023-12-16T20:11:27.515 INFO:tasks.workunit.client.1.smithi141.stdout:2/17: write d6/f7 [748603,15876] 0 2023-12-16T20:11:27.515 INFO:tasks.workunit.client.1.smithi141.stdout:6/39: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:0/22: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:4/19: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:7/1: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:7/2: fdatasync - no filename 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:4/20: creat fa x:0 0 0 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:3/67: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/51: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:2/18: write d6/f7 [158230,31694] 0 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:1/17: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:1/18: dwrite - no filename 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:9/8: sync 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:9/9: dread - no filename 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/52: chown cd 95302772 1 2023-12-16T20:11:27.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/53: chown le 12679 1 2023-12-16T20:11:27.517 INFO:tasks.workunit.client.0.smithi038.stdout:5/376: unlink d2/d14/d25/c4e 0 2023-12-16T20:11:27.517 INFO:tasks.workunit.client.0.smithi038.stdout:5/377: dread - d2/d4/d62/f69 zero size 2023-12-16T20:11:27.517 INFO:tasks.workunit.client.1.smithi141.stdout:5/48: getdents d0/d9 0 2023-12-16T20:11:27.518 INFO:tasks.workunit.client.1.smithi141.stdout:0/23: rmdir d4 39 2023-12-16T20:11:27.518 INFO:tasks.workunit.client.1.smithi141.stdout:6/40: truncate d1/f4 270803 0 2023-12-16T20:11:27.518 INFO:tasks.workunit.client.1.smithi141.stdout:6/41: chown d1/f4 956938 1 2023-12-16T20:11:27.519 INFO:tasks.workunit.client.1.smithi141.stdout:7/3: symlink l0 0 2023-12-16T20:11:27.520 INFO:tasks.workunit.client.1.smithi141.stdout:4/21: link l3 lb 0 2023-12-16T20:11:27.521 INFO:tasks.workunit.client.0.smithi038.stdout:2/433: unlink d1/d5/c13 0 2023-12-16T20:11:27.521 INFO:tasks.workunit.client.1.smithi141.stdout:4/22: creat fc x:0 0 0 2023-12-16T20:11:27.521 INFO:tasks.workunit.client.1.smithi141.stdout:4/23: truncate f1 823814 0 2023-12-16T20:11:27.521 INFO:tasks.workunit.client.1.smithi141.stdout:4/24: creat fd x:0 0 0 2023-12-16T20:11:27.522 INFO:tasks.workunit.client.1.smithi141.stdout:4/25: write f1 [784123,41724] 0 2023-12-16T20:11:27.522 INFO:tasks.workunit.client.1.smithi141.stdout:4/26: write f1 [1127996,67214] 0 2023-12-16T20:11:27.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/10: rename d1/c2 to d1/c3 0 2023-12-16T20:11:27.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/11: rename d1 to d1/d4 22 2023-12-16T20:11:27.527 INFO:tasks.workunit.client.1.smithi141.stdout:5/49: mknod d0/d9/cd 0 2023-12-16T20:11:27.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/434: mknod d1/d5/d6c/c87 0 2023-12-16T20:11:27.527 INFO:tasks.workunit.client.1.smithi141.stdout:6/42: creat d1/d3/f10 x:0 0 0 2023-12-16T20:11:27.527 INFO:tasks.workunit.client.1.smithi141.stdout:6/43: write d1/d3/ff [303699,122086] 0 2023-12-16T20:11:27.530 INFO:tasks.workunit.client.0.smithi038.stdout:2/435: mkdir d1/d88 0 2023-12-16T20:11:27.530 INFO:tasks.workunit.client.1.smithi141.stdout:4/27: mknod ce 0 2023-12-16T20:11:27.530 INFO:tasks.workunit.client.1.smithi141.stdout:4/28: truncate fc 329251 0 2023-12-16T20:11:27.531 INFO:tasks.workunit.client.1.smithi141.stdout:9/12: symlink d1/l5 0 2023-12-16T20:11:27.532 INFO:tasks.workunit.client.0.smithi038.stdout:0/301: dread db/d1a/f33 [0,4194304] 0 2023-12-16T20:11:27.533 INFO:tasks.workunit.client.0.smithi038.stdout:2/436: unlink d1/df/d21/l2d 0 2023-12-16T20:11:27.533 INFO:tasks.workunit.client.0.smithi038.stdout:2/437: write d1/df/d10/d2f/f6f [773615,110982] 0 2023-12-16T20:11:27.533 INFO:tasks.workunit.client.0.smithi038.stdout:2/438: chown d1/l68 7198771 1 2023-12-16T20:11:27.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/29: unlink fc 0 2023-12-16T20:11:27.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/30: write f1 [1582452,105317] 0 2023-12-16T20:11:27.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/31: fdatasync fd 0 2023-12-16T20:11:27.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/32: creat ff x:0 0 0 2023-12-16T20:11:27.535 INFO:tasks.workunit.client.1.smithi141.stdout:4/33: dread - ff zero size 2023-12-16T20:11:27.536 INFO:tasks.workunit.client.1.smithi141.stdout:9/13: creat d1/f6 x:0 0 0 2023-12-16T20:11:27.537 INFO:tasks.workunit.client.0.smithi038.stdout:0/302: mkdir db/d16/d5a/d65 0 2023-12-16T20:11:27.547 INFO:tasks.workunit.client.0.smithi038.stdout:0/303: rename db/d16/d1c/d4f to db/d16/d66 0 2023-12-16T20:11:27.548 INFO:tasks.workunit.client.1.smithi141.stdout:0/24: dwrite f3 [0,4194304] 0 2023-12-16T20:11:27.549 INFO:tasks.workunit.client.1.smithi141.stdout:8/54: write f8 [3188790,35603] 0 2023-12-16T20:11:27.549 INFO:tasks.workunit.client.1.smithi141.stdout:8/55: chown le 39742763 1 2023-12-16T20:11:27.549 INFO:tasks.workunit.client.0.smithi038.stdout:0/304: rmdir db 39 2023-12-16T20:11:27.549 INFO:tasks.workunit.client.0.smithi038.stdout:0/305: chown db/d1a/l39 2 1 2023-12-16T20:11:27.550 INFO:tasks.workunit.client.1.smithi141.stdout:0/25: write f1 [890861,25417] 0 2023-12-16T20:11:27.552 INFO:tasks.workunit.client.1.smithi141.stdout:3/68: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:27.553 INFO:tasks.workunit.client.1.smithi141.stdout:8/56: rename f0 to f12 0 2023-12-16T20:11:27.556 INFO:tasks.workunit.client.1.smithi141.stdout:3/69: mknod d0/d13/c19 0 2023-12-16T20:11:27.556 INFO:tasks.workunit.client.0.smithi038.stdout:5/378: dwrite d2/f11 [0,4194304] 0 2023-12-16T20:11:27.557 INFO:tasks.workunit.client.1.smithi141.stdout:7/4: getdents . 0 2023-12-16T20:11:27.557 INFO:tasks.workunit.client.1.smithi141.stdout:7/5: write - no filename 2023-12-16T20:11:27.557 INFO:tasks.workunit.client.1.smithi141.stdout:7/6: stat l0 0 2023-12-16T20:11:27.558 INFO:tasks.workunit.client.0.smithi038.stdout:0/306: write db/d16/d1c/f48 [1757715,113149] 0 2023-12-16T20:11:27.558 INFO:tasks.workunit.client.0.smithi038.stdout:0/307: chown db/d16/d19/c58 114419 1 2023-12-16T20:11:27.560 INFO:tasks.workunit.client.1.smithi141.stdout:7/7: rename l0 to l1 0 2023-12-16T20:11:27.562 INFO:tasks.workunit.client.1.smithi141.stdout:8/57: symlink l13 0 2023-12-16T20:11:27.562 INFO:tasks.workunit.client.1.smithi141.stdout:8/58: truncate ff 554513 0 2023-12-16T20:11:27.562 INFO:tasks.workunit.client.1.smithi141.stdout:8/59: fdatasync f11 0 2023-12-16T20:11:27.563 INFO:tasks.workunit.client.1.smithi141.stdout:2/19: truncate d6/f7 471909 0 2023-12-16T20:11:27.565 INFO:tasks.workunit.client.1.smithi141.stdout:3/70: dread d0/f8 [0,4194304] 0 2023-12-16T20:11:27.565 INFO:tasks.workunit.client.1.smithi141.stdout:2/20: getdents d6 0 2023-12-16T20:11:27.566 INFO:tasks.workunit.client.1.smithi141.stdout:3/71: read d0/f17 [184651,26366] 0 2023-12-16T20:11:27.568 INFO:tasks.workunit.client.1.smithi141.stdout:2/21: rename l4 to d6/l8 0 2023-12-16T20:11:27.569 INFO:tasks.workunit.client.1.smithi141.stdout:3/72: dread d0/f17 [0,4194304] 0 2023-12-16T20:11:27.572 INFO:tasks.workunit.client.1.smithi141.stdout:3/73: mknod d0/c1a 0 2023-12-16T20:11:27.572 INFO:tasks.workunit.client.1.smithi141.stdout:3/74: truncate d0/f8 4411892 0 2023-12-16T20:11:27.573 INFO:tasks.workunit.client.1.smithi141.stdout:4/34: dwrite fd [0,4194304] 0 2023-12-16T20:11:27.574 INFO:tasks.workunit.client.1.smithi141.stdout:3/75: creat d0/d13/f1b x:0 0 0 2023-12-16T20:11:27.579 INFO:tasks.workunit.client.0.smithi038.stdout:0/308: dread f8 [0,4194304] 0 2023-12-16T20:11:27.579 INFO:tasks.workunit.client.0.smithi038.stdout:0/309: chown db/d16/d66 35399 1 2023-12-16T20:11:27.579 INFO:tasks.workunit.client.1.smithi141.stdout:3/76: mkdir d0/d1c 0 2023-12-16T20:11:27.580 INFO:tasks.workunit.client.1.smithi141.stdout:9/14: getdents d1 0 2023-12-16T20:11:27.581 INFO:tasks.workunit.client.0.smithi038.stdout:0/310: symlink db/d16/d19/d27/d56/l67 0 2023-12-16T20:11:27.581 INFO:tasks.workunit.client.0.smithi038.stdout:0/311: chown db/d16/d19/d27/c5e 1091 1 2023-12-16T20:11:27.581 INFO:tasks.workunit.client.0.smithi038.stdout:5/379: dread d2/d4/fb [0,4194304] 0 2023-12-16T20:11:27.581 INFO:tasks.workunit.client.1.smithi141.stdout:3/77: truncate d0/f6 4625658 0 2023-12-16T20:11:27.582 INFO:tasks.workunit.client.1.smithi141.stdout:3/78: creat d0/d13/f1d x:0 0 0 2023-12-16T20:11:27.582 INFO:tasks.workunit.client.1.smithi141.stdout:3/79: truncate d0/d13/f1d 595043 0 2023-12-16T20:11:27.582 INFO:tasks.workunit.client.0.smithi038.stdout:2/439: dwrite d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:27.583 INFO:tasks.workunit.client.1.smithi141.stdout:6/44: dwrite d1/d3/f10 [0,4194304] 0 2023-12-16T20:11:27.584 INFO:tasks.workunit.client.1.smithi141.stdout:5/50: dwrite d0/f4 [0,4194304] 0 2023-12-16T20:11:27.584 INFO:tasks.workunit.client.1.smithi141.stdout:9/15: symlink d1/l7 0 2023-12-16T20:11:27.585 INFO:tasks.workunit.client.0.smithi038.stdout:2/440: mknod d1/d88/c89 0 2023-12-16T20:11:27.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/441: mknod d1/d5/d3d/c8a 0 2023-12-16T20:11:27.591 INFO:tasks.workunit.client.0.smithi038.stdout:6/331: sync 2023-12-16T20:11:27.591 INFO:tasks.workunit.client.0.smithi038.stdout:1/441: sync 2023-12-16T20:11:27.591 INFO:tasks.workunit.client.0.smithi038.stdout:8/238: sync 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/280: sync 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:3/384: sync 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:9/291: sync 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/281: fdatasync d13/f4a 0 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:9/292: read - d9/d1e/d40/f41 zero size 2023-12-16T20:11:27.592 INFO:tasks.workunit.client.0.smithi038.stdout:9/293: readlink d9/d1e/d3d/l4d 0 2023-12-16T20:11:27.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/442: rename d1/df/d6a/c3f to d1/d5/d2a/d5d/d61/d66/c8b 0 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/8: getdents . 0 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/9: write - no filename 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/10: truncate - no filename 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/11: chown l1 1023064895 1 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/12: write - no filename 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/13: dwrite - no filename 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/14: rmdir - no directory 2023-12-16T20:11:27.595 INFO:tasks.workunit.client.1.smithi141.stdout:7/15: chown l1 0 1 2023-12-16T20:11:27.596 INFO:tasks.workunit.client.0.smithi038.stdout:6/332: unlink d1/c53 0 2023-12-16T20:11:27.596 INFO:tasks.workunit.client.0.smithi038.stdout:6/333: write d1/d16/f44 [40111,36036] 0 2023-12-16T20:11:27.597 INFO:tasks.workunit.client.0.smithi038.stdout:6/334: creat d1/f6c x:0 0 0 2023-12-16T20:11:27.602 INFO:tasks.workunit.client.0.smithi038.stdout:1/442: dread d15/f21 [0,4194304] 0 2023-12-16T20:11:27.603 INFO:tasks.workunit.client.0.smithi038.stdout:9/294: unlink d9/f2c 0 2023-12-16T20:11:27.603 INFO:tasks.workunit.client.0.smithi038.stdout:1/443: write d15/d22/d52/d7f/f96 [747066,103425] 0 2023-12-16T20:11:27.604 INFO:tasks.workunit.client.0.smithi038.stdout:1/444: dread - d15/d22/f51 zero size 2023-12-16T20:11:27.605 INFO:tasks.workunit.client.0.smithi038.stdout:4/282: creat d13/d1f/d22/d34/f58 x:0 0 0 2023-12-16T20:11:27.605 INFO:tasks.workunit.client.0.smithi038.stdout:1/445: truncate d15/d22/d52/f91 109395 0 2023-12-16T20:11:27.606 INFO:tasks.workunit.client.1.smithi141.stdout:5/51: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:27.606 INFO:tasks.workunit.client.0.smithi038.stdout:6/335: mkdir d1/d4/d1d/d61/d6d 0 2023-12-16T20:11:27.608 INFO:tasks.workunit.client.0.smithi038.stdout:9/295: dread d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:27.608 INFO:tasks.workunit.client.0.smithi038.stdout:9/296: fdatasync d9/d1e/d40/f51 0 2023-12-16T20:11:27.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/283: creat d13/d17/d2e/d32/d4e/f59 x:0 0 0 2023-12-16T20:11:27.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/284: read - d13/d17/f36 zero size 2023-12-16T20:11:27.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/297: mkdir d9/d1f/d21/d55 0 2023-12-16T20:11:27.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/298: readlink d9/l1d 0 2023-12-16T20:11:27.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/285: chown d13/d1f/d22/f44 135188 1 2023-12-16T20:11:27.610 INFO:tasks.workunit.client.0.smithi038.stdout:4/286: symlink d13/d1f/l5a 0 2023-12-16T20:11:27.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/52: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:27.612 INFO:tasks.workunit.client.0.smithi038.stdout:3/385: dread d4/d8/f24 [0,4194304] 0 2023-12-16T20:11:27.614 INFO:tasks.workunit.client.1.smithi141.stdout:5/53: creat d0/fe x:0 0 0 2023-12-16T20:11:27.614 INFO:tasks.workunit.client.1.smithi141.stdout:5/54: mkdir d0/df 0 2023-12-16T20:11:27.616 INFO:tasks.workunit.client.0.smithi038.stdout:1/446: write d15/d1e/d23/d34/f5d [1821753,72718] 0 2023-12-16T20:11:27.616 INFO:tasks.workunit.client.0.smithi038.stdout:1/447: readlink l5 0 2023-12-16T20:11:27.616 INFO:tasks.workunit.client.0.smithi038.stdout:4/287: dread d13/d1f/d35/f38 [0,4194304] 0 2023-12-16T20:11:27.616 INFO:tasks.workunit.client.1.smithi141.stdout:5/55: link d0/d9/cd d0/d9/c10 0 2023-12-16T20:11:27.616 INFO:tasks.workunit.client.1.smithi141.stdout:5/56: fdatasync d0/fe 0 2023-12-16T20:11:27.618 INFO:tasks.workunit.client.1.smithi141.stdout:6/45: dwrite d1/d3/ff [0,4194304] 0 2023-12-16T20:11:27.618 INFO:tasks.workunit.client.1.smithi141.stdout:5/57: unlink d0/d9/c10 0 2023-12-16T20:11:27.618 INFO:tasks.workunit.client.1.smithi141.stdout:5/58: truncate d0/fe 764552 0 2023-12-16T20:11:27.621 INFO:tasks.workunit.client.1.smithi141.stdout:6/46: symlink d1/dd/de/l11 0 2023-12-16T20:11:27.622 INFO:tasks.workunit.client.0.smithi038.stdout:4/288: symlink d13/d17/l5b 0 2023-12-16T20:11:27.622 INFO:tasks.workunit.client.0.smithi038.stdout:4/289: truncate d13/d1f/d22/f44 580997 0 2023-12-16T20:11:27.622 INFO:tasks.workunit.client.0.smithi038.stdout:9/299: read d9/f1c [2549166,77133] 0 2023-12-16T20:11:27.622 INFO:tasks.workunit.client.0.smithi038.stdout:4/290: mknod d13/d17/d4b/c5c 0 2023-12-16T20:11:27.623 INFO:tasks.workunit.client.1.smithi141.stdout:2/22: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:27.623 INFO:tasks.workunit.client.1.smithi141.stdout:2/23: readlink d6/l8 0 2023-12-16T20:11:27.623 INFO:tasks.workunit.client.1.smithi141.stdout:8/60: dwrite f8 [0,4194304] 0 2023-12-16T20:11:27.623 INFO:tasks.workunit.client.1.smithi141.stdout:5/59: unlink d0/d9/cc 0 2023-12-16T20:11:27.624 INFO:tasks.workunit.client.1.smithi141.stdout:5/60: rename d0/d9 to d0/d9/d11 22 2023-12-16T20:11:27.628 INFO:tasks.workunit.client.1.smithi141.stdout:6/47: mkdir d1/d12 0 2023-12-16T20:11:27.631 INFO:tasks.workunit.client.0.smithi038.stdout:4/291: write d13/f19 [1584896,78127] 0 2023-12-16T20:11:27.631 INFO:tasks.workunit.client.0.smithi038.stdout:4/292: write d13/d17/d4b/f33 [1649102,120375] 0 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:5/61: symlink d0/df/l12 0 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:4/35: dwrite fa [0,4194304] 0 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:5/62: write d0/fe [1266917,90357] 0 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:5/63: chown d0/df/l12 7909 1 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:4/36: write f9 [270675,97022] 0 2023-12-16T20:11:27.633 INFO:tasks.workunit.client.1.smithi141.stdout:3/80: rmdir d0/d13 39 2023-12-16T20:11:27.636 INFO:tasks.workunit.client.0.smithi038.stdout:2/443: rmdir d1/d5/d2a 39 2023-12-16T20:11:27.636 INFO:tasks.workunit.client.0.smithi038.stdout:2/444: dread - d1/df/d6d/f69 zero size 2023-12-16T20:11:27.636 INFO:tasks.workunit.client.1.smithi141.stdout:6/48: symlink d1/l13 0 2023-12-16T20:11:27.637 INFO:tasks.workunit.client.1.smithi141.stdout:6/49: getdents d1/d12 0 2023-12-16T20:11:27.638 INFO:tasks.workunit.client.0.smithi038.stdout:0/312: dwrite db/f10 [0,4194304] 0 2023-12-16T20:11:27.639 INFO:tasks.workunit.client.0.smithi038.stdout:9/300: dread f2 [0,4194304] 0 2023-12-16T20:11:27.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/445: creat d1/df/d6d/f8c x:0 0 0 2023-12-16T20:11:27.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/446: chown d1/df/d10/f77 589 1 2023-12-16T20:11:27.641 INFO:tasks.workunit.client.0.smithi038.stdout:1/448: dwrite f11 [0,4194304] 0 2023-12-16T20:11:27.641 INFO:tasks.workunit.client.0.smithi038.stdout:1/449: fsync d15/d1e/d23/d34/f38 0 2023-12-16T20:11:27.641 INFO:tasks.workunit.client.0.smithi038.stdout:1/450: chown d15/d1e/d30/f50 9 1 2023-12-16T20:11:27.641 INFO:tasks.workunit.client.0.smithi038.stdout:1/451: chown d15/l70 507280850 1 2023-12-16T20:11:27.642 INFO:tasks.workunit.client.1.smithi141.stdout:5/64: creat d0/d9/f13 x:0 0 0 2023-12-16T20:11:27.642 INFO:tasks.workunit.client.1.smithi141.stdout:5/65: dread - d0/d9/f13 zero size 2023-12-16T20:11:27.642 INFO:tasks.workunit.client.1.smithi141.stdout:5/66: fdatasync d0/f4 0 2023-12-16T20:11:27.642 INFO:tasks.workunit.client.1.smithi141.stdout:5/67: fdatasync d0/d9/f13 0 2023-12-16T20:11:27.644 INFO:tasks.workunit.client.1.smithi141.stdout:4/37: mknod c10 0 2023-12-16T20:11:27.644 INFO:tasks.workunit.client.1.smithi141.stdout:4/38: chown fd 239513 1 2023-12-16T20:11:27.644 INFO:tasks.workunit.client.0.smithi038.stdout:9/301: dread d9/d1f/d21/d3e/f49 [0,4194304] 0 2023-12-16T20:11:27.645 INFO:tasks.workunit.client.1.smithi141.stdout:3/81: rmdir d0 39 2023-12-16T20:11:27.646 INFO:tasks.workunit.client.1.smithi141.stdout:4/39: mknod c11 0 2023-12-16T20:11:27.647 INFO:tasks.workunit.client.1.smithi141.stdout:5/68: dread d0/f4 [4194304,4194304] 0 2023-12-16T20:11:27.648 INFO:tasks.workunit.client.0.smithi038.stdout:6/336: getdents d1 0 2023-12-16T20:11:27.649 INFO:tasks.workunit.client.1.smithi141.stdout:3/82: creat d0/d13/f1e x:0 0 0 2023-12-16T20:11:27.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/386: dwrite d4/d8/f24 [4194304,4194304] 0 2023-12-16T20:11:27.650 INFO:tasks.workunit.client.1.smithi141.stdout:2/24: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:27.650 INFO:tasks.workunit.client.1.smithi141.stdout:2/25: fdatasync d6/f7 0 2023-12-16T20:11:27.650 INFO:tasks.workunit.client.1.smithi141.stdout:2/26: readlink l2 0 2023-12-16T20:11:27.651 INFO:tasks.workunit.client.1.smithi141.stdout:4/40: symlink l12 0 2023-12-16T20:11:27.651 INFO:tasks.workunit.client.1.smithi141.stdout:4/41: chown c11 300956922 1 2023-12-16T20:11:27.653 INFO:tasks.workunit.client.1.smithi141.stdout:3/83: link d0/l3 d0/d13/l1f 0 2023-12-16T20:11:27.653 INFO:tasks.workunit.client.1.smithi141.stdout:3/84: readlink d0/l3 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.1.smithi141.stdout:5/69: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.1.smithi141.stdout:3/85: write d0/f8 [4396567,114911] 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.1.smithi141.stdout:3/86: fsync d0/f17 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/387: creat d4/d8/d15/d6d/d7a/f8a x:0 0 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.0.smithi038.stdout:9/302: dread d9/f1a [0,4194304] 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/388: truncate d4/d27/d2b/d64/f77 289378 0 2023-12-16T20:11:27.657 INFO:tasks.workunit.client.0.smithi038.stdout:3/389: read - d4/d8/d15/f54 zero size 2023-12-16T20:11:27.658 INFO:tasks.workunit.client.0.smithi038.stdout:9/303: creat d9/d1f/d21/d55/f56 x:0 0 0 2023-12-16T20:11:27.659 INFO:tasks.workunit.client.1.smithi141.stdout:4/42: rename ff to f13 0 2023-12-16T20:11:27.663 INFO:tasks.workunit.client.1.smithi141.stdout:5/70: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:27.664 INFO:tasks.workunit.client.0.smithi038.stdout:4/293: dwrite d13/d17/f45 [0,4194304] 0 2023-12-16T20:11:27.664 INFO:tasks.workunit.client.0.smithi038.stdout:4/294: readlink d13/d17/d2e/l51 0 2023-12-16T20:11:27.665 INFO:tasks.workunit.client.1.smithi141.stdout:2/27: mknod d6/c9 0 2023-12-16T20:11:27.666 INFO:tasks.workunit.client.1.smithi141.stdout:8/61: truncate ff 429470 0 2023-12-16T20:11:27.667 INFO:tasks.workunit.client.0.smithi038.stdout:7/303: sync 2023-12-16T20:11:27.667 INFO:tasks.workunit.client.0.smithi038.stdout:7/304: truncate da/d21/d2c/d2e/f2d 1903394 0 2023-12-16T20:11:27.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/452: dread d15/d1e/d23/f39 [0,4194304] 0 2023-12-16T20:11:27.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/453: write d15/d1e/f2d [4884245,112233] 0 2023-12-16T20:11:27.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/454: write d15/d22/f26 [1095194,48807] 0 2023-12-16T20:11:27.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/455: write d15/d1e/d23/d34/f69 [87319,30302] 0 2023-12-16T20:11:27.669 INFO:tasks.workunit.client.1.smithi141.stdout:8/62: mkdir d14 0 2023-12-16T20:11:27.669 INFO:tasks.workunit.client.0.smithi038.stdout:4/295: symlink d13/d17/d2e/l5d 0 2023-12-16T20:11:27.670 INFO:tasks.workunit.client.0.smithi038.stdout:7/305: mkdir da/d21/d61 0 2023-12-16T20:11:27.670 INFO:tasks.workunit.client.1.smithi141.stdout:8/63: creat d14/f15 x:0 0 0 2023-12-16T20:11:27.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/306: dread da/d21/d2c/f30 [0,4194304] 0 2023-12-16T20:11:27.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/456: unlink d15/d1e/d3b/d5a/f85 0 2023-12-16T20:11:27.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/307: creat da/d3e/d31/d38/f62 x:0 0 0 2023-12-16T20:11:27.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/308: readlink da/d21/d2c/d2e/l4e 0 2023-12-16T20:11:27.676 INFO:tasks.workunit.client.0.smithi038.stdout:7/309: symlink da/d21/d2c/l63 0 2023-12-16T20:11:27.678 INFO:tasks.workunit.client.0.smithi038.stdout:4/296: write fb [69180,8493] 0 2023-12-16T20:11:27.678 INFO:tasks.workunit.client.0.smithi038.stdout:4/297: creat d13/d17/d2e/d32/f5e x:0 0 0 2023-12-16T20:11:27.678 INFO:tasks.workunit.client.0.smithi038.stdout:4/298: write d13/d1f/d35/f38 [452050,46826] 0 2023-12-16T20:11:27.679 INFO:tasks.workunit.client.0.smithi038.stdout:1/457: getdents d15/d22/d52/d7f 0 2023-12-16T20:11:27.680 INFO:tasks.workunit.client.0.smithi038.stdout:9/304: write d9/d1f/d21/f3a [2386317,26119] 0 2023-12-16T20:11:27.683 INFO:tasks.workunit.client.0.smithi038.stdout:1/458: creat d15/d1e/d23/d7d/f9b x:0 0 0 2023-12-16T20:11:27.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/459: dread d15/d1e/d23/d34/d79/f83 [0,4194304] 0 2023-12-16T20:11:27.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/305: mknod d9/d1e/d45/c57 0 2023-12-16T20:11:27.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/306: creat d9/d1e/d40/f58 x:0 0 0 2023-12-16T20:11:27.689 INFO:tasks.workunit.client.0.smithi038.stdout:9/307: mkdir d9/d1e/d3d/d42/d59 0 2023-12-16T20:11:27.691 INFO:tasks.workunit.client.0.smithi038.stdout:9/308: mknod d9/d1e/d3d/d42/d59/c5a 0 2023-12-16T20:11:27.698 INFO:tasks.workunit.client.0.smithi038.stdout:0/313: dwrite db/f44 [0,4194304] 0 2023-12-16T20:11:27.699 INFO:tasks.workunit.client.0.smithi038.stdout:0/314: mknod db/d16/d19/d27/c68 0 2023-12-16T20:11:27.700 INFO:tasks.workunit.client.0.smithi038.stdout:0/315: symlink db/d16/d1c/d5d/d64/l69 0 2023-12-16T20:11:27.700 INFO:tasks.workunit.client.0.smithi038.stdout:1/460: read d15/d1e/d30/f5b [4028663,107396] 0 2023-12-16T20:11:27.701 INFO:tasks.workunit.client.0.smithi038.stdout:0/316: write db/d16/d19/d27/f4c [226272,57642] 0 2023-12-16T20:11:27.708 INFO:tasks.workunit.client.0.smithi038.stdout:2/447: dwrite d1/d5/d2a/d5d/d61/d66/f83 [0,4194304] 0 2023-12-16T20:11:27.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/28: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:27.709 INFO:tasks.workunit.client.1.smithi141.stdout:3/87: dwrite d0/d13/f1b [0,4194304] 0 2023-12-16T20:11:27.710 INFO:tasks.workunit.client.1.smithi141.stdout:5/71: dwrite d0/f4 [0,4194304] 0 2023-12-16T20:11:27.710 INFO:tasks.workunit.client.0.smithi038.stdout:0/317: fdatasync db/f3d 0 2023-12-16T20:11:27.711 INFO:tasks.workunit.client.0.smithi038.stdout:0/318: fdatasync db/d16/d19/f2b 0 2023-12-16T20:11:27.711 INFO:tasks.workunit.client.0.smithi038.stdout:7/310: dwrite da/d21/d2c/f47 [0,4194304] 0 2023-12-16T20:11:27.713 INFO:tasks.workunit.client.0.smithi038.stdout:4/299: dwrite d13/d17/d2e/d32/f5e [0,4194304] 0 2023-12-16T20:11:27.714 INFO:tasks.workunit.client.1.smithi141.stdout:3/88: rename d0/c1a to d0/d1c/c20 0 2023-12-16T20:11:27.714 INFO:tasks.workunit.client.0.smithi038.stdout:2/448: unlink d1/d5/d2a/d5d/c85 0 2023-12-16T20:11:27.715 INFO:tasks.workunit.client.1.smithi141.stdout:5/72: mkdir d0/d14 0 2023-12-16T20:11:27.715 INFO:tasks.workunit.client.1.smithi141.stdout:5/73: creat d0/d9/f15 x:0 0 0 2023-12-16T20:11:27.716 INFO:tasks.workunit.client.1.smithi141.stdout:3/89: rmdir d0/d1c 39 2023-12-16T20:11:27.716 INFO:tasks.workunit.client.0.smithi038.stdout:2/449: dread d1/df/d6a/d43/d57/f5a [0,4194304] 0 2023-12-16T20:11:27.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/461: dwrite d15/d1e/d3b/d48/d3d/f58 [0,4194304] 0 2023-12-16T20:11:27.719 INFO:tasks.workunit.client.0.smithi038.stdout:3/390: unlink d4/d27/d2b/d64/f77 0 2023-12-16T20:11:27.719 INFO:tasks.workunit.client.0.smithi038.stdout:3/391: creat d4/d18/f8b x:0 0 0 2023-12-16T20:11:27.722 INFO:tasks.workunit.client.1.smithi141.stdout:2/29: write d6/f7 [3780923,87145] 0 2023-12-16T20:11:27.726 INFO:tasks.workunit.client.1.smithi141.stdout:2/30: mkdir d6/da 0 2023-12-16T20:11:27.727 INFO:tasks.workunit.client.1.smithi141.stdout:2/31: chown c3 3153192 1 2023-12-16T20:11:27.727 INFO:tasks.workunit.client.1.smithi141.stdout:2/32: chown d6/c9 19540 1 2023-12-16T20:11:27.727 INFO:tasks.workunit.client.1.smithi141.stdout:2/33: chown d6 34634730 1 2023-12-16T20:11:27.729 INFO:tasks.workunit.client.0.smithi038.stdout:4/300: truncate fa 4757006 0 2023-12-16T20:11:27.730 INFO:tasks.workunit.client.1.smithi141.stdout:5/74: rmdir d0/d9 39 2023-12-16T20:11:27.735 INFO:tasks.workunit.client.0.smithi038.stdout:9/309: getdents d9/d1e/d3d/d42 0 2023-12-16T20:11:27.744 INFO:tasks.workunit.client.1.smithi141.stdout:3/90: dwrite d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:27.744 INFO:tasks.workunit.client.0.smithi038.stdout:3/392: link d4/d27/d23/c29 d4/d27/d23/d6e/c8c 0 2023-12-16T20:11:27.744 INFO:tasks.workunit.client.0.smithi038.stdout:3/393: truncate d4/d8/d15/f5d 230832 0 2023-12-16T20:11:27.745 INFO:tasks.workunit.client.0.smithi038.stdout:4/301: symlink d13/d17/d2e/d32/d4d/d4f/l5f 0 2023-12-16T20:11:27.746 INFO:tasks.workunit.client.0.smithi038.stdout:2/450: rmdir d1/d5/d3d 39 2023-12-16T20:11:27.750 INFO:tasks.workunit.client.1.smithi141.stdout:4/43: dwrite f2 [0,4194304] 0 2023-12-16T20:11:27.750 INFO:tasks.workunit.client.0.smithi038.stdout:7/311: rename da/l32 to da/l64 0 2023-12-16T20:11:27.752 INFO:tasks.workunit.client.0.smithi038.stdout:4/302: symlink d13/d17/d2e/d32/d4d/l60 0 2023-12-16T20:11:27.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/312: mkdir da/d3e/d31/d38/d65 0 2023-12-16T20:11:27.758 INFO:tasks.workunit.client.0.smithi038.stdout:4/303: mkdir d13/d17/d2e/d32/d4e/d61 0 2023-12-16T20:11:27.758 INFO:tasks.workunit.client.1.smithi141.stdout:4/44: dread f9 [0,4194304] 0 2023-12-16T20:11:27.759 INFO:tasks.workunit.client.1.smithi141.stdout:4/45: dread - f13 zero size 2023-12-16T20:11:27.759 INFO:tasks.workunit.client.1.smithi141.stdout:4/46: truncate f13 268266 0 2023-12-16T20:11:27.760 INFO:tasks.workunit.client.1.smithi141.stdout:5/75: dwrite d0/d9/f15 [0,4194304] 0 2023-12-16T20:11:27.761 INFO:tasks.workunit.client.1.smithi141.stdout:4/47: write f1 [79873,121366] 0 2023-12-16T20:11:27.761 INFO:tasks.workunit.client.1.smithi141.stdout:4/48: write f1 [2422472,55820] 0 2023-12-16T20:11:27.761 INFO:tasks.workunit.client.0.smithi038.stdout:9/310: dwrite d9/d1e/d45/f4a [0,4194304] 0 2023-12-16T20:11:27.761 INFO:tasks.workunit.client.0.smithi038.stdout:7/313: creat da/d21/d61/f66 x:0 0 0 2023-12-16T20:11:27.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/304: mkdir d13/d17/d62 0 2023-12-16T20:11:27.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/305: fsync d13/d17/d2e/d32/f56 0 2023-12-16T20:11:27.764 INFO:tasks.workunit.client.1.smithi141.stdout:4/49: unlink c8 0 2023-12-16T20:11:27.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/311: creat d9/d1f/f5b x:0 0 0 2023-12-16T20:11:27.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/312: chown d9/d1e/d3d/d42/f53 942755 1 2023-12-16T20:11:27.766 INFO:tasks.workunit.client.1.smithi141.stdout:4/50: unlink ce 0 2023-12-16T20:11:27.766 INFO:tasks.workunit.client.0.smithi038.stdout:7/314: mknod da/d21/d61/c67 0 2023-12-16T20:11:27.767 INFO:tasks.workunit.client.1.smithi141.stdout:3/91: truncate d0/d13/f1d 147806 0 2023-12-16T20:11:27.767 INFO:tasks.workunit.client.1.smithi141.stdout:3/92: creat d0/d13/f21 x:0 0 0 2023-12-16T20:11:27.767 INFO:tasks.workunit.client.1.smithi141.stdout:4/51: dread f9 [0,4194304] 0 2023-12-16T20:11:27.769 INFO:tasks.workunit.client.1.smithi141.stdout:3/93: truncate d0/d13/f1e 1974518 0 2023-12-16T20:11:27.769 INFO:tasks.workunit.client.0.smithi038.stdout:4/306: rename d13/d17/d2e/d32/f5e to d13/d1f/d35/f63 0 2023-12-16T20:11:27.769 INFO:tasks.workunit.client.0.smithi038.stdout:4/307: truncate d13/d17/f36 57758 0 2023-12-16T20:11:27.770 INFO:tasks.workunit.client.0.smithi038.stdout:9/313: dread d9/f1c [0,4194304] 0 2023-12-16T20:11:27.770 INFO:tasks.workunit.client.0.smithi038.stdout:7/315: write da/d21/d2c/d2e/f2d [1425472,40401] 0 2023-12-16T20:11:27.771 INFO:tasks.workunit.client.1.smithi141.stdout:4/52: link f13 f14 0 2023-12-16T20:11:27.772 INFO:tasks.workunit.client.0.smithi038.stdout:4/308: unlink d13/d17/d4b/f33 0 2023-12-16T20:11:27.772 INFO:tasks.workunit.client.0.smithi038.stdout:4/309: creat d13/d17/d2e/d32/d4e/f64 x:0 0 0 2023-12-16T20:11:27.772 INFO:tasks.workunit.client.0.smithi038.stdout:2/451: dwrite d1/df/d10/f46 [0,4194304] 0 2023-12-16T20:11:27.772 INFO:tasks.workunit.client.0.smithi038.stdout:2/452: chown d1/df/d6d 8 1 2023-12-16T20:11:27.772 INFO:tasks.workunit.client.1.smithi141.stdout:3/94: symlink d0/d1c/l22 0 2023-12-16T20:11:27.773 INFO:tasks.workunit.client.0.smithi038.stdout:9/314: mknod d9/d1f/d21/d3e/c5c 0 2023-12-16T20:11:27.774 INFO:tasks.workunit.client.1.smithi141.stdout:5/76: read d0/d9/f15 [415805,21372] 0 2023-12-16T20:11:27.774 INFO:tasks.workunit.client.1.smithi141.stdout:5/77: chown d0/c5 1478399 1 2023-12-16T20:11:27.775 INFO:tasks.workunit.client.1.smithi141.stdout:4/53: dread f13 [0,4194304] 0 2023-12-16T20:11:27.775 INFO:tasks.workunit.client.1.smithi141.stdout:4/54: write f13 [1156749,117031] 0 2023-12-16T20:11:27.775 INFO:tasks.workunit.client.1.smithi141.stdout:4/55: creat f15 x:0 0 0 2023-12-16T20:11:27.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/95: dread d0/f17 [0,4194304] 0 2023-12-16T20:11:27.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/96: chown d0/d13/f1d 716 1 2023-12-16T20:11:27.776 INFO:tasks.workunit.client.0.smithi038.stdout:3/394: dwrite d4/f6 [0,4194304] 0 2023-12-16T20:11:27.776 INFO:tasks.workunit.client.0.smithi038.stdout:3/395: chown d4/d18/f66 0 1 2023-12-16T20:11:27.776 INFO:tasks.workunit.client.0.smithi038.stdout:3/396: write d4/d27/d23/d26/f3e [903231,126269] 0 2023-12-16T20:11:27.776 INFO:tasks.workunit.client.0.smithi038.stdout:4/310: rename d13/d17/d4b/f3e to d13/d17/d2e/d32/d4d/f65 0 2023-12-16T20:11:27.776 INFO:tasks.workunit.client.0.smithi038.stdout:4/311: chown d13/d17/d2e/d32/c50 241783577 1 2023-12-16T20:11:27.787 INFO:tasks.workunit.client.1.smithi141.stdout:3/97: write d0/f8 [2560209,37348] 0 2023-12-16T20:11:27.787 INFO:tasks.workunit.client.1.smithi141.stdout:3/98: write d0/f8 [3684335,119201] 0 2023-12-16T20:11:27.787 INFO:tasks.workunit.client.1.smithi141.stdout:3/99: write d0/d13/f21 [80842,1767] 0 2023-12-16T20:11:27.793 INFO:tasks.workunit.client.0.smithi038.stdout:4/312: truncate d13/f3c 3100078 0 2023-12-16T20:11:27.793 INFO:tasks.workunit.client.0.smithi038.stdout:4/313: creat d13/d1f/f66 x:0 0 0 2023-12-16T20:11:27.795 INFO:tasks.workunit.client.0.smithi038.stdout:4/314: readlink d13/d1f/d22/l4c 0 2023-12-16T20:11:27.795 INFO:tasks.workunit.client.0.smithi038.stdout:4/315: fdatasync fa 0 2023-12-16T20:11:27.798 INFO:tasks.workunit.client.0.smithi038.stdout:4/316: symlink d13/d17/d2e/d32/d4e/d61/l67 0 2023-12-16T20:11:27.806 INFO:tasks.workunit.client.1.smithi141.stdout:3/100: write d0/d13/f1b [1787389,30977] 0 2023-12-16T20:11:27.809 INFO:tasks.workunit.client.1.smithi141.stdout:3/101: getdents d0/d13 0 2023-12-16T20:11:27.813 INFO:tasks.workunit.client.1.smithi141.stdout:4/56: dwrite f15 [0,4194304] 0 2023-12-16T20:11:27.813 INFO:tasks.workunit.client.0.smithi038.stdout:9/315: dwrite d9/d1f/f29 [0,4194304] 0 2023-12-16T20:11:27.813 INFO:tasks.workunit.client.0.smithi038.stdout:9/316: getdents d9/d1e/d3d/d42 0 2023-12-16T20:11:27.817 INFO:tasks.workunit.client.0.smithi038.stdout:9/317: rename d9/d1f/d21/d3e/f50 to d9/d1e/d3d/f5d 0 2023-12-16T20:11:27.817 INFO:tasks.workunit.client.0.smithi038.stdout:9/318: chown d9/fe 127 1 2023-12-16T20:11:27.817 INFO:tasks.workunit.client.0.smithi038.stdout:9/319: dread - d9/d1e/d40/f51 zero size 2023-12-16T20:11:27.818 INFO:tasks.workunit.client.0.smithi038.stdout:2/453: dwrite d1/d5/d16/f3b [0,4194304] 0 2023-12-16T20:11:27.818 INFO:tasks.workunit.client.0.smithi038.stdout:2/454: creat d1/df/d10/d23/d3a/f8d x:0 0 0 2023-12-16T20:11:27.818 INFO:tasks.workunit.client.0.smithi038.stdout:9/320: mkdir d9/d1e/d40/d5e 0 2023-12-16T20:11:27.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/317: getdents d13/d17/d4b 0 2023-12-16T20:11:27.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/318: chown d13/d17/d2e/f3d 326370048 1 2023-12-16T20:11:27.831 INFO:tasks.workunit.client.1.smithi141.stdout:4/57: dwrite f15 [0,4194304] 0 2023-12-16T20:11:27.842 INFO:tasks.workunit.client.0.smithi038.stdout:9/321: dwrite d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:27.842 INFO:tasks.workunit.client.0.smithi038.stdout:9/322: chown d9/d1f/d21/d3e/d4e/l4f 5546489 1 2023-12-16T20:11:27.842 INFO:tasks.workunit.client.0.smithi038.stdout:9/323: creat d9/d1f/d21/d3e/f5f x:0 0 0 2023-12-16T20:11:27.843 INFO:tasks.workunit.client.1.smithi141.stdout:4/58: write f2 [939279,91650] 0 2023-12-16T20:11:27.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/59: stat l3 0 2023-12-16T20:11:27.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/60: chown l12 16834037 1 2023-12-16T20:11:27.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/61: write f14 [1413933,36234] 0 2023-12-16T20:11:27.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/62: write f9 [1303618,120452] 0 2023-12-16T20:11:27.845 INFO:tasks.workunit.client.1.smithi141.stdout:3/102: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:27.846 INFO:tasks.workunit.client.0.smithi038.stdout:9/324: rename d9/c2e to d9/d1e/d3d/c60 0 2023-12-16T20:11:27.846 INFO:tasks.workunit.client.0.smithi038.stdout:2/455: dwrite d1/df/f7d [0,4194304] 0 2023-12-16T20:11:27.847 INFO:tasks.workunit.client.1.smithi141.stdout:4/63: symlink l16 0 2023-12-16T20:11:27.847 INFO:tasks.workunit.client.0.smithi038.stdout:9/325: dread d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:27.847 INFO:tasks.workunit.client.1.smithi141.stdout:3/103: link d0/l3 d0/d1c/l23 0 2023-12-16T20:11:27.848 INFO:tasks.workunit.client.0.smithi038.stdout:2/456: symlink d1/df/d10/l8e 0 2023-12-16T20:11:27.848 INFO:tasks.workunit.client.0.smithi038.stdout:9/326: mkdir d9/d1f/d21/d3e/d4e/d61 0 2023-12-16T20:11:27.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/104: unlink d0/d13/c19 0 2023-12-16T20:11:27.850 INFO:tasks.workunit.client.0.smithi038.stdout:2/457: rename d1/l68 to d1/df/d6a/l8f 0 2023-12-16T20:11:27.850 INFO:tasks.workunit.client.1.smithi141.stdout:3/105: mknod d0/c24 0 2023-12-16T20:11:27.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/327: rename d9/l11 to d9/d1e/d40/l62 0 2023-12-16T20:11:27.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/328: write d9/f1c [777641,104005] 0 2023-12-16T20:11:27.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/329: fdatasync d9/d1f/f22 0 2023-12-16T20:11:27.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/330: creat d9/d1e/f63 x:0 0 0 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:6/337: sync 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:8/239: sync 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/380: sync 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/381: creat d2/df/d1a/d2a/f75 x:0 0 0 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:6/338: write d1/d4/f62 [639320,94784] 0 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/382: read - d2/d14/d25/d2d/f63 zero size 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/383: chown d2/d14/d25/d2d/d17 29765972 1 2023-12-16T20:11:27.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/384: chown d2/df/d1a/d2a/d59/c60 25648001 1 2023-12-16T20:11:27.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/106: rename d0/d13/l1f to d0/d1c/l25 0 2023-12-16T20:11:27.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/107: write d0/d13/f1d [499255,95521] 0 2023-12-16T20:11:27.855 INFO:tasks.workunit.client.1.smithi141.stdout:3/108: rmdir d0 39 2023-12-16T20:11:27.855 INFO:tasks.workunit.client.1.smithi141.stdout:3/109: chown d0/l4 102 1 2023-12-16T20:11:27.855 INFO:tasks.workunit.client.1.smithi141.stdout:3/110: write d0/d13/f1b [3752665,93974] 0 2023-12-16T20:11:27.856 INFO:tasks.workunit.client.1.smithi141.stdout:3/111: symlink d0/l26 0 2023-12-16T20:11:27.856 INFO:tasks.workunit.client.0.smithi038.stdout:8/240: rename d17/f20 to d17/d48/f49 0 2023-12-16T20:11:27.858 INFO:tasks.workunit.client.0.smithi038.stdout:6/339: rmdir d1 39 2023-12-16T20:11:27.858 INFO:tasks.workunit.client.1.smithi141.stdout:3/112: creat d0/d13/f27 x:0 0 0 2023-12-16T20:11:27.859 INFO:tasks.workunit.client.0.smithi038.stdout:2/458: write d1/d5/d2a/f35 [3584964,103406] 0 2023-12-16T20:11:27.859 INFO:tasks.workunit.client.0.smithi038.stdout:8/241: truncate d17/d1b/f22 766621 0 2023-12-16T20:11:27.860 INFO:tasks.workunit.client.1.smithi141.stdout:3/113: symlink d0/d1c/l28 0 2023-12-16T20:11:27.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/340: mknod d1/d16/d23/c6e 0 2023-12-16T20:11:27.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/341: write d1/d4/f1c [1440080,75180] 0 2023-12-16T20:11:27.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/342: creat d1/d16/d23/f6f x:0 0 0 2023-12-16T20:11:27.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/343: readlink d1/d4/l1a 0 2023-12-16T20:11:27.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/459: symlink d1/df/d6a/l90 0 2023-12-16T20:11:27.865 INFO:tasks.workunit.client.0.smithi038.stdout:6/344: read d1/d4/d1d/d28/f41 [916112,95646] 0 2023-12-16T20:11:27.865 INFO:tasks.workunit.client.0.smithi038.stdout:6/345: dread - d1/f6c zero size 2023-12-16T20:11:27.866 INFO:tasks.workunit.client.1.smithi141.stdout:4/64: read fa [58728,37214] 0 2023-12-16T20:11:27.867 INFO:tasks.workunit.client.0.smithi038.stdout:2/460: mkdir d1/d5/d6c/d91 0 2023-12-16T20:11:27.867 INFO:tasks.workunit.client.0.smithi038.stdout:2/461: truncate d1/df/d6d/f8c 667574 0 2023-12-16T20:11:27.868 INFO:tasks.workunit.client.0.smithi038.stdout:8/242: mknod d17/c4a 0 2023-12-16T20:11:27.869 INFO:tasks.workunit.client.1.smithi141.stdout:4/65: mknod c17 0 2023-12-16T20:11:27.870 INFO:tasks.workunit.client.1.smithi141.stdout:4/66: symlink l18 0 2023-12-16T20:11:27.870 INFO:tasks.workunit.client.1.smithi141.stdout:4/67: creat f19 x:0 0 0 2023-12-16T20:11:27.871 INFO:tasks.workunit.client.0.smithi038.stdout:6/346: mknod d1/d4/d1d/d28/d2f/c70 0 2023-12-16T20:11:27.871 INFO:tasks.workunit.client.0.smithi038.stdout:8/243: dread d17/d1b/d25/f32 [0,4194304] 0 2023-12-16T20:11:27.871 INFO:tasks.workunit.client.0.smithi038.stdout:5/385: dread d2/df/d1a/d2a/f41 [4194304,4194304] 0 2023-12-16T20:11:27.872 INFO:tasks.workunit.client.0.smithi038.stdout:2/462: mkdir d1/df/d21/d82/d92 0 2023-12-16T20:11:27.872 INFO:tasks.workunit.client.0.smithi038.stdout:2/463: chown d1/df/d6a/l8f 138 1 2023-12-16T20:11:27.874 INFO:tasks.workunit.client.0.smithi038.stdout:6/347: creat d1/f71 x:0 0 0 2023-12-16T20:11:27.879 INFO:tasks.workunit.client.0.smithi038.stdout:6/348: symlink d1/l72 0 2023-12-16T20:11:27.880 INFO:tasks.workunit.client.0.smithi038.stdout:8/244: rmdir d17/d1b/d25 39 2023-12-16T20:11:27.880 INFO:tasks.workunit.client.0.smithi038.stdout:8/245: read f13 [4334115,103027] 0 2023-12-16T20:11:27.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/386: getdents d2/d4 0 2023-12-16T20:11:27.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/387: dread - d2/d4/d62/f69 zero size 2023-12-16T20:11:27.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/388: dread - d2/d14/d25/d2d/f63 zero size 2023-12-16T20:11:27.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/349: mkdir d1/d4/d1d/d67/d73 0 2023-12-16T20:11:27.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/350: write d1/d16/d23/f29 [2288288,61554] 0 2023-12-16T20:11:27.886 INFO:tasks.workunit.client.0.smithi038.stdout:5/389: unlink d2/df/l26 0 2023-12-16T20:11:27.886 INFO:tasks.workunit.client.0.smithi038.stdout:5/390: chown d2/df/d1a/d2a/l65 246700477 1 2023-12-16T20:11:27.888 INFO:tasks.workunit.client.0.smithi038.stdout:5/391: creat d2/d14/d25/d2d/d17/d51/f76 x:0 0 0 2023-12-16T20:11:27.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/464: dread d1/d5/d16/f3b [0,4194304] 0 2023-12-16T20:11:27.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/392: creat d2/d4/d62/f77 x:0 0 0 2023-12-16T20:11:27.895 INFO:tasks.workunit.client.0.smithi038.stdout:5/393: rmdir d2/df/d1a/d2a 39 2023-12-16T20:11:27.895 INFO:tasks.workunit.client.0.smithi038.stdout:5/394: fdatasync d2/d14/f40 0 2023-12-16T20:11:27.895 INFO:tasks.workunit.client.0.smithi038.stdout:5/395: dread - d2/d14/f40 zero size 2023-12-16T20:11:27.895 INFO:tasks.workunit.client.0.smithi038.stdout:5/396: truncate d2/df/d1a/d2a/f75 167395 0 2023-12-16T20:11:27.896 INFO:tasks.workunit.client.1.smithi141.stdout:4/68: dwrite f1 [0,4194304] 0 2023-12-16T20:11:27.896 INFO:tasks.workunit.client.1.smithi141.stdout:3/114: dwrite d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:27.899 INFO:tasks.workunit.client.0.smithi038.stdout:5/397: symlink d2/df/l78 0 2023-12-16T20:11:27.902 INFO:tasks.workunit.client.0.smithi038.stdout:5/398: read d2/df/d1a/d2a/f75 [3632,36331] 0 2023-12-16T20:11:27.902 INFO:tasks.workunit.client.0.smithi038.stdout:2/465: write d1/df/f7d [2213140,29700] 0 2023-12-16T20:11:27.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/331: dwrite d9/d1f/f29 [0,4194304] 0 2023-12-16T20:11:27.902 INFO:tasks.workunit.client.0.smithi038.stdout:5/399: chown d2/d14/l2b 789779 1 2023-12-16T20:11:27.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/332: fsync d9/d1e/d3d/d42/f48 0 2023-12-16T20:11:27.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/466: rename d1/df/d10/d2f/f6f to d1/df/d21/f93 0 2023-12-16T20:11:27.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/467: truncate d1/df/d6a/f59 834307 0 2023-12-16T20:11:27.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/333: mkdir d9/d1f/d21/d3e/d4e/d64 0 2023-12-16T20:11:27.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/334: creat d9/d1f/d21/d55/f65 x:0 0 0 2023-12-16T20:11:27.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/335: readlink d9/lc 0 2023-12-16T20:11:27.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/336: write d9/d1e/f3c [246120,103692] 0 2023-12-16T20:11:27.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/468: symlink d1/df/d21/l94 0 2023-12-16T20:11:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:9/337: dread d9/d1e/d3d/f3f [0,4194304] 0 2023-12-16T20:11:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:9/338: chown d9/d1f/d21/f46 1715 1 2023-12-16T20:11:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:9/339: dread - d9/d1e/d40/f51 zero size 2023-12-16T20:11:27.907 INFO:tasks.workunit.client.0.smithi038.stdout:9/340: write d9/d1f/f38 [263382,126338] 0 2023-12-16T20:11:27.907 INFO:tasks.workunit.client.0.smithi038.stdout:6/351: dwrite d1/d5b/f63 [0,4194304] 0 2023-12-16T20:11:27.907 INFO:tasks.workunit.client.0.smithi038.stdout:8/246: dwrite d17/d18/f26 [0,4194304] 0 2023-12-16T20:11:27.911 INFO:tasks.workunit.client.1.smithi141.stdout:4/69: read fd [1662631,84668] 0 2023-12-16T20:11:27.913 INFO:tasks.workunit.client.1.smithi141.stdout:4/70: mkdir d1a 0 2023-12-16T20:11:27.913 INFO:tasks.workunit.client.1.smithi141.stdout:4/71: chown f9 39446 1 2023-12-16T20:11:27.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/72: link f13 d1a/f1b 0 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:2/469: rename d1/d5/d2a/d5d to d1/d5/d95 0 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/400: write d2/d14/d25/d2d/f31 [4182287,75050] 0 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/401: fsync d2/df/d1a/d2a/f68 0 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/402: chown d2/df/d1a 220 1 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/403: write d2/f9 [1204162,56907] 0 2023-12-16T20:11:27.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/404: creat d2/d14/d25/f79 x:0 0 0 2023-12-16T20:11:27.919 INFO:tasks.workunit.client.1.smithi141.stdout:4/73: creat d1a/f1c x:0 0 0 2023-12-16T20:11:27.919 INFO:tasks.workunit.client.1.smithi141.stdout:4/74: truncate f19 300338 0 2023-12-16T20:11:27.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/470: creat d1/d5/d95/d61/d75/f96 x:0 0 0 2023-12-16T20:11:27.925 INFO:tasks.workunit.client.0.smithi038.stdout:9/341: rename d9/d1e/d3d/c60 to d9/d1e/d3d/d42/d59/c66 0 2023-12-16T20:11:27.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/342: unlink d9/d1f/d21/f46 0 2023-12-16T20:11:27.931 INFO:tasks.workunit.client.0.smithi038.stdout:9/343: read - d9/d1e/f37 zero size 2023-12-16T20:11:27.931 INFO:tasks.workunit.client.0.smithi038.stdout:9/344: chown d9/l1b 104831166 1 2023-12-16T20:11:27.932 INFO:tasks.workunit.client.1.smithi141.stdout:3/115: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T20:11:27.932 INFO:tasks.workunit.client.1.smithi141.stdout:3/116: chown d0/d13/f27 3019 1 2023-12-16T20:11:27.932 INFO:tasks.workunit.client.0.smithi038.stdout:6/352: dwrite d1/d4/d1d/d28/d2f/d3d/f51 [0,4194304] 0 2023-12-16T20:11:27.932 INFO:tasks.workunit.client.0.smithi038.stdout:6/353: fsync d1/f6c 0 2023-12-16T20:11:27.933 INFO:tasks.workunit.client.0.smithi038.stdout:2/471: rename d1/df/d10/d23/d3a/c24 to d1/d5/d16/c97 0 2023-12-16T20:11:27.934 INFO:tasks.workunit.client.0.smithi038.stdout:5/405: getdents d2/d14/d25/d2d/d17 0 2023-12-16T20:11:27.934 INFO:tasks.workunit.client.0.smithi038.stdout:5/406: creat d2/d14/d25/d2d/d17/d55/f7a x:0 0 0 2023-12-16T20:11:27.934 INFO:tasks.workunit.client.0.smithi038.stdout:9/345: creat d9/d1e/d40/d5e/f67 x:0 0 0 2023-12-16T20:11:27.935 INFO:tasks.workunit.client.1.smithi141.stdout:3/117: creat d0/f29 x:0 0 0 2023-12-16T20:11:27.935 INFO:tasks.workunit.client.1.smithi141.stdout:3/118: unlink d0/d13/l14 0 2023-12-16T20:11:27.935 INFO:tasks.workunit.client.1.smithi141.stdout:3/119: fdatasync d0/d13/f1e 0 2023-12-16T20:11:27.939 INFO:tasks.workunit.client.0.smithi038.stdout:6/354: mkdir d1/d4/d1d/d28/d2f/d74 0 2023-12-16T20:11:27.939 INFO:tasks.workunit.client.0.smithi038.stdout:6/355: readlink d1/d4/d1d/l5c 0 2023-12-16T20:11:27.941 INFO:tasks.workunit.client.0.smithi038.stdout:2/472: mknod d1/d5/c98 0 2023-12-16T20:11:27.944 INFO:tasks.workunit.client.0.smithi038.stdout:5/407: dread d2/d14/d25/f3f [0,4194304] 0 2023-12-16T20:11:27.944 INFO:tasks.workunit.client.0.smithi038.stdout:5/408: read d2/d14/d25/d2d/f31 [2128769,55158] 0 2023-12-16T20:11:27.946 INFO:tasks.workunit.client.0.smithi038.stdout:5/409: mkdir d2/d14/d25/d2d/d17/d51/d7b 0 2023-12-16T20:11:27.961 INFO:tasks.workunit.client.1.smithi141.stdout:3/120: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:27.964 INFO:tasks.workunit.client.1.smithi141.stdout:3/121: link d0/lc d0/l2a 0 2023-12-16T20:11:27.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/319: sync 2023-12-16T20:11:27.967 INFO:tasks.workunit.client.0.smithi038.stdout:0/320: creat db/d16/d5a/d65/f6a x:0 0 0 2023-12-16T20:11:27.968 INFO:tasks.workunit.client.0.smithi038.stdout:0/321: dread db/f14 [0,4194304] 0 2023-12-16T20:11:27.969 INFO:tasks.workunit.client.0.smithi038.stdout:0/322: creat db/d16/d66/f6b x:0 0 0 2023-12-16T20:11:27.969 INFO:tasks.workunit.client.0.smithi038.stdout:0/323: truncate db/d1a/f59 258345 0 2023-12-16T20:11:27.973 INFO:tasks.workunit.client.0.smithi038.stdout:0/324: read db/d1a/f33 [755727,128147] 0 2023-12-16T20:11:27.975 INFO:tasks.workunit.client.0.smithi038.stdout:0/325: rename db/d16/d19/f5f to db/d16/d66/f6c 0 2023-12-16T20:11:27.975 INFO:tasks.workunit.client.0.smithi038.stdout:0/326: fdatasync db/d16/d19/d27/f34 0 2023-12-16T20:11:27.975 INFO:tasks.workunit.client.0.smithi038.stdout:0/327: chown db/d16/d19/c22 107975105 1 2023-12-16T20:11:27.976 INFO:tasks.workunit.client.0.smithi038.stdout:0/328: rename db/ce to db/d16/d5a/d65/c6d 0 2023-12-16T20:11:27.979 INFO:tasks.workunit.client.1.smithi141.stdout:3/122: dread d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:27.980 INFO:tasks.workunit.client.0.smithi038.stdout:6/356: dwrite d1/f71 [0,4194304] 0 2023-12-16T20:11:27.980 INFO:tasks.workunit.client.0.smithi038.stdout:5/410: dwrite d2/d14/f22 [0,4194304] 0 2023-12-16T20:11:27.980 INFO:tasks.workunit.client.0.smithi038.stdout:2/473: dwrite d1/d5/d95/d61/d75/f96 [0,4194304] 0 2023-12-16T20:11:27.981 INFO:tasks.workunit.client.0.smithi038.stdout:0/329: write f5 [374889,14965] 0 2023-12-16T20:11:27.982 INFO:tasks.workunit.client.0.smithi038.stdout:5/411: creat d2/df/f7c x:0 0 0 2023-12-16T20:11:27.984 INFO:tasks.workunit.client.0.smithi038.stdout:6/357: creat d1/d4/f75 x:0 0 0 2023-12-16T20:11:27.986 INFO:tasks.workunit.client.1.smithi141.stdout:3/123: truncate d0/f8 881213 0 2023-12-16T20:11:27.989 INFO:tasks.workunit.client.1.smithi141.stdout:3/124: write d0/d13/f1e [529972,56304] 0 2023-12-16T20:11:27.989 INFO:tasks.workunit.client.1.smithi141.stdout:3/125: fsync d0/d13/f21 0 2023-12-16T20:11:27.990 INFO:tasks.workunit.client.0.smithi038.stdout:0/330: rename db/l45 to db/d16/d5a/l6e 0 2023-12-16T20:11:27.990 INFO:tasks.workunit.client.0.smithi038.stdout:5/412: unlink d2/l5 0 2023-12-16T20:11:27.990 INFO:tasks.workunit.client.0.smithi038.stdout:5/413: dread - d2/df/f7c zero size 2023-12-16T20:11:27.991 INFO:tasks.workunit.client.1.smithi141.stdout:3/126: link d0/d1c/c20 d0/d13/c2b 0 2023-12-16T20:11:27.991 INFO:tasks.workunit.client.1.smithi141.stdout:3/127: chown d0/ce 45 1 2023-12-16T20:11:27.991 INFO:tasks.workunit.client.0.smithi038.stdout:6/358: creat d1/d5b/f76 x:0 0 0 2023-12-16T20:11:27.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/331: symlink db/d1a/l6f 0 2023-12-16T20:11:27.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/332: write db/d1a/f59 [418848,76203] 0 2023-12-16T20:11:27.993 INFO:tasks.workunit.client.0.smithi038.stdout:5/414: symlink d2/d14/d25/d2d/d17/d51/l7d 0 2023-12-16T20:11:27.995 INFO:tasks.workunit.client.0.smithi038.stdout:2/474: dwrite d1/df/d10/f50 [0,4194304] 0 2023-12-16T20:11:27.996 INFO:tasks.workunit.client.0.smithi038.stdout:2/475: chown d1/df/d21/l94 2109224376 1 2023-12-16T20:11:27.996 INFO:tasks.workunit.client.0.smithi038.stdout:2/476: fdatasync d1/d73/f7c 0 2023-12-16T20:11:27.996 INFO:tasks.workunit.client.0.smithi038.stdout:2/477: readlink d1/df/d6a/l90 0 2023-12-16T20:11:27.996 INFO:tasks.workunit.client.0.smithi038.stdout:0/333: rmdir db/d16/d66 39 2023-12-16T20:11:27.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/334: rename db/d16/d66 to db/d16/d70 0 2023-12-16T20:11:28.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/335: rmdir db/d16/d1c 39 2023-12-16T20:11:28.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/336: creat db/d1a/f71 x:0 0 0 2023-12-16T20:11:28.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/337: chown db/d16/f54 16743606 1 2023-12-16T20:11:28.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/338: fdatasync db/f3d 0 2023-12-16T20:11:28.005 INFO:tasks.workunit.client.0.smithi038.stdout:0/339: creat db/d16/d1c/f72 x:0 0 0 2023-12-16T20:11:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:0/340: fsync db/d16/d19/d27/f51 0 2023-12-16T20:11:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:0/341: creat db/d1a/f73 x:0 0 0 2023-12-16T20:11:28.007 INFO:tasks.workunit.client.0.smithi038.stdout:0/342: creat db/d16/d70/f74 x:0 0 0 2023-12-16T20:11:28.007 INFO:tasks.workunit.client.0.smithi038.stdout:0/343: truncate db/d16/d19/f23 1122121 0 2023-12-16T20:11:28.007 INFO:tasks.workunit.client.0.smithi038.stdout:0/344: chown db/d16/d19/c28 18359 1 2023-12-16T20:11:28.008 INFO:tasks.workunit.client.0.smithi038.stdout:0/345: symlink db/d16/d19/l75 0 2023-12-16T20:11:28.009 INFO:tasks.workunit.client.0.smithi038.stdout:0/346: unlink l7 0 2023-12-16T20:11:28.010 INFO:tasks.workunit.client.0.smithi038.stdout:0/347: symlink db/d16/l76 0 2023-12-16T20:11:28.012 INFO:tasks.workunit.client.0.smithi038.stdout:2/478: dwrite d1/df/d10/f50 [0,4194304] 0 2023-12-16T20:11:28.012 INFO:tasks.workunit.client.0.smithi038.stdout:0/348: mkdir db/d1a/d77 0 2023-12-16T20:11:28.013 INFO:tasks.workunit.client.0.smithi038.stdout:6/359: dwrite d1/f71 [0,4194304] 0 2023-12-16T20:11:28.013 INFO:tasks.workunit.client.0.smithi038.stdout:6/360: chown d1/d4/f5e 16152859 1 2023-12-16T20:11:28.017 INFO:tasks.workunit.client.0.smithi038.stdout:2/479: rename d1/d5/d16/l2c to d1/d88/l99 0 2023-12-16T20:11:28.017 INFO:tasks.workunit.client.0.smithi038.stdout:2/480: chown d1/df/d6a/f59 1456 1 2023-12-16T20:11:28.018 INFO:tasks.workunit.client.0.smithi038.stdout:2/481: mkdir d1/df/d21/d9a 0 2023-12-16T20:11:28.020 INFO:tasks.workunit.client.0.smithi038.stdout:0/349: dread f6 [0,4194304] 0 2023-12-16T20:11:28.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/350: rmdir db/d16/d1c/d5d/d64 39 2023-12-16T20:11:28.052 INFO:tasks.workunit.client.0.smithi038.stdout:0/351: dread db/d16/f54 [0,4194304] 0 2023-12-16T20:11:28.053 INFO:tasks.workunit.client.0.smithi038.stdout:6/361: read d1/d4/f20 [2118114,74415] 0 2023-12-16T20:11:28.054 INFO:tasks.workunit.client.0.smithi038.stdout:6/362: creat d1/f77 x:0 0 0 2023-12-16T20:11:28.054 INFO:tasks.workunit.client.0.smithi038.stdout:0/352: unlink db/d16/d1c/c63 0 2023-12-16T20:11:28.054 INFO:tasks.workunit.client.0.smithi038.stdout:0/353: truncate db/d16/d19/f2b 870487 0 2023-12-16T20:11:28.058 INFO:tasks.workunit.client.1.smithi141.stdout:3/128: write d0/f8 [871456,45980] 0 2023-12-16T20:11:28.058 INFO:tasks.workunit.client.0.smithi038.stdout:2/482: truncate d1/d5/d95/d61/d75/f96 3941797 0 2023-12-16T20:11:28.058 INFO:tasks.workunit.client.0.smithi038.stdout:2/483: chown d1/d5/d16/f3b 2 1 2023-12-16T20:11:28.063 INFO:tasks.workunit.client.1.smithi141.stdout:3/129: dread d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:28.083 INFO:tasks.workunit.client.1.smithi141.stdout:3/130: dwrite d0/d13/f1d [0,4194304] 0 2023-12-16T20:11:28.083 INFO:tasks.workunit.client.0.smithi038.stdout:6/363: dwrite d1/f19 [0,4194304] 0 2023-12-16T20:11:28.083 INFO:tasks.workunit.client.0.smithi038.stdout:6/364: dread - d1/d5b/f76 zero size 2023-12-16T20:11:28.084 INFO:tasks.workunit.client.1.smithi141.stdout:3/131: mkdir d0/d1c/d2c 0 2023-12-16T20:11:28.084 INFO:tasks.workunit.client.1.smithi141.stdout:3/132: write d0/d13/f1b [188196,92168] 0 2023-12-16T20:11:28.086 INFO:tasks.workunit.client.1.smithi141.stdout:3/133: getdents d0 0 2023-12-16T20:11:28.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/484: creat d1/d5/d2a/d31/d60/f9b x:0 0 0 2023-12-16T20:11:28.088 INFO:tasks.workunit.client.1.smithi141.stdout:3/134: truncate d0/d13/f1b 3884213 0 2023-12-16T20:11:28.089 INFO:tasks.workunit.client.1.smithi141.stdout:3/135: symlink d0/l2d 0 2023-12-16T20:11:28.090 INFO:tasks.workunit.client.1.smithi141.stdout:3/136: rmdir d0/d1c 39 2023-12-16T20:11:28.090 INFO:tasks.workunit.client.1.smithi141.stdout:3/137: readlink d0/l7 0 2023-12-16T20:11:28.091 INFO:tasks.workunit.client.0.smithi038.stdout:6/365: rmdir d1/d4/d1d/d28/d2f/d74 0 2023-12-16T20:11:28.091 INFO:tasks.workunit.client.0.smithi038.stdout:6/366: chown d1/d4/d1d/d28/c31 20636452 1 2023-12-16T20:11:28.091 INFO:tasks.workunit.client.0.smithi038.stdout:6/367: chown d1/d4/d1d/d28/d2f/d3d/f46 1 1 2023-12-16T20:11:28.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/485: symlink d1/d73/l9c 0 2023-12-16T20:11:28.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/486: creat d1/df/d6d/f9d x:0 0 0 2023-12-16T20:11:28.093 INFO:tasks.workunit.client.0.smithi038.stdout:2/487: write d1/d5/d2a/f35 [2833127,110381] 0 2023-12-16T20:11:28.094 INFO:tasks.workunit.client.0.smithi038.stdout:5/415: rmdir d2/d14/d25/d2d/d17/d51 39 2023-12-16T20:11:28.094 INFO:tasks.workunit.client.0.smithi038.stdout:5/416: chown d2/d14/d25/d2d/d17/f19 101710810 1 2023-12-16T20:11:28.097 INFO:tasks.workunit.client.0.smithi038.stdout:2/488: mkdir d1/d5/d3d/d9e 0 2023-12-16T20:11:28.098 INFO:tasks.workunit.client.0.smithi038.stdout:5/417: creat d2/d14/d25/d2d/d4b/f7e x:0 0 0 2023-12-16T20:11:28.100 INFO:tasks.workunit.client.0.smithi038.stdout:5/418: mknod d2/d14/d25/d2d/d17/c7f 0 2023-12-16T20:11:28.101 INFO:tasks.workunit.client.0.smithi038.stdout:2/489: dread d1/df/d10/d23/d3a/f4a [0,4194304] 0 2023-12-16T20:11:28.102 INFO:tasks.workunit.client.0.smithi038.stdout:5/419: rename d2/f11 to d2/d14/d25/d2d/d17/d51/f80 0 2023-12-16T20:11:28.103 INFO:tasks.workunit.client.0.smithi038.stdout:2/490: mkdir d1/d5/d6c/d9f 0 2023-12-16T20:11:28.105 INFO:tasks.workunit.client.0.smithi038.stdout:5/420: truncate d2/f12 3447184 0 2023-12-16T20:11:28.105 INFO:tasks.workunit.client.0.smithi038.stdout:5/421: truncate d2/df/d1a/d2a/f68 813705 0 2023-12-16T20:11:28.107 INFO:tasks.workunit.client.0.smithi038.stdout:6/368: dwrite d1/d4/f1c [0,4194304] 0 2023-12-16T20:11:28.107 INFO:tasks.workunit.client.0.smithi038.stdout:6/369: creat d1/d4/d1d/d28/f78 x:0 0 0 2023-12-16T20:11:28.107 INFO:tasks.workunit.client.0.smithi038.stdout:6/370: write d1/d4/d1d/f3b [39284,32333] 0 2023-12-16T20:11:28.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/491: rename d1/d5/d2a/d31/d60/l7e to d1/df/d10/d2f/la0 0 2023-12-16T20:11:28.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/492: fdatasync d1/df/d10/f77 0 2023-12-16T20:11:28.111 INFO:tasks.workunit.client.1.smithi141.stdout:3/138: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T20:11:28.112 INFO:tasks.workunit.client.1.smithi141.stdout:3/139: getdents d0/d1c/d2c 0 2023-12-16T20:11:28.113 INFO:tasks.workunit.client.0.smithi038.stdout:2/493: getdents d1/d5/d95/d61/d75 0 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:1/462: sync 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/319: sync 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:7/316: sync 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:3/397: sync 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/320: write d13/d1f/d22/f44 [1419352,46426] 0 2023-12-16T20:11:28.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/321: chown c3 220 1 2023-12-16T20:11:28.115 INFO:tasks.workunit.client.0.smithi038.stdout:1/463: write d15/d1e/d3b/d48/d37/f88 [1287204,4831] 0 2023-12-16T20:11:28.115 INFO:tasks.workunit.client.0.smithi038.stdout:1/464: readlink d15/l18 0 2023-12-16T20:11:28.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/422: mkdir d2/d81 0 2023-12-16T20:11:28.121 INFO:tasks.workunit.client.0.smithi038.stdout:2/494: mknod d1/d5/ca1 0 2023-12-16T20:11:28.123 INFO:tasks.workunit.client.0.smithi038.stdout:7/317: mkdir da/d21/d68 0 2023-12-16T20:11:28.123 INFO:tasks.workunit.client.0.smithi038.stdout:8/247: sync 2023-12-16T20:11:28.123 INFO:tasks.workunit.client.0.smithi038.stdout:8/248: dread - d17/f40 zero size 2023-12-16T20:11:28.123 INFO:tasks.workunit.client.0.smithi038.stdout:8/249: fsync d17/d48/f49 0 2023-12-16T20:11:28.123 INFO:tasks.workunit.client.0.smithi038.stdout:9/346: sync 2023-12-16T20:11:28.124 INFO:tasks.workunit.client.0.smithi038.stdout:3/398: mkdir d4/d18/d8d 0 2023-12-16T20:11:28.126 INFO:tasks.workunit.client.0.smithi038.stdout:4/322: symlink d13/d17/l68 0 2023-12-16T20:11:28.129 INFO:tasks.workunit.client.0.smithi038.stdout:1/465: creat d15/d1e/d23/d34/d79/f9c x:0 0 0 2023-12-16T20:11:28.130 INFO:tasks.workunit.client.0.smithi038.stdout:1/466: fdatasync d15/d22/d52/f81 0 2023-12-16T20:11:28.130 INFO:tasks.workunit.client.0.smithi038.stdout:1/467: creat d15/d1e/d23/d34/f9d x:0 0 0 2023-12-16T20:11:28.131 INFO:tasks.workunit.client.0.smithi038.stdout:6/371: dwrite d1/f56 [4194304,4194304] 0 2023-12-16T20:11:28.131 INFO:tasks.workunit.client.1.smithi141.stdout:3/140: dwrite d0/d13/f1d [0,4194304] 0 2023-12-16T20:11:28.132 INFO:tasks.workunit.client.0.smithi038.stdout:5/423: unlink d2/d4/l21 0 2023-12-16T20:11:28.132 INFO:tasks.workunit.client.0.smithi038.stdout:3/399: dread d4/d8/f43 [0,4194304] 0 2023-12-16T20:11:28.133 INFO:tasks.workunit.client.0.smithi038.stdout:7/318: symlink da/d24/l69 0 2023-12-16T20:11:28.133 INFO:tasks.workunit.client.0.smithi038.stdout:7/319: fdatasync da/d21/d2c/f36 0 2023-12-16T20:11:28.133 INFO:tasks.workunit.client.0.smithi038.stdout:7/320: chown da/d21/d68 314154628 1 2023-12-16T20:11:28.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/141: dread d0/f8 [0,4194304] 0 2023-12-16T20:11:28.137 INFO:tasks.workunit.client.1.smithi141.stdout:3/142: stat d0/d13/c2b 0 2023-12-16T20:11:28.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/250: link d17/d1b/f22 d17/d34/d3d/f4b 0 2023-12-16T20:11:28.140 INFO:tasks.workunit.client.0.smithi038.stdout:9/347: link d9/d1f/d21/l44 d9/d1f/d21/d3e/d4e/d61/l68 0 2023-12-16T20:11:28.140 INFO:tasks.workunit.client.0.smithi038.stdout:7/321: write da/d21/d2c/d2e/f3c [2911656,66390] 0 2023-12-16T20:11:28.141 INFO:tasks.workunit.client.0.smithi038.stdout:4/323: mkdir d13/d69 0 2023-12-16T20:11:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:27 smithi038 ceph-mon[80659]: pgmap v174: 65 pgs: 65 active+clean; 523 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 38 MiB/s rd, 46 MiB/s wr, 343 op/s 2023-12-16T20:11:28.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:27 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:28.145 INFO:tasks.workunit.client.0.smithi038.stdout:1/468: unlink d15/f21 0 2023-12-16T20:11:28.145 INFO:tasks.workunit.client.0.smithi038.stdout:1/469: fsync d15/d1e/d23/d7d/f9b 0 2023-12-16T20:11:28.147 INFO:tasks.workunit.client.0.smithi038.stdout:6/372: stat d1/d16/c1f 0 2023-12-16T20:11:28.147 INFO:tasks.workunit.client.0.smithi038.stdout:6/373: creat d1/d4/d1d/d28/f79 x:0 0 0 2023-12-16T20:11:28.150 INFO:tasks.workunit.client.1.smithi141.stdout:3/143: write d0/d13/f1d [2978041,28620] 0 2023-12-16T20:11:28.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/400: mknod d4/d27/d23/d26/c8e 0 2023-12-16T20:11:28.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/401: fsync d4/d67/f76 0 2023-12-16T20:11:28.152 INFO:tasks.workunit.client.0.smithi038.stdout:2/495: dwrite d1/df/d6d/f69 [0,4194304] 0 2023-12-16T20:11:28.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/251: creat d17/d34/d3d/f4c x:0 0 0 2023-12-16T20:11:28.152 INFO:tasks.workunit.client.1.smithi141.stdout:3/144: link d0/d13/c18 d0/d13/c2e 0 2023-12-16T20:11:28.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/496: write d1/df/d6a/d43/d57/f5a [7641,100703] 0 2023-12-16T20:11:28.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/497: chown d1/d5/d3d/l52 0 1 2023-12-16T20:11:28.154 INFO:tasks.workunit.client.0.smithi038.stdout:5/424: dwrite d2/f10 [0,4194304] 0 2023-12-16T20:11:28.155 INFO:tasks.workunit.client.1.smithi141.stdout:3/145: unlink d0/d13/f21 0 2023-12-16T20:11:28.155 INFO:tasks.workunit.client.0.smithi038.stdout:9/348: link d9/d1e/d3d/f5d d9/d1f/d21/d3e/f69 0 2023-12-16T20:11:28.155 INFO:tasks.workunit.client.1.smithi141.stdout:3/146: creat d0/d1c/d2c/f2f x:0 0 0 2023-12-16T20:11:28.157 INFO:tasks.workunit.client.1.smithi141.stdout:3/147: mknod d0/d13/c30 0 2023-12-16T20:11:28.157 INFO:tasks.workunit.client.1.smithi141.stdout:3/148: rmdir d0/d1c 39 2023-12-16T20:11:28.158 INFO:tasks.workunit.client.1.smithi141.stdout:3/149: symlink d0/d1c/l31 0 2023-12-16T20:11:28.158 INFO:tasks.workunit.client.1.smithi141.stdout:3/150: chown d0/d13/f1e 145 1 2023-12-16T20:11:28.160 INFO:tasks.workunit.client.1.smithi141.stdout:3/151: link d0/d1c/l22 d0/l32 0 2023-12-16T20:11:28.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/324: mkdir d13/d17/d2e/d32/d4e/d61/d6a 0 2023-12-16T20:11:28.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/470: unlink d15/d1e/c1f 0 2023-12-16T20:11:28.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/471: creat d15/d1e/d3b/d5a/f9e x:0 0 0 2023-12-16T20:11:28.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/252: link d17/d18/l2d d17/d1b/d25/l4d 0 2023-12-16T20:11:28.171 INFO:tasks.workunit.client.0.smithi038.stdout:2/498: link d1/d5/d95/c78 d1/df/d6a/d43/ca2 0 2023-12-16T20:11:28.173 INFO:tasks.workunit.client.0.smithi038.stdout:5/425: creat d2/df/d1a/d1f/d4a/d53/f82 x:0 0 0 2023-12-16T20:11:28.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/402: read d4/d8/f42 [7315361,73636] 0 2023-12-16T20:11:28.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/403: write d4/d27/d23/d26/f68 [702396,120836] 0 2023-12-16T20:11:28.174 INFO:tasks.workunit.client.0.smithi038.stdout:7/322: symlink da/l6a 0 2023-12-16T20:11:28.178 INFO:tasks.workunit.client.0.smithi038.stdout:6/374: dwrite d1/f25 [0,4194304] 0 2023-12-16T20:11:28.178 INFO:tasks.workunit.client.0.smithi038.stdout:6/375: creat d1/d4/d1d/d28/f7a x:0 0 0 2023-12-16T20:11:28.179 INFO:tasks.workunit.client.0.smithi038.stdout:4/325: mkdir d13/d6b 0 2023-12-16T20:11:28.180 INFO:tasks.workunit.client.0.smithi038.stdout:9/349: dwrite d9/d1f/d21/d55/f56 [0,4194304] 0 2023-12-16T20:11:28.192 INFO:tasks.workunit.client.0.smithi038.stdout:1/472: unlink d15/d22/d62/c7c 0 2023-12-16T20:11:28.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/473: write d15/d1e/d23/d34/f7a [544410,108215] 0 2023-12-16T20:11:28.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/474: chown d15/d1e/d23/d42/l76 2929289 1 2023-12-16T20:11:28.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/475: creat d15/d1e/d3b/d48/d37/f9f x:0 0 0 2023-12-16T20:11:28.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/476: getdents d15/d1e/d30/d95 0 2023-12-16T20:11:28.197 INFO:tasks.workunit.client.0.smithi038.stdout:8/253: rename d17/d48 to d17/d34/d3d/d45/d4e 0 2023-12-16T20:11:28.197 INFO:tasks.workunit.client.0.smithi038.stdout:4/326: dwrite fa [4194304,4194304] 0 2023-12-16T20:11:28.199 INFO:tasks.workunit.client.0.smithi038.stdout:2/499: getdents d1/d5/d3d 0 2023-12-16T20:11:28.199 INFO:tasks.workunit.client.0.smithi038.stdout:2/500: fsync d1/df/d10/f77 0 2023-12-16T20:11:28.199 INFO:tasks.workunit.client.0.smithi038.stdout:2/501: chown d1/d5/f4d 1992 1 2023-12-16T20:11:28.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/426: symlink d2/d14/d25/d2d/d17/l83 0 2023-12-16T20:11:28.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/427: dread - d2/d4/f4c zero size 2023-12-16T20:11:28.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/428: truncate d2/df/d1a/d1f/d4a/d53/f82 280232 0 2023-12-16T20:11:28.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/429: rename d2/d14 to d2/d14/d25/d2d/d17/d51/d7b/d84 22 2023-12-16T20:11:28.200 INFO:tasks.workunit.client.0.smithi038.stdout:3/404: symlink d4/d8/d15/d2c/l8f 0 2023-12-16T20:11:28.201 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:27 smithi141 ceph-mon[88165]: pgmap v174: 65 pgs: 65 active+clean; 523 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 38 MiB/s rd, 46 MiB/s wr, 343 op/s 2023-12-16T20:11:28.201 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:27 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:28.201 INFO:tasks.workunit.client.0.smithi038.stdout:7/323: mkdir da/d21/d41/d6b 0 2023-12-16T20:11:28.202 INFO:tasks.workunit.client.0.smithi038.stdout:7/324: write da/d21/d2c/d2e/f3c [4022160,39103] 0 2023-12-16T20:11:28.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/376: dwrite d1/f56 [0,4194304] 0 2023-12-16T20:11:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/350: mkdir d9/d1f/d6a 0 2023-12-16T20:11:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/351: chown d9/d1f/d21/d3e/d4e/d64 19 1 2023-12-16T20:11:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/352: readlink d9/d1f/d21/d3e/d4e/d61/l68 0 2023-12-16T20:11:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/353: chown d9/d1f/d21 25444201 1 2023-12-16T20:11:28.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/354: creat d9/d1e/d3d/f6b x:0 0 0 2023-12-16T20:11:28.209 INFO:tasks.workunit.client.0.smithi038.stdout:9/355: read - d9/d1e/f37 zero size 2023-12-16T20:11:28.210 INFO:tasks.workunit.client.0.smithi038.stdout:8/254: dwrite d17/f40 [0,4194304] 0 2023-12-16T20:11:28.210 INFO:tasks.workunit.client.0.smithi038.stdout:1/477: creat d15/d1e/d23/d34/d86/fa0 x:0 0 0 2023-12-16T20:11:28.214 INFO:tasks.workunit.client.0.smithi038.stdout:4/327: creat d13/d17/d2e/d32/d4d/f6c x:0 0 0 2023-12-16T20:11:28.216 INFO:tasks.workunit.client.0.smithi038.stdout:4/328: dread d13/d17/d4b/f43 [0,4194304] 0 2023-12-16T20:11:28.217 INFO:tasks.workunit.client.1.smithi141.stdout:1/19: sync 2023-12-16T20:11:28.217 INFO:tasks.workunit.client.1.smithi141.stdout:1/20: truncate - no filename 2023-12-16T20:11:28.217 INFO:tasks.workunit.client.1.smithi141.stdout:0/26: sync 2023-12-16T20:11:28.222 INFO:tasks.workunit.client.0.smithi038.stdout:2/502: unlink d1/df/d6d/f9d 0 2023-12-16T20:11:28.223 INFO:tasks.workunit.client.1.smithi141.stdout:1/21: unlink c2 0 2023-12-16T20:11:28.223 INFO:tasks.workunit.client.1.smithi141.stdout:1/22: dwrite - no filename 2023-12-16T20:11:28.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/430: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d85 0 2023-12-16T20:11:28.223 INFO:tasks.workunit.client.0.smithi038.stdout:3/405: rmdir d4/d6c 39 2023-12-16T20:11:28.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/431: dread - d2/d14/f5a zero size 2023-12-16T20:11:28.224 INFO:tasks.workunit.client.0.smithi038.stdout:5/432: stat d2/df/d1a/d1f/c4f 0 2023-12-16T20:11:28.224 INFO:tasks.workunit.client.0.smithi038.stdout:5/433: dread d2/df/d1a/d1f/d4a/d53/f82 [0,4194304] 0 2023-12-16T20:11:28.224 INFO:tasks.workunit.client.1.smithi141.stdout:6/50: sync 2023-12-16T20:11:28.225 INFO:tasks.workunit.client.1.smithi141.stdout:7/16: sync 2023-12-16T20:11:28.225 INFO:tasks.workunit.client.1.smithi141.stdout:9/16: sync 2023-12-16T20:11:28.227 INFO:tasks.workunit.client.1.smithi141.stdout:0/27: dread f2 [0,4194304] 0 2023-12-16T20:11:28.227 INFO:tasks.workunit.client.1.smithi141.stdout:0/28: stat f2 0 2023-12-16T20:11:28.227 INFO:tasks.workunit.client.1.smithi141.stdout:0/29: rename d4/d7 to d4/d7/d8 22 2023-12-16T20:11:28.227 INFO:tasks.workunit.client.1.smithi141.stdout:0/30: readlink d4/l5 0 2023-12-16T20:11:28.228 INFO:tasks.workunit.client.1.smithi141.stdout:0/31: fdatasync f1 0 2023-12-16T20:11:28.228 INFO:tasks.workunit.client.1.smithi141.stdout:7/17: rename l1 to l2 0 2023-12-16T20:11:28.228 INFO:tasks.workunit.client.1.smithi141.stdout:6/51: mknod d1/d3/c14 0 2023-12-16T20:11:28.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/17: dread - d1/f6 zero size 2023-12-16T20:11:28.229 INFO:tasks.workunit.client.1.smithi141.stdout:0/32: symlink d4/l9 0 2023-12-16T20:11:28.229 INFO:tasks.workunit.client.1.smithi141.stdout:7/18: mknod c3 0 2023-12-16T20:11:28.230 INFO:tasks.workunit.client.1.smithi141.stdout:7/19: readlink l2 0 2023-12-16T20:11:28.231 INFO:tasks.workunit.client.1.smithi141.stdout:6/52: creat d1/dd/f15 x:0 0 0 2023-12-16T20:11:28.231 INFO:tasks.workunit.client.1.smithi141.stdout:6/53: write d1/dd/f15 [164738,80226] 0 2023-12-16T20:11:28.231 INFO:tasks.workunit.client.0.smithi038.stdout:5/434: dread d2/d14/d25/d2d/f31 [0,4194304] 0 2023-12-16T20:11:28.233 INFO:tasks.workunit.client.1.smithi141.stdout:9/18: mkdir d1/d8 0 2023-12-16T20:11:28.233 INFO:tasks.workunit.client.1.smithi141.stdout:9/19: fdatasync d1/f6 0 2023-12-16T20:11:28.233 INFO:tasks.workunit.client.1.smithi141.stdout:9/20: fdatasync d1/f6 0 2023-12-16T20:11:28.237 INFO:tasks.workunit.client.1.smithi141.stdout:9/21: creat d1/f9 x:0 0 0 2023-12-16T20:11:28.237 INFO:tasks.workunit.client.1.smithi141.stdout:9/22: write d1/f9 [730472,62348] 0 2023-12-16T20:11:28.237 INFO:tasks.workunit.client.1.smithi141.stdout:0/33: dread f2 [0,4194304] 0 2023-12-16T20:11:28.237 INFO:tasks.workunit.client.1.smithi141.stdout:0/34: write f3 [4391317,48849] 0 2023-12-16T20:11:28.238 INFO:tasks.workunit.client.0.smithi038.stdout:2/503: dwrite d1/df/d21/f45 [0,4194304] 0 2023-12-16T20:11:28.253 INFO:tasks.workunit.client.1.smithi141.stdout:9/23: dread d1/f9 [0,4194304] 0 2023-12-16T20:11:28.253 INFO:tasks.workunit.client.1.smithi141.stdout:6/54: dwrite d1/fa [0,4194304] 0 2023-12-16T20:11:28.254 INFO:tasks.workunit.client.1.smithi141.stdout:9/24: mkdir d1/d8/da 0 2023-12-16T20:11:28.254 INFO:tasks.workunit.client.1.smithi141.stdout:0/35: dwrite f1 [0,4194304] 0 2023-12-16T20:11:28.258 INFO:tasks.workunit.client.1.smithi141.stdout:0/36: creat d4/fa x:0 0 0 2023-12-16T20:11:28.259 INFO:tasks.workunit.client.1.smithi141.stdout:0/37: truncate d4/fa 277688 0 2023-12-16T20:11:28.259 INFO:tasks.workunit.client.1.smithi141.stdout:0/38: truncate d4/fa 652460 0 2023-12-16T20:11:28.260 INFO:tasks.workunit.client.1.smithi141.stdout:0/39: symlink d4/d7/lb 0 2023-12-16T20:11:28.262 INFO:tasks.workunit.client.1.smithi141.stdout:0/40: mknod d4/d7/cc 0 2023-12-16T20:11:28.272 INFO:tasks.workunit.client.1.smithi141.stdout:9/25: dwrite d1/f9 [0,4194304] 0 2023-12-16T20:11:28.273 INFO:tasks.workunit.client.1.smithi141.stdout:0/41: read f3 [2384312,3669] 0 2023-12-16T20:11:28.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/42: rename f3 to d4/d7/fd 0 2023-12-16T20:11:28.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/43: chown f1 117020690 1 2023-12-16T20:11:28.278 INFO:tasks.workunit.client.1.smithi141.stdout:6/55: truncate d1/fa 2353250 0 2023-12-16T20:11:28.280 INFO:tasks.workunit.client.1.smithi141.stdout:6/56: creat d1/d12/f16 x:0 0 0 2023-12-16T20:11:28.281 INFO:tasks.workunit.client.1.smithi141.stdout:0/44: fdatasync d4/d7/fd 0 2023-12-16T20:11:28.282 INFO:tasks.workunit.client.1.smithi141.stdout:6/57: creat d1/f17 x:0 0 0 2023-12-16T20:11:28.283 INFO:tasks.workunit.client.1.smithi141.stdout:0/45: read d4/fa [384670,67076] 0 2023-12-16T20:11:28.283 INFO:tasks.workunit.client.1.smithi141.stdout:0/46: creat d4/fe x:0 0 0 2023-12-16T20:11:28.283 INFO:tasks.workunit.client.1.smithi141.stdout:6/58: mknod d1/dd/de/c18 0 2023-12-16T20:11:28.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/47: symlink d4/lf 0 2023-12-16T20:11:28.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/48: readlink d4/l9 0 2023-12-16T20:11:28.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/49: stat d4/d7 0 2023-12-16T20:11:28.286 INFO:tasks.workunit.client.1.smithi141.stdout:0/50: link d4/d7/cc d4/c10 0 2023-12-16T20:11:28.286 INFO:tasks.workunit.client.1.smithi141.stdout:0/51: symlink d4/d7/l11 0 2023-12-16T20:11:28.289 INFO:tasks.workunit.client.1.smithi141.stdout:9/26: dwrite d1/f9 [0,4194304] 0 2023-12-16T20:11:28.291 INFO:tasks.workunit.client.1.smithi141.stdout:9/27: creat d1/d8/fb x:0 0 0 2023-12-16T20:11:28.291 INFO:tasks.workunit.client.1.smithi141.stdout:9/28: dread - d1/d8/fb zero size 2023-12-16T20:11:28.291 INFO:tasks.workunit.client.1.smithi141.stdout:9/29: dread - d1/f6 zero size 2023-12-16T20:11:28.291 INFO:tasks.workunit.client.1.smithi141.stdout:9/30: truncate d1/f6 108796 0 2023-12-16T20:11:28.292 INFO:tasks.workunit.client.1.smithi141.stdout:9/31: creat d1/fc x:0 0 0 2023-12-16T20:11:28.294 INFO:tasks.workunit.client.1.smithi141.stdout:9/32: mknod d1/cd 0 2023-12-16T20:11:28.295 INFO:tasks.workunit.client.1.smithi141.stdout:9/33: mkdir d1/d8/da/de 0 2023-12-16T20:11:28.310 INFO:tasks.workunit.client.1.smithi141.stdout:6/59: write d1/fa [1636495,24484] 0 2023-12-16T20:11:28.310 INFO:tasks.workunit.client.1.smithi141.stdout:6/60: write d1/fb [48469,46337] 0 2023-12-16T20:11:28.315 INFO:tasks.workunit.client.1.smithi141.stdout:9/34: dread d1/f9 [0,4194304] 0 2023-12-16T20:11:28.316 INFO:tasks.workunit.client.1.smithi141.stdout:9/35: mknod d1/d8/da/de/cf 0 2023-12-16T20:11:28.317 INFO:tasks.workunit.client.1.smithi141.stdout:9/36: mkdir d1/d10 0 2023-12-16T20:11:28.319 INFO:tasks.workunit.client.1.smithi141.stdout:0/52: dwrite d4/d7/fd [0,4194304] 0 2023-12-16T20:11:28.319 INFO:tasks.workunit.client.1.smithi141.stdout:0/53: write d4/fa [268649,44695] 0 2023-12-16T20:11:28.319 INFO:tasks.workunit.client.1.smithi141.stdout:9/37: symlink d1/d8/l11 0 2023-12-16T20:11:28.321 INFO:tasks.workunit.client.1.smithi141.stdout:0/54: mknod d4/d7/c12 0 2023-12-16T20:11:28.321 INFO:tasks.workunit.client.1.smithi141.stdout:0/55: fdatasync f2 0 2023-12-16T20:11:28.323 INFO:tasks.workunit.client.1.smithi141.stdout:0/56: symlink d4/d7/l13 0 2023-12-16T20:11:28.323 INFO:tasks.workunit.client.1.smithi141.stdout:0/57: write d4/fa [453235,57601] 0 2023-12-16T20:11:28.327 INFO:tasks.workunit.client.1.smithi141.stdout:6/61: dwrite d1/f17 [0,4194304] 0 2023-12-16T20:11:28.327 INFO:tasks.workunit.client.1.smithi141.stdout:6/62: fsync d1/d3/f10 0 2023-12-16T20:11:28.327 INFO:tasks.workunit.client.1.smithi141.stdout:0/58: link d4/lf d4/d7/l14 0 2023-12-16T20:11:28.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/356: mkdir d9/d1f/d6c 0 2023-12-16T20:11:28.332 INFO:tasks.workunit.client.1.smithi141.stdout:0/59: rename d4/l9 to d4/l15 0 2023-12-16T20:11:28.332 INFO:tasks.workunit.client.1.smithi141.stdout:0/60: creat d4/f16 x:0 0 0 2023-12-16T20:11:28.332 INFO:tasks.workunit.client.1.smithi141.stdout:0/61: readlink l0 0 2023-12-16T20:11:28.335 INFO:tasks.workunit.client.1.smithi141.stdout:0/62: unlink d4/fa 0 2023-12-16T20:11:28.338 INFO:tasks.workunit.client.1.smithi141.stdout:9/38: truncate d1/f9 4114080 0 2023-12-16T20:11:28.339 INFO:tasks.workunit.client.1.smithi141.stdout:9/39: creat d1/d10/f12 x:0 0 0 2023-12-16T20:11:28.341 INFO:tasks.workunit.client.1.smithi141.stdout:9/40: unlink d1/cd 0 2023-12-16T20:11:28.341 INFO:tasks.workunit.client.1.smithi141.stdout:9/41: write d1/fc [126452,65584] 0 2023-12-16T20:11:28.341 INFO:tasks.workunit.client.1.smithi141.stdout:9/42: write d1/fc [753931,130274] 0 2023-12-16T20:11:28.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/255: rename d17/d18/l37 to d17/d34/d3d/d45/d4e/l4f 0 2023-12-16T20:11:28.342 INFO:tasks.workunit.client.1.smithi141.stdout:6/63: dwrite d1/f17 [0,4194304] 0 2023-12-16T20:11:28.343 INFO:tasks.workunit.client.1.smithi141.stdout:6/64: readlink d1/d3/l7 0 2023-12-16T20:11:28.343 INFO:tasks.workunit.client.1.smithi141.stdout:9/43: mknod d1/d8/c13 0 2023-12-16T20:11:28.343 INFO:tasks.workunit.client.1.smithi141.stdout:9/44: write d1/d10/f12 [419438,84749] 0 2023-12-16T20:11:28.344 INFO:tasks.workunit.client.1.smithi141.stdout:9/45: mkdir d1/d10/d14 0 2023-12-16T20:11:28.344 INFO:tasks.workunit.client.1.smithi141.stdout:9/46: creat d1/d10/f15 x:0 0 0 2023-12-16T20:11:28.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/478: creat d15/d1e/d23/d34/d86/d9a/fa1 x:0 0 0 2023-12-16T20:11:28.345 INFO:tasks.workunit.client.1.smithi141.stdout:0/63: fsync d4/f16 0 2023-12-16T20:11:28.345 INFO:tasks.workunit.client.1.smithi141.stdout:0/64: creat d4/f17 x:0 0 0 2023-12-16T20:11:28.351 INFO:tasks.workunit.client.0.smithi038.stdout:4/329: creat d13/d6b/f6d x:0 0 0 2023-12-16T20:11:28.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/406: getdents d4/d8/d15/d2c/d4c/d70/d71 0 2023-12-16T20:11:28.357 INFO:tasks.workunit.client.0.smithi038.stdout:6/377: getdents d1/d16 0 2023-12-16T20:11:28.357 INFO:tasks.workunit.client.0.smithi038.stdout:6/378: chown d1/d16/c4f 33638 1 2023-12-16T20:11:28.358 INFO:tasks.workunit.client.0.smithi038.stdout:5/435: symlink d2/df/d1a/d2a/d59/l86 0 2023-12-16T20:11:28.360 INFO:tasks.workunit.client.0.smithi038.stdout:2/504: creat d1/df/d21/d9a/fa3 x:0 0 0 2023-12-16T20:11:28.360 INFO:tasks.workunit.client.0.smithi038.stdout:2/505: write d1/df/d6a/f59 [1539667,78659] 0 2023-12-16T20:11:28.363 INFO:tasks.workunit.client.0.smithi038.stdout:1/479: dwrite d15/d1e/d23/d46/f63 [4194304,4194304] 0 2023-12-16T20:11:28.364 INFO:tasks.workunit.client.0.smithi038.stdout:5/436: dread d2/df/f1d [0,4194304] 0 2023-12-16T20:11:28.364 INFO:tasks.workunit.client.1.smithi141.stdout:6/65: dwrite d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:28.366 INFO:tasks.workunit.client.0.smithi038.stdout:9/357: rename d9/l39 to d9/d1f/l6d 0 2023-12-16T20:11:28.368 INFO:tasks.workunit.client.0.smithi038.stdout:0/354: sync 2023-12-16T20:11:28.369 INFO:tasks.workunit.client.1.smithi141.stdout:9/47: truncate d1/f9 3665582 0 2023-12-16T20:11:28.369 INFO:tasks.workunit.client.0.smithi038.stdout:0/355: dread db/f14 [0,4194304] 0 2023-12-16T20:11:28.371 INFO:tasks.workunit.client.1.smithi141.stdout:9/48: rename l0 to d1/d10/d14/l16 0 2023-12-16T20:11:28.376 INFO:tasks.workunit.client.1.smithi141.stdout:9/49: dread d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:28.377 INFO:tasks.workunit.client.0.smithi038.stdout:8/256: mkdir d17/d34/d3d/d50 0 2023-12-16T20:11:28.378 INFO:tasks.workunit.client.1.smithi141.stdout:9/50: symlink d1/d8/da/l17 0 2023-12-16T20:11:28.379 INFO:tasks.workunit.client.0.smithi038.stdout:4/330: mkdir d13/d17/d2e/d32/d4d/d6e 0 2023-12-16T20:11:28.379 INFO:tasks.workunit.client.0.smithi038.stdout:5/437: read d2/d14/d25/d2d/d17/f19 [1114415,103097] 0 2023-12-16T20:11:28.381 INFO:tasks.workunit.client.1.smithi141.stdout:9/51: symlink d1/l18 0 2023-12-16T20:11:28.382 INFO:tasks.workunit.client.0.smithi038.stdout:3/407: truncate d4/d27/d2b/f5b 986257 0 2023-12-16T20:11:28.386 INFO:tasks.workunit.client.0.smithi038.stdout:2/506: link d1/df/d6a/d43/d57/l86 d1/df/d6a/d7a/la4 0 2023-12-16T20:11:28.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/325: sync 2023-12-16T20:11:28.392 INFO:tasks.workunit.client.0.smithi038.stdout:6/379: rename d1/d4/d1d/f2a to d1/d4/d1d/d61/f7b 0 2023-12-16T20:11:28.392 INFO:tasks.workunit.client.0.smithi038.stdout:6/380: fsync d1/d5b/f76 0 2023-12-16T20:11:28.393 INFO:tasks.workunit.client.0.smithi038.stdout:0/356: getdents db/d16/d1c/d5d/d64 0 2023-12-16T20:11:28.394 INFO:tasks.workunit.client.0.smithi038.stdout:4/331: mknod d13/d1f/c6f 0 2023-12-16T20:11:28.397 INFO:tasks.workunit.client.0.smithi038.stdout:5/438: mkdir d2/df/d87 0 2023-12-16T20:11:28.398 INFO:tasks.workunit.client.0.smithi038.stdout:3/408: symlink d4/d27/d40/l90 0 2023-12-16T20:11:28.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/326: creat da/d24/d4d/f6c x:0 0 0 2023-12-16T20:11:28.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/327: fdatasync da/d21/f34 0 2023-12-16T20:11:28.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/332: mkdir d13/d17/d2e/d32/d70 0 2023-12-16T20:11:28.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/333: fsync d13/d17/f45 0 2023-12-16T20:11:28.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/334: fsync d13/d17/d2e/d32/d4d/f6c 0 2023-12-16T20:11:28.403 INFO:tasks.workunit.client.0.smithi038.stdout:5/439: creat d2/d14/d25/d2d/d17/f88 x:0 0 0 2023-12-16T20:11:28.404 INFO:tasks.workunit.client.0.smithi038.stdout:3/409: creat d4/d8/d15/d2c/d7d/f91 x:0 0 0 2023-12-16T20:11:28.405 INFO:tasks.workunit.client.0.smithi038.stdout:3/410: truncate d4/d27/d23/d6e/f87 426343 0 2023-12-16T20:11:28.405 INFO:tasks.workunit.client.1.smithi141.stdout:6/66: dwrite d1/dd/f15 [0,4194304] 0 2023-12-16T20:11:28.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/358: dwrite d9/d1e/d40/f58 [0,4194304] 0 2023-12-16T20:11:28.411 INFO:tasks.workunit.client.1.smithi141.stdout:6/67: link d1/d12/f16 d1/f19 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/357: mkdir db/d16/d19/d27/d78 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/358: chown db/d1a/d77 123 1 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:4/335: symlink d13/d69/l71 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/359: dread - db/d1a/f73 zero size 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/360: truncate db/d16/d1c/f24 877850 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/361: chown db/cd 455764683 1 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/362: write db/d16/f54 [733194,62881] 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/363: chown db/d1a/l6f 2570 1 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/364: stat db/c41 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:5/440: rename d2/df/d1a/d2a/d5f to d2/d14/d25/d2d/d17/d51/d7b/d89 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:5/441: write d2/d14/d25/d2d/d17/d51/f76 [595322,4820] 0 2023-12-16T20:11:28.412 INFO:tasks.workunit.client.0.smithi038.stdout:5/442: fdatasync d2/d14/d25/d2d/d17/f42 0 2023-12-16T20:11:28.415 INFO:tasks.workunit.client.0.smithi038.stdout:6/381: write d1/d4/f8 [5204259,78612] 0 2023-12-16T20:11:28.417 INFO:tasks.workunit.client.0.smithi038.stdout:3/411: dread d4/d27/d23/d26/f3e [0,4194304] 0 2023-12-16T20:11:28.422 INFO:tasks.workunit.client.1.smithi141.stdout:9/52: dwrite d1/f9 [0,4194304] 0 2023-12-16T20:11:28.422 INFO:tasks.workunit.client.1.smithi141.stdout:9/53: write d1/d10/f12 [1386068,112621] 0 2023-12-16T20:11:28.424 INFO:tasks.workunit.client.1.smithi141.stdout:9/54: mknod d1/d8/da/de/c19 0 2023-12-16T20:11:28.424 INFO:tasks.workunit.client.1.smithi141.stdout:9/55: read d1/fc [776933,87320] 0 2023-12-16T20:11:28.425 INFO:tasks.workunit.client.0.smithi038.stdout:8/257: dwrite d17/d1d/f31 [0,4194304] 0 2023-12-16T20:11:28.426 INFO:tasks.workunit.client.0.smithi038.stdout:2/507: dwrite d1/df/d10/f46 [0,4194304] 0 2023-12-16T20:11:28.426 INFO:tasks.workunit.client.0.smithi038.stdout:2/508: fdatasync d1/df/d6a/f59 0 2023-12-16T20:11:28.427 INFO:tasks.workunit.client.1.smithi141.stdout:9/56: mkdir d1/d8/da/d1a 0 2023-12-16T20:11:28.427 INFO:tasks.workunit.client.1.smithi141.stdout:9/57: creat d1/d10/f1b x:0 0 0 2023-12-16T20:11:28.434 INFO:tasks.workunit.client.1.smithi141.stdout:9/58: rename d1/f9 to d1/d10/f1c 0 2023-12-16T20:11:28.434 INFO:tasks.workunit.client.1.smithi141.stdout:6/68: dread d1/dd/f15 [0,4194304] 0 2023-12-16T20:11:28.435 INFO:tasks.workunit.client.1.smithi141.stdout:6/69: symlink d1/l1a 0 2023-12-16T20:11:28.437 INFO:tasks.workunit.client.0.smithi038.stdout:8/258: write f10 [5503381,113773] 0 2023-12-16T20:11:28.437 INFO:tasks.workunit.client.1.smithi141.stdout:6/70: getdents d1/dd 0 2023-12-16T20:11:28.437 INFO:tasks.workunit.client.1.smithi141.stdout:6/71: truncate d1/dd/f15 5130784 0 2023-12-16T20:11:28.437 INFO:tasks.workunit.client.1.smithi141.stdout:6/72: chown d1/l13 39 1 2023-12-16T20:11:28.440 INFO:tasks.workunit.client.0.smithi038.stdout:2/509: rename d1/df/d10/c14 to d1/d5/d2a/ca5 0 2023-12-16T20:11:28.441 INFO:tasks.workunit.client.0.smithi038.stdout:2/510: fdatasync d1/df/d21/f93 0 2023-12-16T20:11:28.441 INFO:tasks.workunit.client.1.smithi141.stdout:6/73: rename d1/dd/f15 to d1/dd/de/f1b 0 2023-12-16T20:11:28.444 INFO:tasks.workunit.client.0.smithi038.stdout:2/511: truncate d1/df/f7d 1337859 0 2023-12-16T20:11:28.444 INFO:tasks.workunit.client.1.smithi141.stdout:6/74: truncate d1/f4 72005 0 2023-12-16T20:11:28.444 INFO:tasks.workunit.client.1.smithi141.stdout:6/75: mknod d1/d3/c1c 0 2023-12-16T20:11:28.447 INFO:tasks.workunit.client.1.smithi141.stdout:6/76: creat d1/dd/f1d x:0 0 0 2023-12-16T20:11:28.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/259: write d17/d1d/f31 [156289,98241] 0 2023-12-16T20:11:28.449 INFO:tasks.workunit.client.0.smithi038.stdout:8/260: dread d17/f38 [0,4194304] 0 2023-12-16T20:11:28.449 INFO:tasks.workunit.client.0.smithi038.stdout:9/359: dwrite f2 [4194304,4194304] 0 2023-12-16T20:11:28.450 INFO:tasks.workunit.client.0.smithi038.stdout:8/261: dread d17/d1b/d25/f32 [0,4194304] 0 2023-12-16T20:11:28.452 INFO:tasks.workunit.client.0.smithi038.stdout:9/360: truncate d9/d1f/d21/d3e/f49 293032 0 2023-12-16T20:11:28.453 INFO:tasks.workunit.client.1.smithi141.stdout:9/59: fsync d1/d10/f12 0 2023-12-16T20:11:28.454 INFO:tasks.workunit.client.0.smithi038.stdout:9/361: getdents d9/d1f/d21/d55 0 2023-12-16T20:11:28.454 INFO:tasks.workunit.client.0.smithi038.stdout:9/362: truncate d9/d1e/d3d/f5d 975498 0 2023-12-16T20:11:28.457 INFO:tasks.workunit.client.1.smithi141.stdout:9/60: mknod d1/c1d 0 2023-12-16T20:11:28.458 INFO:tasks.workunit.client.1.smithi141.stdout:9/61: write d1/f6 [89194,128147] 0 2023-12-16T20:11:28.458 INFO:tasks.workunit.client.1.smithi141.stdout:9/62: dread - d1/d10/f1b zero size 2023-12-16T20:11:28.459 INFO:tasks.workunit.client.1.smithi141.stdout:9/63: rename d1/l18 to d1/d8/da/l1e 0 2023-12-16T20:11:28.463 INFO:tasks.workunit.client.0.smithi038.stdout:0/365: dwrite f6 [4194304,4194304] 0 2023-12-16T20:11:28.465 INFO:tasks.workunit.client.0.smithi038.stdout:0/366: mkdir db/d16/d70/d79 0 2023-12-16T20:11:28.466 INFO:tasks.workunit.client.1.smithi141.stdout:6/77: write d1/f17 [655591,437] 0 2023-12-16T20:11:28.467 INFO:tasks.workunit.client.0.smithi038.stdout:0/367: link db/d1a/f71 db/d1a/f7a 0 2023-12-16T20:11:28.467 INFO:tasks.workunit.client.0.smithi038.stdout:0/368: fdatasync db/d16/d1c/f62 0 2023-12-16T20:11:28.467 INFO:tasks.workunit.client.1.smithi141.stdout:6/78: rename d1/d3/ff to d1/dd/f1e 0 2023-12-16T20:11:28.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/79: fsync d1/d3/f10 0 2023-12-16T20:11:28.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/80: truncate d1/fa 776338 0 2023-12-16T20:11:28.476 INFO:tasks.workunit.client.0.smithi038.stdout:3/412: dwrite d4/d27/d40/f7f [0,4194304] 0 2023-12-16T20:11:28.476 INFO:tasks.workunit.client.0.smithi038.stdout:3/413: fdatasync d4/d8/d15/d1e/f3d 0 2023-12-16T20:11:28.477 INFO:tasks.workunit.client.1.smithi141.stdout:9/64: write d1/d10/f1c [415443,122269] 0 2023-12-16T20:11:28.477 INFO:tasks.workunit.client.1.smithi141.stdout:9/65: write d1/d10/f15 [964720,107381] 0 2023-12-16T20:11:28.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/363: write d9/d1e/d40/f58 [2640065,61644] 0 2023-12-16T20:11:28.480 INFO:tasks.workunit.client.1.smithi141.stdout:8/64: sync 2023-12-16T20:11:28.480 INFO:tasks.workunit.client.1.smithi141.stdout:8/65: write f5 [3261636,60168] 0 2023-12-16T20:11:28.480 INFO:tasks.workunit.client.1.smithi141.stdout:8/66: chown c6 8864370 1 2023-12-16T20:11:28.481 INFO:tasks.workunit.client.1.smithi141.stdout:9/66: mknod d1/d8/c1f 0 2023-12-16T20:11:28.481 INFO:tasks.workunit.client.1.smithi141.stdout:9/67: truncate d1/d10/f1b 515809 0 2023-12-16T20:11:28.481 INFO:tasks.workunit.client.1.smithi141.stdout:9/68: truncate d1/f6 920397 0 2023-12-16T20:11:28.481 INFO:tasks.workunit.client.0.smithi038.stdout:9/364: dread d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.0.smithi038.stdout:9/365: readlink d9/lc 0 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.0.smithi038.stdout:9/366: chown d9/d1e/l24 0 1 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.0.smithi038.stdout:9/367: write d9/d1e/f63 [876395,129277] 0 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/414: truncate d4/d18/f38 3110245 0 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/415: chown d4/d27/d2b/d64 91319 1 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.1.smithi141.stdout:8/67: getdents d14 0 2023-12-16T20:11:28.482 INFO:tasks.workunit.client.1.smithi141.stdout:8/68: dread - f11 zero size 2023-12-16T20:11:28.483 INFO:tasks.workunit.client.1.smithi141.stdout:8/69: truncate f12 4435066 0 2023-12-16T20:11:28.483 INFO:tasks.workunit.client.0.smithi038.stdout:8/262: dwrite d17/d18/f1a [4194304,4194304] 0 2023-12-16T20:11:28.485 INFO:tasks.workunit.client.0.smithi038.stdout:3/416: truncate d4/d8/f16 4075549 0 2023-12-16T20:11:28.486 INFO:tasks.workunit.client.0.smithi038.stdout:5/443: dwrite d2/d14/d25/d2d/d17/f19 [0,4194304] 0 2023-12-16T20:11:28.487 INFO:tasks.workunit.client.0.smithi038.stdout:6/382: dwrite d1/d4/d1d/d28/d2f/d3d/f4c [0,4194304] 0 2023-12-16T20:11:28.494 INFO:tasks.workunit.client.0.smithi038.stdout:4/336: dwrite fb [4194304,4194304] 0 2023-12-16T20:11:28.495 INFO:tasks.workunit.client.0.smithi038.stdout:3/417: symlink d4/d8/d15/d1e/l92 0 2023-12-16T20:11:28.495 INFO:tasks.workunit.client.0.smithi038.stdout:3/418: readlink d4/d8/d15/d1e/l39 0 2023-12-16T20:11:28.498 INFO:tasks.workunit.client.1.smithi141.stdout:8/70: write f8 [4084807,79055] 0 2023-12-16T20:11:28.499 INFO:tasks.workunit.client.0.smithi038.stdout:4/337: mknod d13/d17/d2e/d32/c72 0 2023-12-16T20:11:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/512: write d1/df/f7d [1001331,26465] 0 2023-12-16T20:11:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:5/444: write d2/df/d1a/f27 [1724423,17274] 0 2023-12-16T20:11:28.502 INFO:tasks.workunit.client.1.smithi141.stdout:8/71: creat d14/f16 x:0 0 0 2023-12-16T20:11:28.502 INFO:tasks.workunit.client.1.smithi141.stdout:8/72: readlink le 0 2023-12-16T20:11:28.504 INFO:tasks.workunit.client.0.smithi038.stdout:4/338: unlink d13/d17/d2e/d32/f56 0 2023-12-16T20:11:28.504 INFO:tasks.workunit.client.0.smithi038.stdout:4/339: write d13/d1f/f66 [728858,103670] 0 2023-12-16T20:11:28.510 INFO:tasks.workunit.client.0.smithi038.stdout:5/445: rmdir d2/d14/d25/d2d/d17/d55 39 2023-12-16T20:11:28.513 INFO:tasks.workunit.client.0.smithi038.stdout:3/419: read d4/d8/d15/d6d/d7a/f86 [214878,111773] 0 2023-12-16T20:11:28.514 INFO:tasks.workunit.client.0.smithi038.stdout:0/369: dwrite db/d16/d1c/f32 [0,4194304] 0 2023-12-16T20:11:28.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/340: dread d13/d17/f45 [0,4194304] 0 2023-12-16T20:11:28.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/341: write fa [3221496,26854] 0 2023-12-16T20:11:28.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/342: chown d13/d17/d4b/c3b 24 1 2023-12-16T20:11:28.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/263: dwrite f16 [4194304,4194304] 0 2023-12-16T20:11:28.528 INFO:tasks.workunit.client.0.smithi038.stdout:5/446: dread d2/f10 [0,4194304] 0 2023-12-16T20:11:28.533 INFO:tasks.workunit.client.0.smithi038.stdout:5/447: rename d2/df/d1a/d2a/d59/c60 to d2/d14/d25/d2d/d17/d55/d6b/c8a 0 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/368: dwrite d9/d1e/d3d/f3f [0,4194304] 0 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/369: write d9/d1f/f5b [939406,12789] 0 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/370: chown d9/d1e/d40/d5e 210689520 1 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/371: chown d9/d1e/d3d/f4b 232420585 1 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.1.smithi141.stdout:9/69: rename d1/d8 to d1/d10/d14/d20 0 2023-12-16T20:11:28.534 INFO:tasks.workunit.client.1.smithi141.stdout:9/70: write d1/d10/f1c [3674698,108787] 0 2023-12-16T20:11:28.535 INFO:tasks.workunit.client.1.smithi141.stdout:9/71: unlink d1/d10/d14/d20/da/l1e 0 2023-12-16T20:11:28.536 INFO:tasks.workunit.client.0.smithi038.stdout:5/448: mkdir d2/d14/d25/d2d/d4b/d8b 0 2023-12-16T20:11:28.537 INFO:tasks.workunit.client.1.smithi141.stdout:8/73: truncate f8 3025112 0 2023-12-16T20:11:28.538 INFO:tasks.workunit.client.1.smithi141.stdout:9/72: write d1/fc [721861,53156] 0 2023-12-16T20:11:28.539 INFO:tasks.workunit.client.1.smithi141.stdout:8/74: mkdir d14/d17 0 2023-12-16T20:11:28.550 INFO:tasks.workunit.client.0.smithi038.stdout:5/449: dwrite d2/d14/d25/f5b [0,4194304] 0 2023-12-16T20:11:28.550 INFO:tasks.workunit.client.0.smithi038.stdout:5/450: truncate d2/df/f1d 4454945 0 2023-12-16T20:11:28.550 INFO:tasks.workunit.client.0.smithi038.stdout:5/451: fsync d2/d4/d62/f77 0 2023-12-16T20:11:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/452: truncate d2/d14/d25/d2d/d17/d51/f80 1169870 0 2023-12-16T20:11:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/453: write d2/df/d1a/d1f/f32 [2060521,95909] 0 2023-12-16T20:11:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/454: chown d2/d14/d25/d2d/d17/d55/f72 0 1 2023-12-16T20:11:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/455: creat d2/d14/d25/d2d/f8c x:0 0 0 2023-12-16T20:11:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/456: dread - d2/d14/d25/f79 zero size 2023-12-16T20:11:28.568 INFO:tasks.workunit.client.0.smithi038.stdout:0/370: dwrite db/d1a/f33 [0,4194304] 0 2023-12-16T20:11:28.568 INFO:tasks.workunit.client.0.smithi038.stdout:6/383: dwrite d1/d16/d23/f57 [0,4194304] 0 2023-12-16T20:11:28.568 INFO:tasks.workunit.client.0.smithi038.stdout:6/384: chown d1/d4/d1d/d28/d2f/l65 5504955 1 2023-12-16T20:11:28.568 INFO:tasks.workunit.client.0.smithi038.stdout:6/385: write d1/d4/d1d/d28/f41 [152062,120118] 0 2023-12-16T20:11:28.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/343: dwrite d13/d17/f45 [4194304,4194304] 0 2023-12-16T20:11:28.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/371: dread db/d16/d19/f23 [0,4194304] 0 2023-12-16T20:11:28.574 INFO:tasks.workunit.client.0.smithi038.stdout:0/372: creat db/d1a/f7b x:0 0 0 2023-12-16T20:11:28.578 INFO:tasks.workunit.client.0.smithi038.stdout:0/373: mkdir db/d16/d70/d7c 0 2023-12-16T20:11:28.580 INFO:tasks.workunit.client.0.smithi038.stdout:4/344: getdents d13/d1f 0 2023-12-16T20:11:28.580 INFO:tasks.workunit.client.0.smithi038.stdout:9/372: dwrite d9/d1f/d21/f28 [4194304,4194304] 0 2023-12-16T20:11:28.581 INFO:tasks.workunit.client.1.smithi141.stdout:9/73: dwrite d1/d10/f15 [0,4194304] 0 2023-12-16T20:11:28.582 INFO:tasks.workunit.client.0.smithi038.stdout:0/374: dread - db/d16/d19/d27/f51 zero size 2023-12-16T20:11:28.582 INFO:tasks.workunit.client.0.smithi038.stdout:0/375: fsync db/d16/d5a/d65/f6a 0 2023-12-16T20:11:28.582 INFO:tasks.workunit.client.0.smithi038.stdout:0/376: readlink db/d16/d19/l53 0 2023-12-16T20:11:28.582 INFO:tasks.workunit.client.0.smithi038.stdout:5/457: dwrite d2/d4/f4c [0,4194304] 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:4/345: mknod d13/d17/d2e/c73 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:4/346: fdatasync d13/d17/d2e/f3d 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:4/347: chown d13/c14 3988 1 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:3/420: dwrite d4/d8/d15/f56 [0,4194304] 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:3/421: getdents d4/d18/d8d 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:3/422: write d4/d8/d15/d2c/f53 [349634,92753] 0 2023-12-16T20:11:28.583 INFO:tasks.workunit.client.0.smithi038.stdout:3/423: chown d4/d8/c44 2088240903 1 2023-12-16T20:11:28.586 INFO:tasks.workunit.client.0.smithi038.stdout:0/377: symlink db/d16/d1c/d5d/d64/l7d 0 2023-12-16T20:11:28.588 INFO:tasks.workunit.client.0.smithi038.stdout:9/373: dread d9/f1c [0,4194304] 0 2023-12-16T20:11:28.590 INFO:tasks.workunit.client.1.smithi141.stdout:9/74: mknod d1/d10/c21 0 2023-12-16T20:11:28.590 INFO:tasks.workunit.client.1.smithi141.stdout:9/75: chown d1/l7 507978 1 2023-12-16T20:11:28.590 INFO:tasks.workunit.client.1.smithi141.stdout:9/76: readlink d1/d10/d14/d20/l11 0 2023-12-16T20:11:28.590 INFO:tasks.workunit.client.1.smithi141.stdout:9/77: creat d1/d10/f22 x:0 0 0 2023-12-16T20:11:28.590 INFO:tasks.workunit.client.0.smithi038.stdout:6/386: dwrite d1/d4/d1d/f3b [0,4194304] 0 2023-12-16T20:11:28.596 INFO:tasks.workunit.client.0.smithi038.stdout:0/378: dread f5 [0,4194304] 0 2023-12-16T20:11:28.603 INFO:tasks.workunit.client.1.smithi141.stdout:8/75: dread f8 [0,4194304] 0 2023-12-16T20:11:28.604 INFO:tasks.workunit.client.0.smithi038.stdout:5/458: dread f0 [8388608,4194304] 0 2023-12-16T20:11:28.605 INFO:tasks.workunit.client.1.smithi141.stdout:8/76: mknod d14/d17/c18 0 2023-12-16T20:11:28.606 INFO:tasks.workunit.client.1.smithi141.stdout:2/34: sync 2023-12-16T20:11:28.606 INFO:tasks.workunit.client.1.smithi141.stdout:2/35: write d6/f7 [1049442,100109] 0 2023-12-16T20:11:28.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/374: symlink d9/d1f/d21/d52/l6e 0 2023-12-16T20:11:28.614 INFO:tasks.workunit.client.0.smithi038.stdout:3/424: dwrite f1 [8388608,4194304] 0 2023-12-16T20:11:28.617 INFO:tasks.workunit.client.1.smithi141.stdout:8/77: write f12 [4446325,123325] 0 2023-12-16T20:11:28.618 INFO:tasks.workunit.client.0.smithi038.stdout:0/379: rename db/d16/d19/f23 to db/d16/d70/d7c/f7e 0 2023-12-16T20:11:28.618 INFO:tasks.workunit.client.0.smithi038.stdout:0/380: stat db/d1a/d77 0 2023-12-16T20:11:28.618 INFO:tasks.workunit.client.0.smithi038.stdout:0/381: fsync db/f3d 0 2023-12-16T20:11:28.618 INFO:tasks.workunit.client.0.smithi038.stdout:0/382: stat db/d16 0 2023-12-16T20:11:28.618 INFO:tasks.workunit.client.1.smithi141.stdout:8/78: truncate ff 1141733 0 2023-12-16T20:11:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:4/348: getdents d13/d6b 0 2023-12-16T20:11:28.621 INFO:tasks.workunit.client.1.smithi141.stdout:9/78: dwrite d1/d10/f22 [0,4194304] 0 2023-12-16T20:11:28.625 INFO:tasks.workunit.client.0.smithi038.stdout:5/459: creat d2/df/d1a/d1f/d4a/d53/d6e/f8d x:0 0 0 2023-12-16T20:11:28.626 INFO:tasks.workunit.client.1.smithi141.stdout:9/79: symlink d1/l23 0 2023-12-16T20:11:28.626 INFO:tasks.workunit.client.1.smithi141.stdout:9/80: chown d1/d10/d14/d20/fb 45104 1 2023-12-16T20:11:28.630 INFO:tasks.workunit.client.1.smithi141.stdout:8/79: dread ff [0,4194304] 0 2023-12-16T20:11:28.631 INFO:tasks.workunit.client.1.smithi141.stdout:8/80: chown c6 1453 1 2023-12-16T20:11:28.632 INFO:tasks.workunit.client.1.smithi141.stdout:8/81: mkdir d14/d19 0 2023-12-16T20:11:28.642 INFO:tasks.workunit.client.1.smithi141.stdout:9/81: read d1/d10/f15 [1647644,56327] 0 2023-12-16T20:11:28.644 INFO:tasks.workunit.client.1.smithi141.stdout:9/82: rmdir d1/d10/d14/d20/da/d1a 0 2023-12-16T20:11:28.646 INFO:tasks.workunit.client.1.smithi141.stdout:9/83: mknod d1/d10/d14/d20/da/de/c24 0 2023-12-16T20:11:28.666 INFO:tasks.workunit.client.0.smithi038.stdout:0/383: dwrite f1 [0,4194304] 0 2023-12-16T20:11:28.666 INFO:tasks.workunit.client.0.smithi038.stdout:0/384: fsync db/d16/d1c/f24 0 2023-12-16T20:11:28.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/36: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:28.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/37: getdents d6/da 0 2023-12-16T20:11:28.671 INFO:tasks.workunit.client.0.smithi038.stdout:5/460: dwrite d2/df/d1a/f27 [0,4194304] 0 2023-12-16T20:11:28.671 INFO:tasks.workunit.client.0.smithi038.stdout:5/461: fsync d2/df/d1a/d1f/f32 0 2023-12-16T20:11:28.671 INFO:tasks.workunit.client.1.smithi141.stdout:2/38: mkdir d6/da/db 0 2023-12-16T20:11:28.672 INFO:tasks.workunit.client.1.smithi141.stdout:9/84: dwrite d1/d10/f1c [0,4194304] 0 2023-12-16T20:11:28.674 INFO:tasks.workunit.client.0.smithi038.stdout:5/462: creat d2/d14/d25/d2d/d17/d51/f8e x:0 0 0 2023-12-16T20:11:28.674 INFO:tasks.workunit.client.0.smithi038.stdout:0/385: dread f3 [0,4194304] 0 2023-12-16T20:11:28.674 INFO:tasks.workunit.client.1.smithi141.stdout:9/85: creat d1/d10/d14/f25 x:0 0 0 2023-12-16T20:11:28.674 INFO:tasks.workunit.client.1.smithi141.stdout:9/86: truncate d1/d10/d14/d20/fb 225168 0 2023-12-16T20:11:28.675 INFO:tasks.workunit.client.0.smithi038.stdout:5/463: symlink d2/df/d1a/d1f/d4a/l8f 0 2023-12-16T20:11:28.675 INFO:tasks.workunit.client.0.smithi038.stdout:0/386: fsync db/d16/d19/d27/f34 0 2023-12-16T20:11:28.676 INFO:tasks.workunit.client.0.smithi038.stdout:0/387: rmdir db/d16/d1c/d5d/d64 39 2023-12-16T20:11:28.677 INFO:tasks.workunit.client.0.smithi038.stdout:4/349: dwrite d13/d1f/d35/f38 [0,4194304] 0 2023-12-16T20:11:28.677 INFO:tasks.workunit.client.1.smithi141.stdout:8/82: dread f12 [0,4194304] 0 2023-12-16T20:11:28.677 INFO:tasks.workunit.client.1.smithi141.stdout:9/87: mkdir d1/d26 0 2023-12-16T20:11:28.677 INFO:tasks.workunit.client.1.smithi141.stdout:8/83: stat d14/d17/c18 0 2023-12-16T20:11:28.677 INFO:tasks.workunit.client.1.smithi141.stdout:8/84: chown l13 60 1 2023-12-16T20:11:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:0/388: link db/d1a/c57 db/c7f 0 2023-12-16T20:11:28.679 INFO:tasks.workunit.client.1.smithi141.stdout:9/88: mkdir d1/d10/d27 0 2023-12-16T20:11:28.679 INFO:tasks.workunit.client.1.smithi141.stdout:8/85: creat d14/d17/f1a x:0 0 0 2023-12-16T20:11:28.680 INFO:tasks.workunit.client.0.smithi038.stdout:0/389: mkdir db/d16/d19/d80 0 2023-12-16T20:11:28.681 INFO:tasks.workunit.client.1.smithi141.stdout:9/89: unlink d1/d10/f1b 0 2023-12-16T20:11:28.683 INFO:tasks.workunit.client.0.smithi038.stdout:0/390: getdents db/d16 0 2023-12-16T20:11:28.686 INFO:tasks.workunit.client.1.smithi141.stdout:9/90: dread d1/d10/d14/d20/fb [0,4194304] 0 2023-12-16T20:11:28.686 INFO:tasks.workunit.client.1.smithi141.stdout:9/91: fdatasync d1/d10/f22 0 2023-12-16T20:11:28.687 INFO:tasks.workunit.client.0.smithi038.stdout:0/391: symlink db/d16/d19/d27/d56/l81 0 2023-12-16T20:11:28.688 INFO:tasks.workunit.client.1.smithi141.stdout:9/92: symlink d1/d10/d27/l28 0 2023-12-16T20:11:28.690 INFO:tasks.workunit.client.1.smithi141.stdout:9/93: link d1/c1d d1/d10/d14/d20/c29 0 2023-12-16T20:11:28.691 INFO:tasks.workunit.client.0.smithi038.stdout:4/350: dread fa [4194304,4194304] 0 2023-12-16T20:11:28.691 INFO:tasks.workunit.client.0.smithi038.stdout:4/351: readlink d13/d17/l68 0 2023-12-16T20:11:28.691 INFO:tasks.workunit.client.0.smithi038.stdout:4/352: read - d13/f4a zero size 2023-12-16T20:11:28.691 INFO:tasks.workunit.client.0.smithi038.stdout:0/392: rename db/d16/d1c/f2c to db/d16/d19/d27/d56/f82 0 2023-12-16T20:11:28.692 INFO:tasks.workunit.client.1.smithi141.stdout:9/94: mknod d1/d10/d14/d20/c2a 0 2023-12-16T20:11:28.700 INFO:tasks.workunit.client.1.smithi141.stdout:8/86: rename d14/d17 to d14/d19/d1b 0 2023-12-16T20:11:28.700 INFO:tasks.workunit.client.1.smithi141.stdout:8/87: dread - d14/d19/d1b/f1a zero size 2023-12-16T20:11:28.700 INFO:tasks.workunit.client.1.smithi141.stdout:8/88: write f12 [2847988,94394] 0 2023-12-16T20:11:28.700 INFO:tasks.workunit.client.1.smithi141.stdout:8/89: truncate d14/d19/d1b/f1a 955147 0 2023-12-16T20:11:28.706 INFO:tasks.workunit.client.1.smithi141.stdout:2/39: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:28.708 INFO:tasks.workunit.client.0.smithi038.stdout:5/464: dwrite f0 [0,4194304] 0 2023-12-16T20:11:28.709 INFO:tasks.workunit.client.0.smithi038.stdout:5/465: dread - d2/df/d1a/d2a/f74 zero size 2023-12-16T20:11:28.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/40: mkdir d6/dc 0 2023-12-16T20:11:28.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/41: chown d6 476 1 2023-12-16T20:11:28.713 INFO:tasks.workunit.client.1.smithi141.stdout:2/42: rename c3 to d6/cd 0 2023-12-16T20:11:28.714 INFO:tasks.workunit.client.1.smithi141.stdout:2/43: mknod d6/da/ce 0 2023-12-16T20:11:28.718 INFO:tasks.workunit.client.0.smithi038.stdout:4/353: dwrite d13/f48 [0,4194304] 0 2023-12-16T20:11:28.722 INFO:tasks.workunit.client.0.smithi038.stdout:4/354: creat d13/d17/f74 x:0 0 0 2023-12-16T20:11:28.722 INFO:tasks.workunit.client.0.smithi038.stdout:4/355: fdatasync d13/d17/f74 0 2023-12-16T20:11:28.722 INFO:tasks.workunit.client.0.smithi038.stdout:0/393: dwrite db/d1a/f7b [0,4194304] 0 2023-12-16T20:11:28.723 INFO:tasks.workunit.client.0.smithi038.stdout:0/394: fdatasync db/d16/d1c/f62 0 2023-12-16T20:11:28.723 INFO:tasks.workunit.client.1.smithi141.stdout:9/95: truncate d1/d10/f1c 3921008 0 2023-12-16T20:11:28.727 INFO:tasks.workunit.client.1.smithi141.stdout:8/90: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:28.730 INFO:tasks.workunit.client.0.smithi038.stdout:5/466: dwrite d2/d14/f5a [0,4194304] 0 2023-12-16T20:11:28.730 INFO:tasks.workunit.client.0.smithi038.stdout:5/467: stat d2/d14/d25/d2d/f31 0 2023-12-16T20:11:28.730 INFO:tasks.workunit.client.0.smithi038.stdout:5/468: fdatasync d2/df/d1a/d2a/f6c 0 2023-12-16T20:11:28.732 INFO:tasks.workunit.client.1.smithi141.stdout:8/91: rename f8 to d14/d19/f1c 0 2023-12-16T20:11:28.735 INFO:tasks.workunit.client.1.smithi141.stdout:2/44: dread d6/f7 [0,4194304] 0 2023-12-16T20:11:28.737 INFO:tasks.workunit.client.0.smithi038.stdout:1/480: sync 2023-12-16T20:11:28.738 INFO:tasks.workunit.client.0.smithi038.stdout:1/481: read - d15/d1e/d23/d42/f92 zero size 2023-12-16T20:11:28.740 INFO:tasks.workunit.client.0.smithi038.stdout:5/469: dread d2/d14/d25/f5b [0,4194304] 0 2023-12-16T20:11:28.741 INFO:tasks.workunit.client.0.smithi038.stdout:5/470: write d2/df/d1a/d1f/d4a/f52 [373103,87366] 0 2023-12-16T20:11:28.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/45: symlink d6/da/db/lf 0 2023-12-16T20:11:28.741 INFO:tasks.workunit.client.1.smithi141.stdout:8/92: getdents d14 0 2023-12-16T20:11:28.743 INFO:tasks.workunit.client.0.smithi038.stdout:1/482: mkdir d15/d1e/d23/da2 0 2023-12-16T20:11:28.743 INFO:tasks.workunit.client.0.smithi038.stdout:5/471: mknod d2/df/d87/c90 0 2023-12-16T20:11:28.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/46: mknod d6/c10 0 2023-12-16T20:11:28.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/483: link d15/d1e/d3b/d48/d37/c55 d15/d1e/d3b/d48/d3d/ca3 0 2023-12-16T20:11:28.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/484: fsync d15/d1e/d23/d34/f69 0 2023-12-16T20:11:28.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/485: creat d15/d1e/d23/d34/d86/d9a/fa4 x:0 0 0 2023-12-16T20:11:28.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/486: fdatasync d15/d1e/d3b/d5a/f9e 0 2023-12-16T20:11:28.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/47: rename l1 to d6/l11 0 2023-12-16T20:11:28.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/487: unlink d15/d1e/d23/c2b 0 2023-12-16T20:11:28.748 INFO:tasks.workunit.client.0.smithi038.stdout:5/472: read f0 [10660340,107798] 0 2023-12-16T20:11:28.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/488: rename d15/d1e/d3b/d5a/l8c to d15/d22/la5 0 2023-12-16T20:11:28.750 INFO:tasks.workunit.client.0.smithi038.stdout:1/489: creat d15/d22/d62/fa6 x:0 0 0 2023-12-16T20:11:28.750 INFO:tasks.workunit.client.0.smithi038.stdout:1/490: chown d15/d22/d62/f94 118656 1 2023-12-16T20:11:28.750 INFO:tasks.workunit.client.0.smithi038.stdout:1/491: getdents d15/d1e/d23/d34/d86/d99 0 2023-12-16T20:11:28.754 INFO:tasks.workunit.client.0.smithi038.stdout:1/492: creat d15/d1e/d23/da2/fa7 x:0 0 0 2023-12-16T20:11:28.756 INFO:tasks.workunit.client.1.smithi141.stdout:2/48: write d6/f7 [146441,108393] 0 2023-12-16T20:11:28.756 INFO:tasks.workunit.client.0.smithi038.stdout:1/493: link d15/d1e/d3b/d48/f6f d15/d22/d62/fa8 0 2023-12-16T20:11:28.756 INFO:tasks.workunit.client.0.smithi038.stdout:1/494: creat d15/d1e/d23/fa9 x:0 0 0 2023-12-16T20:11:28.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/495: chown d15/d1e/d23/d46/f72 7 1 2023-12-16T20:11:28.757 INFO:tasks.workunit.client.1.smithi141.stdout:8/93: write d14/f15 [4002589,39605] 0 2023-12-16T20:11:28.758 INFO:tasks.workunit.client.1.smithi141.stdout:2/49: mkdir d6/d12 0 2023-12-16T20:11:28.758 INFO:tasks.workunit.client.1.smithi141.stdout:2/50: stat d6/f7 0 2023-12-16T20:11:28.760 INFO:tasks.workunit.client.1.smithi141.stdout:8/94: rename le to d14/d19/d1b/l1d 0 2023-12-16T20:11:28.761 INFO:tasks.workunit.client.0.smithi038.stdout:0/395: dwrite db/f14 [0,4194304] 0 2023-12-16T20:11:28.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/356: dwrite d13/d1f/d35/f38 [0,4194304] 0 2023-12-16T20:11:28.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/357: write fb [2857695,52018] 0 2023-12-16T20:11:28.764 INFO:tasks.workunit.client.0.smithi038.stdout:0/396: mknod db/d16/d19/d27/d56/c83 0 2023-12-16T20:11:28.765 INFO:tasks.workunit.client.1.smithi141.stdout:2/51: rename l2 to d6/da/db/l13 0 2023-12-16T20:11:28.765 INFO:tasks.workunit.client.1.smithi141.stdout:2/52: chown d6/da/db/lf 904651749 1 2023-12-16T20:11:28.768 INFO:tasks.workunit.client.0.smithi038.stdout:4/358: getdents d13/d17/d2e/d32 0 2023-12-16T20:11:28.773 INFO:tasks.workunit.client.0.smithi038.stdout:4/359: rmdir d13/d17 39 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/360: rename d13/d6b to d13/d17/d2e/d75 0 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/361: creat d13/d1f/d22/d34/f76 x:0 0 0 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/362: chown d13/d17/d2e/d32/l55 2453 1 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/363: creat d13/f77 x:0 0 0 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/364: chown d13/f77 96 1 2023-12-16T20:11:28.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/365: write d13/d17/d2e/f52 [3681671,42089] 0 2023-12-16T20:11:28.781 INFO:tasks.workunit.client.0.smithi038.stdout:4/366: dread d13/d1f/d22/f44 [0,4194304] 0 2023-12-16T20:11:28.781 INFO:tasks.workunit.client.0.smithi038.stdout:4/367: read - d13/d17/d2e/d32/d4e/f59 zero size 2023-12-16T20:11:28.781 INFO:tasks.workunit.client.0.smithi038.stdout:4/368: read - d13/d17/d2e/d32/d4e/f64 zero size 2023-12-16T20:11:28.781 INFO:tasks.workunit.client.0.smithi038.stdout:1/496: dwrite d15/d1e/d3b/d48/d37/f8f [0,4194304] 0 2023-12-16T20:11:28.781 INFO:tasks.workunit.client.0.smithi038.stdout:5/473: dwrite d2/d14/d25/f5b [4194304,4194304] 0 2023-12-16T20:11:28.788 INFO:tasks.workunit.client.0.smithi038.stdout:0/397: dwrite db/d16/d19/d27/f4c [0,4194304] 0 2023-12-16T20:11:28.788 INFO:tasks.workunit.client.0.smithi038.stdout:0/398: chown db/d16/d1c/d5d/d64/l69 68 1 2023-12-16T20:11:28.790 INFO:tasks.workunit.client.1.smithi141.stdout:9/96: truncate d1/d10/f1c 2429508 0 2023-12-16T20:11:28.790 INFO:tasks.workunit.client.1.smithi141.stdout:9/97: write d1/d10/d14/f25 [42150,15143] 0 2023-12-16T20:11:28.791 INFO:tasks.workunit.client.1.smithi141.stdout:8/95: dwrite d14/d19/f1c [0,4194304] 0 2023-12-16T20:11:28.791 INFO:tasks.workunit.client.1.smithi141.stdout:8/96: dread - d14/f16 zero size 2023-12-16T20:11:28.791 INFO:tasks.workunit.client.1.smithi141.stdout:8/97: chown f5 116 1 2023-12-16T20:11:28.791 INFO:tasks.workunit.client.1.smithi141.stdout:8/98: dread - f11 zero size 2023-12-16T20:11:28.792 INFO:tasks.workunit.client.1.smithi141.stdout:9/98: symlink d1/d10/d14/d20/da/l2b 0 2023-12-16T20:11:28.792 INFO:tasks.workunit.client.1.smithi141.stdout:9/99: write d1/d10/f15 [3877425,8288] 0 2023-12-16T20:11:28.792 INFO:tasks.workunit.client.1.smithi141.stdout:9/100: stat d1/d10/d14/d20/fb 0 2023-12-16T20:11:28.793 INFO:tasks.workunit.client.1.smithi141.stdout:8/99: mknod d14/c1e 0 2023-12-16T20:11:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:0/399: dread db/d16/d19/d27/d56/f82 [0,4194304] 0 2023-12-16T20:11:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:0/400: read - db/f5b zero size 2023-12-16T20:11:28.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/100: creat d14/d19/f1f x:0 0 0 2023-12-16T20:11:28.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/101: chown d14/d19/f1c 15521951 1 2023-12-16T20:11:28.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/102: creat d14/d19/f20 x:0 0 0 2023-12-16T20:11:28.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/103: chown d14/d19 27288773 1 2023-12-16T20:11:28.797 INFO:tasks.workunit.client.0.smithi038.stdout:0/401: creat db/d16/d1c/d5d/d64/f84 x:0 0 0 2023-12-16T20:11:28.797 INFO:tasks.workunit.client.0.smithi038.stdout:0/402: creat db/d1a/f85 x:0 0 0 2023-12-16T20:11:28.797 INFO:tasks.workunit.client.0.smithi038.stdout:0/403: chown db/d16/d19/c58 2017855 1 2023-12-16T20:11:28.797 INFO:tasks.workunit.client.0.smithi038.stdout:0/404: fsync db/d16/f18 0 2023-12-16T20:11:28.798 INFO:tasks.workunit.client.1.smithi141.stdout:8/104: creat d14/d19/d1b/f21 x:0 0 0 2023-12-16T20:11:28.799 INFO:tasks.workunit.client.1.smithi141.stdout:8/105: symlink d14/d19/d1b/l22 0 2023-12-16T20:11:28.800 INFO:tasks.workunit.client.1.smithi141.stdout:8/106: creat d14/f23 x:0 0 0 2023-12-16T20:11:28.803 INFO:tasks.workunit.client.0.smithi038.stdout:0/405: symlink db/d16/d1c/l86 0 2023-12-16T20:11:28.806 INFO:tasks.workunit.client.0.smithi038.stdout:1/497: read d15/d22/d52/f81 [1297721,32265] 0 2023-12-16T20:11:28.806 INFO:tasks.workunit.client.0.smithi038.stdout:1/498: truncate d15/d1e/d23/d34/f69 772379 0 2023-12-16T20:11:28.808 INFO:tasks.workunit.client.0.smithi038.stdout:1/499: mkdir d15/d1e/d23/d7d/daa 0 2023-12-16T20:11:28.813 INFO:tasks.workunit.client.1.smithi141.stdout:4/75: sync 2023-12-16T20:11:28.813 INFO:tasks.workunit.client.1.smithi141.stdout:5/78: sync 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:1/23: sync 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:1/24: fsync - no filename 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:1/25: dread - no filename 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/79: readlink d0/l7 0 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:7/20: sync 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:7/21: fsync - no filename 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:3/152: sync 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:0/65: sync 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:0/66: write d4/f17 [728643,19998] 0 2023-12-16T20:11:28.814 INFO:tasks.workunit.client.1.smithi141.stdout:0/67: chown f1 2117720902 1 2023-12-16T20:11:28.815 INFO:tasks.workunit.client.1.smithi141.stdout:6/81: sync 2023-12-16T20:11:28.815 INFO:tasks.workunit.client.0.smithi038.stdout:4/369: dwrite d13/f77 [0,4194304] 0 2023-12-16T20:11:28.815 INFO:tasks.workunit.client.0.smithi038.stdout:4/370: readlink d13/d17/d2e/d32/d4d/l60 0 2023-12-16T20:11:28.816 INFO:tasks.workunit.client.1.smithi141.stdout:5/80: mkdir d0/d9/d16 0 2023-12-16T20:11:28.816 INFO:tasks.workunit.client.1.smithi141.stdout:5/81: stat d0/d9/f13 0 2023-12-16T20:11:28.816 INFO:tasks.workunit.client.0.smithi038.stdout:5/474: dwrite d2/d14/f5a [0,4194304] 0 2023-12-16T20:11:28.816 INFO:tasks.workunit.client.0.smithi038.stdout:5/475: fsync d2/d14/d25/f5b 0 2023-12-16T20:11:28.817 INFO:tasks.workunit.client.0.smithi038.stdout:4/371: mkdir d13/d17/d2e/d32/d4d/d78 0 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/22: link c3 c4 0 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/23: truncate - no filename 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/24: rmdir - no directory 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/25: dread - no filename 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/26: dwrite - no filename 2023-12-16T20:11:28.819 INFO:tasks.workunit.client.1.smithi141.stdout:7/27: chown l2 0 1 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:3/153: rename d0/d1c/l31 to d0/d13/l33 0 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:3/154: readlink d0/l4 0 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:2/53: dwrite d6/f7 [4194304,4194304] 0 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:8/107: dread f5 [0,4194304] 0 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:1/26: symlink l3 0 2023-12-16T20:11:28.820 INFO:tasks.workunit.client.1.smithi141.stdout:1/27: dwrite - no filename 2023-12-16T20:11:28.823 INFO:tasks.workunit.client.1.smithi141.stdout:7/28: mkdir d5 0 2023-12-16T20:11:28.823 INFO:tasks.workunit.client.1.smithi141.stdout:7/29: write - no filename 2023-12-16T20:11:28.824 INFO:tasks.workunit.client.1.smithi141.stdout:7/30: dread - no filename 2023-12-16T20:11:28.824 INFO:tasks.workunit.client.1.smithi141.stdout:7/31: read - no filename 2023-12-16T20:11:28.824 INFO:tasks.workunit.client.1.smithi141.stdout:7/32: write - no filename 2023-12-16T20:11:28.825 INFO:tasks.workunit.client.1.smithi141.stdout:3/155: mknod d0/d1c/c34 0 2023-12-16T20:11:28.825 INFO:tasks.workunit.client.1.smithi141.stdout:3/156: fdatasync d0/f8 0 2023-12-16T20:11:28.826 INFO:tasks.workunit.client.0.smithi038.stdout:5/476: unlink d2/d4/d62/f69 0 2023-12-16T20:11:28.829 INFO:tasks.workunit.client.0.smithi038.stdout:5/477: creat d2/df/d1a/d2a/f91 x:0 0 0 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/33: link l2 d5/l6 0 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/34: write - no filename 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/35: dwrite - no filename 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/36: chown d5 316704611 1 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/37: truncate - no filename 2023-12-16T20:11:28.830 INFO:tasks.workunit.client.1.smithi141.stdout:7/38: write - no filename 2023-12-16T20:11:28.832 INFO:tasks.workunit.client.1.smithi141.stdout:3/157: link d0/l15 d0/d13/l35 0 2023-12-16T20:11:28.833 INFO:tasks.workunit.client.0.smithi038.stdout:5/478: rename d2/df/d1a/d1f/f6a to d2/d14/f92 0 2023-12-16T20:11:28.834 INFO:tasks.workunit.client.1.smithi141.stdout:1/28: rename l3 to l4 0 2023-12-16T20:11:28.834 INFO:tasks.workunit.client.1.smithi141.stdout:1/29: rmdir - no directory 2023-12-16T20:11:28.836 INFO:tasks.workunit.client.1.smithi141.stdout:7/39: link d5/l6 d5/l7 0 2023-12-16T20:11:28.841 INFO:tasks.workunit.client.1.smithi141.stdout:3/158: symlink d0/d1c/d2c/l36 0 2023-12-16T20:11:28.841 INFO:tasks.workunit.client.1.smithi141.stdout:3/159: chown d0/f8 122324581 1 2023-12-16T20:11:28.841 INFO:tasks.workunit.client.1.smithi141.stdout:1/30: creat f5 x:0 0 0 2023-12-16T20:11:28.841 INFO:tasks.workunit.client.1.smithi141.stdout:5/82: dread d0/f4 [0,4194304] 0 2023-12-16T20:11:28.841 INFO:tasks.workunit.client.1.smithi141.stdout:5/83: chown d0 480 1 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:5/84: creat d0/f17 x:0 0 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:5/85: dread - d0/d9/f13 zero size 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/40: creat d5/f8 x:0 0 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/41: write d5/f8 [763618,124006] 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/42: write d5/f8 [1589472,86360] 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/43: readlink d5/l7 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/44: stat d5/f8 0 2023-12-16T20:11:28.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/45: write d5/f8 [1995764,123009] 0 2023-12-16T20:11:28.843 INFO:tasks.workunit.client.1.smithi141.stdout:3/160: creat d0/f37 x:0 0 0 2023-12-16T20:11:28.843 INFO:tasks.workunit.client.1.smithi141.stdout:3/161: truncate d0/d13/f1d 4372743 0 2023-12-16T20:11:28.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/76: dwrite f19 [0,4194304] 0 2023-12-16T20:11:28.846 INFO:tasks.workunit.client.1.smithi141.stdout:5/86: symlink d0/d9/l18 0 2023-12-16T20:11:28.848 INFO:tasks.workunit.client.0.smithi038.stdout:0/406: dwrite f1 [0,4194304] 0 2023-12-16T20:11:28.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/162: unlink d0/d13/c30 0 2023-12-16T20:11:28.851 INFO:tasks.workunit.client.0.smithi038.stdout:0/407: creat db/d16/d19/d27/d56/f87 x:0 0 0 2023-12-16T20:11:28.852 INFO:tasks.workunit.client.0.smithi038.stdout:4/372: dwrite d13/d17/d2e/d32/d4d/f65 [0,4194304] 0 2023-12-16T20:11:28.852 INFO:tasks.workunit.client.1.smithi141.stdout:0/68: dwrite f1 [0,4194304] 0 2023-12-16T20:11:28.852 INFO:tasks.workunit.client.1.smithi141.stdout:0/69: fsync f2 0 2023-12-16T20:11:28.853 INFO:tasks.workunit.client.1.smithi141.stdout:4/77: rename f13 to d1a/f1d 0 2023-12-16T20:11:28.853 INFO:tasks.workunit.client.0.smithi038.stdout:5/479: dwrite d2/d14/d25/d2d/f2c [0,4194304] 0 2023-12-16T20:11:28.856 INFO:tasks.workunit.client.1.smithi141.stdout:5/87: read d0/f4 [1051823,110156] 0 2023-12-16T20:11:28.856 INFO:tasks.workunit.client.1.smithi141.stdout:5/88: stat d0 0 2023-12-16T20:11:28.858 INFO:tasks.workunit.client.0.smithi038.stdout:4/373: symlink d13/d17/l79 0 2023-12-16T20:11:28.859 INFO:tasks.workunit.client.1.smithi141.stdout:0/70: unlink l0 0 2023-12-16T20:11:28.859 INFO:tasks.workunit.client.1.smithi141.stdout:6/82: dwrite d1/fa [0,4194304] 0 2023-12-16T20:11:28.863 INFO:tasks.workunit.client.0.smithi038.stdout:4/374: mkdir d13/d69/d7a 0 2023-12-16T20:11:28.865 INFO:tasks.workunit.client.1.smithi141.stdout:5/89: rename d0/df/l12 to d0/d14/l19 0 2023-12-16T20:11:28.865 INFO:tasks.workunit.client.1.smithi141.stdout:8/108: rmdir d14 39 2023-12-16T20:11:28.865 INFO:tasks.workunit.client.1.smithi141.stdout:8/109: chown ca 76387 1 2023-12-16T20:11:28.867 INFO:tasks.workunit.client.1.smithi141.stdout:7/46: dread d5/f8 [0,4194304] 0 2023-12-16T20:11:28.867 INFO:tasks.workunit.client.1.smithi141.stdout:7/47: write d5/f8 [2061124,22205] 0 2023-12-16T20:11:28.867 INFO:tasks.workunit.client.1.smithi141.stdout:7/48: chown l2 11 1 2023-12-16T20:11:28.867 INFO:tasks.workunit.client.1.smithi141.stdout:6/83: truncate d1/f17 1550436 0 2023-12-16T20:11:28.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/375: link d13/d1f/c40 d13/d17/d62/c7b 0 2023-12-16T20:11:28.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/376: fdatasync d13/d1f/d22/d34/f58 0 2023-12-16T20:11:28.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/377: truncate d13/f37 829125 0 2023-12-16T20:11:28.869 INFO:tasks.workunit.client.1.smithi141.stdout:5/90: creat d0/df/f1a x:0 0 0 2023-12-16T20:11:28.870 INFO:tasks.workunit.client.1.smithi141.stdout:5/91: truncate d0/df/f1a 507076 0 2023-12-16T20:11:28.870 INFO:tasks.workunit.client.0.smithi038.stdout:4/378: mkdir d13/d17/d2e/d32/d7c 0 2023-12-16T20:11:28.870 INFO:tasks.workunit.client.0.smithi038.stdout:4/379: dread - d13/f4a zero size 2023-12-16T20:11:28.871 INFO:tasks.workunit.client.1.smithi141.stdout:0/71: dread f2 [0,4194304] 0 2023-12-16T20:11:28.871 INFO:tasks.workunit.client.1.smithi141.stdout:1/31: dwrite f5 [0,4194304] 0 2023-12-16T20:11:28.871 INFO:tasks.workunit.client.1.smithi141.stdout:8/110: mkdir d14/d19/d1b/d24 0 2023-12-16T20:11:28.872 INFO:tasks.workunit.client.1.smithi141.stdout:7/49: stat l2 0 2023-12-16T20:11:28.875 INFO:tasks.workunit.client.0.smithi038.stdout:4/380: mkdir d13/d17/d4b/d7d 0 2023-12-16T20:11:28.876 INFO:tasks.workunit.client.1.smithi141.stdout:0/72: mknod d4/d7/c18 0 2023-12-16T20:11:28.879 INFO:tasks.workunit.client.0.smithi038.stdout:4/381: unlink d13/d17/d2e/d32/d4d/f6c 0 2023-12-16T20:11:28.879 INFO:tasks.workunit.client.0.smithi038.stdout:4/382: chown d13/d1f/d22 512119 1 2023-12-16T20:11:28.880 INFO:tasks.workunit.client.1.smithi141.stdout:7/50: dread d5/f8 [0,4194304] 0 2023-12-16T20:11:28.880 INFO:tasks.workunit.client.1.smithi141.stdout:7/51: stat d5/f8 0 2023-12-16T20:11:28.881 INFO:tasks.workunit.client.1.smithi141.stdout:1/32: creat f6 x:0 0 0 2023-12-16T20:11:28.881 INFO:tasks.workunit.client.0.smithi038.stdout:4/383: unlink d13/d17/d2e/d32/d4e/l54 0 2023-12-16T20:11:28.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/384: chown c3 67585 1 2023-12-16T20:11:28.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/385: chown d13/d17/d62/c7b 61 1 2023-12-16T20:11:28.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/386: dread - d13/d17/f74 zero size 2023-12-16T20:11:28.882 INFO:tasks.workunit.client.1.smithi141.stdout:8/111: creat d14/f25 x:0 0 0 2023-12-16T20:11:28.884 INFO:tasks.workunit.client.0.smithi038.stdout:4/387: rename d13/f26 to d13/d1f/d22/f7e 0 2023-12-16T20:11:28.886 INFO:tasks.workunit.client.0.smithi038.stdout:4/388: mknod d13/d17/d2e/d32/d4d/d4f/c7f 0 2023-12-16T20:11:28.886 INFO:tasks.workunit.client.0.smithi038.stdout:4/389: chown d13/d17/d2e/d32/d4e/d61/l67 457672270 1 2023-12-16T20:11:28.886 INFO:tasks.workunit.client.1.smithi141.stdout:8/112: mknod d14/d19/d1b/d24/c26 0 2023-12-16T20:11:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/328: sync 2023-12-16T20:11:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:2/513: sync 2023-12-16T20:11:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:3/425: sync 2023-12-16T20:11:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:8/264: sync 2023-12-16T20:11:28.887 INFO:tasks.workunit.client.0.smithi038.stdout:2/514: write d1/df/d6d/f8c [1299316,65919] 0 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:8/265: write d17/f3b [1035248,676] 0 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:9/375: sync 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/387: sync 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/388: creat d1/d4/f7c x:0 0 0 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/389: readlink d1/d16/d23/l4d 0 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/390: fsync d1/d16/d23/f57 0 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:4/390: rmdir d13/d17/d2e 39 2023-12-16T20:11:28.888 INFO:tasks.workunit.client.0.smithi038.stdout:5/480: dwrite d2/d4/d62/f77 [0,4194304] 0 2023-12-16T20:11:28.891 INFO:tasks.workunit.client.0.smithi038.stdout:7/329: creat da/d24/d4d/d51/f6d x:0 0 0 2023-12-16T20:11:28.891 INFO:tasks.workunit.client.0.smithi038.stdout:3/426: unlink d4/d27/d23/l41 0 2023-12-16T20:11:28.891 INFO:tasks.workunit.client.0.smithi038.stdout:3/427: truncate d4/d8/d15/f54 904406 0 2023-12-16T20:11:28.891 INFO:tasks.workunit.client.0.smithi038.stdout:3/428: stat d4/d8/d15/d2c/d7d/f91 0 2023-12-16T20:11:28.892 INFO:tasks.workunit.client.0.smithi038.stdout:2/515: creat d1/df/d6a/fa6 x:0 0 0 2023-12-16T20:11:28.892 INFO:tasks.workunit.client.0.smithi038.stdout:0/408: dwrite db/d16/d5a/d65/f6a [0,4194304] 0 2023-12-16T20:11:28.894 INFO:tasks.workunit.client.1.smithi141.stdout:8/113: mknod d14/d19/d1b/c27 0 2023-12-16T20:11:28.894 INFO:tasks.workunit.client.1.smithi141.stdout:8/114: dread - d14/d19/d1b/f21 zero size 2023-12-16T20:11:28.895 INFO:tasks.workunit.client.0.smithi038.stdout:9/376: rename d9/d1e/d3d/f47 to d9/d1f/d21/d55/f6f 0 2023-12-16T20:11:28.895 INFO:tasks.workunit.client.0.smithi038.stdout:9/377: rename d9/d1f/d21 to d9/d1f/d21/d3e/d4e/d61/d70 22 2023-12-16T20:11:28.895 INFO:tasks.workunit.client.0.smithi038.stdout:9/378: dread - d9/d1e/f37 zero size 2023-12-16T20:11:28.895 INFO:tasks.workunit.client.0.smithi038.stdout:9/379: readlink d9/d1e/d40/l62 0 2023-12-16T20:11:28.896 INFO:tasks.workunit.client.1.smithi141.stdout:8/115: link f12 d14/d19/d1b/d24/f28 0 2023-12-16T20:11:28.896 INFO:tasks.workunit.client.1.smithi141.stdout:8/116: readlink d14/d19/d1b/l1d 0 2023-12-16T20:11:28.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/391: rmdir d1/d16 39 2023-12-16T20:11:28.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/392: fsync d1/d4/d1d/d61/f7b 0 2023-12-16T20:11:28.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/393: truncate d1/f19 5119517 0 2023-12-16T20:11:28.900 INFO:tasks.workunit.client.0.smithi038.stdout:4/391: creat d13/d17/d2e/d32/d4e/d61/f80 x:0 0 0 2023-12-16T20:11:28.900 INFO:tasks.workunit.client.0.smithi038.stdout:4/392: truncate d13/d17/d2e/d75/f6d 89746 0 2023-12-16T20:11:28.901 INFO:tasks.workunit.client.0.smithi038.stdout:7/330: mknod da/d21/c6e 0 2023-12-16T20:11:28.902 INFO:tasks.workunit.client.1.smithi141.stdout:1/33: read f5 [2216368,58513] 0 2023-12-16T20:11:28.902 INFO:tasks.workunit.client.0.smithi038.stdout:8/266: dread d17/d18/f1a [0,4194304] 0 2023-12-16T20:11:28.903 INFO:tasks.workunit.client.0.smithi038.stdout:3/429: truncate d4/d8/d15/f56 2432187 0 2023-12-16T20:11:28.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/516: mkdir d1/d5/d6c/da7 0 2023-12-16T20:11:28.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/517: write d1/d5/d2a/d31/f36 [2044447,71632] 0 2023-12-16T20:11:28.906 INFO:tasks.workunit.client.1.smithi141.stdout:1/34: creat f7 x:0 0 0 2023-12-16T20:11:28.907 INFO:tasks.workunit.client.0.smithi038.stdout:0/409: creat db/f88 x:0 0 0 2023-12-16T20:11:28.910 INFO:tasks.workunit.client.0.smithi038.stdout:8/267: unlink d17/d1b/l27 0 2023-12-16T20:11:28.910 INFO:tasks.workunit.client.0.smithi038.stdout:7/331: creat da/d24/f6f x:0 0 0 2023-12-16T20:11:28.911 INFO:tasks.workunit.client.1.smithi141.stdout:1/35: creat f8 x:0 0 0 2023-12-16T20:11:28.911 INFO:tasks.workunit.client.0.smithi038.stdout:6/394: dread d1/f22 [4194304,4194304] 0 2023-12-16T20:11:28.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/430: link d4/d8/d15/d2c/d4c/d58/c75 d4/d27/d40/c93 0 2023-12-16T20:11:28.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/431: creat d4/d18/f94 x:0 0 0 2023-12-16T20:11:28.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/78: getdents d1a 0 2023-12-16T20:11:28.915 INFO:tasks.workunit.client.0.smithi038.stdout:2/518: symlink d1/df/d6a/la8 0 2023-12-16T20:11:28.916 INFO:tasks.workunit.client.0.smithi038.stdout:8/268: unlink f5 0 2023-12-16T20:11:28.917 INFO:tasks.workunit.client.0.smithi038.stdout:7/332: creat da/f70 x:0 0 0 2023-12-16T20:11:28.919 INFO:tasks.workunit.client.0.smithi038.stdout:6/395: mkdir d1/d5b/d7d 0 2023-12-16T20:11:28.919 INFO:tasks.workunit.client.0.smithi038.stdout:6/396: creat d1/d4/d1d/f7e x:0 0 0 2023-12-16T20:11:28.919 INFO:tasks.workunit.client.0.smithi038.stdout:6/397: chown d1 83265463 1 2023-12-16T20:11:28.922 INFO:tasks.workunit.client.0.smithi038.stdout:2/519: creat d1/d5/d6c/da7/fa9 x:0 0 0 2023-12-16T20:11:28.924 INFO:tasks.workunit.client.0.smithi038.stdout:8/269: rename d17/d18/l2d to d17/d18/l51 0 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.1.smithi141.stdout:0/73: rmdir d4 39 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.1.smithi141.stdout:0/74: dread - d4/fe zero size 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.1.smithi141.stdout:0/75: fsync d4/fe 0 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.1.smithi141.stdout:0/76: fsync d4/fe 0 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.1.smithi141.stdout:0/77: write d4/f16 [23168,74685] 0 2023-12-16T20:11:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/333: symlink da/d21/d2c/l71 0 2023-12-16T20:11:28.930 INFO:tasks.workunit.client.0.smithi038.stdout:6/398: mknod d1/d4/c7f 0 2023-12-16T20:11:28.930 INFO:tasks.workunit.client.0.smithi038.stdout:6/399: dread - d1/d2e/f47 zero size 2023-12-16T20:11:28.930 INFO:tasks.workunit.client.0.smithi038.stdout:6/400: readlink d1/d2e/l42 0 2023-12-16T20:11:28.935 INFO:tasks.workunit.client.0.smithi038.stdout:2/520: link d1/df/d21/f93 d1/df/d6a/d43/faa 0 2023-12-16T20:11:28.937 INFO:tasks.workunit.client.0.smithi038.stdout:5/481: dwrite d2/d14/f22 [0,4194304] 0 2023-12-16T20:11:28.937 INFO:tasks.workunit.client.0.smithi038.stdout:8/270: creat d17/d34/d3d/d45/d4e/f52 x:0 0 0 2023-12-16T20:11:28.942 INFO:tasks.workunit.client.0.smithi038.stdout:6/401: mknod d1/d4/d1d/d67/c80 0 2023-12-16T20:11:28.942 INFO:tasks.workunit.client.0.smithi038.stdout:6/402: read - d1/d2e/f43 zero size 2023-12-16T20:11:28.942 INFO:tasks.workunit.client.0.smithi038.stdout:6/403: chown d1/d2e/l68 49855619 1 2023-12-16T20:11:28.942 INFO:tasks.workunit.client.0.smithi038.stdout:6/404: write d1/d4/d1d/d28/f69 [192636,2055] 0 2023-12-16T20:11:28.944 INFO:tasks.workunit.client.1.smithi141.stdout:0/78: dread f2 [0,4194304] 0 2023-12-16T20:11:28.946 INFO:tasks.workunit.client.1.smithi141.stdout:0/79: symlink d4/d7/l19 0 2023-12-16T20:11:28.948 INFO:tasks.workunit.client.0.smithi038.stdout:5/482: mkdir d2/d14/d25/d2d/d17/d93 0 2023-12-16T20:11:28.948 INFO:tasks.workunit.client.0.smithi038.stdout:9/380: dwrite d9/f1c [0,4194304] 0 2023-12-16T20:11:28.948 INFO:tasks.workunit.client.1.smithi141.stdout:0/80: truncate d4/f17 55237 0 2023-12-16T20:11:28.948 INFO:tasks.workunit.client.1.smithi141.stdout:0/81: chown d4/f16 8 1 2023-12-16T20:11:28.949 INFO:tasks.workunit.client.0.smithi038.stdout:5/483: dread d2/df/d1a/d2a/f75 [0,4194304] 0 2023-12-16T20:11:28.949 INFO:tasks.workunit.client.0.smithi038.stdout:5/484: creat d2/df/d1a/f94 x:0 0 0 2023-12-16T20:11:28.949 INFO:tasks.workunit.client.0.smithi038.stdout:7/334: getdents da/d3e/d31 0 2023-12-16T20:11:28.949 INFO:tasks.workunit.client.0.smithi038.stdout:7/335: fdatasync da/d21/f50 0 2023-12-16T20:11:28.950 INFO:tasks.workunit.client.1.smithi141.stdout:0/82: symlink d4/l1a 0 2023-12-16T20:11:28.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/405: rename d1/f77 to d1/d4/d1d/d28/f81 0 2023-12-16T20:11:28.957 INFO:tasks.workunit.client.1.smithi141.stdout:8/117: dwrite f12 [0,4194304] 0 2023-12-16T20:11:28.957 INFO:tasks.workunit.client.1.smithi141.stdout:8/118: write d14/f23 [994732,47879] 0 2023-12-16T20:11:28.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/119: fsync ff 0 2023-12-16T20:11:28.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/120: fsync f11 0 2023-12-16T20:11:28.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/336: symlink da/d21/d41/l72 0 2023-12-16T20:11:28.960 INFO:tasks.workunit.client.0.smithi038.stdout:6/406: symlink d1/d4/d1d/d28/l82 0 2023-12-16T20:11:28.962 INFO:tasks.workunit.client.0.smithi038.stdout:7/337: symlink da/d21/d2c/d2e/l73 0 2023-12-16T20:11:28.963 INFO:tasks.workunit.client.0.smithi038.stdout:6/407: unlink d1/d16/d23/c6e 0 2023-12-16T20:11:28.969 INFO:tasks.workunit.client.1.smithi141.stdout:1/36: dwrite f8 [0,4194304] 0 2023-12-16T20:11:28.972 INFO:tasks.workunit.client.1.smithi141.stdout:1/37: creat f9 x:0 0 0 2023-12-16T20:11:28.972 INFO:tasks.workunit.client.1.smithi141.stdout:1/38: readlink l4 0 2023-12-16T20:11:28.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/39: mkdir da 0 2023-12-16T20:11:28.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/40: dread - f9 zero size 2023-12-16T20:11:28.977 INFO:tasks.workunit.client.1.smithi141.stdout:1/41: rename f8 to da/fb 0 2023-12-16T20:11:28.979 INFO:tasks.workunit.client.1.smithi141.stdout:3/163: dwrite d0/f6 [4194304,4194304] 0 2023-12-16T20:11:28.989 INFO:tasks.workunit.client.0.smithi038.stdout:0/410: dwrite db/d16/d19/d27/f4c [0,4194304] 0 2023-12-16T20:11:28.990 INFO:tasks.workunit.client.0.smithi038.stdout:4/393: dwrite d13/f77 [0,4194304] 0 2023-12-16T20:11:28.991 INFO:tasks.workunit.client.1.smithi141.stdout:1/42: dread da/fb [0,4194304] 0 2023-12-16T20:11:28.991 INFO:tasks.workunit.client.1.smithi141.stdout:4/79: dwrite f2 [0,4194304] 0 2023-12-16T20:11:28.991 INFO:tasks.workunit.client.1.smithi141.stdout:1/43: fdatasync f5 0 2023-12-16T20:11:28.991 INFO:tasks.workunit.client.1.smithi141.stdout:6/84: dwrite d1/f4 [0,4194304] 0 2023-12-16T20:11:28.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/411: mkdir db/d16/d19/d4e/d89 0 2023-12-16T20:11:28.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/412: creat db/d16/d19/d27/d56/f8a x:0 0 0 2023-12-16T20:11:28.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/413: chown db/f3d 67 1 2023-12-16T20:11:28.993 INFO:tasks.workunit.client.1.smithi141.stdout:4/80: creat d1a/f1e x:0 0 0 2023-12-16T20:11:28.993 INFO:tasks.workunit.client.1.smithi141.stdout:4/81: fdatasync f19 0 2023-12-16T20:11:28.993 INFO:tasks.workunit.client.1.smithi141.stdout:4/82: write fa [700108,89234] 0 2023-12-16T20:11:28.993 INFO:tasks.workunit.client.1.smithi141.stdout:4/83: creat d1a/f1f x:0 0 0 2023-12-16T20:11:28.995 INFO:tasks.workunit.client.1.smithi141.stdout:1/44: dread da/fb [0,4194304] 0 2023-12-16T20:11:28.995 INFO:tasks.workunit.client.1.smithi141.stdout:1/45: write f7 [548059,111110] 0 2023-12-16T20:11:28.995 INFO:tasks.workunit.client.1.smithi141.stdout:1/46: write f7 [756427,124928] 0 2023-12-16T20:11:28.995 INFO:tasks.workunit.client.1.smithi141.stdout:1/47: write f5 [2814153,98903] 0 2023-12-16T20:11:28.997 INFO:tasks.workunit.client.1.smithi141.stdout:6/85: symlink d1/l1f 0 2023-12-16T20:11:28.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/414: dread f5 [0,4194304] 0 2023-12-16T20:11:28.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/415: chown db/d16/d19/d27/d56/f82 1 1 2023-12-16T20:11:28.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/416: chown db/d16/f18 128330890 1 2023-12-16T20:11:29.000 INFO:tasks.workunit.client.1.smithi141.stdout:6/86: mkdir d1/d12/d20 0 2023-12-16T20:11:29.000 INFO:tasks.workunit.client.1.smithi141.stdout:6/87: chown d1/l1f 3 1 2023-12-16T20:11:29.000 INFO:tasks.workunit.client.1.smithi141.stdout:6/88: mknod d1/d12/d20/c21 0 2023-12-16T20:11:29.000 INFO:tasks.workunit.client.1.smithi141.stdout:6/89: write d1/f17 [1761814,12445] 0 2023-12-16T20:11:29.001 INFO:tasks.workunit.client.0.smithi038.stdout:0/417: truncate db/d16/d19/f2b 657975 0 2023-12-16T20:11:29.001 INFO:tasks.workunit.client.1.smithi141.stdout:6/90: unlink d1/l1a 0 2023-12-16T20:11:29.003 INFO:tasks.workunit.client.1.smithi141.stdout:6/91: mkdir d1/d12/d22 0 2023-12-16T20:11:29.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/418: getdents db/d1a 0 2023-12-16T20:11:29.004 INFO:tasks.workunit.client.1.smithi141.stdout:1/48: dread da/fb [0,4194304] 0 2023-12-16T20:11:29.004 INFO:tasks.workunit.client.1.smithi141.stdout:6/92: creat d1/dd/f23 x:0 0 0 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:8/271: dwrite d17/d1b/f22 [0,4194304] 0 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:8/272: dread - d17/d34/d3d/f4c zero size 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:5/485: dwrite d2/d14/d25/d2d/d17/d51/f76 [0,4194304] 0 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:9/381: dwrite d9/d1e/d3d/f5d [0,4194304] 0 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:9/382: fdatasync d9/d1e/d40/f41 0 2023-12-16T20:11:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:2/521: dwrite d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:29.006 INFO:tasks.workunit.client.0.smithi038.stdout:6/408: dwrite d1/d4/d1d/f66 [0,4194304] 0 2023-12-16T20:11:29.006 INFO:tasks.workunit.client.1.smithi141.stdout:1/49: unlink f9 0 2023-12-16T20:11:29.007 INFO:tasks.workunit.client.0.smithi038.stdout:9/383: dread d9/d1e/f3c [0,4194304] 0 2023-12-16T20:11:29.007 INFO:tasks.workunit.client.0.smithi038.stdout:9/384: readlink d9/d1f/d21/d3e/d4e/d61/l68 0 2023-12-16T20:11:29.007 INFO:tasks.workunit.client.0.smithi038.stdout:9/385: stat d9/d1f/f38 0 2023-12-16T20:11:29.008 INFO:tasks.workunit.client.0.smithi038.stdout:8/273: getdents d17/d1b/d25 0 2023-12-16T20:11:29.009 INFO:tasks.workunit.client.1.smithi141.stdout:6/93: symlink d1/d12/d20/l24 0 2023-12-16T20:11:29.012 INFO:tasks.workunit.client.0.smithi038.stdout:4/394: write d13/d1f/d35/f38 [3597233,79951] 0 2023-12-16T20:11:29.014 INFO:tasks.workunit.client.0.smithi038.stdout:5/486: rename d2/d14/d25/d2d/f45 to d2/df/d1a/d2a/f95 0 2023-12-16T20:11:29.014 INFO:tasks.workunit.client.0.smithi038.stdout:3/432: write d4/d8/f45 [1036922,84148] 0 2023-12-16T20:11:29.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/419: write db/d16/d1c/f2a [1860050,66523] 0 2023-12-16T20:11:29.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/274: dread d17/d34/f36 [0,4194304] 0 2023-12-16T20:11:29.016 INFO:tasks.workunit.client.0.smithi038.stdout:3/433: dread d4/d27/d23/d26/f68 [0,4194304] 0 2023-12-16T20:11:29.020 INFO:tasks.workunit.client.0.smithi038.stdout:7/338: dwrite f6 [4194304,4194304] 0 2023-12-16T20:11:29.022 INFO:tasks.workunit.client.1.smithi141.stdout:6/94: mkdir d1/d12/d22/d25 0 2023-12-16T20:11:29.024 INFO:tasks.workunit.client.1.smithi141.stdout:6/95: mknod d1/d12/c26 0 2023-12-16T20:11:29.025 INFO:tasks.workunit.client.1.smithi141.stdout:4/84: dwrite d1a/f1b [0,4194304] 0 2023-12-16T20:11:29.026 INFO:tasks.workunit.client.1.smithi141.stdout:4/85: truncate d1a/f1f 647834 0 2023-12-16T20:11:29.026 INFO:tasks.workunit.client.1.smithi141.stdout:4/86: creat d1a/f20 x:0 0 0 2023-12-16T20:11:29.026 INFO:tasks.workunit.client.1.smithi141.stdout:4/87: write d1a/f1e [883982,98309] 0 2023-12-16T20:11:29.026 INFO:tasks.workunit.client.0.smithi038.stdout:2/522: mknod d1/df/d10/d2f/cab 0 2023-12-16T20:11:29.027 INFO:tasks.workunit.client.1.smithi141.stdout:1/50: dread f7 [0,4194304] 0 2023-12-16T20:11:29.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/96: rename d1/fb to d1/dd/de/f27 0 2023-12-16T20:11:29.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/97: stat d1/c8 0 2023-12-16T20:11:29.037 INFO:tasks.workunit.client.1.smithi141.stdout:4/88: mknod d1a/c21 0 2023-12-16T20:11:29.037 INFO:tasks.workunit.client.1.smithi141.stdout:4/89: write fd [541647,16880] 0 2023-12-16T20:11:29.038 INFO:tasks.workunit.client.1.smithi141.stdout:4/90: fdatasync d1a/f1c 0 2023-12-16T20:11:29.038 INFO:tasks.workunit.client.0.smithi038.stdout:9/386: unlink d9/d1f/l30 0 2023-12-16T20:11:29.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/409: dwrite d1/f25 [0,4194304] 0 2023-12-16T20:11:29.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/410: chown d1/d4/d1d/d28/f37 958835 1 2023-12-16T20:11:29.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/411: creat d1/f83 x:0 0 0 2023-12-16T20:11:29.041 INFO:tasks.workunit.client.1.smithi141.stdout:6/98: link d1/d12/d20/c21 d1/dd/de/c28 0 2023-12-16T20:11:29.041 INFO:tasks.workunit.client.1.smithi141.stdout:6/99: read - d1/dd/f23 zero size 2023-12-16T20:11:29.043 INFO:tasks.workunit.client.0.smithi038.stdout:4/395: creat d13/d17/d2e/d32/d4d/f81 x:0 0 0 2023-12-16T20:11:29.043 INFO:tasks.workunit.client.1.smithi141.stdout:1/51: rename f5 to da/fc 0 2023-12-16T20:11:29.045 INFO:tasks.workunit.client.1.smithi141.stdout:4/91: rename l18 to d1a/l22 0 2023-12-16T20:11:29.049 INFO:tasks.workunit.client.1.smithi141.stdout:1/52: rename da to da/dd 22 2023-12-16T20:11:29.049 INFO:tasks.workunit.client.1.smithi141.stdout:1/53: write f6 [598764,120080] 0 2023-12-16T20:11:29.050 INFO:tasks.workunit.client.1.smithi141.stdout:1/54: read f6 [260473,27054] 0 2023-12-16T20:11:29.050 INFO:tasks.workunit.client.1.smithi141.stdout:1/55: readlink l4 0 2023-12-16T20:11:29.050 INFO:tasks.workunit.client.0.smithi038.stdout:5/487: rename d2/c29 to d2/d4/d62/c96 0 2023-12-16T20:11:29.050 INFO:tasks.workunit.client.0.smithi038.stdout:0/420: mknod db/d16/d19/d4e/d89/c8b 0 2023-12-16T20:11:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:7/339: truncate da/d3e/f40 1256947 0 2023-12-16T20:11:29.053 INFO:tasks.workunit.client.1.smithi141.stdout:6/100: dread d1/f19 [0,4194304] 0 2023-12-16T20:11:29.055 INFO:tasks.workunit.client.0.smithi038.stdout:8/275: dwrite d17/d34/d3d/d45/d4e/f52 [0,4194304] 0 2023-12-16T20:11:29.055 INFO:tasks.workunit.client.1.smithi141.stdout:6/101: unlink d1/l6 0 2023-12-16T20:11:29.055 INFO:tasks.workunit.client.1.smithi141.stdout:6/102: chown d1/d12/d20/l24 125446898 1 2023-12-16T20:11:29.059 INFO:tasks.workunit.client.0.smithi038.stdout:2/523: mknod d1/d88/cac 0 2023-12-16T20:11:29.059 INFO:tasks.workunit.client.1.smithi141.stdout:0/83: dwrite d4/f17 [0,4194304] 0 2023-12-16T20:11:29.059 INFO:tasks.workunit.client.1.smithi141.stdout:6/103: rename d1/dd/de/f1b to d1/dd/de/f29 0 2023-12-16T20:11:29.065 INFO:tasks.workunit.client.0.smithi038.stdout:4/396: truncate d13/d1f/d22/f41 4265428 0 2023-12-16T20:11:29.065 INFO:tasks.workunit.client.1.smithi141.stdout:0/84: mknod d4/d7/c1b 0 2023-12-16T20:11:29.065 INFO:tasks.workunit.client.1.smithi141.stdout:0/85: dread - d4/fe zero size 2023-12-16T20:11:29.065 INFO:tasks.workunit.client.1.smithi141.stdout:0/86: write d4/fe [176931,13367] 0 2023-12-16T20:11:29.067 INFO:tasks.workunit.client.1.smithi141.stdout:6/104: creat d1/d12/d22/f2a x:0 0 0 2023-12-16T20:11:29.069 INFO:tasks.workunit.client.1.smithi141.stdout:0/87: link d4/f17 d4/f1c 0 2023-12-16T20:11:29.069 INFO:tasks.workunit.client.1.smithi141.stdout:6/105: rename d1/l2 to d1/l2b 0 2023-12-16T20:11:29.071 INFO:tasks.workunit.client.0.smithi038.stdout:6/412: rename d1/d16/d23/f29 to d1/d5b/d7d/f84 0 2023-12-16T20:11:29.071 INFO:tasks.workunit.client.0.smithi038.stdout:6/413: dread - d1/d4/d1d/d28/f7a zero size 2023-12-16T20:11:29.071 INFO:tasks.workunit.client.0.smithi038.stdout:6/414: write d1/d4/f62 [1373513,13703] 0 2023-12-16T20:11:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:0/421: rename db/d16/f54 to db/d16/f8c 0 2023-12-16T20:11:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:0/422: dread - db/d16/d1c/f72 zero size 2023-12-16T20:11:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:0/423: fsync db/f44 0 2023-12-16T20:11:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:9/387: dwrite d9/d1e/d3d/d42/f48 [0,4194304] 0 2023-12-16T20:11:29.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/524: creat d1/fad x:0 0 0 2023-12-16T20:11:29.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/525: creat d1/df/fae x:0 0 0 2023-12-16T20:11:29.079 INFO:tasks.workunit.client.0.smithi038.stdout:4/397: symlink d13/d17/d2e/d32/d4e/d61/l82 0 2023-12-16T20:11:29.084 INFO:tasks.workunit.client.0.smithi038.stdout:1/500: sync 2023-12-16T20:11:29.089 INFO:tasks.workunit.client.1.smithi141.stdout:1/56: dwrite da/fb [4194304,4194304] 0 2023-12-16T20:11:29.090 INFO:tasks.workunit.client.1.smithi141.stdout:4/92: dwrite d1a/f20 [0,4194304] 0 2023-12-16T20:11:29.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/276: dwrite d17/f40 [4194304,4194304] 0 2023-12-16T20:11:29.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/277: dread - d17/d1b/f3f zero size 2023-12-16T20:11:29.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/278: getdents d17/d1b/d25 0 2023-12-16T20:11:29.099 INFO:tasks.workunit.client.1.smithi141.stdout:6/106: dread d1/f17 [0,4194304] 0 2023-12-16T20:11:29.099 INFO:tasks.workunit.client.1.smithi141.stdout:0/88: dread d4/fe [0,4194304] 0 2023-12-16T20:11:29.099 INFO:tasks.workunit.client.1.smithi141.stdout:0/89: fsync d4/f16 0 2023-12-16T20:11:29.101 INFO:tasks.workunit.client.1.smithi141.stdout:6/107: rename d1/d12/d20/l24 to d1/d12/l2c 0 2023-12-16T20:11:29.102 INFO:tasks.workunit.client.0.smithi038.stdout:2/526: dwrite d1/d5/d2a/f79 [0,4194304] 0 2023-12-16T20:11:29.102 INFO:tasks.workunit.client.1.smithi141.stdout:0/90: creat d4/d7/f1d x:0 0 0 2023-12-16T20:11:29.107 INFO:tasks.workunit.client.0.smithi038.stdout:1/501: dwrite d15/d1e/d3b/d48/d3d/f58 [0,4194304] 0 2023-12-16T20:11:29.110 INFO:tasks.workunit.client.0.smithi038.stdout:5/488: rmdir d2 39 2023-12-16T20:11:29.110 INFO:tasks.workunit.client.0.smithi038.stdout:5/489: dread - d2/d14/d25/f79 zero size 2023-12-16T20:11:29.110 INFO:tasks.workunit.client.0.smithi038.stdout:5/490: truncate d2/df/d1a/d2a/f74 602031 0 2023-12-16T20:11:29.110 INFO:tasks.workunit.client.0.smithi038.stdout:5/491: readlink d2/l15 0 2023-12-16T20:11:29.113 INFO:tasks.workunit.client.0.smithi038.stdout:7/340: rename da/d3e/f5c to da/d21/d68/f74 0 2023-12-16T20:11:29.113 INFO:tasks.workunit.client.0.smithi038.stdout:7/341: write da/d3e/d31/f39 [3331051,109028] 0 2023-12-16T20:11:29.115 INFO:tasks.workunit.client.1.smithi141.stdout:1/57: dwrite f7 [0,4194304] 0 2023-12-16T20:11:29.116 INFO:tasks.workunit.client.0.smithi038.stdout:6/415: mkdir d1/d4/d1d/d28/d2f/d85 0 2023-12-16T20:11:29.116 INFO:tasks.workunit.client.0.smithi038.stdout:6/416: fdatasync d1/d4/d1d/d28/f41 0 2023-12-16T20:11:29.120 INFO:tasks.workunit.client.0.smithi038.stdout:0/424: creat db/d16/d1c/d5d/f8d x:0 0 0 2023-12-16T20:11:29.120 INFO:tasks.workunit.client.0.smithi038.stdout:0/425: chown db/d16 247784 1 2023-12-16T20:11:29.122 INFO:tasks.workunit.client.0.smithi038.stdout:0/426: write f5 [4590433,8460] 0 2023-12-16T20:11:29.123 INFO:tasks.workunit.client.1.smithi141.stdout:9/101: sync 2023-12-16T20:11:29.124 INFO:tasks.workunit.client.1.smithi141.stdout:0/91: dread f1 [0,4194304] 0 2023-12-16T20:11:29.124 INFO:tasks.workunit.client.1.smithi141.stdout:0/92: creat d4/d7/f1e x:0 0 0 2023-12-16T20:11:29.125 INFO:tasks.workunit.client.1.smithi141.stdout:0/93: chown d4/d7/c18 1597315 1 2023-12-16T20:11:29.125 INFO:tasks.workunit.client.1.smithi141.stdout:0/94: chown d4/d7/l11 1549 1 2023-12-16T20:11:29.125 INFO:tasks.workunit.client.1.smithi141.stdout:0/95: fsync d4/f17 0 2023-12-16T20:11:29.125 INFO:tasks.workunit.client.1.smithi141.stdout:0/96: chown d4/c6 5265 1 2023-12-16T20:11:29.125 INFO:tasks.workunit.client.1.smithi141.stdout:0/97: truncate d4/f16 250641 0 2023-12-16T20:11:29.128 INFO:tasks.workunit.client.1.smithi141.stdout:4/93: dread fa [0,4194304] 0 2023-12-16T20:11:29.128 INFO:tasks.workunit.client.1.smithi141.stdout:0/98: mknod d4/d7/c1f 0 2023-12-16T20:11:29.130 INFO:tasks.workunit.client.0.smithi038.stdout:9/388: mkdir d9/d1e/d40/d5e/d71 0 2023-12-16T20:11:29.130 INFO:tasks.workunit.client.0.smithi038.stdout:4/398: mknod d13/d17/d4b/c83 0 2023-12-16T20:11:29.130 INFO:tasks.workunit.client.0.smithi038.stdout:8/279: mkdir d17/d1b/d53 0 2023-12-16T20:11:29.132 INFO:tasks.workunit.client.1.smithi141.stdout:6/108: dwrite d1/dd/f9 [0,4194304] 0 2023-12-16T20:11:29.133 INFO:tasks.workunit.client.1.smithi141.stdout:6/109: mknod d1/d3/c2d 0 2023-12-16T20:11:29.136 INFO:tasks.workunit.client.1.smithi141.stdout:6/110: creat d1/d12/d22/d25/f2e x:0 0 0 2023-12-16T20:11:29.136 INFO:tasks.workunit.client.1.smithi141.stdout:6/111: chown d1/d3/l7 12279910 1 2023-12-16T20:11:29.139 INFO:tasks.workunit.client.0.smithi038.stdout:6/417: write d1/f25 [1690655,90351] 0 2023-12-16T20:11:29.139 INFO:tasks.workunit.client.0.smithi038.stdout:6/418: chown d1/f54 7696008 1 2023-12-16T20:11:29.139 INFO:tasks.workunit.client.0.smithi038.stdout:1/502: dwrite d15/d1e/d23/d34/d86/d9a/fa4 [0,4194304] 0 2023-12-16T20:11:29.140 INFO:tasks.workunit.client.0.smithi038.stdout:2/527: truncate d1/df/d21/f45 2997900 0 2023-12-16T20:11:29.140 INFO:tasks.workunit.client.1.smithi141.stdout:6/112: mkdir d1/dd/d2f 0 2023-12-16T20:11:29.142 INFO:tasks.workunit.client.0.smithi038.stdout:5/492: mkdir d2/df/d1a/d1f/d4a/d53/d97 0 2023-12-16T20:11:29.142 INFO:tasks.workunit.client.1.smithi141.stdout:6/113: unlink d1/d12/d20/c21 0 2023-12-16T20:11:29.144 INFO:tasks.workunit.client.1.smithi141.stdout:6/114: creat d1/dd/d2f/f30 x:0 0 0 2023-12-16T20:11:29.145 INFO:tasks.workunit.client.1.smithi141.stdout:6/115: mkdir d1/d12/d22/d31 0 2023-12-16T20:11:29.146 INFO:tasks.workunit.client.1.smithi141.stdout:6/116: chown d1/c8 102726 1 2023-12-16T20:11:29.147 INFO:tasks.workunit.client.0.smithi038.stdout:9/389: mkdir d9/d1f/d21/d3e/d72 0 2023-12-16T20:11:29.147 INFO:tasks.workunit.client.0.smithi038.stdout:4/399: mkdir d13/d17/d2e/d32/d70/d84 0 2023-12-16T20:11:29.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/280: fdatasync d17/f24 0 2023-12-16T20:11:29.148 INFO:tasks.workunit.client.1.smithi141.stdout:6/117: symlink d1/d12/d22/d25/l32 0 2023-12-16T20:11:29.148 INFO:tasks.workunit.client.1.smithi141.stdout:6/118: creat d1/d12/f33 x:0 0 0 2023-12-16T20:11:29.148 INFO:tasks.workunit.client.1.smithi141.stdout:6/119: dread - d1/d12/d22/d25/f2e zero size 2023-12-16T20:11:29.148 INFO:tasks.workunit.client.1.smithi141.stdout:1/58: truncate f7 2712770 0 2023-12-16T20:11:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/419: mknod d1/d4/d1d/c86 0 2023-12-16T20:11:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/420: read - d1/d4/d1d/d28/f81 zero size 2023-12-16T20:11:29.149 INFO:tasks.workunit.client.1.smithi141.stdout:0/99: truncate d4/fe 66501 0 2023-12-16T20:11:29.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/528: symlink d1/df/laf 0 2023-12-16T20:11:29.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/529: write d1/df/d21/d9a/fa3 [149730,4213] 0 2023-12-16T20:11:29.154 INFO:tasks.workunit.client.0.smithi038.stdout:5/493: mkdir d2/d14/d25/d2d/d2f/d98 0 2023-12-16T20:11:29.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/427: rename db/d16/d19/d27/c68 to db/d1a/d77/c8e 0 2023-12-16T20:11:29.156 INFO:tasks.workunit.client.0.smithi038.stdout:7/342: dwrite da/d21/d2c/d2e/f5f [0,4194304] 0 2023-12-16T20:11:29.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/428: fdatasync db/d16/d1c/d5d/f8d 0 2023-12-16T20:11:29.157 INFO:tasks.workunit.client.0.smithi038.stdout:0/429: fdatasync db/d16/d19/d27/f34 0 2023-12-16T20:11:29.158 INFO:tasks.workunit.client.0.smithi038.stdout:4/400: link d13/d1f/d22/f41 d13/d17/d2e/d32/d4d/d78/f85 0 2023-12-16T20:11:29.159 INFO:tasks.workunit.client.1.smithi141.stdout:9/102: dwrite d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:29.159 INFO:tasks.workunit.client.1.smithi141.stdout:9/103: getdents d1/d26 0 2023-12-16T20:11:29.160 INFO:tasks.workunit.client.0.smithi038.stdout:8/281: mkdir d17/d34/d3d/d45/d54 0 2023-12-16T20:11:29.162 INFO:tasks.workunit.client.1.smithi141.stdout:9/104: chown d1/c3 48481687 1 2023-12-16T20:11:29.164 INFO:tasks.workunit.client.0.smithi038.stdout:6/421: link d1/d4/d1d/d28/d2f/l3c d1/d16/d23/l87 0 2023-12-16T20:11:29.165 INFO:tasks.workunit.client.1.smithi141.stdout:9/105: symlink d1/d10/d27/l2c 0 2023-12-16T20:11:29.166 INFO:tasks.workunit.client.0.smithi038.stdout:1/503: rmdir d15/d1e/d30 39 2023-12-16T20:11:29.166 INFO:tasks.workunit.client.0.smithi038.stdout:9/390: write d9/d1f/f29 [2424186,5968] 0 2023-12-16T20:11:29.166 INFO:tasks.workunit.client.0.smithi038.stdout:9/391: truncate d9/d1e/d3d/f6b 369563 0 2023-12-16T20:11:29.166 INFO:tasks.workunit.client.0.smithi038.stdout:9/392: stat d9/d1f/d21/d3e/d4e/d61 0 2023-12-16T20:11:29.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/59: fsync da/fc 0 2023-12-16T20:11:29.169 INFO:tasks.workunit.client.0.smithi038.stdout:5/494: symlink d2/d14/d25/d2d/d17/d55/l99 0 2023-12-16T20:11:29.170 INFO:tasks.workunit.client.0.smithi038.stdout:7/343: symlink da/d3e/d31/d38/l75 0 2023-12-16T20:11:29.173 INFO:tasks.workunit.client.1.smithi141.stdout:9/106: symlink d1/l2d 0 2023-12-16T20:11:29.175 INFO:tasks.workunit.client.1.smithi141.stdout:9/107: mknod d1/d10/d27/c2e 0 2023-12-16T20:11:29.176 INFO:tasks.workunit.client.0.smithi038.stdout:0/430: link db/d16/d1c/d5d/d64/l69 db/d16/d19/d4e/l8f 0 2023-12-16T20:11:29.176 INFO:tasks.workunit.client.0.smithi038.stdout:0/431: readlink db/d16/l76 0 2023-12-16T20:11:29.177 INFO:tasks.workunit.client.0.smithi038.stdout:8/282: mkdir d17/d34/d3d/d45/d55 0 2023-12-16T20:11:29.178 INFO:tasks.workunit.client.1.smithi141.stdout:9/108: rename d1/d10/f1c to d1/d26/f2f 0 2023-12-16T20:11:29.180 INFO:tasks.workunit.client.1.smithi141.stdout:6/120: getdents d1/dd/d2f 0 2023-12-16T20:11:29.182 INFO:tasks.workunit.client.1.smithi141.stdout:4/94: dwrite fd [0,4194304] 0 2023-12-16T20:11:29.182 INFO:tasks.workunit.client.1.smithi141.stdout:4/95: write fa [2442686,21358] 0 2023-12-16T20:11:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:6/422: rmdir d1/d5b/d7d 39 2023-12-16T20:11:29.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/432: dread db/d16/d70/f6c [0,4194304] 0 2023-12-16T20:11:29.188 INFO:tasks.workunit.client.1.smithi141.stdout:4/96: truncate f2 2575633 0 2023-12-16T20:11:29.188 INFO:tasks.workunit.client.1.smithi141.stdout:4/97: fdatasync f9 0 2023-12-16T20:11:29.188 INFO:tasks.workunit.client.1.smithi141.stdout:4/98: write d1a/f1e [1198512,26823] 0 2023-12-16T20:11:29.189 INFO:tasks.workunit.client.0.smithi038.stdout:7/344: mkdir da/d21/d2c/d76 0 2023-12-16T20:11:29.190 INFO:tasks.workunit.client.0.smithi038.stdout:9/393: dread d9/d1e/d3d/f4b [0,4194304] 0 2023-12-16T20:11:29.191 INFO:tasks.workunit.client.0.smithi038.stdout:9/394: readlink d9/l31 0 2023-12-16T20:11:29.191 INFO:tasks.workunit.client.0.smithi038.stdout:9/395: chown d9/d1e/f37 8009 1 2023-12-16T20:11:29.192 INFO:tasks.workunit.client.0.smithi038.stdout:7/345: creat da/d3e/d31/d38/d65/f77 x:0 0 0 2023-12-16T20:11:29.192 INFO:tasks.workunit.client.0.smithi038.stdout:7/346: dread - da/d21/f55 zero size 2023-12-16T20:11:29.193 INFO:tasks.workunit.client.0.smithi038.stdout:5/495: dread d2/df/d1a/d1f/f32 [0,4194304] 0 2023-12-16T20:11:29.193 INFO:tasks.workunit.client.0.smithi038.stdout:5/496: chown d2/df/d1a/d2a/f95 99914845 1 2023-12-16T20:11:29.194 INFO:tasks.workunit.client.0.smithi038.stdout:5/497: write d2/d14/d25/d2d/d17/d55/f7a [808727,61752] 0 2023-12-16T20:11:29.195 INFO:tasks.workunit.client.1.smithi141.stdout:6/121: write d1/d12/f16 [1970017,46676] 0 2023-12-16T20:11:29.198 INFO:tasks.workunit.client.1.smithi141.stdout:6/122: link d1/d3/c2d d1/d12/c34 0 2023-12-16T20:11:29.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/498: symlink d2/d81/l9a 0 2023-12-16T20:11:29.201 INFO:tasks.workunit.client.1.smithi141.stdout:6/123: mkdir d1/d12/d22/d25/d35 0 2023-12-16T20:11:29.203 INFO:tasks.workunit.client.1.smithi141.stdout:6/124: rename d1/d12/d22/d25/d35 to d1/d36 0 2023-12-16T20:11:29.204 INFO:tasks.workunit.client.0.smithi038.stdout:2/530: dwrite d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:29.205 INFO:tasks.workunit.client.1.smithi141.stdout:6/125: mknod d1/d12/d22/d25/c37 0 2023-12-16T20:11:29.206 INFO:tasks.workunit.client.1.smithi141.stdout:6/126: dread - d1/dd/d2f/f30 zero size 2023-12-16T20:11:29.206 INFO:tasks.workunit.client.1.smithi141.stdout:6/127: fsync d1/f4 0 2023-12-16T20:11:29.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/499: mknod d2/d14/c9b 0 2023-12-16T20:11:29.209 INFO:tasks.workunit.client.0.smithi038.stdout:9/396: dread d9/d1e/d40/f58 [0,4194304] 0 2023-12-16T20:11:29.216 INFO:tasks.workunit.client.0.smithi038.stdout:2/531: unlink d1/d5/d6c/c87 0 2023-12-16T20:11:29.216 INFO:tasks.workunit.client.0.smithi038.stdout:5/500: creat d2/d14/d25/d2d/d17/d51/f9c x:0 0 0 2023-12-16T20:11:29.217 INFO:tasks.workunit.client.0.smithi038.stdout:9/397: mknod d9/d1f/d21/d3e/d72/c73 0 2023-12-16T20:11:29.217 INFO:tasks.workunit.client.0.smithi038.stdout:9/398: creat d9/d1e/f74 x:0 0 0 2023-12-16T20:11:29.219 INFO:tasks.workunit.client.0.smithi038.stdout:9/399: read d9/d1e/d3d/f6b [210986,30931] 0 2023-12-16T20:11:29.220 INFO:tasks.workunit.client.0.smithi038.stdout:5/501: creat d2/df/d1a/d1f/d4a/d53/d6e/d85/f9d x:0 0 0 2023-12-16T20:11:29.223 INFO:tasks.workunit.client.0.smithi038.stdout:9/400: mknod d9/d1f/d21/d3e/d4e/c75 0 2023-12-16T20:11:29.223 INFO:tasks.workunit.client.1.smithi141.stdout:1/60: dread f7 [0,4194304] 0 2023-12-16T20:11:29.223 INFO:tasks.workunit.client.1.smithi141.stdout:1/61: stat f6 0 2023-12-16T20:11:29.225 INFO:tasks.workunit.client.0.smithi038.stdout:5/502: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d9e 0 2023-12-16T20:11:29.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/504: dwrite f11 [0,4194304] 0 2023-12-16T20:11:29.228 INFO:tasks.workunit.client.0.smithi038.stdout:9/401: mkdir d9/d1e/d3d/d42/d59/d76 0 2023-12-16T20:11:29.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/505: write d15/d22/d52/f81 [4319154,79809] 0 2023-12-16T20:11:29.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/506: readlink l5 0 2023-12-16T20:11:29.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/507: write d15/d1e/d23/f78 [108031,25928] 0 2023-12-16T20:11:29.231 INFO:tasks.workunit.client.0.smithi038.stdout:9/402: creat d9/d1f/d6a/f77 x:0 0 0 2023-12-16T20:11:29.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/508: symlink d15/d1e/d23/d7d/lab 0 2023-12-16T20:11:29.234 INFO:tasks.workunit.client.0.smithi038.stdout:9/403: link d9/d1f/d21/d55/f6f d9/d1e/d3d/d42/d59/d76/f78 0 2023-12-16T20:11:29.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/509: rename d15/d22/d52/d7f/f96 to d15/d1e/d30/fac 0 2023-12-16T20:11:29.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/510: chown d15/d22/d62/f94 198215 1 2023-12-16T20:11:29.240 INFO:tasks.workunit.client.0.smithi038.stdout:1/511: mknod d15/cad 0 2023-12-16T20:11:29.242 INFO:tasks.workunit.client.0.smithi038.stdout:1/512: rename d15/d4a/f8a to d15/d1e/d23/d42/fae 0 2023-12-16T20:11:29.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/401: dwrite d13/d1f/d22/d34/f58 [0,4194304] 0 2023-12-16T20:11:29.242 INFO:tasks.workunit.client.0.smithi038.stdout:2/532: write d1/df/d21/f3c [2513897,21487] 0 2023-12-16T20:11:29.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/402: truncate d13/d17/d2e/d32/d4e/f59 260831 0 2023-12-16T20:11:29.245 INFO:tasks.workunit.client.0.smithi038.stdout:2/533: creat d1/df/d6a/d43/fb0 x:0 0 0 2023-12-16T20:11:29.245 INFO:tasks.workunit.client.1.smithi141.stdout:0/100: dwrite f2 [0,4194304] 0 2023-12-16T20:11:29.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/283: dwrite d17/d1d/f21 [0,4194304] 0 2023-12-16T20:11:29.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/284: fdatasync d17/d34/d3d/d45/d4e/f49 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.1.smithi141.stdout:9/109: dwrite d1/d26/f2f [0,4194304] 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.1.smithi141.stdout:9/110: fdatasync d1/d26/f2f 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.1.smithi141.stdout:9/111: fsync d1/f6 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.1.smithi141.stdout:9/112: truncate d1/d10/d14/f25 1002907 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.1.smithi141.stdout:0/101: creat d4/f20 x:0 0 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.0.smithi038.stdout:4/403: mknod d13/d69/c86 0 2023-12-16T20:11:29.247 INFO:tasks.workunit.client.0.smithi038.stdout:4/404: truncate d13/d1f/d22/f7e 4219969 0 2023-12-16T20:11:29.252 INFO:tasks.workunit.client.0.smithi038.stdout:1/513: rmdir d15/d22/d7b 39 2023-12-16T20:11:29.253 INFO:tasks.workunit.client.0.smithi038.stdout:1/514: chown d15/c1c 392115527 1 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:2/534: link d1/d5/d2a/c33 d1/df/cb1 0 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:2/535: write d1/d5/d2a/f30 [4692768,44341] 0 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/404: dread d9/f18 [0,4194304] 0 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/405: write d9/d1e/d45/f4a [4510086,58073] 0 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/406: chown d9/fe 5664 1 2023-12-16T20:11:29.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/515: dread d15/d22/d52/f89 [0,4194304] 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:2/536: rename d1/df/d10/f46 to d1/df/d10/d23/fb2 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:2/537: readlink d1/df/d6a/l8f 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:2/538: write d1/df/d6a/d43/faa [1192279,84704] 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:0/433: dwrite db/d16/d19/d27/d56/f82 [0,4194304] 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:0/434: fsync db/d16/d19/f43 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:7/347: dwrite da/d21/f34 [0,4194304] 0 2023-12-16T20:11:29.257 INFO:tasks.workunit.client.0.smithi038.stdout:6/423: dwrite d1/d16/f21 [0,4194304] 0 2023-12-16T20:11:29.258 INFO:tasks.workunit.client.0.smithi038.stdout:5/503: dwrite d2/d4/d62/f77 [0,4194304] 0 2023-12-16T20:11:29.259 INFO:tasks.workunit.client.0.smithi038.stdout:9/407: rename d9/d1f/d21/l44 to d9/l79 0 2023-12-16T20:11:29.262 INFO:tasks.workunit.client.0.smithi038.stdout:2/539: mkdir d1/df/d21/d82/d92/db3 0 2023-12-16T20:11:29.262 INFO:tasks.workunit.client.1.smithi141.stdout:4/99: truncate fa 1711326 0 2023-12-16T20:11:29.265 INFO:tasks.workunit.client.1.smithi141.stdout:6/128: rename d1/d36 to d1/d12/d22/d25/d38 0 2023-12-16T20:11:29.266 INFO:tasks.workunit.client.1.smithi141.stdout:6/129: fdatasync d1/dd/f23 0 2023-12-16T20:11:29.266 INFO:tasks.workunit.client.1.smithi141.stdout:6/130: chown d1/l1f 96240830 1 2023-12-16T20:11:29.266 INFO:tasks.workunit.client.1.smithi141.stdout:6/131: stat d1/dd/d2f 0 2023-12-16T20:11:29.266 INFO:tasks.workunit.client.1.smithi141.stdout:6/132: truncate d1/dd/f1d 973397 0 2023-12-16T20:11:29.267 INFO:tasks.workunit.client.1.smithi141.stdout:0/102: truncate d4/f17 3762799 0 2023-12-16T20:11:29.267 INFO:tasks.workunit.client.0.smithi038.stdout:5/504: write d2/df/d1a/f46 [2013372,73286] 0 2023-12-16T20:11:29.267 INFO:tasks.workunit.client.0.smithi038.stdout:5/505: truncate d2/d14/d25/d2d/f8c 39417 0 2023-12-16T20:11:29.268 INFO:tasks.workunit.client.0.smithi038.stdout:8/285: dwrite d17/d18/f1a [4194304,4194304] 0 2023-12-16T20:11:29.269 INFO:tasks.workunit.client.1.smithi141.stdout:9/113: getdents d1/d10/d14 0 2023-12-16T20:11:29.270 INFO:tasks.workunit.client.0.smithi038.stdout:9/408: write d9/d1f/d21/d3e/f69 [3456366,48361] 0 2023-12-16T20:11:29.270 INFO:tasks.workunit.client.0.smithi038.stdout:9/409: stat d9/d1e/d45/c57 0 2023-12-16T20:11:29.272 INFO:tasks.workunit.client.1.smithi141.stdout:0/103: symlink d4/d7/l21 0 2023-12-16T20:11:29.274 INFO:tasks.workunit.client.1.smithi141.stdout:9/114: unlink d1/d10/d14/d20/da/de/c19 0 2023-12-16T20:11:29.275 INFO:tasks.workunit.client.1.smithi141.stdout:6/133: rmdir d1/dd 39 2023-12-16T20:11:29.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/104: rename d4/d7/c1b to d4/d7/c22 0 2023-12-16T20:11:29.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/105: fdatasync d4/f16 0 2023-12-16T20:11:29.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/106: chown d4/l1a 3 1 2023-12-16T20:11:29.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/107: write f2 [5134957,46286] 0 2023-12-16T20:11:29.280 INFO:tasks.workunit.client.1.smithi141.stdout:9/115: mknod d1/d10/d14/d20/c30 0 2023-12-16T20:11:29.280 INFO:tasks.workunit.client.1.smithi141.stdout:9/116: stat d1/c3 0 2023-12-16T20:11:29.281 INFO:tasks.workunit.client.0.smithi038.stdout:0/435: mkdir db/d16/d5a/d65/d90 0 2023-12-16T20:11:29.285 INFO:tasks.workunit.client.0.smithi038.stdout:2/540: stat d1/df/d6a/l8f 0 2023-12-16T20:11:29.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/108: truncate d4/d7/fd 2258311 0 2023-12-16T20:11:29.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/109: creat d4/f23 x:0 0 0 2023-12-16T20:11:29.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/110: creat d4/d7/f24 x:0 0 0 2023-12-16T20:11:29.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/506: getdents d2/d14/d25/d2d 0 2023-12-16T20:11:29.288 INFO:tasks.workunit.client.1.smithi141.stdout:5/92: sync 2023-12-16T20:11:29.288 INFO:tasks.workunit.client.1.smithi141.stdout:2/54: sync 2023-12-16T20:11:29.288 INFO:tasks.workunit.client.1.smithi141.stdout:5/93: dread - d0/d9/f13 zero size 2023-12-16T20:11:29.290 INFO:tasks.workunit.client.0.smithi038.stdout:9/410: mknod d9/d1f/c7a 0 2023-12-16T20:11:29.290 INFO:tasks.workunit.client.0.smithi038.stdout:9/411: readlink d9/d1f/d21/l36 0 2023-12-16T20:11:29.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/286: dwrite f13 [8388608,4194304] 0 2023-12-16T20:11:29.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/287: readlink d17/d18/l51 0 2023-12-16T20:11:29.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/288: chown d17/d18/f1a 366680 1 2023-12-16T20:11:29.292 INFO:tasks.workunit.client.1.smithi141.stdout:9/117: truncate d1/d26/f2f 3746049 0 2023-12-16T20:11:29.292 INFO:tasks.workunit.client.1.smithi141.stdout:2/55: rmdir d6 39 2023-12-16T20:11:29.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/348: dread da/f19 [0,4194304] 0 2023-12-16T20:11:29.295 INFO:tasks.workunit.client.1.smithi141.stdout:5/94: creat d0/d14/f1b x:0 0 0 2023-12-16T20:11:29.295 INFO:tasks.workunit.client.1.smithi141.stdout:5/95: dread - d0/d9/f13 zero size 2023-12-16T20:11:29.295 INFO:tasks.workunit.client.1.smithi141.stdout:5/96: rename d0 to d0/d9/d1c 22 2023-12-16T20:11:29.295 INFO:tasks.workunit.client.1.smithi141.stdout:5/97: dread - d0/d9/f13 zero size 2023-12-16T20:11:29.295 INFO:tasks.workunit.client.0.smithi038.stdout:7/349: dread da/d21/d2c/f30 [0,4194304] 0 2023-12-16T20:11:29.296 INFO:tasks.workunit.client.1.smithi141.stdout:9/118: getdents d1/d26 0 2023-12-16T20:11:29.296 INFO:tasks.workunit.client.1.smithi141.stdout:9/119: write d1/d10/d14/d20/fb [1083863,46200] 0 2023-12-16T20:11:29.296 INFO:tasks.workunit.client.1.smithi141.stdout:6/134: dread d1/dd/de/f29 [0,4194304] 0 2023-12-16T20:11:29.299 INFO:tasks.workunit.client.1.smithi141.stdout:2/56: mkdir d6/da/db/d14 0 2023-12-16T20:11:29.299 INFO:tasks.workunit.client.0.smithi038.stdout:6/424: getdents d1/d2e 0 2023-12-16T20:11:29.302 INFO:tasks.workunit.client.0.smithi038.stdout:2/541: truncate d1/d5/d16/f2e 3869927 0 2023-12-16T20:11:29.302 INFO:tasks.workunit.client.1.smithi141.stdout:5/98: rename d0/f17 to d0/df/f1d 0 2023-12-16T20:11:29.303 INFO:tasks.workunit.client.1.smithi141.stdout:5/99: chown d0/d14 214 1 2023-12-16T20:11:29.306 INFO:tasks.workunit.client.0.smithi038.stdout:5/507: unlink d2/d4/ca 0 2023-12-16T20:11:29.306 INFO:tasks.workunit.client.0.smithi038.stdout:7/350: dread f6 [4194304,4194304] 0 2023-12-16T20:11:29.306 INFO:tasks.workunit.client.0.smithi038.stdout:7/351: fsync da/d21/f25 0 2023-12-16T20:11:29.306 INFO:tasks.workunit.client.0.smithi038.stdout:9/412: getdents d9/d1f/d21/d52 0 2023-12-16T20:11:29.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/413: write d9/d1f/d21/d3e/f69 [4513471,39107] 0 2023-12-16T20:11:29.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/414: write d9/fe [5156567,85284] 0 2023-12-16T20:11:29.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/415: read d9/fe [1046090,41067] 0 2023-12-16T20:11:29.309 INFO:tasks.workunit.client.0.smithi038.stdout:0/436: symlink db/d16/d19/d27/l91 0 2023-12-16T20:11:29.310 INFO:tasks.workunit.client.0.smithi038.stdout:6/425: write d1/d4/d1d/d28/d2f/d3d/f51 [1131640,93293] 0 2023-12-16T20:11:29.310 INFO:tasks.workunit.client.1.smithi141.stdout:2/57: rename d6/da/db/d14 to d6/d12/d15 0 2023-12-16T20:11:29.311 INFO:tasks.workunit.client.1.smithi141.stdout:2/58: chown d6/d12 119299 1 2023-12-16T20:11:29.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/542: creat d1/d5/d95/fb4 x:0 0 0 2023-12-16T20:11:29.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/543: creat d1/df/d10/fb5 x:0 0 0 2023-12-16T20:11:29.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/544: readlink d1/d5/d16/l22 0 2023-12-16T20:11:29.312 INFO:tasks.workunit.client.1.smithi141.stdout:6/135: getdents d1/d3 0 2023-12-16T20:11:29.314 INFO:tasks.workunit.client.0.smithi038.stdout:7/352: write da/d21/d2c/d2e/f5f [1651044,12482] 0 2023-12-16T20:11:29.315 INFO:tasks.workunit.client.1.smithi141.stdout:6/136: unlink d1/dd/f1d 0 2023-12-16T20:11:29.315 INFO:tasks.workunit.client.1.smithi141.stdout:6/137: fsync d1/dd/de/f29 0 2023-12-16T20:11:29.315 INFO:tasks.workunit.client.1.smithi141.stdout:6/138: truncate d1/d12/d22/f2a 883130 0 2023-12-16T20:11:29.315 INFO:tasks.workunit.client.1.smithi141.stdout:2/59: link d6/c10 d6/c16 0 2023-12-16T20:11:29.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/434: sync 2023-12-16T20:11:29.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/435: write d4/d8/f84 [91122,7338] 0 2023-12-16T20:11:29.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/436: creat d4/d8/d15/d2c/f95 x:0 0 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.1.smithi141.stdout:6/139: rename d1/l13 to d1/d12/d22/d31/l39 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/416: unlink d9/fe 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/417: creat d9/d1e/d3d/f7b x:0 0 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/289: dwrite f1 [0,4194304] 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.0.smithi038.stdout:2/545: dread d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:29.318 INFO:tasks.workunit.client.0.smithi038.stdout:2/546: fsync d1/d5/f4e 0 2023-12-16T20:11:29.319 INFO:tasks.workunit.client.0.smithi038.stdout:2/547: chown d1/df/d10/d23/d3a/f56 8280059 1 2023-12-16T20:11:29.319 INFO:tasks.workunit.client.0.smithi038.stdout:0/437: creat db/d16/d19/d80/f92 x:0 0 0 2023-12-16T20:11:29.320 INFO:tasks.workunit.client.0.smithi038.stdout:6/426: mknod d1/d4/d1d/d67/d73/c88 0 2023-12-16T20:11:29.320 INFO:tasks.workunit.client.0.smithi038.stdout:6/427: chown d1/f6c 7 1 2023-12-16T20:11:29.321 INFO:tasks.workunit.client.1.smithi141.stdout:2/60: creat d6/f17 x:0 0 0 2023-12-16T20:11:29.322 INFO:tasks.workunit.client.0.smithi038.stdout:7/353: dread da/d24/d4d/d51/f60 [0,4194304] 0 2023-12-16T20:11:29.322 INFO:tasks.workunit.client.0.smithi038.stdout:7/354: dread - da/d24/f6f zero size 2023-12-16T20:11:29.322 INFO:tasks.workunit.client.0.smithi038.stdout:5/508: write d2/d4/d62/f77 [3102952,95287] 0 2023-12-16T20:11:29.328 INFO:tasks.workunit.client.1.smithi141.stdout:6/140: dread d1/f4 [0,4194304] 0 2023-12-16T20:11:29.328 INFO:tasks.workunit.client.0.smithi038.stdout:9/418: symlink d9/d1f/d6a/l7c 0 2023-12-16T20:11:29.329 INFO:tasks.workunit.client.1.smithi141.stdout:6/141: unlink d1/dd/f9 0 2023-12-16T20:11:29.330 INFO:tasks.workunit.client.0.smithi038.stdout:8/290: readlink d17/l30 0 2023-12-16T20:11:29.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/437: dwrite d4/d27/d2b/f5b [0,4194304] 0 2023-12-16T20:11:29.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/438: stat d4/d27/d23 0 2023-12-16T20:11:29.332 INFO:tasks.workunit.client.1.smithi141.stdout:6/142: dread d1/f17 [0,4194304] 0 2023-12-16T20:11:29.333 INFO:tasks.workunit.client.0.smithi038.stdout:2/548: truncate d1/d5/d2a/f35 891251 0 2023-12-16T20:11:29.333 INFO:tasks.workunit.client.0.smithi038.stdout:2/549: creat d1/df/d10/d23/d3a/fb6 x:0 0 0 2023-12-16T20:11:29.333 INFO:tasks.workunit.client.0.smithi038.stdout:2/550: creat d1/d5/d95/fb7 x:0 0 0 2023-12-16T20:11:29.333 INFO:tasks.workunit.client.0.smithi038.stdout:0/438: readlink db/d16/d19/d27/l29 0 2023-12-16T20:11:29.334 INFO:tasks.workunit.client.1.smithi141.stdout:9/120: dread d1/d26/f2f [0,4194304] 0 2023-12-16T20:11:29.335 INFO:tasks.workunit.client.0.smithi038.stdout:6/428: symlink d1/d4/d1d/d61/l89 0 2023-12-16T20:11:29.336 INFO:tasks.workunit.client.1.smithi141.stdout:9/121: creat d1/d10/d14/f31 x:0 0 0 2023-12-16T20:11:29.336 INFO:tasks.workunit.client.1.smithi141.stdout:9/122: fsync d1/f6 0 2023-12-16T20:11:29.337 INFO:tasks.workunit.client.0.smithi038.stdout:7/355: creat da/d21/d68/f78 x:0 0 0 2023-12-16T20:11:29.338 INFO:tasks.workunit.client.1.smithi141.stdout:6/143: dread d1/f19 [0,4194304] 0 2023-12-16T20:11:29.338 INFO:tasks.workunit.client.1.smithi141.stdout:6/144: truncate d1/f4 4797394 0 2023-12-16T20:11:29.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/509: mknod d2/d81/c9f 0 2023-12-16T20:11:29.340 INFO:tasks.workunit.client.1.smithi141.stdout:6/145: mkdir d1/d12/d20/d3a 0 2023-12-16T20:11:29.341 INFO:tasks.workunit.client.0.smithi038.stdout:9/419: creat d9/d1e/d3d/d42/d59/f7d x:0 0 0 2023-12-16T20:11:29.341 INFO:tasks.workunit.client.0.smithi038.stdout:9/420: creat d9/d1f/d21/f7e x:0 0 0 2023-12-16T20:11:29.342 INFO:tasks.workunit.client.0.smithi038.stdout:3/439: write d4/f14 [3747527,50517] 0 2023-12-16T20:11:29.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/291: mknod d17/d1b/d53/c56 0 2023-12-16T20:11:29.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/292: dread - d17/d1b/f3f zero size 2023-12-16T20:11:29.343 INFO:tasks.workunit.client.1.smithi141.stdout:6/146: link d1/f17 d1/dd/d2f/f3b 0 2023-12-16T20:11:29.343 INFO:tasks.workunit.client.1.smithi141.stdout:6/147: getdents d1/d12/d22/d25/d38 0 2023-12-16T20:11:29.347 INFO:tasks.workunit.client.0.smithi038.stdout:0/439: mknod db/d1a/d77/c93 0 2023-12-16T20:11:29.347 INFO:tasks.workunit.client.0.smithi038.stdout:0/440: stat db/d16/d19/d80/f92 0 2023-12-16T20:11:29.348 INFO:tasks.workunit.client.1.smithi141.stdout:6/148: creat d1/dd/f3c x:0 0 0 2023-12-16T20:11:29.349 INFO:tasks.workunit.client.0.smithi038.stdout:7/356: symlink da/d3e/d31/l79 0 2023-12-16T20:11:29.349 INFO:tasks.workunit.client.0.smithi038.stdout:5/510: dread d2/df/d1a/f27 [0,4194304] 0 2023-12-16T20:11:29.350 INFO:tasks.workunit.client.1.smithi141.stdout:6/149: creat d1/d12/d20/f3d x:0 0 0 2023-12-16T20:11:29.351 INFO:tasks.workunit.client.1.smithi141.stdout:6/150: creat d1/d12/d22/d25/d38/f3e x:0 0 0 2023-12-16T20:11:29.352 INFO:tasks.workunit.client.0.smithi038.stdout:6/429: dwrite d1/d2e/f47 [0,4194304] 0 2023-12-16T20:11:29.352 INFO:tasks.workunit.client.1.smithi141.stdout:6/151: getdents d1/d12/d22/d31 0 2023-12-16T20:11:29.352 INFO:tasks.workunit.client.1.smithi141.stdout:6/152: readlink d1/d3/lc 0 2023-12-16T20:11:29.355 INFO:tasks.workunit.client.0.smithi038.stdout:9/421: rmdir d9/d1e/d3d/d42/d59/d76 39 2023-12-16T20:11:29.355 INFO:tasks.workunit.client.0.smithi038.stdout:9/422: chown d9/d1e/d40/f41 4 1 2023-12-16T20:11:29.359 INFO:tasks.workunit.client.0.smithi038.stdout:0/441: symlink db/l94 0 2023-12-16T20:11:29.359 INFO:tasks.workunit.client.0.smithi038.stdout:0/442: dread - db/f5b zero size 2023-12-16T20:11:29.359 INFO:tasks.workunit.client.0.smithi038.stdout:0/443: dread - db/d1a/f85 zero size 2023-12-16T20:11:29.360 INFO:tasks.workunit.client.0.smithi038.stdout:7/357: creat da/d21/d41/f7a x:0 0 0 2023-12-16T20:11:29.360 INFO:tasks.workunit.client.0.smithi038.stdout:7/358: chown da/d21/f28 57169304 1 2023-12-16T20:11:29.360 INFO:tasks.workunit.client.0.smithi038.stdout:7/359: creat da/d21/d41/f7b x:0 0 0 2023-12-16T20:11:29.361 INFO:tasks.workunit.client.0.smithi038.stdout:5/511: symlink d2/d14/d25/d2d/d2f/d98/la0 0 2023-12-16T20:11:29.361 INFO:tasks.workunit.client.0.smithi038.stdout:5/512: write d2/df/d1a/f46 [1595194,53522] 0 2023-12-16T20:11:29.361 INFO:tasks.workunit.client.0.smithi038.stdout:5/513: chown d2/d14 61270 1 2023-12-16T20:11:29.365 INFO:tasks.workunit.client.0.smithi038.stdout:8/293: dwrite d17/f40 [4194304,4194304] 0 2023-12-16T20:11:29.365 INFO:tasks.workunit.client.0.smithi038.stdout:6/430: unlink d1/d4/d1d/f7e 0 2023-12-16T20:11:29.367 INFO:tasks.workunit.client.1.smithi141.stdout:6/153: rmdir d1/dd 39 2023-12-16T20:11:29.369 INFO:tasks.workunit.client.1.smithi141.stdout:6/154: mknod d1/c3f 0 2023-12-16T20:11:29.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/444: mkdir db/d1a/d77/d95 0 2023-12-16T20:11:29.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/445: dread - db/d16/d1c/d5d/f8d zero size 2023-12-16T20:11:29.371 INFO:tasks.workunit.client.1.smithi141.stdout:6/155: link d1/d3/l7 d1/d12/d22/l40 0 2023-12-16T20:11:29.373 INFO:tasks.workunit.client.0.smithi038.stdout:0/446: creat db/d16/d70/d7c/f96 x:0 0 0 2023-12-16T20:11:29.373 INFO:tasks.workunit.client.0.smithi038.stdout:0/447: chown db/d16 8 1 2023-12-16T20:11:29.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/431: write d1/d4/f1c [2542350,66776] 0 2023-12-16T20:11:29.374 INFO:tasks.workunit.client.1.smithi141.stdout:6/156: unlink d1/dd/f3c 0 2023-12-16T20:11:29.375 INFO:tasks.workunit.client.0.smithi038.stdout:7/360: link da/d21/d2c/d2e/f5f da/d3e/f7c 0 2023-12-16T20:11:29.375 INFO:tasks.workunit.client.0.smithi038.stdout:7/361: fdatasync da/d21/d2c/f36 0 2023-12-16T20:11:29.375 INFO:tasks.workunit.client.1.smithi141.stdout:6/157: unlink d1/d12/d22/d25/l32 0 2023-12-16T20:11:29.375 INFO:tasks.workunit.client.1.smithi141.stdout:6/158: chown d1/dd/d2f/f3b 8 1 2023-12-16T20:11:29.376 INFO:tasks.workunit.client.1.smithi141.stdout:6/159: readlink d1/d3/lc 0 2023-12-16T20:11:29.376 INFO:tasks.workunit.client.0.smithi038.stdout:8/294: getdents d17/d1b 0 2023-12-16T20:11:29.377 INFO:tasks.workunit.client.0.smithi038.stdout:0/448: chown db/d16/d19/d27/c5e 159186 1 2023-12-16T20:11:29.378 INFO:tasks.workunit.client.0.smithi038.stdout:6/432: mkdir d1/d4/d1d/d8a 0 2023-12-16T20:11:29.378 INFO:tasks.workunit.client.0.smithi038.stdout:6/433: write d1/f25 [3018456,100869] 0 2023-12-16T20:11:29.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/362: rename da/d21/d2c/l63 to da/d21/d2c/d76/l7d 0 2023-12-16T20:11:29.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/363: stat da/d24/d4d/d51/f60 0 2023-12-16T20:11:29.384 INFO:tasks.workunit.client.0.smithi038.stdout:8/295: mkdir d17/d1b/d57 0 2023-12-16T20:11:29.384 INFO:tasks.workunit.client.0.smithi038.stdout:8/296: chown d17/d34/d3d/l46 249267607 1 2023-12-16T20:11:29.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/449: mkdir db/d16/d70/d97 0 2023-12-16T20:11:29.385 INFO:tasks.workunit.client.0.smithi038.stdout:9/423: dwrite d9/d1e/d3d/f7b [0,4194304] 0 2023-12-16T20:11:29.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/434: creat d1/d4/d1d/d28/d2f/d85/f8b x:0 0 0 2023-12-16T20:11:29.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/435: chown d1/d4/d1d/d28/l82 55 1 2023-12-16T20:11:29.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/436: fsync d1/f56 0 2023-12-16T20:11:29.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/514: dwrite d2/f12 [0,4194304] 0 2023-12-16T20:11:29.389 INFO:tasks.workunit.client.0.smithi038.stdout:0/450: rename db/d16/d70/f6b to db/d16/d19/f98 0 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr fail", "who": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "mgr fail", "who": "smithi038.gdlrfj"}]': finished 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: mgrmap e21: smithi141.cycgjd(active, starting, since 0.0164862s) 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:11:29.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: Manager daemon smithi141.cycgjd is now available 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/trash_purge_schedule"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/trash_purge_schedule"}]: dispatch 2023-12-16T20:11:29.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:29 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.397 INFO:tasks.workunit.client.0.smithi038.stdout:6/437: getdents d1/d5b/d7d 0 2023-12-16T20:11:29.397 INFO:tasks.workunit.client.0.smithi038.stdout:5/515: creat d2/d14/d25/d2d/d17/d51/d7b/fa1 x:0 0 0 2023-12-16T20:11:29.397 INFO:tasks.workunit.client.0.smithi038.stdout:8/297: symlink d17/d1b/d53/l58 0 2023-12-16T20:11:29.398 INFO:tasks.workunit.client.1.smithi141.stdout:7/52: sync 2023-12-16T20:11:29.398 INFO:tasks.workunit.client.0.smithi038.stdout:0/451: unlink f1 0 2023-12-16T20:11:29.398 INFO:tasks.workunit.client.0.smithi038.stdout:0/452: creat db/d16/d19/d27/d56/f99 x:0 0 0 2023-12-16T20:11:29.400 INFO:tasks.workunit.client.1.smithi141.stdout:6/160: dwrite d1/fa [0,4194304] 0 2023-12-16T20:11:29.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/364: dwrite da/d24/d4d/f6c [0,4194304] 0 2023-12-16T20:11:29.402 INFO:tasks.workunit.client.1.smithi141.stdout:6/161: symlink d1/dd/l41 0 2023-12-16T20:11:29.403 INFO:tasks.workunit.client.1.smithi141.stdout:6/162: truncate d1/d12/d22/d25/d38/f3e 980623 0 2023-12-16T20:11:29.403 INFO:tasks.workunit.client.0.smithi038.stdout:9/424: rmdir d9/d1f 39 2023-12-16T20:11:29.403 INFO:tasks.workunit.client.0.smithi038.stdout:9/425: write d9/d1e/f74 [13629,128462] 0 2023-12-16T20:11:29.404 INFO:tasks.workunit.client.0.smithi038.stdout:6/438: getdents d1/d4/d1d/d61 0 2023-12-16T20:11:29.405 INFO:tasks.workunit.client.1.smithi141.stdout:6/163: unlink d1/dd/f23 0 2023-12-16T20:11:29.405 INFO:tasks.workunit.client.1.smithi141.stdout:6/164: stat d1/f17 0 2023-12-16T20:11:29.405 INFO:tasks.workunit.client.1.smithi141.stdout:6/165: read - d1/d12/d20/f3d zero size 2023-12-16T20:11:29.407 INFO:tasks.workunit.client.1.smithi141.stdout:6/166: write d1/d12/d22/d25/d38/f3e [16323,93633] 0 2023-12-16T20:11:29.407 INFO:tasks.workunit.client.0.smithi038.stdout:0/453: read db/f14 [3767406,88983] 0 2023-12-16T20:11:29.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/298: mkdir d17/d34/d3d/d59 0 2023-12-16T20:11:29.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/299: dread - d17/f24 zero size 2023-12-16T20:11:29.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/300: truncate f16 8722282 0 2023-12-16T20:11:29.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/301: truncate d17/d34/f36 991071 0 2023-12-16T20:11:29.410 INFO:tasks.workunit.client.1.smithi141.stdout:6/167: rename d1/c3f to d1/d12/d20/c42 0 2023-12-16T20:11:29.415 INFO:tasks.workunit.client.0.smithi038.stdout:7/365: truncate da/d21/d2c/d2e/f16 1651454 0 2023-12-16T20:11:29.417 INFO:tasks.workunit.client.0.smithi038.stdout:0/454: symlink db/d16/d19/d4e/l9a 0 2023-12-16T20:11:29.417 INFO:tasks.workunit.client.0.smithi038.stdout:0/455: write db/d16/d1c/f24 [1876251,22824] 0 2023-12-16T20:11:29.419 INFO:tasks.workunit.client.0.smithi038.stdout:7/366: symlink da/d21/d2c/d2e/l7e 0 2023-12-16T20:11:29.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/439: dread d1/d4/f1c [0,4194304] 0 2023-12-16T20:11:29.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/440: rename d1/d4 to d1/d4/d1d/d28/d2f/d3d/d8c 22 2023-12-16T20:11:29.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/441: write d1/d16/f44 [256881,108942] 0 2023-12-16T20:11:29.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/442: chown d1/d4/d1d 71 1 2023-12-16T20:11:29.421 INFO:tasks.workunit.client.0.smithi038.stdout:0/456: truncate f8 852110 0 2023-12-16T20:11:29.421 INFO:tasks.workunit.client.0.smithi038.stdout:0/457: write db/d16/d19/d27/d56/f99 [884704,36265] 0 2023-12-16T20:11:29.422 INFO:tasks.workunit.client.0.smithi038.stdout:0/458: write db/d16/d19/d27/f3b [675620,59558] 0 2023-12-16T20:11:29.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/302: dread f13 [8388608,4194304] 0 2023-12-16T20:11:29.423 INFO:tasks.workunit.client.0.smithi038.stdout:0/459: rmdir db/d16/d70/d97 0 2023-12-16T20:11:29.423 INFO:tasks.workunit.client.0.smithi038.stdout:0/460: dread - db/d16/d70/f74 zero size 2023-12-16T20:11:29.425 INFO:tasks.workunit.client.0.smithi038.stdout:5/516: dwrite d2/df/d1a/d1f/d4a/f52 [0,4194304] 0 2023-12-16T20:11:29.425 INFO:tasks.workunit.client.0.smithi038.stdout:5/517: chown d2/d14/d25/d2d/d17/d51/d7b/fa1 2364 1 2023-12-16T20:11:29.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/461: mknod db/d16/d5a/d65/c9b 0 2023-12-16T20:11:29.426 INFO:tasks.workunit.client.0.smithi038.stdout:8/303: mkdir d17/d5a 0 2023-12-16T20:11:29.427 INFO:tasks.workunit.client.1.smithi141.stdout:7/53: dwrite d5/f8 [0,4194304] 0 2023-12-16T20:11:29.428 INFO:tasks.workunit.client.0.smithi038.stdout:9/426: dwrite d9/d1f/d21/d55/f65 [0,4194304] 0 2023-12-16T20:11:29.429 INFO:tasks.workunit.client.1.smithi141.stdout:6/168: rmdir d1/d12/d22/d25 39 2023-12-16T20:11:29.429 INFO:tasks.workunit.client.1.smithi141.stdout:6/169: stat d1/f4 0 2023-12-16T20:11:29.429 INFO:tasks.workunit.client.0.smithi038.stdout:5/518: mknod d2/df/d87/ca2 0 2023-12-16T20:11:29.429 INFO:tasks.workunit.client.0.smithi038.stdout:5/519: dread - d2/df/d1a/d1f/d4a/d53/d6e/f8d zero size 2023-12-16T20:11:29.430 INFO:tasks.workunit.client.1.smithi141.stdout:7/54: symlink d5/l9 0 2023-12-16T20:11:29.430 INFO:tasks.workunit.client.1.smithi141.stdout:7/55: stat d5/f8 0 2023-12-16T20:11:29.433 INFO:tasks.workunit.client.0.smithi038.stdout:0/462: mknod db/d16/d1c/d5d/c9c 0 2023-12-16T20:11:29.433 INFO:tasks.workunit.client.0.smithi038.stdout:0/463: stat db/d16/d19/d27/d78 0 2023-12-16T20:11:29.433 INFO:tasks.workunit.client.0.smithi038.stdout:0/464: dread - db/d16/d19/f98 zero size 2023-12-16T20:11:29.433 INFO:tasks.workunit.client.0.smithi038.stdout:0/465: chown db/d16/f8c 0 1 2023-12-16T20:11:29.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/520: dread d2/df/d1a/d2a/f68 [0,4194304] 0 2023-12-16T20:11:29.437 INFO:tasks.workunit.client.0.smithi038.stdout:9/427: truncate d9/d1f/f38 132416 0 2023-12-16T20:11:29.440 INFO:tasks.workunit.client.0.smithi038.stdout:0/466: creat db/d16/d19/d4e/f9d x:0 0 0 2023-12-16T20:11:29.443 INFO:tasks.workunit.client.0.smithi038.stdout:8/304: rename d17/d18 to d17/d5b 0 2023-12-16T20:11:29.443 INFO:tasks.workunit.client.0.smithi038.stdout:9/428: dread d9/f18 [0,4194304] 0 2023-12-16T20:11:29.444 INFO:tasks.workunit.client.1.smithi141.stdout:6/170: dread d1/d3/f10 [0,4194304] 0 2023-12-16T20:11:29.444 INFO:tasks.workunit.client.1.smithi141.stdout:6/171: write d1/d12/f33 [314562,120947] 0 2023-12-16T20:11:29.444 INFO:tasks.workunit.client.1.smithi141.stdout:7/56: dread d5/f8 [0,4194304] 0 2023-12-16T20:11:29.444 INFO:tasks.workunit.client.0.smithi038.stdout:5/521: mknod d2/d4/d62/ca3 0 2023-12-16T20:11:29.445 INFO:tasks.workunit.client.0.smithi038.stdout:5/522: dread - d2/df/d1a/d2a/f91 zero size 2023-12-16T20:11:29.445 INFO:tasks.workunit.client.0.smithi038.stdout:0/467: truncate db/d16/d70/d7c/f7e 199870 0 2023-12-16T20:11:29.446 INFO:tasks.workunit.client.1.smithi141.stdout:6/172: mkdir d1/dd/d43 0 2023-12-16T20:11:29.447 INFO:tasks.workunit.client.1.smithi141.stdout:6/173: mkdir d1/d12/d20/d44 0 2023-12-16T20:11:29.447 INFO:tasks.workunit.client.0.smithi038.stdout:6/443: dwrite d1/d4/d1d/d28/d2f/d3d/f46 [4194304,4194304] 0 2023-12-16T20:11:29.447 INFO:tasks.workunit.client.0.smithi038.stdout:6/444: dread - d1/d4/f75 zero size 2023-12-16T20:11:29.448 INFO:tasks.workunit.client.1.smithi141.stdout:6/174: mkdir d1/d12/d20/d3a/d45 0 2023-12-16T20:11:29.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/367: dwrite da/d21/f28 [4194304,4194304] 0 2023-12-16T20:11:29.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/368: chown da/d3e/d31 0 1 2023-12-16T20:11:29.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/369: stat da/d21/d2c 0 2023-12-16T20:11:29.449 INFO:tasks.workunit.client.0.smithi038.stdout:9/429: symlink d9/d1e/d45/l7f 0 2023-12-16T20:11:29.449 INFO:tasks.workunit.client.1.smithi141.stdout:7/57: getdents d5 0 2023-12-16T20:11:29.451 INFO:tasks.workunit.client.0.smithi038.stdout:5/523: unlink d2/d4/ce 0 2023-12-16T20:11:29.451 INFO:tasks.workunit.client.1.smithi141.stdout:6/175: mknod d1/d12/d20/d44/c46 0 2023-12-16T20:11:29.451 INFO:tasks.workunit.client.1.smithi141.stdout:7/58: mknod d5/ca 0 2023-12-16T20:11:29.453 INFO:tasks.workunit.client.1.smithi141.stdout:7/59: rename d5/ca to d5/cb 0 2023-12-16T20:11:29.458 INFO:tasks.workunit.client.0.smithi038.stdout:6/445: write d1/f22 [6026796,44723] 0 2023-12-16T20:11:29.458 INFO:tasks.workunit.client.0.smithi038.stdout:8/305: creat d17/d1b/d25/f5c x:0 0 0 2023-12-16T20:11:29.461 INFO:tasks.workunit.client.1.smithi141.stdout:7/60: read d5/f8 [2040454,42250] 0 2023-12-16T20:11:29.463 INFO:tasks.workunit.client.0.smithi038.stdout:7/370: rename da/f70 to da/d21/d41/d6b/f7f 0 2023-12-16T20:11:29.466 INFO:tasks.workunit.client.0.smithi038.stdout:9/430: creat d9/f80 x:0 0 0 2023-12-16T20:11:29.466 INFO:tasks.workunit.client.0.smithi038.stdout:9/431: readlink d9/d1e/d3d/l4d 0 2023-12-16T20:11:29.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/176: dwrite d1/f17 [0,4194304] 0 2023-12-16T20:11:29.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/177: readlink d1/d3/lc 0 2023-12-16T20:11:29.470 INFO:tasks.workunit.client.0.smithi038.stdout:5/524: creat d2/df/d1a/d2a/d59/fa4 x:0 0 0 2023-12-16T20:11:29.471 INFO:tasks.workunit.client.0.smithi038.stdout:0/468: getdents db 0 2023-12-16T20:11:29.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/306: rename d17/d1b/d53/l58 to d17/d34/d3d/d45/d54/l5d 0 2023-12-16T20:11:29.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/307: write d17/d34/d3d/f4c [67053,73996] 0 2023-12-16T20:11:29.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/308: dread - d17/d5b/f2a zero size 2023-12-16T20:11:29.477 INFO:tasks.workunit.client.0.smithi038.stdout:9/432: link d9/d1f/d21/f3a d9/f81 0 2023-12-16T20:11:29.486 INFO:tasks.workunit.client.0.smithi038.stdout:5/525: write d2/d14/f22 [2340348,45769] 0 2023-12-16T20:11:29.488 INFO:tasks.workunit.client.0.smithi038.stdout:8/309: symlink d17/d1b/d25/l5e 0 2023-12-16T20:11:29.490 INFO:tasks.workunit.client.0.smithi038.stdout:9/433: unlink d9/d1f/d21/l36 0 2023-12-16T20:11:29.490 INFO:tasks.workunit.client.1.smithi141.stdout:7/61: dwrite d5/f8 [4194304,4194304] 0 2023-12-16T20:11:29.491 INFO:tasks.workunit.client.0.smithi038.stdout:8/310: symlink d17/d34/d3d/d59/l5f 0 2023-12-16T20:11:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/311: chown d17/d34/d3d/d45/d55 93 1 2023-12-16T20:11:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/312: stat f13 0 2023-12-16T20:11:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/313: read - d17/f24 zero size 2023-12-16T20:11:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/314: write d17/d1b/d25/f5c [42679,52241] 0 2023-12-16T20:11:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/315: chown d17/f38 29153410 1 2023-12-16T20:11:29.494 INFO:tasks.workunit.client.1.smithi141.stdout:7/62: unlink d5/l7 0 2023-12-16T20:11:29.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:29.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:11:29.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr fail", "who": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.14214 172.21.15.38:0/1911940506' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "mgr fail", "who": "smithi038.gdlrfj"}]': finished 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: mgrmap e21: smithi141.cycgjd(active, starting, since 0.0164862s) 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:11:29.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:11:29.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:11:29.498 INFO:tasks.workunit.client.0.smithi038.stdout:8/316: dread f10 [4194304,4194304] 0 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: Manager daemon smithi141.cycgjd is now available 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/trash_purge_schedule"}]: dispatch 2023-12-16T20:11:29.498 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi141.cycgjd/trash_purge_schedule"}]: dispatch 2023-12-16T20:11:29.499 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.499 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:29 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:29.508 INFO:tasks.workunit.client.0.smithi038.stdout:7/371: dwrite da/d21/d2c/d2e/f16 [0,4194304] 0 2023-12-16T20:11:29.508 INFO:tasks.workunit.client.0.smithi038.stdout:0/469: dwrite db/d16/d19/f46 [0,4194304] 0 2023-12-16T20:11:29.510 INFO:tasks.workunit.client.0.smithi038.stdout:7/372: symlink da/d21/d41/l80 0 2023-12-16T20:11:29.511 INFO:tasks.workunit.client.0.smithi038.stdout:0/470: mkdir db/d1a/d77/d95/d9e 0 2023-12-16T20:11:29.513 INFO:tasks.workunit.client.0.smithi038.stdout:9/434: dwrite d9/d1e/d40/f41 [0,4194304] 0 2023-12-16T20:11:29.513 INFO:tasks.workunit.client.0.smithi038.stdout:9/435: chown d9/d1e/d3d/d42 9934 1 2023-12-16T20:11:29.513 INFO:tasks.workunit.client.0.smithi038.stdout:9/436: chown d9/d1f/d21/d55/f56 1 1 2023-12-16T20:11:29.513 INFO:tasks.workunit.client.0.smithi038.stdout:9/437: readlink d9/d1e/l24 0 2023-12-16T20:11:29.516 INFO:tasks.workunit.client.0.smithi038.stdout:9/438: getdents d9/d1e/d45 0 2023-12-16T20:11:29.517 INFO:tasks.workunit.client.0.smithi038.stdout:9/439: getdents d9/d1f/d21/d3e/d4e/d61 0 2023-12-16T20:11:29.517 INFO:tasks.workunit.client.1.smithi141.stdout:6/178: dwrite d1/dd/d2f/f3b [0,4194304] 0 2023-12-16T20:11:29.519 INFO:tasks.workunit.client.1.smithi141.stdout:6/179: mkdir d1/d12/d20/d3a/d45/d47 0 2023-12-16T20:11:29.519 INFO:tasks.workunit.client.1.smithi141.stdout:6/180: readlink d1/d3/lc 0 2023-12-16T20:11:29.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/440: creat d9/d1f/d21/d52/f82 x:0 0 0 2023-12-16T20:11:29.519 INFO:tasks.workunit.client.1.smithi141.stdout:7/63: dwrite d5/f8 [0,4194304] 0 2023-12-16T20:11:29.520 INFO:tasks.workunit.client.0.smithi038.stdout:8/317: dread d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:29.521 INFO:tasks.workunit.client.0.smithi038.stdout:9/441: mkdir d9/d1e/d40/d5e/d71/d83 0 2023-12-16T20:11:29.521 INFO:tasks.workunit.client.0.smithi038.stdout:9/442: write d9/d1f/d21/d52/f82 [341904,127039] 0 2023-12-16T20:11:29.521 INFO:tasks.workunit.client.0.smithi038.stdout:9/443: chown d9/f1c 3604 1 2023-12-16T20:11:29.522 INFO:tasks.workunit.client.1.smithi141.stdout:6/181: mkdir d1/dd/d2f/d48 0 2023-12-16T20:11:29.522 INFO:tasks.workunit.client.1.smithi141.stdout:6/182: readlink d1/l2b 0 2023-12-16T20:11:29.523 INFO:tasks.workunit.client.1.smithi141.stdout:6/183: symlink d1/d3/l49 0 2023-12-16T20:11:29.523 INFO:tasks.workunit.client.1.smithi141.stdout:6/184: chown d1/d12/d22/d25/d38 8637193 1 2023-12-16T20:11:29.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/318: rename d17/d5b/c42 to d17/d1b/d25/c60 0 2023-12-16T20:11:29.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/319: creat d17/d34/f61 x:0 0 0 2023-12-16T20:11:29.528 INFO:tasks.workunit.client.0.smithi038.stdout:9/444: mkdir d9/d1f/d21/d84 0 2023-12-16T20:11:29.528 INFO:tasks.workunit.client.0.smithi038.stdout:0/471: read db/d16/d19/d27/f34 [1835509,80657] 0 2023-12-16T20:11:29.528 INFO:tasks.workunit.client.0.smithi038.stdout:5/526: dwrite d2/d14/d25/f5b [4194304,4194304] 0 2023-12-16T20:11:29.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/445: symlink d9/d1e/d45/l85 0 2023-12-16T20:11:29.531 INFO:tasks.workunit.client.0.smithi038.stdout:7/373: dwrite da/d21/d2c/d2e/f15 [0,4194304] 0 2023-12-16T20:11:29.531 INFO:tasks.workunit.client.0.smithi038.stdout:7/374: write da/d21/d61/f66 [560717,95572] 0 2023-12-16T20:11:29.532 INFO:tasks.workunit.client.0.smithi038.stdout:0/472: mkdir db/d1a/d77/d95/d9f 0 2023-12-16T20:11:29.535 INFO:tasks.workunit.client.1.smithi141.stdout:6/185: write d1/dd/f1e [4082648,102512] 0 2023-12-16T20:11:29.542 INFO:tasks.workunit.client.1.smithi141.stdout:6/186: unlink d1/d3/c14 0 2023-12-16T20:11:29.542 INFO:tasks.workunit.client.1.smithi141.stdout:6/187: mkdir d1/d12/d20/d44/d4a 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/320: rename d17/d1b/l1f to d17/d1b/d57/l62 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/321: fdatasync d17/d34/f61 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:9/446: link d9/d1f/d21/f3a d9/d1f/d21/d3e/d72/f86 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:9/447: dread d9/d1e/f63 [0,4194304] 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:9/448: read d9/d1f/d21/f3a [800285,35416] 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/322: link d17/d34/d3d/f4b d17/d5a/f63 0 2023-12-16T20:11:29.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/323: chown l15 316104664 1 2023-12-16T20:11:29.544 INFO:tasks.workunit.client.1.smithi141.stdout:7/64: dwrite d5/f8 [0,4194304] 0 2023-12-16T20:11:29.550 INFO:tasks.workunit.client.0.smithi038.stdout:7/375: dread da/d21/d2c/f47 [0,4194304] 0 2023-12-16T20:11:29.550 INFO:tasks.workunit.client.0.smithi038.stdout:7/376: write da/d3e/d31/f39 [1794644,93889] 0 2023-12-16T20:11:29.552 INFO:tasks.workunit.client.0.smithi038.stdout:7/377: mkdir da/d3e/d31/d38/d65/d81 0 2023-12-16T20:11:29.552 INFO:tasks.workunit.client.0.smithi038.stdout:7/378: chown da/f5e 55098819 1 2023-12-16T20:11:29.557 INFO:tasks.workunit.client.0.smithi038.stdout:9/449: write d9/d1f/d21/f28 [7756858,98435] 0 2023-12-16T20:11:29.559 INFO:tasks.workunit.client.1.smithi141.stdout:7/65: dread d5/f8 [4194304,4194304] 0 2023-12-16T20:11:29.559 INFO:tasks.workunit.client.1.smithi141.stdout:7/66: chown c4 1 1 2023-12-16T20:11:29.560 INFO:tasks.workunit.client.0.smithi038.stdout:9/450: rmdir d9/d1f/d21/d55 39 2023-12-16T20:11:29.560 INFO:tasks.workunit.client.0.smithi038.stdout:0/473: dwrite db/d1a/f7b [0,4194304] 0 2023-12-16T20:11:29.560 INFO:tasks.workunit.client.0.smithi038.stdout:8/324: write d17/d5a/f63 [1062028,17755] 0 2023-12-16T20:11:29.562 INFO:tasks.workunit.client.1.smithi141.stdout:7/67: creat d5/fc x:0 0 0 2023-12-16T20:11:29.562 INFO:tasks.workunit.client.0.smithi038.stdout:9/451: write d9/d1f/d21/d3e/f49 [172045,61379] 0 2023-12-16T20:11:29.565 INFO:tasks.workunit.client.0.smithi038.stdout:0/474: unlink db/d16/f18 0 2023-12-16T20:11:29.565 INFO:tasks.workunit.client.0.smithi038.stdout:0/475: fsync db/d16/d70/d7c/f7e 0 2023-12-16T20:11:29.569 INFO:tasks.workunit.client.1.smithi141.stdout:7/68: rename d5/l9 to d5/ld 0 2023-12-16T20:11:29.569 INFO:tasks.workunit.client.1.smithi141.stdout:7/69: write d5/fc [455893,97570] 0 2023-12-16T20:11:29.571 INFO:tasks.workunit.client.1.smithi141.stdout:7/70: creat d5/fe x:0 0 0 2023-12-16T20:11:29.574 INFO:tasks.workunit.client.1.smithi141.stdout:7/71: mkdir d5/df 0 2023-12-16T20:11:29.574 INFO:tasks.workunit.client.1.smithi141.stdout:7/72: write d5/fc [1289182,93772] 0 2023-12-16T20:11:29.575 INFO:tasks.workunit.client.1.smithi141.stdout:6/188: dwrite d1/d12/d22/d25/d38/f3e [0,4194304] 0 2023-12-16T20:11:29.578 INFO:tasks.workunit.client.1.smithi141.stdout:7/73: creat d5/f10 x:0 0 0 2023-12-16T20:11:29.578 INFO:tasks.workunit.client.1.smithi141.stdout:7/74: chown d5/f10 837 1 2023-12-16T20:11:29.578 INFO:tasks.workunit.client.0.smithi038.stdout:0/476: write db/f10 [545622,127960] 0 2023-12-16T20:11:29.579 INFO:tasks.workunit.client.1.smithi141.stdout:6/189: truncate d1/f19 1908111 0 2023-12-16T20:11:29.579 INFO:tasks.workunit.client.1.smithi141.stdout:6/190: chown d1/d12 433951 1 2023-12-16T20:11:29.579 INFO:tasks.workunit.client.1.smithi141.stdout:6/191: write d1/d12/f33 [1293515,48828] 0 2023-12-16T20:11:29.580 INFO:tasks.workunit.client.0.smithi038.stdout:7/379: dwrite da/d21/d2c/d2e/f3c [0,4194304] 0 2023-12-16T20:11:29.580 INFO:tasks.workunit.client.0.smithi038.stdout:7/380: readlink da/d3e/d31/l57 0 2023-12-16T20:11:29.580 INFO:tasks.workunit.client.1.smithi141.stdout:7/75: creat d5/f11 x:0 0 0 2023-12-16T20:11:29.581 INFO:tasks.workunit.client.0.smithi038.stdout:0/477: rename db/d16/d70/f74 to db/d16/fa0 0 2023-12-16T20:11:29.581 INFO:tasks.workunit.client.0.smithi038.stdout:0/478: chown db/d16/d1c/d5d/c9c 10475 1 2023-12-16T20:11:29.582 INFO:tasks.workunit.client.0.smithi038.stdout:7/381: symlink da/d3e/d31/l82 0 2023-12-16T20:11:29.582 INFO:tasks.workunit.client.1.smithi141.stdout:7/76: rmdir d5/df 0 2023-12-16T20:11:29.582 INFO:tasks.workunit.client.1.smithi141.stdout:7/77: chown l2 1612 1 2023-12-16T20:11:29.583 INFO:tasks.workunit.client.0.smithi038.stdout:0/479: creat db/d16/d70/fa1 x:0 0 0 2023-12-16T20:11:29.584 INFO:tasks.workunit.client.1.smithi141.stdout:7/78: creat d5/f12 x:0 0 0 2023-12-16T20:11:29.584 INFO:tasks.workunit.client.1.smithi141.stdout:7/79: stat d5/f12 0 2023-12-16T20:11:29.585 INFO:tasks.workunit.client.0.smithi038.stdout:7/382: getdents da/d21/d41 0 2023-12-16T20:11:29.586 INFO:tasks.workunit.client.0.smithi038.stdout:0/480: getdents db/d16/d1c/d5d 0 2023-12-16T20:11:29.586 INFO:tasks.workunit.client.0.smithi038.stdout:7/383: stat da/f1d 0 2023-12-16T20:11:29.588 INFO:tasks.workunit.client.0.smithi038.stdout:0/481: rename db/d16/c25 to db/d16/d70/d7c/ca2 0 2023-12-16T20:11:29.588 INFO:tasks.workunit.client.0.smithi038.stdout:0/482: dread - db/d16/d19/d27/d56/f8a zero size 2023-12-16T20:11:29.588 INFO:tasks.workunit.client.0.smithi038.stdout:0/483: dread - db/d16/d1c/f62 zero size 2023-12-16T20:11:29.589 INFO:tasks.workunit.client.0.smithi038.stdout:0/484: symlink db/d16/d1c/d5d/d64/la3 0 2023-12-16T20:11:29.589 INFO:tasks.workunit.client.0.smithi038.stdout:0/485: write db/d16/d19/f46 [4671642,62551] 0 2023-12-16T20:11:29.590 INFO:tasks.workunit.client.0.smithi038.stdout:7/384: rename da/l33 to da/d21/d2c/d2e/l83 0 2023-12-16T20:11:29.591 INFO:tasks.workunit.client.0.smithi038.stdout:8/325: dwrite d17/d5b/f26 [0,4194304] 0 2023-12-16T20:11:29.592 INFO:tasks.workunit.client.0.smithi038.stdout:9/452: dwrite d9/d1e/d3d/d42/d59/d76/f78 [0,4194304] 0 2023-12-16T20:11:29.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/326: mknod d17/d1d/c64 0 2023-12-16T20:11:29.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/327: write d17/d34/d3d/f4c [260369,21113] 0 2023-12-16T20:11:29.601 INFO:tasks.workunit.client.1.smithi141.stdout:7/80: dread d5/fc [0,4194304] 0 2023-12-16T20:11:29.602 INFO:tasks.workunit.client.1.smithi141.stdout:7/81: chown d5/ld 778845 1 2023-12-16T20:11:29.602 INFO:tasks.workunit.client.1.smithi141.stdout:7/82: write d5/f10 [67847,34221] 0 2023-12-16T20:11:29.603 INFO:tasks.workunit.client.0.smithi038.stdout:8/328: dread d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:29.604 INFO:tasks.workunit.client.1.smithi141.stdout:7/83: creat d5/f13 x:0 0 0 2023-12-16T20:11:29.605 INFO:tasks.workunit.client.0.smithi038.stdout:9/453: rename d9/d1e/d3d/d42/d59/c5a to d9/d1f/d6c/c87 0 2023-12-16T20:11:29.607 INFO:tasks.workunit.client.0.smithi038.stdout:8/329: creat d17/d1b/d57/f65 x:0 0 0 2023-12-16T20:11:29.609 INFO:tasks.workunit.client.0.smithi038.stdout:7/385: dread da/d21/f28 [4194304,4194304] 0 2023-12-16T20:11:29.611 INFO:tasks.workunit.client.0.smithi038.stdout:8/330: mkdir d17/d1b/d66 0 2023-12-16T20:11:29.614 INFO:tasks.workunit.client.0.smithi038.stdout:8/331: creat d17/d34/d3d/d50/f67 x:0 0 0 2023-12-16T20:11:29.617 INFO:tasks.workunit.client.0.smithi038.stdout:8/332: fsync d17/d1b/f3f 0 2023-12-16T20:11:29.621 INFO:tasks.workunit.client.1.smithi141.stdout:7/84: dread d5/f8 [0,4194304] 0 2023-12-16T20:11:29.621 INFO:tasks.workunit.client.1.smithi141.stdout:7/85: dread - d5/f11 zero size 2023-12-16T20:11:29.621 INFO:tasks.workunit.client.0.smithi038.stdout:0/486: dwrite db/d16/d70/d7c/f96 [0,4194304] 0 2023-12-16T20:11:29.622 INFO:tasks.workunit.client.0.smithi038.stdout:8/333: symlink d17/d1b/d25/l68 0 2023-12-16T20:11:29.622 INFO:tasks.workunit.client.0.smithi038.stdout:8/334: write d17/d1b/d57/f65 [568051,1561] 0 2023-12-16T20:11:29.622 INFO:tasks.workunit.client.1.smithi141.stdout:6/192: dwrite d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:29.622 INFO:tasks.workunit.client.1.smithi141.stdout:7/86: creat d5/f14 x:0 0 0 2023-12-16T20:11:29.623 INFO:tasks.workunit.client.0.smithi038.stdout:8/335: dread d17/d1b/d25/f5c [0,4194304] 0 2023-12-16T20:11:29.624 INFO:tasks.workunit.client.1.smithi141.stdout:6/193: mkdir d1/d3/d4b 0 2023-12-16T20:11:29.624 INFO:tasks.workunit.client.1.smithi141.stdout:6/194: rename d1/d12 to d1/d12/d22/d4c 22 2023-12-16T20:11:29.624 INFO:tasks.workunit.client.1.smithi141.stdout:6/195: fsync d1/f17 0 2023-12-16T20:11:29.624 INFO:tasks.workunit.client.0.smithi038.stdout:0/487: mkdir db/d1a/d77/d95/da4 0 2023-12-16T20:11:29.626 INFO:tasks.workunit.client.1.smithi141.stdout:7/87: mknod d5/c15 0 2023-12-16T20:11:29.626 INFO:tasks.workunit.client.0.smithi038.stdout:0/488: getdents db/d16/d19 0 2023-12-16T20:11:29.628 INFO:tasks.workunit.client.1.smithi141.stdout:7/88: mkdir d5/d16 0 2023-12-16T20:11:29.628 INFO:tasks.workunit.client.0.smithi038.stdout:0/489: read db/d16/d19/d27/d56/f99 [745288,74475] 0 2023-12-16T20:11:29.631 INFO:tasks.workunit.client.1.smithi141.stdout:7/89: creat d5/d16/f17 x:0 0 0 2023-12-16T20:11:29.631 INFO:tasks.workunit.client.1.smithi141.stdout:7/90: truncate d5/f13 194554 0 2023-12-16T20:11:29.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/91: dread d5/fc [0,4194304] 0 2023-12-16T20:11:29.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/92: creat d5/d16/f18 x:0 0 0 2023-12-16T20:11:29.633 INFO:tasks.workunit.client.1.smithi141.stdout:7/93: dread - d5/f11 zero size 2023-12-16T20:11:29.633 INFO:tasks.workunit.client.0.smithi038.stdout:8/336: dread d17/d5b/f1a [4194304,4194304] 0 2023-12-16T20:11:29.635 INFO:tasks.workunit.client.1.smithi141.stdout:7/94: symlink d5/l19 0 2023-12-16T20:11:29.635 INFO:tasks.workunit.client.1.smithi141.stdout:7/95: stat d5/f13 0 2023-12-16T20:11:29.637 INFO:tasks.workunit.client.1.smithi141.stdout:6/196: dread d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:29.638 INFO:tasks.workunit.client.0.smithi038.stdout:9/454: dwrite d9/d1e/d3d/d42/f53 [0,4194304] 0 2023-12-16T20:11:29.638 INFO:tasks.workunit.client.0.smithi038.stdout:9/455: write d9/d1f/f38 [573427,44978] 0 2023-12-16T20:11:29.638 INFO:tasks.workunit.client.0.smithi038.stdout:9/456: write d9/d1f/f29 [3975694,110104] 0 2023-12-16T20:11:29.639 INFO:tasks.workunit.client.0.smithi038.stdout:7/386: dwrite da/d21/f29 [0,4194304] 0 2023-12-16T20:11:29.639 INFO:tasks.workunit.client.0.smithi038.stdout:7/387: read - da/d21/d68/f78 zero size 2023-12-16T20:11:29.643 INFO:tasks.workunit.client.1.smithi141.stdout:7/96: rmdir d5/d16 39 2023-12-16T20:11:29.644 INFO:tasks.workunit.client.1.smithi141.stdout:7/97: dread - d5/f11 zero size 2023-12-16T20:11:29.645 INFO:tasks.workunit.client.1.smithi141.stdout:7/98: rmdir d5/d16 39 2023-12-16T20:11:29.648 INFO:tasks.workunit.client.0.smithi038.stdout:7/388: mknod da/d24/d4d/d51/c84 0 2023-12-16T20:11:29.648 INFO:tasks.workunit.client.0.smithi038.stdout:7/389: fsync da/d21/d68/f74 0 2023-12-16T20:11:29.665 INFO:tasks.workunit.client.0.smithi038.stdout:7/390: dread da/d3e/f2a [4194304,4194304] 0 2023-12-16T20:11:29.679 INFO:tasks.workunit.client.1.smithi141.stdout:6/197: dwrite d1/d12/d22/f2a [0,4194304] 0 2023-12-16T20:11:29.679 INFO:tasks.workunit.client.0.smithi038.stdout:8/337: dwrite d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:29.679 INFO:tasks.workunit.client.0.smithi038.stdout:8/338: read d17/d1b/f22 [3026860,26522] 0 2023-12-16T20:11:29.679 INFO:tasks.workunit.client.0.smithi038.stdout:8/339: readlink d17/d5b/l2f 0 2023-12-16T20:11:29.681 INFO:tasks.workunit.client.0.smithi038.stdout:8/340: rename d17/d5b to d17/d34/d3d/d45/d54/d69 0 2023-12-16T20:11:29.681 INFO:tasks.workunit.client.1.smithi141.stdout:6/198: mknod d1/d3/d4b/c4d 0 2023-12-16T20:11:29.683 INFO:tasks.workunit.client.0.smithi038.stdout:9/457: dwrite d9/f18 [0,4194304] 0 2023-12-16T20:11:29.683 INFO:tasks.workunit.client.0.smithi038.stdout:7/391: dwrite da/f5d [0,4194304] 0 2023-12-16T20:11:29.683 INFO:tasks.workunit.client.1.smithi141.stdout:7/99: dwrite d5/d16/f17 [0,4194304] 0 2023-12-16T20:11:29.683 INFO:tasks.workunit.client.1.smithi141.stdout:6/199: mknod d1/dd/d43/c4e 0 2023-12-16T20:11:29.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/100: mkdir d5/d16/d1a 0 2023-12-16T20:11:29.686 INFO:tasks.workunit.client.0.smithi038.stdout:9/458: rename d9/d1e/c2d to d9/d1e/d3d/c88 0 2023-12-16T20:11:29.687 INFO:tasks.workunit.client.1.smithi141.stdout:7/101: unlink d5/fe 0 2023-12-16T20:11:29.687 INFO:tasks.workunit.client.1.smithi141.stdout:7/102: write d5/f13 [1194182,36213] 0 2023-12-16T20:11:29.687 INFO:tasks.workunit.client.1.smithi141.stdout:7/103: chown d5/ld 45 1 2023-12-16T20:11:29.687 INFO:tasks.workunit.client.1.smithi141.stdout:7/104: symlink d5/d16/d1a/l1b 0 2023-12-16T20:11:29.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/392: truncate da/d21/d2c/f47 3597367 0 2023-12-16T20:11:29.690 INFO:tasks.workunit.client.1.smithi141.stdout:7/105: symlink d5/l1c 0 2023-12-16T20:11:29.690 INFO:tasks.workunit.client.1.smithi141.stdout:7/106: write d5/f14 [145520,723] 0 2023-12-16T20:11:29.690 INFO:tasks.workunit.client.1.smithi141.stdout:7/107: dread - d5/d16/f18 zero size 2023-12-16T20:11:29.691 INFO:tasks.workunit.client.0.smithi038.stdout:9/459: rename d9/f1a to d9/d1f/d21/d3e/d4e/d61/f89 0 2023-12-16T20:11:29.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/393: symlink da/d21/d68/l85 0 2023-12-16T20:11:29.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/394: chown da/d24 38 1 2023-12-16T20:11:29.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/395: chown da/d24/d4d/f6c 60045059 1 2023-12-16T20:11:29.694 INFO:tasks.workunit.client.0.smithi038.stdout:9/460: mkdir d9/d1f/d21/d3e/d72/d8a 0 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/516: sync 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:4/405: sync 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/517: chown d15/d22/d62/c84 74 1 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/518: fdatasync d15/d1e/d23/f39 0 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/519: getdents d15/d1e/d23/d7d/daa 0 2023-12-16T20:11:29.696 INFO:tasks.workunit.client.0.smithi038.stdout:1/520: chown d15/d1e/d23/d34/d86/d9a 39450360 1 2023-12-16T20:11:29.701 INFO:tasks.workunit.client.0.smithi038.stdout:4/406: rmdir d13 39 2023-12-16T20:11:29.701 INFO:tasks.workunit.client.0.smithi038.stdout:4/407: stat d13/d17/d2e/d32/d4e/f59 0 2023-12-16T20:11:29.701 INFO:tasks.workunit.client.0.smithi038.stdout:4/408: write fb [9049148,90658] 0 2023-12-16T20:11:29.702 INFO:tasks.workunit.client.0.smithi038.stdout:7/396: write da/d21/d2c/d2e/ff [317851,64127] 0 2023-12-16T20:11:29.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/409: creat d13/d17/d4b/f87 x:0 0 0 2023-12-16T20:11:29.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/410: fsync d13/d1f/d35/f63 0 2023-12-16T20:11:29.704 INFO:tasks.workunit.client.1.smithi141.stdout:6/200: dwrite d1/d12/d22/d25/d38/f3e [0,4194304] 0 2023-12-16T20:11:29.705 INFO:tasks.workunit.client.1.smithi141.stdout:6/201: readlink d1/d12/d22/l40 0 2023-12-16T20:11:29.706 INFO:tasks.workunit.client.0.smithi038.stdout:7/397: mkdir da/d21/d86 0 2023-12-16T20:11:29.706 INFO:tasks.workunit.client.0.smithi038.stdout:7/398: chown da/d21/l54 56 1 2023-12-16T20:11:29.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/202: mkdir d1/d3/d4f 0 2023-12-16T20:11:29.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/203: chown d1/dd/l41 448658100 1 2023-12-16T20:11:29.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/204: chown d1/d12/d20 1 1 2023-12-16T20:11:29.708 INFO:tasks.workunit.client.1.smithi141.stdout:6/205: creat d1/d12/d22/f50 x:0 0 0 2023-12-16T20:11:29.708 INFO:tasks.workunit.client.0.smithi038.stdout:9/461: dread d9/d1f/d21/d55/f65 [0,4194304] 0 2023-12-16T20:11:29.712 INFO:tasks.workunit.client.0.smithi038.stdout:1/521: dread d15/d1e/d23/d34/d86/d9a/fa4 [0,4194304] 0 2023-12-16T20:11:29.715 INFO:tasks.workunit.client.0.smithi038.stdout:1/522: mknod d15/d1e/d23/d42/caf 0 2023-12-16T20:11:29.717 INFO:tasks.workunit.client.0.smithi038.stdout:9/462: write d9/f1c [1466306,75038] 0 2023-12-16T20:11:29.718 INFO:tasks.workunit.client.0.smithi038.stdout:1/523: mkdir d15/d1e/db0 0 2023-12-16T20:11:29.719 INFO:tasks.workunit.client.0.smithi038.stdout:9/463: symlink d9/d1e/d40/l8b 0 2023-12-16T20:11:29.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/524: dread d15/d1e/f4c [0,4194304] 0 2023-12-16T20:11:29.721 INFO:tasks.workunit.client.0.smithi038.stdout:9/464: rmdir d9/d1f/d21 39 2023-12-16T20:11:29.723 INFO:tasks.workunit.client.1.smithi141.stdout:1/62: sync 2023-12-16T20:11:29.723 INFO:tasks.workunit.client.1.smithi141.stdout:3/164: sync 2023-12-16T20:11:29.723 INFO:tasks.workunit.client.1.smithi141.stdout:1/63: rename da to da/de 22 2023-12-16T20:11:29.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/525: symlink d15/d1e/d23/da2/lb1 0 2023-12-16T20:11:29.724 INFO:tasks.workunit.client.1.smithi141.stdout:3/165: truncate d0/d13/f1e 3310628 0 2023-12-16T20:11:29.724 INFO:tasks.workunit.client.1.smithi141.stdout:3/166: fsync d0/d13/f1b 0 2023-12-16T20:11:29.724 INFO:tasks.workunit.client.1.smithi141.stdout:3/167: readlink d0/l3 0 2023-12-16T20:11:29.724 INFO:tasks.workunit.client.1.smithi141.stdout:3/168: chown d0/f37 5830 1 2023-12-16T20:11:29.724 INFO:tasks.workunit.client.1.smithi141.stdout:3/169: creat d0/d1c/d2c/f38 x:0 0 0 2023-12-16T20:11:29.725 INFO:tasks.workunit.client.1.smithi141.stdout:1/64: mkdir da/df 0 2023-12-16T20:11:29.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/465: link d9/d1f/d21/f3a d9/d1f/d21/d52/f8c 0 2023-12-16T20:11:29.725 INFO:tasks.workunit.client.0.smithi038.stdout:1/526: mknod d15/d1e/d3b/d48/cb2 0 2023-12-16T20:11:29.726 INFO:tasks.workunit.client.0.smithi038.stdout:9/466: mkdir d9/d1e/d3d/d42/d59/d76/d8d 0 2023-12-16T20:11:29.726 INFO:tasks.workunit.client.0.smithi038.stdout:9/467: dread - d9/d1e/d40/d5e/f67 zero size 2023-12-16T20:11:29.726 INFO:tasks.workunit.client.1.smithi141.stdout:1/65: mknod da/df/c10 0 2023-12-16T20:11:29.727 INFO:tasks.workunit.client.0.smithi038.stdout:9/468: mknod d9/d1f/d21/d3e/d4e/d64/c8e 0 2023-12-16T20:11:29.727 INFO:tasks.workunit.client.0.smithi038.stdout:9/469: chown d9/d1f/d21/d3e/d72/f86 0 1 2023-12-16T20:11:29.728 INFO:tasks.workunit.client.1.smithi141.stdout:1/66: symlink da/df/l11 0 2023-12-16T20:11:29.728 INFO:tasks.workunit.client.0.smithi038.stdout:9/470: read d9/d1f/d21/d52/f82 [328677,66041] 0 2023-12-16T20:11:29.728 INFO:tasks.workunit.client.0.smithi038.stdout:9/471: creat d9/d1e/d40/d5e/f8f x:0 0 0 2023-12-16T20:11:29.730 INFO:tasks.workunit.client.1.smithi141.stdout:1/67: creat da/f12 x:0 0 0 2023-12-16T20:11:29.731 INFO:tasks.workunit.client.1.smithi141.stdout:1/68: creat da/df/f13 x:0 0 0 2023-12-16T20:11:29.737 INFO:tasks.workunit.client.0.smithi038.stdout:9/472: write d9/d1e/d3d/d42/f53 [2080990,3822] 0 2023-12-16T20:11:29.741 INFO:tasks.workunit.client.1.smithi141.stdout:3/170: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:29.741 INFO:tasks.workunit.client.1.smithi141.stdout:3/171: write d0/f37 [219143,47726] 0 2023-12-16T20:11:29.742 INFO:tasks.workunit.client.1.smithi141.stdout:3/172: readlink d0/l2d 0 2023-12-16T20:11:29.742 INFO:tasks.workunit.client.1.smithi141.stdout:3/173: fdatasync d0/d13/f27 0 2023-12-16T20:11:29.742 INFO:tasks.workunit.client.1.smithi141.stdout:8/121: sync 2023-12-16T20:11:29.748 INFO:tasks.workunit.client.1.smithi141.stdout:6/206: dwrite d1/dd/d2f/f3b [4194304,4194304] 0 2023-12-16T20:11:29.748 INFO:tasks.workunit.client.1.smithi141.stdout:6/207: dread - d1/d12/d22/f50 zero size 2023-12-16T20:11:29.748 INFO:tasks.workunit.client.1.smithi141.stdout:6/208: chown d1/d12/d22/d31/l39 26 1 2023-12-16T20:11:29.750 INFO:tasks.workunit.client.1.smithi141.stdout:6/209: mknod d1/d12/d22/d31/c51 0 2023-12-16T20:11:29.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/122: dread d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:29.752 INFO:tasks.workunit.client.1.smithi141.stdout:6/210: rename d1/c8 to d1/d12/d22/d25/d38/c52 0 2023-12-16T20:11:29.752 INFO:tasks.workunit.client.1.smithi141.stdout:6/211: chown d1/d3/l7 759 1 2023-12-16T20:11:29.752 INFO:tasks.workunit.client.1.smithi141.stdout:6/212: chown d1/d12/d22/d31 175035 1 2023-12-16T20:11:29.753 INFO:tasks.workunit.client.1.smithi141.stdout:8/123: link d14/d19/d1b/l1d d14/d19/d1b/d24/l29 0 2023-12-16T20:11:29.761 INFO:tasks.workunit.client.0.smithi038.stdout:4/411: dwrite d13/d17/d2e/d32/d4e/f64 [0,4194304] 0 2023-12-16T20:11:29.764 INFO:tasks.workunit.client.0.smithi038.stdout:4/412: dread d13/d1f/f66 [0,4194304] 0 2023-12-16T20:11:29.764 INFO:tasks.workunit.client.0.smithi038.stdout:4/413: write d13/d1f/d22/f44 [2038304,85388] 0 2023-12-16T20:11:29.765 INFO:tasks.workunit.client.0.smithi038.stdout:4/414: read d13/d17/f36 [23172,52255] 0 2023-12-16T20:11:29.765 INFO:tasks.workunit.client.0.smithi038.stdout:4/415: chown d13/d17/l21 3 1 2023-12-16T20:11:29.766 INFO:tasks.workunit.client.0.smithi038.stdout:4/416: mkdir d13/d17/d2e/d32/d70/d84/d88 0 2023-12-16T20:11:29.767 INFO:tasks.workunit.client.0.smithi038.stdout:4/417: link d13/f3c d13/d69/d7a/f89 0 2023-12-16T20:11:29.767 INFO:tasks.workunit.client.0.smithi038.stdout:4/418: read - d13/d17/f74 zero size 2023-12-16T20:11:29.768 INFO:tasks.workunit.client.0.smithi038.stdout:4/419: mkdir d13/d1f/d22/d8a 0 2023-12-16T20:11:29.768 INFO:tasks.workunit.client.0.smithi038.stdout:4/420: truncate d13/d17/d2e/d32/d4e/f59 671643 0 2023-12-16T20:11:29.768 INFO:tasks.workunit.client.0.smithi038.stdout:4/421: write d13/f3c [2255642,98759] 0 2023-12-16T20:11:29.770 INFO:tasks.workunit.client.0.smithi038.stdout:7/399: dwrite da/d21/f50 [0,4194304] 0 2023-12-16T20:11:29.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/527: dwrite d15/d1e/d23/d34/f8b [0,4194304] 0 2023-12-16T20:11:29.774 INFO:tasks.workunit.client.0.smithi038.stdout:9/473: dwrite d9/d1f/f35 [0,4194304] 0 2023-12-16T20:11:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:1/528: unlink d15/d1e/d23/d46/l4f 0 2023-12-16T20:11:29.780 INFO:tasks.workunit.client.0.smithi038.stdout:9/474: rename d9/d1e/d3d/d42/d59/c66 to d9/d1e/d40/c90 0 2023-12-16T20:11:29.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/124: dwrite d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:29.782 INFO:tasks.workunit.client.1.smithi141.stdout:1/69: dwrite da/f12 [0,4194304] 0 2023-12-16T20:11:29.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/125: truncate d14/f16 650290 0 2023-12-16T20:11:29.783 INFO:tasks.workunit.client.0.smithi038.stdout:9/475: link d9/d1e/f37 d9/d1e/d3d/d42/d59/f91 0 2023-12-16T20:11:29.784 INFO:tasks.workunit.client.0.smithi038.stdout:1/529: getdents d15/d22/d52 0 2023-12-16T20:11:29.784 INFO:tasks.workunit.client.1.smithi141.stdout:1/70: mknod da/c14 0 2023-12-16T20:11:29.785 INFO:tasks.workunit.client.1.smithi141.stdout:8/126: symlink d14/d19/d1b/l2a 0 2023-12-16T20:11:29.785 INFO:tasks.workunit.client.1.smithi141.stdout:1/71: truncate da/fb 1945703 0 2023-12-16T20:11:29.786 INFO:tasks.workunit.client.0.smithi038.stdout:9/476: rmdir d9/d1f/d21/d55 39 2023-12-16T20:11:29.787 INFO:tasks.workunit.client.1.smithi141.stdout:8/127: symlink d14/d19/d1b/d24/l2b 0 2023-12-16T20:11:29.788 INFO:tasks.workunit.client.0.smithi038.stdout:9/477: unlink d9/f2a 0 2023-12-16T20:11:29.788 INFO:tasks.workunit.client.0.smithi038.stdout:9/478: write d9/d1e/f33 [176539,3118] 0 2023-12-16T20:11:29.792 INFO:tasks.workunit.client.0.smithi038.stdout:7/400: dread da/d21/f29 [0,4194304] 0 2023-12-16T20:11:29.792 INFO:tasks.workunit.client.0.smithi038.stdout:1/530: dread d15/d1e/d23/d34/f7a [0,4194304] 0 2023-12-16T20:11:29.795 INFO:tasks.workunit.client.0.smithi038.stdout:7/401: link da/d21/d2c/f30 da/d21/f87 0 2023-12-16T20:11:29.796 INFO:tasks.workunit.client.0.smithi038.stdout:7/402: write da/d21/d41/f7a [618498,101468] 0 2023-12-16T20:11:29.797 INFO:tasks.workunit.client.0.smithi038.stdout:7/403: mknod da/d3e/d31/c88 0 2023-12-16T20:11:29.798 INFO:tasks.workunit.client.0.smithi038.stdout:7/404: fdatasync da/f1d 0 2023-12-16T20:11:29.801 INFO:tasks.workunit.client.0.smithi038.stdout:4/422: dwrite d13/f48 [0,4194304] 0 2023-12-16T20:11:29.807 INFO:tasks.workunit.client.1.smithi141.stdout:3/174: dwrite d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:29.807 INFO:tasks.workunit.client.1.smithi141.stdout:1/72: dwrite da/df/f13 [0,4194304] 0 2023-12-16T20:11:29.807 INFO:tasks.workunit.client.1.smithi141.stdout:1/73: stat f7 0 2023-12-16T20:11:29.807 INFO:tasks.workunit.client.1.smithi141.stdout:1/74: fdatasync da/df/f13 0 2023-12-16T20:11:29.809 INFO:tasks.workunit.client.0.smithi038.stdout:4/423: unlink d13/f4a 0 2023-12-16T20:11:29.809 INFO:tasks.workunit.client.0.smithi038.stdout:4/424: fdatasync d13/d17/d4b/f87 0 2023-12-16T20:11:29.810 INFO:tasks.workunit.client.1.smithi141.stdout:1/75: mknod da/c15 0 2023-12-16T20:11:29.811 INFO:tasks.workunit.client.0.smithi038.stdout:7/405: read da/d21/d2c/d2e/f16 [4048884,79701] 0 2023-12-16T20:11:29.812 INFO:tasks.workunit.client.1.smithi141.stdout:3/175: dread d0/d13/f1d [0,4194304] 0 2023-12-16T20:11:29.812 INFO:tasks.workunit.client.0.smithi038.stdout:4/425: rmdir d13/d1f/d22/d8a 0 2023-12-16T20:11:29.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/406: rename da/d21/d41/f48 to da/d21/d2c/d76/f89 0 2023-12-16T20:11:29.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/407: write da/d21/d2c/f30 [1881370,49875] 0 2023-12-16T20:11:29.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/408: dread - da/d21/f55 zero size 2023-12-16T20:11:29.815 INFO:tasks.workunit.client.1.smithi141.stdout:3/176: rename d0/d1c/d2c/f38 to d0/d13/f39 0 2023-12-16T20:11:29.817 INFO:tasks.workunit.client.1.smithi141.stdout:3/177: rename d0/f17 to d0/f3a 0 2023-12-16T20:11:29.818 INFO:tasks.workunit.client.0.smithi038.stdout:7/409: truncate da/d21/f29 3601935 0 2023-12-16T20:11:29.820 INFO:tasks.workunit.client.0.smithi038.stdout:7/410: mknod da/d3e/d31/c8a 0 2023-12-16T20:11:29.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/479: dwrite d9/d1e/d3d/f6b [0,4194304] 0 2023-12-16T20:11:29.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/531: dwrite d15/f1d [4194304,4194304] 0 2023-12-16T20:11:29.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/76: read da/f12 [2830221,33822] 0 2023-12-16T20:11:29.826 INFO:tasks.workunit.client.1.smithi141.stdout:8/128: truncate d14/f16 260239 0 2023-12-16T20:11:29.828 INFO:tasks.workunit.client.1.smithi141.stdout:8/129: rename d14/c1e to d14/d19/d1b/c2c 0 2023-12-16T20:11:29.828 INFO:tasks.workunit.client.1.smithi141.stdout:8/130: fdatasync f5 0 2023-12-16T20:11:29.828 INFO:tasks.workunit.client.1.smithi141.stdout:1/77: write da/fb [722709,106936] 0 2023-12-16T20:11:29.828 INFO:tasks.workunit.client.1.smithi141.stdout:1/78: creat da/df/f16 x:0 0 0 2023-12-16T20:11:29.828 INFO:tasks.workunit.client.1.smithi141.stdout:8/131: symlink d14/l2d 0 2023-12-16T20:11:29.829 INFO:tasks.workunit.client.0.smithi038.stdout:7/411: dread da/d21/d2c/d2e/f15 [0,4194304] 0 2023-12-16T20:11:29.829 INFO:tasks.workunit.client.0.smithi038.stdout:7/412: read da/d3e/d31/f39 [906798,43004] 0 2023-12-16T20:11:29.829 INFO:tasks.workunit.client.0.smithi038.stdout:7/413: stat da/d21/d41/d6b/f7f 0 2023-12-16T20:11:29.830 INFO:tasks.workunit.client.1.smithi141.stdout:1/79: symlink da/df/l17 0 2023-12-16T20:11:29.830 INFO:tasks.workunit.client.1.smithi141.stdout:1/80: write da/f12 [5045233,92276] 0 2023-12-16T20:11:29.831 INFO:tasks.workunit.client.0.smithi038.stdout:9/480: rename d9/d1e/d40/d5e/f8f to d9/d1e/d40/d5e/d71/d83/f92 0 2023-12-16T20:11:29.831 INFO:tasks.workunit.client.0.smithi038.stdout:9/481: chown d9/d1f/d6a/l7c 26199561 1 2023-12-16T20:11:29.831 INFO:tasks.workunit.client.0.smithi038.stdout:9/482: dread - d9/d1f/d21/f7e zero size 2023-12-16T20:11:29.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/483: creat d9/d1f/d21/d3e/d4e/d64/f93 x:0 0 0 2023-12-16T20:11:29.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/484: write d9/d1f/d21/d52/f82 [236308,13161] 0 2023-12-16T20:11:29.839 INFO:tasks.workunit.client.0.smithi038.stdout:4/426: dread d13/d1f/d22/f7e [0,4194304] 0 2023-12-16T20:11:29.840 INFO:tasks.workunit.client.0.smithi038.stdout:2/551: sync 2023-12-16T20:11:29.842 INFO:tasks.workunit.client.0.smithi038.stdout:9/485: rmdir d9/d1e/d3d/d42/d59 39 2023-12-16T20:11:29.842 INFO:tasks.workunit.client.1.smithi141.stdout:3/178: dwrite d0/d13/f39 [0,4194304] 0 2023-12-16T20:11:29.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/179: getdents d0/d1c/d2c 0 2023-12-16T20:11:29.850 INFO:tasks.workunit.client.0.smithi038.stdout:7/414: dwrite da/d3e/d31/f4a [0,4194304] 0 2023-12-16T20:11:29.851 INFO:tasks.workunit.client.1.smithi141.stdout:8/132: dwrite d14/d19/f1f [0,4194304] 0 2023-12-16T20:11:29.851 INFO:tasks.workunit.client.1.smithi141.stdout:3/180: rename d0/d1c/d2c/l36 to d0/d1c/d2c/l3b 0 2023-12-16T20:11:29.854 INFO:tasks.workunit.client.0.smithi038.stdout:4/427: dread d13/d1f/d35/f63 [0,4194304] 0 2023-12-16T20:11:29.856 INFO:tasks.workunit.client.0.smithi038.stdout:2/552: rename d1/df/d10/d23 to d1/db8 0 2023-12-16T20:11:29.856 INFO:tasks.workunit.client.0.smithi038.stdout:2/553: write d1/fad [993963,20833] 0 2023-12-16T20:11:29.857 INFO:tasks.workunit.client.0.smithi038.stdout:3/440: sync 2023-12-16T20:11:29.858 INFO:tasks.workunit.client.1.smithi141.stdout:8/133: getdents d14 0 2023-12-16T20:11:29.858 INFO:tasks.workunit.client.1.smithi141.stdout:8/134: write f11 [15581,97883] 0 2023-12-16T20:11:29.859 INFO:tasks.workunit.client.0.smithi038.stdout:4/428: symlink d13/d17/d2e/d32/d4e/d61/l8b 0 2023-12-16T20:11:29.859 INFO:tasks.workunit.client.1.smithi141.stdout:1/81: truncate da/f12 2340186 0 2023-12-16T20:11:29.865 INFO:tasks.workunit.client.0.smithi038.stdout:7/415: rename da/d24/l52 to da/d3e/d31/l8b 0 2023-12-16T20:11:29.866 INFO:tasks.workunit.client.0.smithi038.stdout:3/441: mknod d4/d8/d15/d2c/d4c/d70/c96 0 2023-12-16T20:11:29.866 INFO:tasks.workunit.client.0.smithi038.stdout:7/416: mknod da/d3e/d31/d38/d65/c8c 0 2023-12-16T20:11:29.866 INFO:tasks.workunit.client.0.smithi038.stdout:7/417: write da/d21/f29 [4017461,106055] 0 2023-12-16T20:11:29.866 INFO:tasks.workunit.client.1.smithi141.stdout:1/82: fsync da/fb 0 2023-12-16T20:11:29.867 INFO:tasks.workunit.client.1.smithi141.stdout:1/83: dread - da/df/f16 zero size 2023-12-16T20:11:29.867 INFO:tasks.workunit.client.0.smithi038.stdout:4/429: dread d13/f3c [0,4194304] 0 2023-12-16T20:11:29.867 INFO:tasks.workunit.client.1.smithi141.stdout:3/181: dread d0/d13/f39 [0,4194304] 0 2023-12-16T20:11:29.867 INFO:tasks.workunit.client.1.smithi141.stdout:3/182: write d0/f8 [1152174,96682] 0 2023-12-16T20:11:29.868 INFO:tasks.workunit.client.0.smithi038.stdout:3/442: unlink d4/d27/d23/d26/c8e 0 2023-12-16T20:11:29.868 INFO:tasks.workunit.client.0.smithi038.stdout:9/486: dwrite d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:29.868 INFO:tasks.workunit.client.0.smithi038.stdout:7/418: dread da/d24/d4d/d51/f60 [0,4194304] 0 2023-12-16T20:11:29.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/430: truncate d13/f3c 441698 0 2023-12-16T20:11:29.869 INFO:tasks.workunit.client.1.smithi141.stdout:3/183: getdents d0/d13 0 2023-12-16T20:11:29.871 INFO:tasks.workunit.client.0.smithi038.stdout:9/487: creat d9/d1f/d21/d3e/f94 x:0 0 0 2023-12-16T20:11:29.871 INFO:tasks.workunit.client.1.smithi141.stdout:4/100: sync 2023-12-16T20:11:29.872 INFO:tasks.workunit.client.1.smithi141.stdout:3/184: mkdir d0/d13/d3c 0 2023-12-16T20:11:29.872 INFO:tasks.workunit.client.1.smithi141.stdout:3/185: fdatasync d0/f6 0 2023-12-16T20:11:29.875 INFO:tasks.workunit.client.1.smithi141.stdout:4/101: symlink d1a/l23 0 2023-12-16T20:11:29.875 INFO:tasks.workunit.client.1.smithi141.stdout:4/102: chown d1a/l23 3558 1 2023-12-16T20:11:29.875 INFO:tasks.workunit.client.1.smithi141.stdout:4/103: chown d1a/f1f 16071 1 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:9/488: dread d9/d1f/f38 [0,4194304] 0 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:9/489: chown d9/d1e/d45/c57 39845 1 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:9/490: truncate d9/d1e/d40/d5e/d71/d83/f92 766516 0 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:4/431: creat d13/d17/d2e/d32/d70/f8c x:0 0 0 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:7/419: getdents da/d24/d4d/d51 0 2023-12-16T20:11:29.876 INFO:tasks.workunit.client.0.smithi038.stdout:7/420: stat da/d21/d2c/d76 0 2023-12-16T20:11:29.880 INFO:tasks.workunit.client.1.smithi141.stdout:8/135: dwrite f12 [0,4194304] 0 2023-12-16T20:11:29.880 INFO:tasks.workunit.client.1.smithi141.stdout:8/136: readlink d14/d19/d1b/l1d 0 2023-12-16T20:11:29.881 INFO:tasks.workunit.client.0.smithi038.stdout:3/443: write d4/d18/f66 [3728366,4594] 0 2023-12-16T20:11:29.881 INFO:tasks.workunit.client.1.smithi141.stdout:8/137: creat d14/d19/f2e x:0 0 0 2023-12-16T20:11:29.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/432: rmdir d13/d17/d2e/d32/d4e/d61/d6a 0 2023-12-16T20:11:29.884 INFO:tasks.workunit.client.1.smithi141.stdout:8/138: link d14/f16 d14/d19/d1b/f2f 0 2023-12-16T20:11:29.886 INFO:tasks.workunit.client.1.smithi141.stdout:4/104: read f15 [2529526,105207] 0 2023-12-16T20:11:29.888 INFO:tasks.workunit.client.1.smithi141.stdout:4/105: mknod d1a/c24 0 2023-12-16T20:11:29.888 INFO:tasks.workunit.client.1.smithi141.stdout:4/106: creat d1a/f25 x:0 0 0 2023-12-16T20:11:29.888 INFO:tasks.workunit.client.0.smithi038.stdout:3/444: rename d4/d18/l36 to d4/d8/d15/l97 0 2023-12-16T20:11:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:4/433: rename d13/d17/d2e/d32/d4e/d61/l67 to d13/d17/d2e/l8d 0 2023-12-16T20:11:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:4/434: fdatasync d13/d17/f45 0 2023-12-16T20:11:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:4/435: rename d13/d17/d2e/d32/d4e/d61/f80 to d13/d1f/f8e 0 2023-12-16T20:11:29.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/436: symlink d13/d17/d2e/d32/d4e/l8f 0 2023-12-16T20:11:29.898 INFO:tasks.workunit.client.0.smithi038.stdout:3/445: dread d4/f17 [0,4194304] 0 2023-12-16T20:11:29.900 INFO:tasks.workunit.client.0.smithi038.stdout:4/437: mkdir d13/d17/d4b/d7d/d90 0 2023-12-16T20:11:29.900 INFO:tasks.workunit.client.0.smithi038.stdout:3/446: mkdir d4/d8/d15/d6d/d7a/d98 0 2023-12-16T20:11:29.900 INFO:tasks.workunit.client.0.smithi038.stdout:3/447: dread - d4/d27/d23/f57 zero size 2023-12-16T20:11:29.902 INFO:tasks.workunit.client.0.smithi038.stdout:3/448: rename d4/d8/d15/d2c/d4c/d70/c96 to d4/d8/d15/d6d/d7a/c99 0 2023-12-16T20:11:29.907 INFO:tasks.workunit.client.1.smithi141.stdout:1/84: dwrite da/df/f13 [4194304,4194304] 0 2023-12-16T20:11:29.909 INFO:tasks.workunit.client.0.smithi038.stdout:7/421: dwrite da/f5d [0,4194304] 0 2023-12-16T20:11:29.911 INFO:tasks.workunit.client.1.smithi141.stdout:1/85: rename da/df/f16 to da/df/f18 0 2023-12-16T20:11:29.911 INFO:tasks.workunit.client.1.smithi141.stdout:3/186: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:29.911 INFO:tasks.workunit.client.0.smithi038.stdout:7/422: rmdir da/d24/d4d/d51 39 2023-12-16T20:11:29.911 INFO:tasks.workunit.client.0.smithi038.stdout:7/423: creat da/d3e/d31/d38/f8d x:0 0 0 2023-12-16T20:11:29.913 INFO:tasks.workunit.client.0.smithi038.stdout:9/491: dwrite d9/d1f/d21/f3a [0,4194304] 0 2023-12-16T20:11:29.917 INFO:tasks.workunit.client.0.smithi038.stdout:9/492: symlink d9/d1e/d40/d5e/l95 0 2023-12-16T20:11:29.917 INFO:tasks.workunit.client.0.smithi038.stdout:9/493: dread - d9/d1f/d6a/f77 zero size 2023-12-16T20:11:29.919 INFO:tasks.workunit.client.1.smithi141.stdout:3/187: read d0/d13/f39 [706724,22491] 0 2023-12-16T20:11:29.920 INFO:tasks.workunit.client.0.smithi038.stdout:9/494: mkdir d9/d1f/d96 0 2023-12-16T20:11:29.920 INFO:tasks.workunit.client.0.smithi038.stdout:9/495: chown d9/d1e/d3d/d42/d59 116899 1 2023-12-16T20:11:29.921 INFO:tasks.workunit.client.1.smithi141.stdout:4/107: getdents d1a 0 2023-12-16T20:11:29.921 INFO:tasks.workunit.client.1.smithi141.stdout:4/108: stat d1a/c24 0 2023-12-16T20:11:29.923 INFO:tasks.workunit.client.1.smithi141.stdout:3/188: dread d0/d13/f39 [0,4194304] 0 2023-12-16T20:11:29.923 INFO:tasks.workunit.client.1.smithi141.stdout:3/189: truncate d0/f37 418540 0 2023-12-16T20:11:29.923 INFO:tasks.workunit.client.1.smithi141.stdout:4/109: mknod d1a/c26 0 2023-12-16T20:11:29.924 INFO:tasks.workunit.client.1.smithi141.stdout:3/190: fsync d0/d13/f27 0 2023-12-16T20:11:29.925 INFO:tasks.workunit.client.1.smithi141.stdout:3/191: chown d0/d13/c18 3 1 2023-12-16T20:11:29.926 INFO:tasks.workunit.client.1.smithi141.stdout:4/110: mknod d1a/c27 0 2023-12-16T20:11:29.928 INFO:tasks.workunit.client.1.smithi141.stdout:4/111: mknod d1a/c28 0 2023-12-16T20:11:29.929 INFO:tasks.workunit.client.1.smithi141.stdout:4/112: rmdir d1a 39 2023-12-16T20:11:29.929 INFO:tasks.workunit.client.1.smithi141.stdout:4/113: readlink lb 0 2023-12-16T20:11:29.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/496: write d9/d1e/d3d/f6b [2286453,126242] 0 2023-12-16T20:11:29.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/497: fsync d9/d1e/d40/d5e/d71/d83/f92 0 2023-12-16T20:11:29.931 INFO:tasks.workunit.client.1.smithi141.stdout:4/114: creat d1a/f29 x:0 0 0 2023-12-16T20:11:29.934 INFO:tasks.workunit.client.1.smithi141.stdout:4/115: mkdir d1a/d2a 0 2023-12-16T20:11:29.934 INFO:tasks.workunit.client.0.smithi038.stdout:9/498: rename d9/d1e/d40/f51 to d9/d1f/d6a/f97 0 2023-12-16T20:11:29.934 INFO:tasks.workunit.client.0.smithi038.stdout:9/499: write d9/d1f/d21/d3e/d4e/d61/f89 [2599262,37004] 0 2023-12-16T20:11:29.935 INFO:tasks.workunit.client.0.smithi038.stdout:9/500: read d9/d1f/d21/d3e/f69 [2540912,38605] 0 2023-12-16T20:11:29.935 INFO:tasks.workunit.client.0.smithi038.stdout:4/438: dwrite d13/f48 [0,4194304] 0 2023-12-16T20:11:29.935 INFO:tasks.workunit.client.0.smithi038.stdout:4/439: truncate d13/d17/f36 97970 0 2023-12-16T20:11:29.937 INFO:tasks.workunit.client.1.smithi141.stdout:1/86: dwrite da/fb [0,4194304] 0 2023-12-16T20:11:29.937 INFO:tasks.workunit.client.1.smithi141.stdout:1/87: readlink l4 0 2023-12-16T20:11:29.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/449: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:29.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/450: truncate d4/d8/d15/d2c/f65 571834 0 2023-12-16T20:11:29.937 INFO:tasks.workunit.client.1.smithi141.stdout:4/116: dread f15 [0,4194304] 0 2023-12-16T20:11:29.938 INFO:tasks.workunit.client.0.smithi038.stdout:4/440: creat d13/f91 x:0 0 0 2023-12-16T20:11:29.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/88: symlink da/l19 0 2023-12-16T20:11:29.940 INFO:tasks.workunit.client.1.smithi141.stdout:1/89: mkdir da/d1a 0 2023-12-16T20:11:29.940 INFO:tasks.workunit.client.1.smithi141.stdout:1/90: chown da/df/f18 1010625 1 2023-12-16T20:11:29.940 INFO:tasks.workunit.client.1.smithi141.stdout:1/91: creat da/df/f1b x:0 0 0 2023-12-16T20:11:29.941 INFO:tasks.workunit.client.1.smithi141.stdout:4/117: symlink d1a/l2b 0 2023-12-16T20:11:29.942 INFO:tasks.workunit.client.1.smithi141.stdout:1/92: symlink da/d1a/l1c 0 2023-12-16T20:11:29.942 INFO:tasks.workunit.client.1.smithi141.stdout:1/93: chown f6 0 1 2023-12-16T20:11:29.945 INFO:tasks.workunit.client.0.smithi038.stdout:3/451: read d4/d8/d15/d1e/f22 [1869651,16962] 0 2023-12-16T20:11:29.946 INFO:tasks.workunit.client.1.smithi141.stdout:4/118: dread d1a/f1e [0,4194304] 0 2023-12-16T20:11:29.949 INFO:tasks.workunit.client.1.smithi141.stdout:4/119: mknod d1a/c2c 0 2023-12-16T20:11:29.951 INFO:tasks.workunit.client.1.smithi141.stdout:4/120: symlink d1a/l2d 0 2023-12-16T20:11:29.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/501: dwrite d9/d1f/d21/d52/f82 [0,4194304] 0 2023-12-16T20:11:29.953 INFO:tasks.workunit.client.1.smithi141.stdout:4/121: creat d1a/f2e x:0 0 0 2023-12-16T20:11:29.954 INFO:tasks.workunit.client.0.smithi038.stdout:7/424: getdents da/d3e/d31/d38 0 2023-12-16T20:11:29.954 INFO:tasks.workunit.client.0.smithi038.stdout:7/425: write da/d3e/d31/d38/f8d [575691,49718] 0 2023-12-16T20:11:29.954 INFO:tasks.workunit.client.0.smithi038.stdout:7/426: getdents da/d3e/d31/d38 0 2023-12-16T20:11:29.955 INFO:tasks.workunit.client.0.smithi038.stdout:4/441: unlink d13/l16 0 2023-12-16T20:11:29.956 INFO:tasks.workunit.client.1.smithi141.stdout:4/122: unlink d1a/f1d 0 2023-12-16T20:11:29.957 INFO:tasks.workunit.client.0.smithi038.stdout:3/452: mkdir d4/d8/d15/d2c/d4c/d58/d9a 0 2023-12-16T20:11:29.957 INFO:tasks.workunit.client.0.smithi038.stdout:3/453: chown d4/d8/d15/d6d/d7a/c99 5675 1 2023-12-16T20:11:29.957 INFO:tasks.workunit.client.0.smithi038.stdout:3/454: truncate d4/d8/d15/f5d 689393 0 2023-12-16T20:11:29.958 INFO:tasks.workunit.client.1.smithi141.stdout:4/123: creat d1a/d2a/f2f x:0 0 0 2023-12-16T20:11:29.963 INFO:tasks.workunit.client.0.smithi038.stdout:4/442: creat d13/d1f/d35/f92 x:0 0 0 2023-12-16T20:11:29.963 INFO:tasks.workunit.client.0.smithi038.stdout:9/502: dread d9/d1f/d21/d52/f82 [0,4194304] 0 2023-12-16T20:11:29.965 INFO:tasks.workunit.client.0.smithi038.stdout:3/455: mknod d4/d8/c9b 0 2023-12-16T20:11:29.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/503: truncate d9/d1e/d40/f41 1059467 0 2023-12-16T20:11:29.968 INFO:tasks.workunit.client.1.smithi141.stdout:1/94: dwrite da/df/f13 [4194304,4194304] 0 2023-12-16T20:11:29.970 INFO:tasks.workunit.client.0.smithi038.stdout:9/504: creat d9/d1f/f98 x:0 0 0 2023-12-16T20:11:29.972 INFO:tasks.workunit.client.0.smithi038.stdout:7/427: rename da/d21/d68 to da/d3e/d8e 0 2023-12-16T20:11:29.975 INFO:tasks.workunit.client.0.smithi038.stdout:4/443: rename d13/d1f/d22/f7e to d13/d17/d2e/d32/d4d/d78/f93 0 2023-12-16T20:11:29.975 INFO:tasks.workunit.client.0.smithi038.stdout:4/444: chown d13/d1f/d22/f41 58 1 2023-12-16T20:11:29.975 INFO:tasks.workunit.client.0.smithi038.stdout:4/445: fsync d13/d1f/d22/f41 0 2023-12-16T20:11:29.976 INFO:tasks.workunit.client.0.smithi038.stdout:6/446: sync 2023-12-16T20:11:29.976 INFO:tasks.workunit.client.0.smithi038.stdout:5/527: sync 2023-12-16T20:11:29.978 INFO:tasks.workunit.client.0.smithi038.stdout:0/490: sync 2023-12-16T20:11:29.978 INFO:tasks.workunit.client.0.smithi038.stdout:8/341: sync 2023-12-16T20:11:29.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/124: rmdir d1a 39 2023-12-16T20:11:29.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/125: truncate d1a/f2e 960317 0 2023-12-16T20:11:29.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/126: rmdir d1a 39 2023-12-16T20:11:29.979 INFO:tasks.workunit.client.1.smithi141.stdout:1/95: dread da/df/f13 [0,4194304] 0 2023-12-16T20:11:29.982 INFO:tasks.workunit.client.0.smithi038.stdout:3/456: rename d4/d8/d15/d6d/d7a/c99 to d4/d6c/c9c 0 2023-12-16T20:11:29.982 INFO:tasks.workunit.client.0.smithi038.stdout:3/457: fdatasync d4/d27/d23/d26/f3e 0 2023-12-16T20:11:29.982 INFO:tasks.workunit.client.0.smithi038.stdout:5/528: creat d2/df/d1a/d1f/d4a/d53/fa5 x:0 0 0 2023-12-16T20:11:29.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/529: write d2/d14/d25/d2d/d17/d51/f8e [627960,22241] 0 2023-12-16T20:11:29.985 INFO:tasks.workunit.client.0.smithi038.stdout:4/446: link d13/d17/d4b/f43 d13/d1f/d22/f94 0 2023-12-16T20:11:29.985 INFO:tasks.workunit.client.1.smithi141.stdout:1/96: mkdir da/d1a/d1d 0 2023-12-16T20:11:29.985 INFO:tasks.workunit.client.1.smithi141.stdout:1/97: chown da/df/f1b 320 1 2023-12-16T20:11:29.986 INFO:tasks.workunit.client.0.smithi038.stdout:3/458: dread d4/d8/d15/d1e/f22 [0,4194304] 0 2023-12-16T20:11:29.987 INFO:tasks.workunit.client.1.smithi141.stdout:1/98: link da/c15 da/c1e 0 2023-12-16T20:11:29.987 INFO:tasks.workunit.client.0.smithi038.stdout:5/530: mknod d2/d14/d25/d2d/d4b/ca6 0 2023-12-16T20:11:29.988 INFO:tasks.workunit.client.0.smithi038.stdout:5/531: fsync f0 0 2023-12-16T20:11:29.988 INFO:tasks.workunit.client.0.smithi038.stdout:5/532: fsync d2/d4/f58 0 2023-12-16T20:11:29.988 INFO:tasks.workunit.client.0.smithi038.stdout:5/533: write d2/df/d1a/d2a/f95 [1436483,89775] 0 2023-12-16T20:11:29.988 INFO:tasks.workunit.client.0.smithi038.stdout:0/491: dread db/d1a/f7b [0,4194304] 0 2023-12-16T20:11:29.988 INFO:tasks.workunit.client.0.smithi038.stdout:0/492: creat db/d16/d1c/fa5 x:0 0 0 2023-12-16T20:11:29.989 INFO:tasks.workunit.client.0.smithi038.stdout:4/447: unlink d13/d17/f74 0 2023-12-16T20:11:29.990 INFO:tasks.workunit.client.0.smithi038.stdout:7/428: dwrite da/d21/d41/f7a [0,4194304] 0 2023-12-16T20:11:29.990 INFO:tasks.workunit.client.0.smithi038.stdout:7/429: creat da/d21/f8f x:0 0 0 2023-12-16T20:11:29.991 INFO:tasks.workunit.client.1.smithi141.stdout:4/127: dread fa [0,4194304] 0 2023-12-16T20:11:29.992 INFO:tasks.workunit.client.0.smithi038.stdout:8/342: getdents d17/d1b/d57 0 2023-12-16T20:11:29.997 INFO:tasks.workunit.client.0.smithi038.stdout:3/459: symlink d4/d67/l9d 0 2023-12-16T20:11:29.999 INFO:tasks.workunit.client.1.smithi141.stdout:4/128: chown d1a/f29 13 1 2023-12-16T20:11:30.000 INFO:tasks.workunit.client.0.smithi038.stdout:0/493: mkdir db/d16/da6 0 2023-12-16T20:11:30.001 INFO:tasks.workunit.client.1.smithi141.stdout:1/99: write da/fb [3168118,2255] 0 2023-12-16T20:11:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:8/343: dread d17/d34/d3d/d45/d54/d69/f1a [4194304,4194304] 0 2023-12-16T20:11:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:6/447: dwrite d1/f45 [0,4194304] 0 2023-12-16T20:11:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:6/448: read - d1/d4/d1d/f60 zero size 2023-12-16T20:11:30.002 INFO:tasks.workunit.client.1.smithi141.stdout:4/129: creat d1a/f30 x:0 0 0 2023-12-16T20:11:30.003 INFO:tasks.workunit.client.1.smithi141.stdout:1/100: mknod da/d1a/c1f 0 2023-12-16T20:11:30.003 INFO:tasks.workunit.client.1.smithi141.stdout:1/101: chown da/c15 803 1 2023-12-16T20:11:30.003 INFO:tasks.workunit.client.1.smithi141.stdout:1/102: truncate da/df/f1b 187370 0 2023-12-16T20:11:30.003 INFO:tasks.workunit.client.1.smithi141.stdout:1/103: creat da/df/f20 x:0 0 0 2023-12-16T20:11:30.007 INFO:tasks.workunit.client.0.smithi038.stdout:3/460: mknod d4/d27/d2b/d64/c9e 0 2023-12-16T20:11:30.007 INFO:tasks.workunit.client.0.smithi038.stdout:3/461: getdents d4/d8/d15/d2c/d4c/d58/d9a 0 2023-12-16T20:11:30.007 INFO:tasks.workunit.client.1.smithi141.stdout:4/130: rmdir d1a/d2a 39 2023-12-16T20:11:30.009 INFO:tasks.workunit.client.0.smithi038.stdout:0/494: truncate db/f26 185159 0 2023-12-16T20:11:30.009 INFO:tasks.workunit.client.0.smithi038.stdout:9/505: write d9/d1e/d40/f41 [176706,102634] 0 2023-12-16T20:11:30.010 INFO:tasks.workunit.client.1.smithi141.stdout:4/131: rename d1a/f30 to d1a/d2a/f31 0 2023-12-16T20:11:30.012 INFO:tasks.workunit.client.0.smithi038.stdout:6/449: creat d1/d2e/f8d x:0 0 0 2023-12-16T20:11:30.012 INFO:tasks.workunit.client.1.smithi141.stdout:4/132: creat d1a/f32 x:0 0 0 2023-12-16T20:11:30.013 INFO:tasks.workunit.client.0.smithi038.stdout:3/462: mknod d4/d8/d15/d2c/d4c/d70/d71/c9f 0 2023-12-16T20:11:30.014 INFO:tasks.workunit.client.1.smithi141.stdout:4/133: symlink d1a/d2a/l33 0 2023-12-16T20:11:30.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/495: mkdir db/d16/d5a/d65/d90/da7 0 2023-12-16T20:11:30.018 INFO:tasks.workunit.client.0.smithi038.stdout:3/463: mkdir d4/d27/d2b/da0 0 2023-12-16T20:11:30.018 INFO:tasks.workunit.client.0.smithi038.stdout:3/464: creat d4/d67/fa1 x:0 0 0 2023-12-16T20:11:30.019 INFO:tasks.workunit.client.1.smithi141.stdout:4/134: rename d1a/l22 to d1a/l34 0 2023-12-16T20:11:30.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/496: creat db/d16/d70/d79/fa8 x:0 0 0 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.0.smithi038.stdout:0/497: chown db/d16/d1c/d5d/d64/l7d 30 1 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.0.smithi038.stdout:0/498: chown ca 688104 1 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.0.smithi038.stdout:3/465: write d4/f6 [5523244,58558] 0 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.0.smithi038.stdout:3/466: chown d4/d18/f66 190 1 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.1.smithi141.stdout:4/135: creat d1a/f35 x:0 0 0 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.1.smithi141.stdout:4/136: truncate d1a/f35 694768 0 2023-12-16T20:11:30.020 INFO:tasks.workunit.client.1.smithi141.stdout:4/137: chown d1a/f29 239971 1 2023-12-16T20:11:30.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/499: mknod db/d1a/d77/d95/ca9 0 2023-12-16T20:11:30.023 INFO:tasks.workunit.client.1.smithi141.stdout:4/138: mknod d1a/c36 0 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/500: symlink db/d16/d1c/laa 0 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/501: readlink db/d16/d19/l75 0 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/502: chown db/d16/d1c/f48 10 1 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/503: readlink db/d16/d19/d4e/l8f 0 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/504: write db/d1a/f7a [526609,69205] 0 2023-12-16T20:11:30.024 INFO:tasks.workunit.client.0.smithi038.stdout:0/505: dread - db/d16/d19/d27/f51 zero size 2023-12-16T20:11:30.025 INFO:tasks.workunit.client.1.smithi141.stdout:4/139: truncate fd 1529362 0 2023-12-16T20:11:30.025 INFO:tasks.workunit.client.1.smithi141.stdout:4/140: stat f19 0 2023-12-16T20:11:30.025 INFO:tasks.workunit.client.0.smithi038.stdout:0/506: symlink db/d16/d70/d79/lab 0 2023-12-16T20:11:30.027 INFO:tasks.workunit.client.1.smithi141.stdout:4/141: write d1a/f1f [648952,11238] 0 2023-12-16T20:11:30.028 INFO:tasks.workunit.client.0.smithi038.stdout:3/467: dread d4/d8/f1a [0,4194304] 0 2023-12-16T20:11:30.028 INFO:tasks.workunit.client.0.smithi038.stdout:3/468: truncate d4/d8/f24 9437068 0 2023-12-16T20:11:30.029 INFO:tasks.workunit.client.1.smithi141.stdout:4/142: creat d1a/d2a/f37 x:0 0 0 2023-12-16T20:11:30.030 INFO:tasks.workunit.client.0.smithi038.stdout:3/469: creat d4/d8/d15/d2c/d4c/d70/d71/d85/fa2 x:0 0 0 2023-12-16T20:11:30.031 INFO:tasks.workunit.client.0.smithi038.stdout:5/534: dwrite d2/d14/d25/d2d/d17/d51/d7b/fa1 [0,4194304] 0 2023-12-16T20:11:30.034 INFO:tasks.workunit.client.0.smithi038.stdout:5/535: mknod d2/d14/d25/d2d/ca7 0 2023-12-16T20:11:30.035 INFO:tasks.workunit.client.0.smithi038.stdout:5/536: creat d2/d14/d25/d2d/d17/d51/d7b/d89/fa8 x:0 0 0 2023-12-16T20:11:30.036 INFO:tasks.workunit.client.0.smithi038.stdout:5/537: mkdir d2/d14/d25/d2d/d17/da9 0 2023-12-16T20:11:30.036 INFO:tasks.workunit.client.0.smithi038.stdout:5/538: truncate d2/df/d1a/d2a/f75 815548 0 2023-12-16T20:11:30.036 INFO:tasks.workunit.client.0.smithi038.stdout:5/539: chown d2/c6 2776444 1 2023-12-16T20:11:30.036 INFO:tasks.workunit.client.1.smithi141.stdout:0/111: sync 2023-12-16T20:11:30.039 INFO:tasks.workunit.client.1.smithi141.stdout:0/112: symlink d4/d7/l25 0 2023-12-16T20:11:30.039 INFO:tasks.workunit.client.1.smithi141.stdout:0/113: rename d4/d7/c1f to d4/c26 0 2023-12-16T20:11:30.040 INFO:tasks.workunit.client.1.smithi141.stdout:0/114: symlink d4/l27 0 2023-12-16T20:11:30.045 INFO:tasks.workunit.client.0.smithi038.stdout:4/448: dwrite d13/d17/d2e/d32/d4d/d4f/f53 [0,4194304] 0 2023-12-16T20:11:30.045 INFO:tasks.workunit.client.0.smithi038.stdout:4/449: fsync d13/d1f/d22/f94 0 2023-12-16T20:11:30.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/115: write f1 [1730326,75767] 0 2023-12-16T20:11:30.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/116: write d4/d7/f24 [323260,21684] 0 2023-12-16T20:11:30.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/117: fsync d4/f17 0 2023-12-16T20:11:30.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/118: chown d4/c10 240762 1 2023-12-16T20:11:30.048 INFO:tasks.workunit.client.1.smithi141.stdout:0/119: symlink d4/l28 0 2023-12-16T20:11:30.051 INFO:tasks.workunit.client.0.smithi038.stdout:3/470: write d4/d8/f24 [8257086,49143] 0 2023-12-16T20:11:30.052 INFO:tasks.workunit.client.0.smithi038.stdout:4/450: getdents d13/d17 0 2023-12-16T20:11:30.052 INFO:tasks.workunit.client.0.smithi038.stdout:3/471: creat d4/d6c/d80/fa3 x:0 0 0 2023-12-16T20:11:30.052 INFO:tasks.workunit.client.0.smithi038.stdout:8/344: dwrite d17/d1d/f31 [0,4194304] 0 2023-12-16T20:11:30.053 INFO:tasks.workunit.client.0.smithi038.stdout:4/451: stat d13/d1f/d22/l29 0 2023-12-16T20:11:30.055 INFO:tasks.workunit.client.0.smithi038.stdout:3/472: unlink d4/f14 0 2023-12-16T20:11:30.057 INFO:tasks.workunit.client.1.smithi141.stdout:1/104: dwrite da/df/f18 [0,4194304] 0 2023-12-16T20:11:30.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/345: creat d17/d34/d3d/d59/f6a x:0 0 0 2023-12-16T20:11:30.058 INFO:tasks.workunit.client.0.smithi038.stdout:9/506: dwrite d9/d1f/d21/d55/f6f [4194304,4194304] 0 2023-12-16T20:11:30.058 INFO:tasks.workunit.client.0.smithi038.stdout:7/430: dwrite da/d3e/f2a [0,4194304] 0 2023-12-16T20:11:30.059 INFO:tasks.workunit.client.0.smithi038.stdout:6/450: dwrite d1/d4/d1d/d28/d2f/d3d/f4c [0,4194304] 0 2023-12-16T20:11:30.059 INFO:tasks.workunit.client.0.smithi038.stdout:5/540: dwrite d2/df/d1a/d1f/d4a/d53/d6e/f8d [0,4194304] 0 2023-12-16T20:11:30.059 INFO:tasks.workunit.client.0.smithi038.stdout:5/541: write d2/df/d1a/d2a/f6c [761826,104160] 0 2023-12-16T20:11:30.060 INFO:tasks.workunit.client.0.smithi038.stdout:4/452: creat d13/d17/f95 x:0 0 0 2023-12-16T20:11:30.064 INFO:tasks.workunit.client.0.smithi038.stdout:8/346: truncate f16 5571212 0 2023-12-16T20:11:30.070 INFO:tasks.workunit.client.1.smithi141.stdout:1/105: creat da/d1a/d1d/f21 x:0 0 0 2023-12-16T20:11:30.070 INFO:tasks.workunit.client.1.smithi141.stdout:1/106: write da/fc [2355627,69856] 0 2023-12-16T20:11:30.070 INFO:tasks.workunit.client.1.smithi141.stdout:1/107: dread - da/d1a/d1d/f21 zero size 2023-12-16T20:11:30.074 INFO:tasks.workunit.client.1.smithi141.stdout:0/120: rmdir d4/d7 39 2023-12-16T20:11:30.076 INFO:tasks.workunit.client.1.smithi141.stdout:0/121: symlink d4/d7/l29 0 2023-12-16T20:11:30.077 INFO:tasks.workunit.client.1.smithi141.stdout:0/122: mknod d4/c2a 0 2023-12-16T20:11:30.080 INFO:tasks.workunit.client.1.smithi141.stdout:0/123: link d4/d7/l21 d4/d7/l2b 0 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.1.smithi141.stdout:1/108: dread da/df/f13 [4194304,4194304] 0 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.1.smithi141.stdout:0/124: mknod d4/c2c 0 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.1.smithi141.stdout:0/125: chown d4 7093827 1 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.1.smithi141.stdout:0/126: chown d4/c10 215 1 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.1.smithi141.stdout:0/127: write d4/f23 [985051,1313] 0 2023-12-16T20:11:30.082 INFO:tasks.workunit.client.0.smithi038.stdout:9/507: link d9/d1f/f29 d9/d1f/d21/d3e/d4e/d61/f99 0 2023-12-16T20:11:30.083 INFO:tasks.workunit.client.1.smithi141.stdout:1/109: mkdir da/d1a/d1d/d22 0 2023-12-16T20:11:30.084 INFO:tasks.workunit.client.1.smithi141.stdout:0/128: rmdir d4/d7 39 2023-12-16T20:11:30.084 INFO:tasks.workunit.client.0.smithi038.stdout:5/542: creat d2/d14/d25/d2d/d17/d55/faa x:0 0 0 2023-12-16T20:11:30.085 INFO:tasks.workunit.client.1.smithi141.stdout:0/129: symlink d4/l2d 0 2023-12-16T20:11:30.086 INFO:tasks.workunit.client.0.smithi038.stdout:4/453: symlink d13/d17/d2e/d32/d4d/d6e/l96 0 2023-12-16T20:11:30.087 INFO:tasks.workunit.client.1.smithi141.stdout:0/130: mknod d4/c2e 0 2023-12-16T20:11:30.087 INFO:tasks.workunit.client.1.smithi141.stdout:1/110: write da/df/f13 [2382707,38856] 0 2023-12-16T20:11:30.087 INFO:tasks.workunit.client.0.smithi038.stdout:9/508: getdents d9/d1f/d6a 0 2023-12-16T20:11:30.087 INFO:tasks.workunit.client.0.smithi038.stdout:9/509: stat d9/d1f/d21/d3e 0 2023-12-16T20:11:30.088 INFO:tasks.workunit.client.1.smithi141.stdout:0/131: link d4/c6 d4/d7/c2f 0 2023-12-16T20:11:30.089 INFO:tasks.workunit.client.0.smithi038.stdout:3/473: dwrite d4/d8/d15/d6d/d7a/f8a [0,4194304] 0 2023-12-16T20:11:30.089 INFO:tasks.workunit.client.0.smithi038.stdout:4/454: mkdir d13/d17/d2e/d75/d97 0 2023-12-16T20:11:30.089 INFO:tasks.workunit.client.0.smithi038.stdout:4/455: chown d13/d17/d2e/d32/d4d/d4f/l5f 256021885 1 2023-12-16T20:11:30.090 INFO:tasks.workunit.client.0.smithi038.stdout:9/510: creat d9/d1e/d3d/d42/d59/d76/f9a x:0 0 0 2023-12-16T20:11:30.090 INFO:tasks.workunit.client.0.smithi038.stdout:9/511: truncate d9/d1e/d3d/d42/d59/f7d 1008716 0 2023-12-16T20:11:30.091 INFO:tasks.workunit.client.0.smithi038.stdout:9/512: fdatasync d9/d1e/d3d/d42/d59/d76/f78 0 2023-12-16T20:11:30.091 INFO:tasks.workunit.client.1.smithi141.stdout:0/132: dread f2 [4194304,4194304] 0 2023-12-16T20:11:30.093 INFO:tasks.workunit.client.0.smithi038.stdout:7/431: dwrite da/d3e/d31/f39 [0,4194304] 0 2023-12-16T20:11:30.095 INFO:tasks.workunit.client.1.smithi141.stdout:1/111: fsync da/fc 0 2023-12-16T20:11:30.095 INFO:tasks.workunit.client.1.smithi141.stdout:1/112: stat da/df/l11 0 2023-12-16T20:11:30.095 INFO:tasks.workunit.client.1.smithi141.stdout:0/133: rename d4/d7/f1d to d4/f30 0 2023-12-16T20:11:30.095 INFO:tasks.workunit.client.1.smithi141.stdout:0/134: fdatasync d4/f1c 0 2023-12-16T20:11:30.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/347: dwrite d17/f40 [4194304,4194304] 0 2023-12-16T20:11:30.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/348: creat d17/d1b/d25/f6b x:0 0 0 2023-12-16T20:11:30.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/349: chown d17/d1b/d25/f32 215185 1 2023-12-16T20:11:30.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/350: chown d17/d34/d3d/d45/d55 2758 1 2023-12-16T20:11:30.097 INFO:tasks.workunit.client.0.smithi038.stdout:9/513: mkdir d9/d1f/d21/d3e/d4e/d61/d9b 0 2023-12-16T20:11:30.100 INFO:tasks.workunit.client.1.smithi141.stdout:1/113: creat da/d1a/f23 x:0 0 0 2023-12-16T20:11:30.102 INFO:tasks.workunit.client.1.smithi141.stdout:1/114: link da/d1a/f23 da/df/f24 0 2023-12-16T20:11:30.104 INFO:tasks.workunit.client.0.smithi038.stdout:7/432: rename da/d21/d2c/d2e to da/d3e/d31/d38/d90 0 2023-12-16T20:11:30.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/135: read d4/d7/fd [719554,65775] 0 2023-12-16T20:11:30.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/136: creat d4/f31 x:0 0 0 2023-12-16T20:11:30.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/137: write d4/d7/f24 [1325289,79299] 0 2023-12-16T20:11:30.111 INFO:tasks.workunit.client.0.smithi038.stdout:9/514: dread d9/d1f/d21/d3e/d72/f86 [0,4194304] 0 2023-12-16T20:11:30.112 INFO:tasks.workunit.client.0.smithi038.stdout:9/515: chown d9/d1f/f35 42868788 1 2023-12-16T20:11:30.112 INFO:tasks.workunit.client.0.smithi038.stdout:8/351: truncate f16 6378663 0 2023-12-16T20:11:30.114 INFO:tasks.workunit.client.1.smithi141.stdout:0/138: symlink d4/l32 0 2023-12-16T20:11:30.114 INFO:tasks.workunit.client.1.smithi141.stdout:0/139: stat f1 0 2023-12-16T20:11:30.115 INFO:tasks.workunit.client.0.smithi038.stdout:9/516: rename d9/d1f/c7a to d9/d1f/d21/d3e/d4e/d64/c9c 0 2023-12-16T20:11:30.119 INFO:tasks.workunit.client.0.smithi038.stdout:9/517: getdents d9/d1f/d21/d3e 0 2023-12-16T20:11:30.120 INFO:tasks.workunit.client.0.smithi038.stdout:9/518: chown d9/d1e/f74 28448467 1 2023-12-16T20:11:30.121 INFO:tasks.workunit.client.0.smithi038.stdout:9/519: mknod d9/d1e/d3d/d42/d59/c9d 0 2023-12-16T20:11:30.125 INFO:tasks.workunit.client.0.smithi038.stdout:9/520: write d9/f81 [2639772,97193] 0 2023-12-16T20:11:30.126 INFO:tasks.workunit.client.0.smithi038.stdout:3/474: dwrite d4/d8/d15/d2c/d7d/f91 [0,4194304] 0 2023-12-16T20:11:30.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/521: mkdir d9/d1f/d21/d3e/d4e/d61/d9e 0 2023-12-16T20:11:30.128 INFO:tasks.workunit.client.0.smithi038.stdout:9/522: truncate d9/d1e/d3d/d42/d59/f91 442355 0 2023-12-16T20:11:30.129 INFO:tasks.workunit.client.0.smithi038.stdout:3/475: creat d4/d8/d15/d2c/d4c/d70/fa4 x:0 0 0 2023-12-16T20:11:30.130 INFO:tasks.workunit.client.0.smithi038.stdout:8/352: dread f13 [0,4194304] 0 2023-12-16T20:11:30.130 INFO:tasks.workunit.client.0.smithi038.stdout:9/523: truncate d9/d1f/f29 403952 0 2023-12-16T20:11:30.130 INFO:tasks.workunit.client.1.smithi141.stdout:1/115: fsync da/df/f13 0 2023-12-16T20:11:30.130 INFO:tasks.workunit.client.1.smithi141.stdout:1/116: write da/d1a/f23 [580932,101126] 0 2023-12-16T20:11:30.132 INFO:tasks.workunit.client.0.smithi038.stdout:9/524: rename d9/f1c to d9/d1e/d40/d5e/d71/d83/f9f 0 2023-12-16T20:11:30.132 INFO:tasks.workunit.client.0.smithi038.stdout:9/525: write d9/d1e/d3d/d42/f53 [2774030,2169] 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:8/353: dread f10 [4194304,4194304] 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:8/354: chown d17/d1b/d25/l4d 1 1 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:5/543: dwrite d2/df/d1a/d2a/f6c [0,4194304] 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:4/456: dwrite d13/d17/d2e/f52 [0,4194304] 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:4/457: dread - d13/d17/f95 zero size 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:4/458: fdatasync d13/d17/d4b/f87 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:3/476: getdents d4/d8/d15/d2c/d7d 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.0.smithi038.stdout:7/433: dwrite da/d3e/d31/d38/d90/f16 [0,4194304] 0 2023-12-16T20:11:30.134 INFO:tasks.workunit.client.1.smithi141.stdout:1/117: unlink da/df/f20 0 2023-12-16T20:11:30.135 INFO:tasks.workunit.client.1.smithi141.stdout:1/118: mkdir da/d25 0 2023-12-16T20:11:30.137 INFO:tasks.workunit.client.1.smithi141.stdout:1/119: creat da/d25/f26 x:0 0 0 2023-12-16T20:11:30.138 INFO:tasks.workunit.client.0.smithi038.stdout:7/434: dread da/f19 [0,4194304] 0 2023-12-16T20:11:30.138 INFO:tasks.workunit.client.0.smithi038.stdout:7/435: write da/d3e/d31/d38/d90/f2d [2382902,119356] 0 2023-12-16T20:11:30.138 INFO:tasks.workunit.client.0.smithi038.stdout:7/436: stat da/d3e/d31/d38/d90/f2d 0 2023-12-16T20:11:30.138 INFO:tasks.workunit.client.0.smithi038.stdout:9/526: rename d9/d1e/d3d/f5d to d9/d1f/d21/d3e/d4e/d64/fa0 0 2023-12-16T20:11:30.139 INFO:tasks.workunit.client.1.smithi141.stdout:1/120: unlink da/d1a/l1c 0 2023-12-16T20:11:30.139 INFO:tasks.workunit.client.1.smithi141.stdout:1/121: write da/fb [3058272,89939] 0 2023-12-16T20:11:30.139 INFO:tasks.workunit.client.1.smithi141.stdout:1/122: write da/fb [672772,46555] 0 2023-12-16T20:11:30.140 INFO:tasks.workunit.client.1.smithi141.stdout:1/123: creat da/df/f27 x:0 0 0 2023-12-16T20:11:30.140 INFO:tasks.workunit.client.0.smithi038.stdout:5/544: creat d2/d14/d25/d2d/d17/d93/fab x:0 0 0 2023-12-16T20:11:30.141 INFO:tasks.workunit.client.1.smithi141.stdout:1/124: unlink da/d1a/f23 0 2023-12-16T20:11:30.143 INFO:tasks.workunit.client.0.smithi038.stdout:4/459: mkdir d13/d1f/d98 0 2023-12-16T20:11:30.144 INFO:tasks.workunit.client.0.smithi038.stdout:4/460: write d13/d1f/f66 [688886,23490] 0 2023-12-16T20:11:30.144 INFO:tasks.workunit.client.0.smithi038.stdout:3/477: unlink d4/d8/f45 0 2023-12-16T20:11:30.148 INFO:tasks.workunit.client.1.smithi141.stdout:0/140: dwrite d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:30.149 INFO:tasks.workunit.client.0.smithi038.stdout:7/437: symlink da/d21/l91 0 2023-12-16T20:11:30.150 INFO:tasks.workunit.client.0.smithi038.stdout:9/527: mkdir d9/d1e/d40/d5e/d71/d83/da1 0 2023-12-16T20:11:30.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/355: mknod d17/c6c 0 2023-12-16T20:11:30.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/356: readlink d17/d34/d3d/d45/d4e/l4f 0 2023-12-16T20:11:30.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/545: truncate d2/d14/f22 3924579 0 2023-12-16T20:11:30.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/546: chown d2/d14/c3b 0 1 2023-12-16T20:11:30.154 INFO:tasks.workunit.client.0.smithi038.stdout:4/461: truncate d13/d1f/d22/f44 1709242 0 2023-12-16T20:11:30.154 INFO:tasks.workunit.client.0.smithi038.stdout:4/462: getdents d13/d1f/d98 0 2023-12-16T20:11:30.154 INFO:tasks.workunit.client.0.smithi038.stdout:4/463: stat d13/d17/d4b 0 2023-12-16T20:11:30.157 INFO:tasks.workunit.client.1.smithi141.stdout:1/125: getdents da/d1a 0 2023-12-16T20:11:30.157 INFO:tasks.workunit.client.1.smithi141.stdout:0/141: rename d4/f17 to d4/f33 0 2023-12-16T20:11:30.158 INFO:tasks.workunit.client.0.smithi038.stdout:9/528: rmdir d9/d1e/d40/d5e/d71 39 2023-12-16T20:11:30.158 INFO:tasks.workunit.client.0.smithi038.stdout:9/529: write d9/d1e/d3d/f6b [2590088,86842] 0 2023-12-16T20:11:30.159 INFO:tasks.workunit.client.0.smithi038.stdout:8/357: mknod d17/d1b/d25/c6d 0 2023-12-16T20:11:30.160 INFO:tasks.workunit.client.1.smithi141.stdout:1/126: symlink da/d1a/l28 0 2023-12-16T20:11:30.163 INFO:tasks.workunit.client.0.smithi038.stdout:5/547: dread d2/df/d1a/d2a/f6c [0,4194304] 0 2023-12-16T20:11:30.163 INFO:tasks.workunit.client.0.smithi038.stdout:5/548: chown d2/d14/d25/d2d/d17/d55/f72 20134236 1 2023-12-16T20:11:30.163 INFO:tasks.workunit.client.0.smithi038.stdout:5/549: fdatasync d2/d14/d25/d2d/d17/d51/d7b/d89/fa8 0 2023-12-16T20:11:30.164 INFO:tasks.workunit.client.0.smithi038.stdout:1/532: sync 2023-12-16T20:11:30.164 INFO:tasks.workunit.client.0.smithi038.stdout:4/464: dread d13/d1f/d22/d34/f58 [0,4194304] 0 2023-12-16T20:11:30.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/478: getdents d4/d27/d40 0 2023-12-16T20:11:30.165 INFO:tasks.workunit.client.0.smithi038.stdout:1/533: dread d15/d22/d52/f91 [0,4194304] 0 2023-12-16T20:11:30.165 INFO:tasks.workunit.client.1.smithi141.stdout:0/142: symlink d4/l34 0 2023-12-16T20:11:30.165 INFO:tasks.workunit.client.1.smithi141.stdout:0/143: read - d4/f30 zero size 2023-12-16T20:11:30.167 INFO:tasks.workunit.client.0.smithi038.stdout:9/530: read d9/d1e/d3d/d42/d59/d76/f78 [338646,79454] 0 2023-12-16T20:11:30.167 INFO:tasks.workunit.client.0.smithi038.stdout:9/531: dread - d9/d1f/d21/d3e/f5f zero size 2023-12-16T20:11:30.167 INFO:tasks.workunit.client.0.smithi038.stdout:9/532: readlink d9/d1e/d40/d5e/l95 0 2023-12-16T20:11:30.169 INFO:tasks.workunit.client.1.smithi141.stdout:0/144: unlink d4/d7/l11 0 2023-12-16T20:11:30.169 INFO:tasks.workunit.client.1.smithi141.stdout:0/145: creat d4/f35 x:0 0 0 2023-12-16T20:11:30.169 INFO:tasks.workunit.client.1.smithi141.stdout:0/146: fsync d4/fe 0 2023-12-16T20:11:30.169 INFO:tasks.workunit.client.1.smithi141.stdout:0/147: truncate d4/f31 576053 0 2023-12-16T20:11:30.169 INFO:tasks.workunit.client.0.smithi038.stdout:5/550: rename d2/d14/d25/d2d/d17/f42 to d2/d14/d25/d2d/d4b/fac 0 2023-12-16T20:11:30.171 INFO:tasks.workunit.client.0.smithi038.stdout:8/358: write d17/f40 [8369654,49493] 0 2023-12-16T20:11:30.171 INFO:tasks.workunit.client.0.smithi038.stdout:8/359: creat d17/d34/d3d/d50/f6e x:0 0 0 2023-12-16T20:11:30.172 INFO:tasks.workunit.client.1.smithi141.stdout:1/127: unlink da/d1a/d1d/f21 0 2023-12-16T20:11:30.177 INFO:tasks.workunit.client.0.smithi038.stdout:9/533: link d9/d1e/f74 d9/d1e/d3d/d42/d59/fa2 0 2023-12-16T20:11:30.177 INFO:tasks.workunit.client.0.smithi038.stdout:9/534: write d9/d1e/d40/d5e/f67 [563634,8391] 0 2023-12-16T20:11:30.179 INFO:tasks.workunit.client.0.smithi038.stdout:4/465: rename d13/d1f/l5a to d13/d1f/d22/d34/l99 0 2023-12-16T20:11:30.179 INFO:tasks.workunit.client.0.smithi038.stdout:4/466: write d13/d1f/d22/d34/f76 [537081,31655] 0 2023-12-16T20:11:30.179 INFO:tasks.workunit.client.0.smithi038.stdout:4/467: dread - d13/f91 zero size 2023-12-16T20:11:30.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/551: link d2/df/d1a/d2a/f68 d2/df/d1a/d2a/d59/fad 0 2023-12-16T20:11:30.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/552: write d2/d4/fb [12022949,27181] 0 2023-12-16T20:11:30.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/553: truncate d2/f9 1905495 0 2023-12-16T20:11:30.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/554: truncate d2/d14/d25/d2d/f63 44035 0 2023-12-16T20:11:30.185 INFO:tasks.workunit.client.0.smithi038.stdout:2/554: sync 2023-12-16T20:11:30.186 INFO:tasks.workunit.client.0.smithi038.stdout:0/507: sync 2023-12-16T20:11:30.186 INFO:tasks.workunit.client.0.smithi038.stdout:0/508: truncate db/d16/d1c/d5d/d64/f84 717093 0 2023-12-16T20:11:30.186 INFO:tasks.workunit.client.0.smithi038.stdout:0/509: chown db/d16/fa0 82505 1 2023-12-16T20:11:30.189 INFO:tasks.workunit.client.1.smithi141.stdout:1/128: dread da/df/f18 [0,4194304] 0 2023-12-16T20:11:30.190 INFO:tasks.workunit.client.1.smithi141.stdout:0/148: dwrite d4/fe [0,4194304] 0 2023-12-16T20:11:30.190 INFO:tasks.workunit.client.1.smithi141.stdout:0/149: fsync f2 0 2023-12-16T20:11:30.193 INFO:tasks.workunit.client.1.smithi141.stdout:1/129: mkdir da/d1a/d1d/d22/d29 0 2023-12-16T20:11:30.194 INFO:tasks.workunit.client.1.smithi141.stdout:0/150: symlink d4/l36 0 2023-12-16T20:11:30.194 INFO:tasks.workunit.client.1.smithi141.stdout:1/130: truncate da/df/f27 604111 0 2023-12-16T20:11:30.195 INFO:tasks.workunit.client.1.smithi141.stdout:0/151: mknod d4/c37 0 2023-12-16T20:11:30.197 INFO:tasks.workunit.client.1.smithi141.stdout:0/152: mknod d4/d7/c38 0 2023-12-16T20:11:30.197 INFO:tasks.workunit.client.0.smithi038.stdout:8/360: mknod d17/d34/d3d/d45/d55/c6f 0 2023-12-16T20:11:30.198 INFO:tasks.workunit.client.1.smithi141.stdout:0/153: unlink d4/f30 0 2023-12-16T20:11:30.198 INFO:tasks.workunit.client.1.smithi141.stdout:0/154: stat d4/c37 0 2023-12-16T20:11:30.202 INFO:tasks.workunit.client.0.smithi038.stdout:3/479: rmdir d4 39 2023-12-16T20:11:30.203 INFO:tasks.workunit.client.1.smithi141.stdout:1/131: dread da/fb [0,4194304] 0 2023-12-16T20:11:30.204 INFO:tasks.workunit.client.0.smithi038.stdout:0/510: read db/d1a/f33 [173430,115225] 0 2023-12-16T20:11:30.204 INFO:tasks.workunit.client.0.smithi038.stdout:0/511: write db/d16/d19/d27/f3b [917338,27955] 0 2023-12-16T20:11:30.204 INFO:tasks.workunit.client.0.smithi038.stdout:1/534: unlink d15/d22/d71/l73 0 2023-12-16T20:11:30.206 INFO:tasks.workunit.client.1.smithi141.stdout:1/132: rename f7 to da/d1a/d1d/d22/d29/f2a 0 2023-12-16T20:11:30.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/468: creat d13/d1f/f9a x:0 0 0 2023-12-16T20:11:30.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/469: fsync fb 0 2023-12-16T20:11:30.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/470: chown d13/d17/d2e/d32/d70/d84 1701955 1 2023-12-16T20:11:30.207 INFO:tasks.workunit.client.1.smithi141.stdout:1/133: mkdir da/df/d2b 0 2023-12-16T20:11:30.208 INFO:tasks.workunit.client.0.smithi038.stdout:8/361: unlink d17/d1b/d25/l5e 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.1.smithi141.stdout:0/155: dread d4/f33 [0,4194304] 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.1.smithi141.stdout:1/134: write da/df/f24 [502721,67957] 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.1.smithi141.stdout:1/135: stat da 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.1.smithi141.stdout:1/136: creat da/f2c x:0 0 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.1.smithi141.stdout:1/137: fdatasync f6 0 2023-12-16T20:11:30.209 INFO:tasks.workunit.client.0.smithi038.stdout:3/480: getdents d4/d8/d15/d2c/d4c/d70/d71 0 2023-12-16T20:11:30.210 INFO:tasks.workunit.client.0.smithi038.stdout:2/555: dwrite d1/d73/f7c [4194304,4194304] 0 2023-12-16T20:11:30.210 INFO:tasks.workunit.client.0.smithi038.stdout:5/555: dwrite d2/d14/f22 [0,4194304] 0 2023-12-16T20:11:30.211 INFO:tasks.workunit.client.0.smithi038.stdout:4/471: rename d13/d17/d2e/d32/d4d/f81 to d13/d17/d2e/d32/d4e/d61/f9b 0 2023-12-16T20:11:30.212 INFO:tasks.workunit.client.0.smithi038.stdout:9/535: dwrite d9/d1f/d21/d3e/d4e/d61/f89 [0,4194304] 0 2023-12-16T20:11:30.213 INFO:tasks.workunit.client.1.smithi141.stdout:5/100: sync 2023-12-16T20:11:30.213 INFO:tasks.workunit.client.1.smithi141.stdout:6/213: sync 2023-12-16T20:11:30.213 INFO:tasks.workunit.client.1.smithi141.stdout:2/61: sync 2023-12-16T20:11:30.213 INFO:tasks.workunit.client.1.smithi141.stdout:2/62: chown d6/da/db/l13 940 1 2023-12-16T20:11:30.213 INFO:tasks.workunit.client.1.smithi141.stdout:7/108: sync 2023-12-16T20:11:30.214 INFO:tasks.workunit.client.1.smithi141.stdout:9/123: sync 2023-12-16T20:11:30.216 INFO:tasks.workunit.client.0.smithi038.stdout:8/362: unlink d17/d34/d3d/d59/l5f 0 2023-12-16T20:11:30.218 INFO:tasks.workunit.client.1.smithi141.stdout:5/101: mknod d0/d9/c1e 0 2023-12-16T20:11:30.218 INFO:tasks.workunit.client.0.smithi038.stdout:3/481: mknod d4/d27/ca5 0 2023-12-16T20:11:30.218 INFO:tasks.workunit.client.0.smithi038.stdout:3/482: write d4/d27/d40/f5f [898775,106848] 0 2023-12-16T20:11:30.218 INFO:tasks.workunit.client.0.smithi038.stdout:0/512: dread db/d16/f8c [0,4194304] 0 2023-12-16T20:11:30.218 INFO:tasks.workunit.client.0.smithi038.stdout:5/556: dread d2/df/d1a/d2a/f74 [0,4194304] 0 2023-12-16T20:11:30.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/557: stat d2/df/d1a/d2a/d59/f6f 0 2023-12-16T20:11:30.219 INFO:tasks.workunit.client.1.smithi141.stdout:0/156: read d4/d7/f24 [1833816,82261] 0 2023-12-16T20:11:30.219 INFO:tasks.workunit.client.1.smithi141.stdout:0/157: readlink d4/l36 0 2023-12-16T20:11:30.219 INFO:tasks.workunit.client.1.smithi141.stdout:9/124: creat d1/d10/d14/d20/da/f32 x:0 0 0 2023-12-16T20:11:30.220 INFO:tasks.workunit.client.1.smithi141.stdout:1/138: dread da/d1a/d1d/d22/d29/f2a [0,4194304] 0 2023-12-16T20:11:30.222 INFO:tasks.workunit.client.0.smithi038.stdout:2/556: rename d1/db8 to d1/df/d21/d9a/db9 0 2023-12-16T20:11:30.224 INFO:tasks.workunit.client.1.smithi141.stdout:5/102: dread d0/fe [0,4194304] 0 2023-12-16T20:11:30.224 INFO:tasks.workunit.client.1.smithi141.stdout:6/214: rmdir d1/d12 39 2023-12-16T20:11:30.224 INFO:tasks.workunit.client.1.smithi141.stdout:7/109: mkdir d5/d1d 0 2023-12-16T20:11:30.226 INFO:tasks.workunit.client.0.smithi038.stdout:9/536: truncate d9/d1e/d45/f4a 2294464 0 2023-12-16T20:11:30.226 INFO:tasks.workunit.client.0.smithi038.stdout:9/537: fsync d9/d1f/d21/d55/f65 0 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.1.smithi141.stdout:9/125: unlink d1/f6 0 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.1.smithi141.stdout:9/126: fdatasync d1/d10/d14/d20/da/f32 0 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.1.smithi141.stdout:9/127: write d1/d10/d14/f31 [697163,106464] 0 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.1.smithi141.stdout:9/128: chown d1/d10/d27/c2e 1924 1 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.1.smithi141.stdout:9/129: chown d1/d10/f15 566996 1 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.0.smithi038.stdout:3/483: creat d4/d6c/fa6 x:0 0 0 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.0.smithi038.stdout:3/484: chown d4/d8/f43 5387643 1 2023-12-16T20:11:30.227 INFO:tasks.workunit.client.0.smithi038.stdout:3/485: fsync d4/d6c/d80/f83 0 2023-12-16T20:11:30.228 INFO:tasks.workunit.client.0.smithi038.stdout:3/486: dread d4/d8/d15/f5d [0,4194304] 0 2023-12-16T20:11:30.228 INFO:tasks.workunit.client.1.smithi141.stdout:1/139: symlink da/d25/l2d 0 2023-12-16T20:11:30.228 INFO:tasks.workunit.client.1.smithi141.stdout:1/140: stat da 0 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/103: rename d0/d14/l19 to d0/df/l1f 0 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/104: chown d0/df/l1f 3563 1 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/105: chown d0/d9/d16 15 1 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/106: write d0/f4 [190286,89644] 0 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/107: write d0/d14/f1b [863967,33324] 0 2023-12-16T20:11:30.230 INFO:tasks.workunit.client.1.smithi141.stdout:5/108: dread - d0/df/f1d zero size 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.0.smithi038.stdout:5/558: mknod d2/df/d1a/d1f/d4a/cae 0 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/557: rename d1/d5/d3d/f47 to d1/df/d21/d82/fba 0 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.0.smithi038.stdout:5/559: truncate d2/d14/f92 575215 0 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/558: dread - d1/d5/d95/fb4 zero size 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/559: dread - d1/df/f62 zero size 2023-12-16T20:11:30.232 INFO:tasks.workunit.client.1.smithi141.stdout:6/215: unlink d1/f4 0 2023-12-16T20:11:30.233 INFO:tasks.workunit.client.0.smithi038.stdout:1/535: dwrite d15/d22/f51 [0,4194304] 0 2023-12-16T20:11:30.233 INFO:tasks.workunit.client.0.smithi038.stdout:0/513: mkdir db/d16/d19/d4e/dac 0 2023-12-16T20:11:30.233 INFO:tasks.workunit.client.0.smithi038.stdout:0/514: write f5 [5560758,9490] 0 2023-12-16T20:11:30.234 INFO:tasks.workunit.client.1.smithi141.stdout:7/110: mkdir d5/d1d/d1e 0 2023-12-16T20:11:30.235 INFO:tasks.workunit.client.0.smithi038.stdout:3/487: mkdir d4/d6c/da7 0 2023-12-16T20:11:30.236 INFO:tasks.workunit.client.1.smithi141.stdout:9/130: mkdir d1/d10/d33 0 2023-12-16T20:11:30.237 INFO:tasks.workunit.client.1.smithi141.stdout:7/111: dread d5/f14 [0,4194304] 0 2023-12-16T20:11:30.237 INFO:tasks.workunit.client.1.smithi141.stdout:1/141: mknod da/d1a/d1d/c2e 0 2023-12-16T20:11:30.237 INFO:tasks.workunit.client.1.smithi141.stdout:1/142: creat da/d25/f2f x:0 0 0 2023-12-16T20:11:30.238 INFO:tasks.workunit.client.0.smithi038.stdout:1/536: mknod d15/d1e/d23/d34/d86/cb3 0 2023-12-16T20:11:30.239 INFO:tasks.workunit.client.0.smithi038.stdout:1/537: readlink d15/d1e/d23/d7d/lab 0 2023-12-16T20:11:30.239 INFO:tasks.workunit.client.0.smithi038.stdout:9/538: dread d9/d1f/d21/f3a [0,4194304] 0 2023-12-16T20:11:30.239 INFO:tasks.workunit.client.0.smithi038.stdout:9/539: write d9/d1e/f74 [119117,120101] 0 2023-12-16T20:11:30.240 INFO:tasks.workunit.client.0.smithi038.stdout:8/363: rename ca to d17/d34/d3d/d45/d55/c70 0 2023-12-16T20:11:30.241 INFO:tasks.workunit.client.1.smithi141.stdout:5/109: unlink d0/df/f1a 0 2023-12-16T20:11:30.242 INFO:tasks.workunit.client.0.smithi038.stdout:5/560: rmdir d2/d14/d25/d2d/d17/d93 39 2023-12-16T20:11:30.243 INFO:tasks.workunit.client.1.smithi141.stdout:6/216: rmdir d1/d12/d20 39 2023-12-16T20:11:30.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/488: mkdir d4/d6c/d80/da8 0 2023-12-16T20:11:30.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/489: dread - d4/d18/f94 zero size 2023-12-16T20:11:30.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/490: fdatasync d4/d27/d23/f4f 0 2023-12-16T20:11:30.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/491: readlink d4/d18/l89 0 2023-12-16T20:11:30.246 INFO:tasks.workunit.client.1.smithi141.stdout:7/112: creat d5/d16/d1a/f1f x:0 0 0 2023-12-16T20:11:30.249 INFO:tasks.workunit.client.0.smithi038.stdout:0/515: rename db/d16/d19/l5c to db/d16/d5a/d65/d90/lad 0 2023-12-16T20:11:30.249 INFO:tasks.workunit.client.0.smithi038.stdout:0/516: creat db/d16/d1c/fae x:0 0 0 2023-12-16T20:11:30.252 INFO:tasks.workunit.client.0.smithi038.stdout:3/492: creat d4/d27/fa9 x:0 0 0 2023-12-16T20:11:30.255 INFO:tasks.workunit.client.0.smithi038.stdout:4/472: dwrite d13/d1f/f66 [0,4194304] 0 2023-12-16T20:11:30.255 INFO:tasks.workunit.client.1.smithi141.stdout:5/110: creat d0/d9/f20 x:0 0 0 2023-12-16T20:11:30.257 INFO:tasks.workunit.client.1.smithi141.stdout:6/217: truncate d1/d12/d22/d25/d38/f3e 3062981 0 2023-12-16T20:11:30.258 INFO:tasks.workunit.client.0.smithi038.stdout:8/364: rename d17/d34/d3d/d45/d4e/f52 to d17/d1d/f71 0 2023-12-16T20:11:30.259 INFO:tasks.workunit.client.1.smithi141.stdout:0/158: dwrite f1 [0,4194304] 0 2023-12-16T20:11:30.260 INFO:tasks.workunit.client.1.smithi141.stdout:2/63: dwrite d6/f17 [0,4194304] 0 2023-12-16T20:11:30.261 INFO:tasks.workunit.client.1.smithi141.stdout:5/111: dread d0/fe [0,4194304] 0 2023-12-16T20:11:30.262 INFO:tasks.workunit.client.1.smithi141.stdout:0/159: link d4/d7/c38 d4/c39 0 2023-12-16T20:11:30.263 INFO:tasks.workunit.client.0.smithi038.stdout:3/493: rmdir d4/d8/d15/d6d 39 2023-12-16T20:11:30.266 INFO:tasks.workunit.client.0.smithi038.stdout:4/473: dread d13/f77 [0,4194304] 0 2023-12-16T20:11:30.267 INFO:tasks.workunit.client.0.smithi038.stdout:2/560: dwrite d1/d5/d6c/da7/fa9 [0,4194304] 0 2023-12-16T20:11:30.269 INFO:tasks.workunit.client.1.smithi141.stdout:0/160: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:30.269 INFO:tasks.workunit.client.1.smithi141.stdout:0/161: chown d4/l28 29694 1 2023-12-16T20:11:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/474: write fb [8947052,27908] 0 2023-12-16T20:11:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/475: read - d13/f91 zero size 2023-12-16T20:11:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/476: write d13/d1f/f8e [404093,59421] 0 2023-12-16T20:11:30.273 INFO:tasks.workunit.client.1.smithi141.stdout:0/162: mkdir d4/d3a 0 2023-12-16T20:11:30.273 INFO:tasks.workunit.client.1.smithi141.stdout:0/163: chown d4/f20 31 1 2023-12-16T20:11:30.277 INFO:tasks.workunit.client.1.smithi141.stdout:7/113: dwrite d5/d16/f17 [0,4194304] 0 2023-12-16T20:11:30.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/164: mkdir d4/d3a/d3b 0 2023-12-16T20:11:30.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/165: stat d4/d7/f1e 0 2023-12-16T20:11:30.279 INFO:tasks.workunit.client.1.smithi141.stdout:7/114: symlink d5/d1d/d1e/l20 0 2023-12-16T20:11:30.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/166: symlink d4/l3c 0 2023-12-16T20:11:30.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/167: chown d4/l28 91933 1 2023-12-16T20:11:30.282 INFO:tasks.workunit.client.1.smithi141.stdout:0/168: link d4/l27 d4/d7/l3d 0 2023-12-16T20:11:30.282 INFO:tasks.workunit.client.1.smithi141.stdout:2/64: dread d6/f17 [0,4194304] 0 2023-12-16T20:11:30.283 INFO:tasks.workunit.client.0.smithi038.stdout:3/494: symlink d4/d8/d15/d2c/d7d/laa 0 2023-12-16T20:11:30.285 INFO:tasks.workunit.client.1.smithi141.stdout:0/169: unlink d4/f23 0 2023-12-16T20:11:30.288 INFO:tasks.workunit.client.1.smithi141.stdout:2/65: rename d6/da/db/l13 to d6/l18 0 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.0.smithi038.stdout:2/561: symlink d1/df/d6a/lbb 0 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.0.smithi038.stdout:1/538: dwrite d15/d1e/d3b/d48/d37/f47 [0,4194304] 0 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.1.smithi141.stdout:0/170: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.1.smithi141.stdout:0/171: chown d4/l15 121 1 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.1.smithi141.stdout:0/172: chown d4/d7/fd 45 1 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.1.smithi141.stdout:0/173: stat d4/d7/c2f 0 2023-12-16T20:11:30.293 INFO:tasks.workunit.client.0.smithi038.stdout:3/495: mkdir d4/dab 0 2023-12-16T20:11:30.295 INFO:tasks.workunit.client.0.smithi038.stdout:2/562: mknod d1/df/d21/d82/cbc 0 2023-12-16T20:11:30.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/115: dread d5/d16/f17 [0,4194304] 0 2023-12-16T20:11:30.297 INFO:tasks.workunit.client.1.smithi141.stdout:7/116: link d5/d1d/d1e/l20 d5/d1d/l21 0 2023-12-16T20:11:30.298 INFO:tasks.workunit.client.0.smithi038.stdout:2/563: link d1/d5/d2a/c33 d1/cbd 0 2023-12-16T20:11:30.301 INFO:tasks.workunit.client.0.smithi038.stdout:2/564: rename d1/d88/cac to d1/df/d6d/cbe 0 2023-12-16T20:11:30.302 INFO:tasks.workunit.client.0.smithi038.stdout:2/565: stat d1/df/d21/d82/l65 0 2023-12-16T20:11:30.302 INFO:tasks.workunit.client.1.smithi141.stdout:7/117: rename d5/d16/f18 to d5/f22 0 2023-12-16T20:11:30.308 INFO:tasks.workunit.client.1.smithi141.stdout:9/131: dwrite d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:30.308 INFO:tasks.workunit.client.1.smithi141.stdout:1/143: dwrite da/df/f13 [4194304,4194304] 0 2023-12-16T20:11:30.309 INFO:tasks.workunit.client.0.smithi038.stdout:4/477: dwrite d13/d17/f95 [0,4194304] 0 2023-12-16T20:11:30.309 INFO:tasks.workunit.client.1.smithi141.stdout:9/132: creat d1/d10/d33/f34 x:0 0 0 2023-12-16T20:11:30.311 INFO:tasks.workunit.client.1.smithi141.stdout:1/144: creat da/d1a/d1d/d22/f30 x:0 0 0 2023-12-16T20:11:30.311 INFO:tasks.workunit.client.0.smithi038.stdout:0/517: dwrite f8 [0,4194304] 0 2023-12-16T20:11:30.312 INFO:tasks.workunit.client.1.smithi141.stdout:7/118: read d5/d16/f17 [801531,113635] 0 2023-12-16T20:11:30.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/119: mknod d5/d1d/d1e/c23 0 2023-12-16T20:11:30.317 INFO:tasks.workunit.client.0.smithi038.stdout:4/478: write d13/d17/d2e/f52 [1354107,17519] 0 2023-12-16T20:11:30.317 INFO:tasks.workunit.client.0.smithi038.stdout:4/479: chown d13/d17/d4b/d7d 64 1 2023-12-16T20:11:30.318 INFO:tasks.workunit.client.1.smithi141.stdout:7/120: creat d5/f24 x:0 0 0 2023-12-16T20:11:30.319 INFO:tasks.workunit.client.0.smithi038.stdout:4/480: read d13/f37 [550435,62396] 0 2023-12-16T20:11:30.320 INFO:tasks.workunit.client.0.smithi038.stdout:8/365: getdents d17/d1d 0 2023-12-16T20:11:30.321 INFO:tasks.workunit.client.1.smithi141.stdout:7/121: dread d5/fc [0,4194304] 0 2023-12-16T20:11:30.322 INFO:tasks.workunit.client.1.smithi141.stdout:7/122: creat d5/d16/d1a/f25 x:0 0 0 2023-12-16T20:11:30.323 INFO:tasks.workunit.client.0.smithi038.stdout:4/481: creat d13/d17/d62/f9c x:0 0 0 2023-12-16T20:11:30.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/123: dread d5/fc [0,4194304] 0 2023-12-16T20:11:30.326 INFO:tasks.workunit.client.0.smithi038.stdout:8/366: rename d17/d1d/f21 to d17/d1b/d66/f72 0 2023-12-16T20:11:30.326 INFO:tasks.workunit.client.1.smithi141.stdout:7/124: truncate d5/f13 858558 0 2023-12-16T20:11:30.330 INFO:tasks.workunit.client.0.smithi038.stdout:8/367: rename d17/d34/d3d/d45 to d17/d1b/d66/d73 0 2023-12-16T20:11:30.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/482: rename d13/d17/d2e/d32/d4e/d61 to d13/d1f/d22/d9d 0 2023-12-16T20:11:30.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/483: write d13/f48 [4669301,103709] 0 2023-12-16T20:11:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/496: dwrite d4/d8/d15/d2c/d4c/f78 [0,4194304] 0 2023-12-16T20:11:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/484: rename d13/d17/d4b/c3b to d13/d1f/c9e 0 2023-12-16T20:11:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/485: readlink d13/d17/l5b 0 2023-12-16T20:11:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/486: read d13/d1f/d35/f38 [1595519,90571] 0 2023-12-16T20:11:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/487: stat d13/d17/d2e/l51 0 2023-12-16T20:11:30.343 INFO:tasks.workunit.client.1.smithi141.stdout:3/192: sync 2023-12-16T20:11:30.343 INFO:tasks.workunit.client.1.smithi141.stdout:8/139: sync 2023-12-16T20:11:30.343 INFO:tasks.workunit.client.1.smithi141.stdout:3/193: fdatasync d0/f6 0 2023-12-16T20:11:30.343 INFO:tasks.workunit.client.1.smithi141.stdout:4/143: sync 2023-12-16T20:11:30.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/140: write d14/f15 [2651589,86204] 0 2023-12-16T20:11:30.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/141: write ff [1342001,29366] 0 2023-12-16T20:11:30.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/142: read - d14/d19/f20 zero size 2023-12-16T20:11:30.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/143: chown d14/d19/d1b/d24/l2b 63884731 1 2023-12-16T20:11:30.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/144: stat d14/d19/d1b/f1a 0 2023-12-16T20:11:30.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/144: chown d1a/c24 854575 1 2023-12-16T20:11:30.345 INFO:tasks.workunit.client.1.smithi141.stdout:3/194: symlink d0/d1c/l3d 0 2023-12-16T20:11:30.345 INFO:tasks.workunit.client.1.smithi141.stdout:3/195: stat d0/d13/f39 0 2023-12-16T20:11:30.345 INFO:tasks.workunit.client.0.smithi038.stdout:3/497: rename d4/d8/d15/d6d/d7a/f8a to d4/d27/d40/fac 0 2023-12-16T20:11:30.346 INFO:tasks.workunit.client.1.smithi141.stdout:8/145: mkdir d14/d19/d1b/d30 0 2023-12-16T20:11:30.346 INFO:tasks.workunit.client.1.smithi141.stdout:8/146: write d14/d19/f20 [765837,118629] 0 2023-12-16T20:11:30.346 INFO:tasks.workunit.client.1.smithi141.stdout:4/145: mknod d1a/d2a/c38 0 2023-12-16T20:11:30.346 INFO:tasks.workunit.client.1.smithi141.stdout:4/146: write fa [1355073,36067] 0 2023-12-16T20:11:30.346 INFO:tasks.workunit.client.1.smithi141.stdout:4/147: chown c7 660 1 2023-12-16T20:11:30.347 INFO:tasks.workunit.client.0.smithi038.stdout:4/488: mknod d13/d17/d4b/c9f 0 2023-12-16T20:11:30.347 INFO:tasks.workunit.client.0.smithi038.stdout:4/489: chown d13/d1f/d22/d9d/l8b 3578 1 2023-12-16T20:11:30.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/498: getdents d4/d8/d15/d2c/d4c/d70 0 2023-12-16T20:11:30.348 INFO:tasks.workunit.client.0.smithi038.stdout:3/499: mknod d4/d6c/cad 0 2023-12-16T20:11:30.348 INFO:tasks.workunit.client.0.smithi038.stdout:3/500: chown d4/d8/d15/d6d/d7a/d98 16469740 1 2023-12-16T20:11:30.348 INFO:tasks.workunit.client.1.smithi141.stdout:3/196: symlink d0/d1c/d2c/l3e 0 2023-12-16T20:11:30.349 INFO:tasks.workunit.client.0.smithi038.stdout:3/501: rename d4/d8/d15/d2c/d4c/d70/d71/d85 to d4/d8/d15/d2c/d4c/dae 0 2023-12-16T20:11:30.349 INFO:tasks.workunit.client.1.smithi141.stdout:3/197: mkdir d0/d13/d3f 0 2023-12-16T20:11:30.351 INFO:tasks.workunit.client.0.smithi038.stdout:1/539: dwrite d15/d1e/d3b/d48/d37/f9f [0,4194304] 0 2023-12-16T20:11:30.351 INFO:tasks.workunit.client.0.smithi038.stdout:1/540: read - d15/d1e/d23/d34/f38 zero size 2023-12-16T20:11:30.357 INFO:tasks.workunit.client.0.smithi038.stdout:4/490: dread d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:30.357 INFO:tasks.workunit.client.0.smithi038.stdout:4/491: chown d13/d17/d2e/d32/d70/d84/d88 14167 1 2023-12-16T20:11:30.360 INFO:tasks.workunit.client.1.smithi141.stdout:1/145: dwrite da/df/f27 [0,4194304] 0 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.0.smithi038.stdout:0/518: dwrite db/d16/d1c/d5d/d64/f84 [0,4194304] 0 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.0.smithi038.stdout:0/519: fsync db/d16/d19/d4e/f9d 0 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.0.smithi038.stdout:8/368: dwrite f1 [0,4194304] 0 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.0.smithi038.stdout:8/369: fdatasync d17/d1b/f22 0 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.0.smithi038.stdout:8/370: chown d17/f38 1 1 2023-12-16T20:11:30.361 INFO:tasks.workunit.client.1.smithi141.stdout:4/148: dread f19 [0,4194304] 0 2023-12-16T20:11:30.362 INFO:tasks.workunit.client.1.smithi141.stdout:2/66: dwrite d6/f17 [4194304,4194304] 0 2023-12-16T20:11:30.365 INFO:tasks.workunit.client.1.smithi141.stdout:3/198: dread d0/d13/f1e [0,4194304] 0 2023-12-16T20:11:30.365 INFO:tasks.workunit.client.1.smithi141.stdout:3/199: stat d0/ce 0 2023-12-16T20:11:30.365 INFO:tasks.workunit.client.1.smithi141.stdout:3/200: chown d0/d1c 226001325 1 2023-12-16T20:11:30.368 INFO:tasks.workunit.client.0.smithi038.stdout:4/492: dread d13/d17/d2e/d32/d4d/d4f/f53 [0,4194304] 0 2023-12-16T20:11:30.373 INFO:tasks.workunit.client.1.smithi141.stdout:1/146: rename da/df/d2b to da/d1a/d31 0 2023-12-16T20:11:30.373 INFO:tasks.workunit.client.1.smithi141.stdout:1/147: chown da/df/f24 20637 1 2023-12-16T20:11:30.373 INFO:tasks.workunit.client.0.smithi038.stdout:0/520: creat db/d16/d19/d27/d78/faf x:0 0 0 2023-12-16T20:11:30.375 INFO:tasks.workunit.client.1.smithi141.stdout:4/149: rename d1a/l34 to d1a/l39 0 2023-12-16T20:11:30.376 INFO:tasks.workunit.client.0.smithi038.stdout:3/502: dwrite d4/d8/d15/f56 [0,4194304] 0 2023-12-16T20:11:30.376 INFO:tasks.workunit.client.1.smithi141.stdout:2/67: dread d6/f17 [4194304,4194304] 0 2023-12-16T20:11:30.376 INFO:tasks.workunit.client.1.smithi141.stdout:9/133: rmdir d1/d10/d33 39 2023-12-16T20:11:30.379 INFO:tasks.workunit.client.1.smithi141.stdout:4/150: symlink d1a/d2a/l3a 0 2023-12-16T20:11:30.379 INFO:tasks.workunit.client.0.smithi038.stdout:0/521: dread db/d16/d19/f43 [0,4194304] 0 2023-12-16T20:11:30.380 INFO:tasks.workunit.client.1.smithi141.stdout:2/68: stat d6/c16 0 2023-12-16T20:11:30.380 INFO:tasks.workunit.client.1.smithi141.stdout:2/69: chown d6/c16 8874 1 2023-12-16T20:11:30.381 INFO:tasks.workunit.client.0.smithi038.stdout:3/503: dread d4/d18/f34 [4194304,4194304] 0 2023-12-16T20:11:30.381 INFO:tasks.workunit.client.0.smithi038.stdout:4/493: getdents d13 0 2023-12-16T20:11:30.381 INFO:tasks.workunit.client.1.smithi141.stdout:9/134: mknod d1/d10/d33/c35 0 2023-12-16T20:11:30.382 INFO:tasks.workunit.client.0.smithi038.stdout:8/371: dwrite d17/d34/f36 [0,4194304] 0 2023-12-16T20:11:30.385 INFO:tasks.workunit.client.1.smithi141.stdout:8/147: getdents d14/d19/d1b 0 2023-12-16T20:11:30.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/504: mkdir d4/d8/d15/d6d/d7a/daf 0 2023-12-16T20:11:30.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/505: truncate d4/d27/d23/d26/f68 1565678 0 2023-12-16T20:11:30.386 INFO:tasks.workunit.client.0.smithi038.stdout:4/494: stat d13/d1f/c9e 0 2023-12-16T20:11:30.387 INFO:tasks.workunit.client.1.smithi141.stdout:4/151: mkdir d1a/d2a/d3b 0 2023-12-16T20:11:30.388 INFO:tasks.workunit.client.0.smithi038.stdout:6/451: sync 2023-12-16T20:11:30.391 INFO:tasks.workunit.client.0.smithi038.stdout:8/372: creat d17/d1b/d57/f74 x:0 0 0 2023-12-16T20:11:30.391 INFO:tasks.workunit.client.0.smithi038.stdout:8/373: dread - d17/d1b/d66/d73/d54/d69/f2a zero size 2023-12-16T20:11:30.391 INFO:tasks.workunit.client.1.smithi141.stdout:9/135: unlink d1/d10/d14/d20/fb 0 2023-12-16T20:11:30.392 INFO:tasks.workunit.client.0.smithi038.stdout:4/495: read d13/d1f/d35/f63 [685675,33748] 0 2023-12-16T20:11:30.392 INFO:tasks.workunit.client.0.smithi038.stdout:0/522: getdents db/d16/d5a/d65 0 2023-12-16T20:11:30.392 INFO:tasks.workunit.client.0.smithi038.stdout:0/523: write db/d16/d19/d27/f34 [1947427,61736] 0 2023-12-16T20:11:30.394 INFO:tasks.workunit.client.0.smithi038.stdout:3/506: symlink d4/d8/d15/d2c/d4c/d58/lb0 0 2023-12-16T20:11:30.395 INFO:tasks.workunit.client.0.smithi038.stdout:6/452: mkdir d1/d4/d1d/d8e 0 2023-12-16T20:11:30.395 INFO:tasks.workunit.client.0.smithi038.stdout:6/453: creat d1/f8f x:0 0 0 2023-12-16T20:11:30.395 INFO:tasks.workunit.client.0.smithi038.stdout:6/454: write d1/f38 [31170,29296] 0 2023-12-16T20:11:30.395 INFO:tasks.workunit.client.1.smithi141.stdout:8/148: dread d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:30.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/496: creat d13/d69/d7a/fa0 x:0 0 0 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:3/201: rename d0/d13 to d0/d1c/d40 0 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:3/202: chown d0/d1c/d40/d3f 2558460 1 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:3/203: fsync d0/f6 0 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:3/204: creat d0/f41 x:0 0 0 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:3/205: stat d0/d1c/c20 0 2023-12-16T20:11:30.397 INFO:tasks.workunit.client.1.smithi141.stdout:2/70: symlink d6/l19 0 2023-12-16T20:11:30.400 INFO:tasks.workunit.client.1.smithi141.stdout:4/152: mkdir d1a/d3c 0 2023-12-16T20:11:30.402 INFO:tasks.workunit.client.1.smithi141.stdout:8/149: unlink f5 0 2023-12-16T20:11:30.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/455: link d1/d4/d1d/d67/c80 d1/d16/d23/d5f/c90 0 2023-12-16T20:11:30.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/150: dread d14/d19/d1b/f2f [0,4194304] 0 2023-12-16T20:11:30.404 INFO:tasks.workunit.client.1.smithi141.stdout:8/151: write d14/d19/f20 [552360,7161] 0 2023-12-16T20:11:30.405 INFO:tasks.workunit.client.0.smithi038.stdout:6/456: mkdir d1/d4/d1d/d8e/d91 0 2023-12-16T20:11:30.405 INFO:tasks.workunit.client.0.smithi038.stdout:6/457: stat d1/f25 0 2023-12-16T20:11:30.407 INFO:tasks.workunit.client.1.smithi141.stdout:1/148: rmdir da 39 2023-12-16T20:11:30.409 INFO:tasks.workunit.client.0.smithi038.stdout:6/458: truncate d1/f56 8001735 0 2023-12-16T20:11:30.410 INFO:tasks.workunit.client.1.smithi141.stdout:8/152: rmdir d14/d19/d1b/d24 39 2023-12-16T20:11:30.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/507: write d4/f6 [3120253,3398] 0 2023-12-16T20:11:30.412 INFO:tasks.workunit.client.1.smithi141.stdout:2/71: dread d6/f7 [0,4194304] 0 2023-12-16T20:11:30.414 INFO:tasks.workunit.client.0.smithi038.stdout:6/459: mknod d1/d4/d1d/d67/c92 0 2023-12-16T20:11:30.416 INFO:tasks.workunit.client.1.smithi141.stdout:3/206: rename d0/d1c/l22 to d0/d1c/d40/l42 0 2023-12-16T20:11:30.416 INFO:tasks.workunit.client.1.smithi141.stdout:3/207: write d0/f41 [827340,59364] 0 2023-12-16T20:11:30.416 INFO:tasks.workunit.client.0.smithi038.stdout:3/508: symlink d4/lb1 0 2023-12-16T20:11:30.419 INFO:tasks.workunit.client.0.smithi038.stdout:6/460: rmdir d1/d4/d1d/d61/d6d 0 2023-12-16T20:11:30.419 INFO:tasks.workunit.client.1.smithi141.stdout:1/149: chown da/df/l17 14 1 2023-12-16T20:11:30.419 INFO:tasks.workunit.client.1.smithi141.stdout:1/150: readlink da/l19 0 2023-12-16T20:11:30.419 INFO:tasks.workunit.client.1.smithi141.stdout:1/151: write da/fc [1792434,791] 0 2023-12-16T20:11:30.421 INFO:tasks.workunit.client.1.smithi141.stdout:2/72: unlink d6/c9 0 2023-12-16T20:11:30.424 INFO:tasks.workunit.client.1.smithi141.stdout:2/73: mknod d6/d12/c1a 0 2023-12-16T20:11:30.424 INFO:tasks.workunit.client.1.smithi141.stdout:4/153: read f14 [352068,44966] 0 2023-12-16T20:11:30.424 INFO:tasks.workunit.client.1.smithi141.stdout:2/74: write d6/f7 [289034,63315] 0 2023-12-16T20:11:30.426 INFO:tasks.workunit.client.1.smithi141.stdout:3/208: link d0/f6 d0/d1c/d40/f43 0 2023-12-16T20:11:30.426 INFO:tasks.workunit.client.1.smithi141.stdout:3/209: write d0/f3a [1318539,122859] 0 2023-12-16T20:11:30.427 INFO:tasks.workunit.client.1.smithi141.stdout:4/154: symlink d1a/d3c/l3d 0 2023-12-16T20:11:30.429 INFO:tasks.workunit.client.1.smithi141.stdout:3/210: creat d0/d1c/f44 x:0 0 0 2023-12-16T20:11:30.431 INFO:tasks.workunit.client.1.smithi141.stdout:4/155: truncate d1a/f1c 744973 0 2023-12-16T20:11:30.434 INFO:tasks.workunit.client.1.smithi141.stdout:4/156: creat d1a/f3e x:0 0 0 2023-12-16T20:11:30.434 INFO:tasks.workunit.client.1.smithi141.stdout:4/157: read - d1a/d2a/f31 zero size 2023-12-16T20:11:30.437 INFO:tasks.workunit.client.1.smithi141.stdout:4/158: rename c10 to d1a/d2a/c3f 0 2023-12-16T20:11:30.439 INFO:tasks.workunit.client.0.smithi038.stdout:8/374: dwrite f1 [0,4194304] 0 2023-12-16T20:11:30.439 INFO:tasks.workunit.client.1.smithi141.stdout:4/159: mknod d1a/c40 0 2023-12-16T20:11:30.439 INFO:tasks.workunit.client.1.smithi141.stdout:4/160: chown l12 117698 1 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.0.smithi038.stdout:8/375: symlink d17/d34/d3d/l75 0 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.0.smithi038.stdout:8/376: fsync d17/d1b/f3f 0 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.1.smithi141.stdout:3/211: dread d0/f6 [4194304,4194304] 0 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.1.smithi141.stdout:9/136: dwrite d1/d10/f15 [0,4194304] 0 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.1.smithi141.stdout:3/212: write d0/f3a [670917,109578] 0 2023-12-16T20:11:30.442 INFO:tasks.workunit.client.1.smithi141.stdout:4/161: write d1a/f1c [98964,67507] 0 2023-12-16T20:11:30.443 INFO:tasks.workunit.client.0.smithi038.stdout:4/497: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:30.443 INFO:tasks.workunit.client.0.smithi038.stdout:4/498: fdatasync d13/d1f/d22/d34/f58 0 2023-12-16T20:11:30.443 INFO:tasks.workunit.client.0.smithi038.stdout:4/499: stat d13/d17/l79 0 2023-12-16T20:11:30.443 INFO:tasks.workunit.client.0.smithi038.stdout:8/377: getdents d17/d1b/d66/d73/d54/d69 0 2023-12-16T20:11:30.445 INFO:tasks.workunit.client.1.smithi141.stdout:9/137: mkdir d1/d10/d27/d36 0 2023-12-16T20:11:30.446 INFO:tasks.workunit.client.1.smithi141.stdout:4/162: symlink d1a/d3c/l41 0 2023-12-16T20:11:30.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/524: dwrite db/d1a/f73 [0,4194304] 0 2023-12-16T20:11:30.446 INFO:tasks.workunit.client.1.smithi141.stdout:8/153: dwrite d14/d19/f1f [4194304,4194304] 0 2023-12-16T20:11:30.447 INFO:tasks.workunit.client.0.smithi038.stdout:4/500: mknod d13/d17/d2e/d32/d70/ca1 0 2023-12-16T20:11:30.452 INFO:tasks.workunit.client.1.smithi141.stdout:4/163: write d1a/f1b [683345,129812] 0 2023-12-16T20:11:30.454 INFO:tasks.workunit.client.0.smithi038.stdout:4/501: symlink d13/d17/d2e/d32/d4e/la2 0 2023-12-16T20:11:30.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/164: rename d1a/d3c/l3d to d1a/d2a/d3b/l42 0 2023-12-16T20:11:30.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/165: dread - d1a/d2a/f2f zero size 2023-12-16T20:11:30.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/166: write f15 [2690230,47845] 0 2023-12-16T20:11:30.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/167: symlink d1a/d3c/l43 0 2023-12-16T20:11:30.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/168: read - d1a/f3e zero size 2023-12-16T20:11:30.457 INFO:tasks.workunit.client.1.smithi141.stdout:4/169: mknod d1a/d2a/c44 0 2023-12-16T20:11:30.457 INFO:tasks.workunit.client.0.smithi038.stdout:8/378: write d17/d1d/f31 [386862,123352] 0 2023-12-16T20:11:30.458 INFO:tasks.workunit.client.0.smithi038.stdout:4/502: link d13/f3c d13/d17/d2e/d32/d70/fa3 0 2023-12-16T20:11:30.459 INFO:tasks.workunit.client.0.smithi038.stdout:4/503: chown d13/d17/d2e/d32/d4d/d6e 971 1 2023-12-16T20:11:30.460 INFO:tasks.workunit.client.1.smithi141.stdout:9/138: write d1/d10/f12 [1438636,43410] 0 2023-12-16T20:11:30.460 INFO:tasks.workunit.client.1.smithi141.stdout:9/139: dread - d1/d10/d33/f34 zero size 2023-12-16T20:11:30.462 INFO:tasks.workunit.client.0.smithi038.stdout:8/379: mknod d17/d34/d3d/c76 0 2023-12-16T20:11:30.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/170: creat d1a/d2a/d3b/f45 x:0 0 0 2023-12-16T20:11:30.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/171: chown d1a/d2a/c3f 226304 1 2023-12-16T20:11:30.462 INFO:tasks.workunit.client.0.smithi038.stdout:6/461: dwrite d1/d4/f75 [0,4194304] 0 2023-12-16T20:11:30.464 INFO:tasks.workunit.client.1.smithi141.stdout:3/213: dread d0/d1c/d40/f1b [0,4194304] 0 2023-12-16T20:11:30.465 INFO:tasks.workunit.client.0.smithi038.stdout:4/504: rename d13/d1f/d22 to d13/d17/d4b/da4 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.0.smithi038.stdout:4/505: write d13/d17/d4b/da4/d9d/f9b [949576,19358] 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.0.smithi038.stdout:3/509: dwrite d4/d8/d15/d1e/f3f [0,4194304] 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.0.smithi038.stdout:3/510: fsync d4/d67/fa1 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.1.smithi141.stdout:3/214: fsync d0/d1c/d40/f1d 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.1.smithi141.stdout:1/152: dwrite da/d25/f26 [0,4194304] 0 2023-12-16T20:11:30.466 INFO:tasks.workunit.client.1.smithi141.stdout:1/153: stat da/l19 0 2023-12-16T20:11:30.468 INFO:tasks.workunit.client.1.smithi141.stdout:3/215: creat d0/d1c/d40/f45 x:0 0 0 2023-12-16T20:11:30.468 INFO:tasks.workunit.client.1.smithi141.stdout:3/216: creat d0/f46 x:0 0 0 2023-12-16T20:11:30.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/506: mkdir d13/d69/d7a/da5 0 2023-12-16T20:11:30.475 INFO:tasks.workunit.client.0.smithi038.stdout:3/511: creat d4/d8/fb2 x:0 0 0 2023-12-16T20:11:30.477 INFO:tasks.workunit.client.0.smithi038.stdout:8/380: unlink l3 0 2023-12-16T20:11:30.479 INFO:tasks.workunit.client.0.smithi038.stdout:4/507: rmdir d13/d17/d2e/d32/d70/d84 39 2023-12-16T20:11:30.479 INFO:tasks.workunit.client.1.smithi141.stdout:1/154: creat da/d1a/d1d/d22/d29/f32 x:0 0 0 2023-12-16T20:11:30.480 INFO:tasks.workunit.client.1.smithi141.stdout:2/75: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:30.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/512: rmdir d4 39 2023-12-16T20:11:30.485 INFO:tasks.workunit.client.1.smithi141.stdout:8/154: dwrite d14/d19/d1b/f21 [0,4194304] 0 2023-12-16T20:11:30.485 INFO:tasks.workunit.client.1.smithi141.stdout:3/217: mknod d0/c47 0 2023-12-16T20:11:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:4/508: mkdir d13/d17/d2e/d32/d4d/d78/da6 0 2023-12-16T20:11:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:3/513: creat d4/d6c/d80/fb3 x:0 0 0 2023-12-16T20:11:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:4/509: creat d13/d17/d2e/d32/fa7 x:0 0 0 2023-12-16T20:11:30.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/510: read d13/d17/d2e/f52 [1562811,118009] 0 2023-12-16T20:11:30.487 INFO:tasks.workunit.client.1.smithi141.stdout:1/155: mkdir da/d1a/d1d/d33 0 2023-12-16T20:11:30.490 INFO:tasks.workunit.client.0.smithi038.stdout:3/514: rename d4/d8/d15/d2c/d4c/d58/c75 to d4/cb4 0 2023-12-16T20:11:30.490 INFO:tasks.workunit.client.0.smithi038.stdout:4/511: dread d13/d17/d2e/d32/d70/fa3 [0,4194304] 0 2023-12-16T20:11:30.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/512: dread - d13/d17/d62/f9c zero size 2023-12-16T20:11:30.492 INFO:tasks.workunit.client.1.smithi141.stdout:8/155: creat d14/d19/d1b/d24/f31 x:0 0 0 2023-12-16T20:11:30.492 INFO:tasks.workunit.client.1.smithi141.stdout:4/172: dwrite f9 [0,4194304] 0 2023-12-16T20:11:30.492 INFO:tasks.workunit.client.1.smithi141.stdout:2/76: read d6/f7 [954162,62730] 0 2023-12-16T20:11:30.492 INFO:tasks.workunit.client.0.smithi038.stdout:4/513: rmdir d13/d17/d2e/d32/d4d/d4f 39 2023-12-16T20:11:30.492 INFO:tasks.workunit.client.0.smithi038.stdout:6/462: dwrite d1/d4/d1d/d28/d2f/d3d/f4c [0,4194304] 0 2023-12-16T20:11:30.493 INFO:tasks.workunit.client.1.smithi141.stdout:3/218: creat d0/d1c/d2c/f48 x:0 0 0 2023-12-16T20:11:30.493 INFO:tasks.workunit.client.1.smithi141.stdout:3/219: read - d0/d1c/d40/f45 zero size 2023-12-16T20:11:30.494 INFO:tasks.workunit.client.1.smithi141.stdout:1/156: creat da/df/f34 x:0 0 0 2023-12-16T20:11:30.494 INFO:tasks.workunit.client.1.smithi141.stdout:1/157: chown da/d1a/d1d/d22/d29/f2a 3 1 2023-12-16T20:11:30.494 INFO:tasks.workunit.client.1.smithi141.stdout:1/158: readlink da/df/l17 0 2023-12-16T20:11:30.494 INFO:tasks.workunit.client.1.smithi141.stdout:1/159: write da/df/f13 [614729,25402] 0 2023-12-16T20:11:30.495 INFO:tasks.workunit.client.0.smithi038.stdout:6/463: mknod d1/d4/c93 0 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: Deploying cephadm binary to smithi038 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: Deploying cephadm binary to smithi141 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: mgrmap e22: smithi141.cycgjd(active, since 1.02635s) 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: [16/Dec/2023:20:11:29] ENGINE Bus STARTING 2023-12-16T20:11:30.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: [16/Dec/2023:20:11:29] ENGINE Serving on https://172.21.15.141:7150 2023-12-16T20:11:30.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: [16/Dec/2023:20:11:29] ENGINE Serving on http://172.21.15.141:8765 2023-12-16T20:11:30.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:30 smithi141 ceph-mon[88165]: [16/Dec/2023:20:11:29] ENGINE Bus STARTED 2023-12-16T20:11:30.496 INFO:tasks.workunit.client.0.smithi038.stdout:9/540: sync 2023-12-16T20:11:30.496 INFO:tasks.workunit.client.0.smithi038.stdout:4/514: dread d13/d69/d7a/f89 [0,4194304] 0 2023-12-16T20:11:30.498 INFO:tasks.workunit.client.1.smithi141.stdout:8/156: mkdir d14/d19/d1b/d30/d32 0 2023-12-16T20:11:30.500 INFO:tasks.workunit.client.0.smithi038.stdout:9/541: creat d9/d1f/d21/d3e/d4e/d61/d9b/fa3 x:0 0 0 2023-12-16T20:11:30.500 INFO:tasks.workunit.client.1.smithi141.stdout:4/173: mknod d1a/d3c/c46 0 2023-12-16T20:11:30.500 INFO:tasks.workunit.client.0.smithi038.stdout:7/438: sync 2023-12-16T20:11:30.503 INFO:tasks.workunit.client.1.smithi141.stdout:2/77: rename d6/dc to d6/da/d1b 0 2023-12-16T20:11:30.504 INFO:tasks.workunit.client.1.smithi141.stdout:3/220: creat d0/d1c/d2c/f49 x:0 0 0 2023-12-16T20:11:30.505 INFO:tasks.workunit.client.1.smithi141.stdout:3/221: chown d0/f37 1 1 2023-12-16T20:11:30.505 INFO:tasks.workunit.client.0.smithi038.stdout:9/542: unlink d9/d1e/d40/d5e/d71/d83/f92 0 2023-12-16T20:11:30.505 INFO:tasks.workunit.client.0.smithi038.stdout:3/515: dread d4/f5 [0,4194304] 0 2023-12-16T20:11:30.506 INFO:tasks.workunit.client.0.smithi038.stdout:7/439: mkdir da/d21/d86/d92 0 2023-12-16T20:11:30.506 INFO:tasks.workunit.client.0.smithi038.stdout:7/440: chown da/d21 1 1 2023-12-16T20:11:30.509 INFO:tasks.workunit.client.1.smithi141.stdout:8/157: creat d14/d19/d1b/d30/d32/f33 x:0 0 0 2023-12-16T20:11:30.509 INFO:tasks.workunit.client.1.smithi141.stdout:4/174: dread f19 [0,4194304] 0 2023-12-16T20:11:30.512 INFO:tasks.workunit.client.0.smithi038.stdout:3/516: rename d4/d27/fa9 to d4/d27/d40/fb5 0 2023-12-16T20:11:30.512 INFO:tasks.workunit.client.0.smithi038.stdout:7/441: rmdir da/d3e/d31 39 2023-12-16T20:11:30.514 INFO:tasks.workunit.client.1.smithi141.stdout:2/78: rmdir d6/da 39 2023-12-16T20:11:30.514 INFO:tasks.workunit.client.1.smithi141.stdout:3/222: creat d0/d1c/d40/d3c/f4a x:0 0 0 2023-12-16T20:11:30.514 INFO:tasks.workunit.client.1.smithi141.stdout:3/223: fsync d0/f3a 0 2023-12-16T20:11:30.514 INFO:tasks.workunit.client.1.smithi141.stdout:3/224: truncate d0/d1c/d40/f27 664596 0 2023-12-16T20:11:30.514 INFO:tasks.workunit.client.1.smithi141.stdout:3/225: chown d0/d1c/d2c/f48 5480610 1 2023-12-16T20:11:30.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/158: rmdir d14/d19/d1b 39 2023-12-16T20:11:30.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/159: readlink d14/d19/d1b/l2a 0 2023-12-16T20:11:30.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/160: stat d14/d19/d1b/c2c 0 2023-12-16T20:11:30.516 INFO:tasks.workunit.client.1.smithi141.stdout:8/161: readlink d14/d19/d1b/l22 0 2023-12-16T20:11:30.518 INFO:tasks.workunit.client.1.smithi141.stdout:4/175: dread f14 [0,4194304] 0 2023-12-16T20:11:30.518 INFO:tasks.workunit.client.1.smithi141.stdout:4/176: chown d1a 100241 1 2023-12-16T20:11:30.518 INFO:tasks.workunit.client.1.smithi141.stdout:4/177: dread - d1a/d2a/f31 zero size 2023-12-16T20:11:30.519 INFO:tasks.workunit.client.1.smithi141.stdout:2/79: rename d6/da/db to d6/da/d1b/d1c 0 2023-12-16T20:11:30.521 INFO:tasks.workunit.client.0.smithi038.stdout:6/464: dwrite d1/f54 [0,4194304] 0 2023-12-16T20:11:30.522 INFO:tasks.workunit.client.1.smithi141.stdout:3/226: mkdir d0/d1c/d40/d3c/d4b 0 2023-12-16T20:11:30.523 INFO:tasks.workunit.client.1.smithi141.stdout:4/178: unlink c17 0 2023-12-16T20:11:30.525 INFO:tasks.workunit.client.0.smithi038.stdout:7/442: dread da/d3e/d31/d38/d90/f5f [0,4194304] 0 2023-12-16T20:11:30.525 INFO:tasks.workunit.client.0.smithi038.stdout:4/515: dwrite d13/d17/d4b/da4/d9d/f9b [0,4194304] 0 2023-12-16T20:11:30.525 INFO:tasks.workunit.client.0.smithi038.stdout:7/443: chown da/d24 1325720 1 2023-12-16T20:11:30.525 INFO:tasks.workunit.client.0.smithi038.stdout:7/444: chown da/d3e/d31/d38/d90/f5f 7 1 2023-12-16T20:11:30.530 INFO:tasks.workunit.client.1.smithi141.stdout:2/80: creat d6/f1d x:0 0 0 2023-12-16T20:11:30.530 INFO:tasks.workunit.client.1.smithi141.stdout:6/218: sync 2023-12-16T20:11:30.531 INFO:tasks.workunit.client.1.smithi141.stdout:4/179: read d1a/f1e [533149,115680] 0 2023-12-16T20:11:30.531 INFO:tasks.workunit.client.1.smithi141.stdout:4/180: write d1a/f1b [2174838,13339] 0 2023-12-16T20:11:30.535 INFO:tasks.workunit.client.0.smithi038.stdout:9/543: dwrite d9/d1f/d21/d3e/d4e/d61/f89 [0,4194304] 0 2023-12-16T20:11:30.536 INFO:tasks.workunit.client.0.smithi038.stdout:7/445: link da/d3e/d8e/l85 da/d21/l93 0 2023-12-16T20:11:30.540 INFO:tasks.workunit.client.0.smithi038.stdout:9/544: truncate d9/d1e/d3d/f4b 662360 0 2023-12-16T20:11:30.540 INFO:tasks.workunit.client.0.smithi038.stdout:9/545: creat d9/d1e/d3d/d42/d59/d76/fa4 x:0 0 0 2023-12-16T20:11:30.543 INFO:tasks.workunit.client.0.smithi038.stdout:9/546: getdents d9/d1e/d3d 0 2023-12-16T20:11:30.554 INFO:tasks.workunit.client.0.smithi038.stdout:7/446: dread da/d24/d4d/f6c [0,4194304] 0 2023-12-16T20:11:30.554 INFO:tasks.workunit.client.0.smithi038.stdout:7/447: readlink da/d3e/d31/d38/d90/l73 0 2023-12-16T20:11:30.556 INFO:tasks.workunit.client.0.smithi038.stdout:7/448: rmdir da/d3e/d31/d38/d90 39 2023-12-16T20:11:30.558 INFO:tasks.workunit.client.0.smithi038.stdout:7/449: mknod da/d21/d2c/c94 0 2023-12-16T20:11:30.565 INFO:tasks.workunit.client.1.smithi141.stdout:3/227: dwrite d0/d1c/d40/d3c/f4a [0,4194304] 0 2023-12-16T20:11:30.566 INFO:tasks.workunit.client.0.smithi038.stdout:3/517: dwrite d4/d8/d15/d6d/d7a/f86 [0,4194304] 0 2023-12-16T20:11:30.566 INFO:tasks.workunit.client.0.smithi038.stdout:3/518: truncate d4/d8/f84 857004 0 2023-12-16T20:11:30.568 INFO:tasks.workunit.client.1.smithi141.stdout:3/228: truncate d0/d1c/d40/f1b 672723 0 2023-12-16T20:11:30.568 INFO:tasks.workunit.client.1.smithi141.stdout:3/229: mkdir d0/d1c/d40/d3c/d4b/d4c 0 2023-12-16T20:11:30.570 INFO:tasks.workunit.client.1.smithi141.stdout:3/230: creat d0/d1c/d2c/f4d x:0 0 0 2023-12-16T20:11:30.570 INFO:tasks.workunit.client.0.smithi038.stdout:3/519: getdents d4/d8/d15/d2c 0 2023-12-16T20:11:30.570 INFO:tasks.workunit.client.1.smithi141.stdout:3/231: dread d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:30.573 INFO:tasks.workunit.client.0.smithi038.stdout:3/520: unlink d4/d8/d15/f5d 0 2023-12-16T20:11:30.582 INFO:tasks.workunit.client.1.smithi141.stdout:8/162: dwrite d14/d19/f1f [8388608,4194304] 0 2023-12-16T20:11:30.585 INFO:tasks.workunit.client.0.smithi038.stdout:6/465: dwrite d1/d4/d1d/f59 [0,4194304] 0 2023-12-16T20:11:30.585 INFO:tasks.workunit.client.0.smithi038.stdout:6/466: write d1/d4/f49 [4970492,7163] 0 2023-12-16T20:11:30.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/467: mkdir d1/d2e/d94 0 2023-12-16T20:11:30.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/516: dwrite d13/d17/d62/f9c [0,4194304] 0 2023-12-16T20:11:30.588 INFO:tasks.workunit.client.1.smithi141.stdout:6/219: dwrite d1/d12/d22/d25/d38/f3e [0,4194304] 0 2023-12-16T20:11:30.589 INFO:tasks.workunit.client.0.smithi038.stdout:6/468: mknod d1/d16/d23/c95 0 2023-12-16T20:11:30.589 INFO:tasks.workunit.client.0.smithi038.stdout:6/469: read - d1/d4/d1d/d28/f81 zero size 2023-12-16T20:11:30.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/517: creat d13/d17/d2e/d32/d7c/fa8 x:0 0 0 2023-12-16T20:11:30.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/518: chown d13/d17/d2e/l8d 9633111 1 2023-12-16T20:11:30.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/519: fdatasync d13/f77 0 2023-12-16T20:11:30.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/520: readlink d13/d17/d4b/da4/d34/l99 0 2023-12-16T20:11:30.593 INFO:tasks.workunit.client.0.smithi038.stdout:6/470: mkdir d1/d5b/d7d/d96 0 2023-12-16T20:11:30.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: Deploying cephadm binary to smithi038 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: Deploying cephadm binary to smithi141 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: mgrmap e22: smithi141.cycgjd(active, since 1.02635s) 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: [16/Dec/2023:20:11:29] ENGINE Bus STARTING 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: [16/Dec/2023:20:11:29] ENGINE Serving on https://172.21.15.141:7150 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: [16/Dec/2023:20:11:29] ENGINE Serving on http://172.21.15.141:8765 2023-12-16T20:11:30.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:30 smithi038 ceph-mon[80659]: [16/Dec/2023:20:11:29] ENGINE Bus STARTED 2023-12-16T20:11:30.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/521: creat d13/d17/d2e/d32/d4e/fa9 x:0 0 0 2023-12-16T20:11:30.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/522: read d13/d69/d7a/f89 [1243559,79153] 0 2023-12-16T20:11:30.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/523: fsync d13/d17/d2e/d75/f6d 0 2023-12-16T20:11:30.595 INFO:tasks.workunit.client.0.smithi038.stdout:6/471: symlink d1/d5b/d7d/l97 0 2023-12-16T20:11:30.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/524: symlink d13/d17/d4b/laa 0 2023-12-16T20:11:30.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/525: dread - d13/d1f/d35/f92 zero size 2023-12-16T20:11:30.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/526: fdatasync d13/d17/d4b/da4/d9d/f9b 0 2023-12-16T20:11:30.599 INFO:tasks.workunit.client.1.smithi141.stdout:8/163: read d14/d19/d1b/f21 [1217414,28121] 0 2023-12-16T20:11:30.599 INFO:tasks.workunit.client.1.smithi141.stdout:2/81: dwrite d6/f7 [0,4194304] 0 2023-12-16T20:11:30.600 INFO:tasks.workunit.client.1.smithi141.stdout:8/164: link d14/f25 d14/d19/d1b/d30/f34 0 2023-12-16T20:11:30.601 INFO:tasks.workunit.client.0.smithi038.stdout:7/450: dwrite da/d3e/d31/f43 [0,4194304] 0 2023-12-16T20:11:30.602 INFO:tasks.workunit.client.1.smithi141.stdout:2/82: truncate d6/f17 3423979 0 2023-12-16T20:11:30.602 INFO:tasks.workunit.client.1.smithi141.stdout:8/165: stat d14/d19/d1b/d24/l29 0 2023-12-16T20:11:30.604 INFO:tasks.workunit.client.0.smithi038.stdout:7/451: truncate da/d21/f25 3122161 0 2023-12-16T20:11:30.605 INFO:tasks.workunit.client.0.smithi038.stdout:7/452: fsync da/d21/d41/f7b 0 2023-12-16T20:11:30.607 INFO:tasks.workunit.client.0.smithi038.stdout:9/547: dwrite d9/d1f/d21/f7e [0,4194304] 0 2023-12-16T20:11:30.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/548: truncate d9/d1e/d3d/f3f 54801 0 2023-12-16T20:11:30.615 INFO:tasks.workunit.client.1.smithi141.stdout:3/232: dwrite d0/d1c/d2c/f2f [0,4194304] 0 2023-12-16T20:11:30.615 INFO:tasks.workunit.client.0.smithi038.stdout:6/472: dread d1/f54 [0,4194304] 0 2023-12-16T20:11:30.616 INFO:tasks.workunit.client.0.smithi038.stdout:9/549: stat d9/d1f/d21/d3e/d4e/d64/c9c 0 2023-12-16T20:11:30.618 INFO:tasks.workunit.client.0.smithi038.stdout:6/473: creat d1/d4/d1d/d67/d73/f98 x:0 0 0 2023-12-16T20:11:30.620 INFO:tasks.workunit.client.1.smithi141.stdout:6/220: dwrite d1/d12/d22/f50 [0,4194304] 0 2023-12-16T20:11:30.620 INFO:tasks.workunit.client.0.smithi038.stdout:7/453: write da/d21/d2c/f47 [32826,122336] 0 2023-12-16T20:11:30.620 INFO:tasks.workunit.client.0.smithi038.stdout:3/521: dwrite d4/d18/f4b [0,4194304] 0 2023-12-16T20:11:30.620 INFO:tasks.workunit.client.0.smithi038.stdout:3/522: readlink d4/l1d 0 2023-12-16T20:11:30.621 INFO:tasks.workunit.client.1.smithi141.stdout:3/233: symlink d0/d1c/d40/l4e 0 2023-12-16T20:11:30.623 INFO:tasks.workunit.client.1.smithi141.stdout:6/221: rmdir d1/dd/de 39 2023-12-16T20:11:30.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/474: read d1/d4/d1d/f1e [72406,7769] 0 2023-12-16T20:11:30.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/475: chown d1/d4/d1d/d28/f37 499 1 2023-12-16T20:11:30.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/476: creat d1/d5b/f99 x:0 0 0 2023-12-16T20:11:30.624 INFO:tasks.workunit.client.1.smithi141.stdout:3/234: creat d0/d1c/d40/d3c/d4b/d4c/f4f x:0 0 0 2023-12-16T20:11:30.625 INFO:tasks.workunit.client.1.smithi141.stdout:3/235: readlink d0/d1c/l3d 0 2023-12-16T20:11:30.625 INFO:tasks.workunit.client.1.smithi141.stdout:3/236: chown d0/f8 61 1 2023-12-16T20:11:30.626 INFO:tasks.workunit.client.0.smithi038.stdout:9/550: dread d9/d1e/d3d/d42/f53 [0,4194304] 0 2023-12-16T20:11:30.626 INFO:tasks.workunit.client.0.smithi038.stdout:9/551: getdents d9/d1e/d3d/d42/d59/d76/d8d 0 2023-12-16T20:11:30.627 INFO:tasks.workunit.client.0.smithi038.stdout:3/523: mkdir d4/d27/d23/db6 0 2023-12-16T20:11:30.627 INFO:tasks.workunit.client.0.smithi038.stdout:3/524: write d4/d8/f1c [6615529,8236] 0 2023-12-16T20:11:30.628 INFO:tasks.workunit.client.1.smithi141.stdout:6/222: creat d1/d12/d22/f53 x:0 0 0 2023-12-16T20:11:30.629 INFO:tasks.workunit.client.0.smithi038.stdout:7/454: truncate da/f1b 1055105 0 2023-12-16T20:11:30.630 INFO:tasks.workunit.client.1.smithi141.stdout:5/112: sync 2023-12-16T20:11:30.632 INFO:tasks.workunit.client.1.smithi141.stdout:6/223: rename d1/l2b to d1/d12/d20/l54 0 2023-12-16T20:11:30.633 INFO:tasks.workunit.client.1.smithi141.stdout:8/166: dwrite d14/d19/f2e [0,4194304] 0 2023-12-16T20:11:30.633 INFO:tasks.workunit.client.1.smithi141.stdout:8/167: truncate d14/d19/f1c 4280585 0 2023-12-16T20:11:30.634 INFO:tasks.workunit.client.1.smithi141.stdout:8/168: dread d14/f16 [0,4194304] 0 2023-12-16T20:11:30.634 INFO:tasks.workunit.client.1.smithi141.stdout:5/113: creat d0/d9/d16/f21 x:0 0 0 2023-12-16T20:11:30.634 INFO:tasks.workunit.client.0.smithi038.stdout:3/525: creat d4/d8/d15/d2c/d4c/d58/d9a/fb7 x:0 0 0 2023-12-16T20:11:30.634 INFO:tasks.workunit.client.0.smithi038.stdout:3/526: readlink d4/d18/l3a 0 2023-12-16T20:11:30.635 INFO:tasks.workunit.client.0.smithi038.stdout:9/552: dread d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:30.636 INFO:tasks.workunit.client.1.smithi141.stdout:2/83: dwrite d6/f7 [4194304,4194304] 0 2023-12-16T20:11:30.636 INFO:tasks.workunit.client.1.smithi141.stdout:3/237: symlink d0/d1c/d40/l50 0 2023-12-16T20:11:30.638 INFO:tasks.workunit.client.1.smithi141.stdout:6/224: creat d1/d12/d22/d25/f55 x:0 0 0 2023-12-16T20:11:30.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/527: creat d4/dab/fb8 x:0 0 0 2023-12-16T20:11:30.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/528: read - d4/d18/f8b zero size 2023-12-16T20:11:30.640 INFO:tasks.workunit.client.0.smithi038.stdout:3/529: write d4/f17 [5470967,32498] 0 2023-12-16T20:11:30.640 INFO:tasks.workunit.client.0.smithi038.stdout:3/530: truncate d4/d8/fb2 922391 0 2023-12-16T20:11:30.640 INFO:tasks.workunit.client.0.smithi038.stdout:3/531: write f1 [7279966,64842] 0 2023-12-16T20:11:30.642 INFO:tasks.workunit.client.1.smithi141.stdout:8/169: mkdir d14/d35 0 2023-12-16T20:11:30.642 INFO:tasks.workunit.client.1.smithi141.stdout:8/170: chown d14/d19 33867 1 2023-12-16T20:11:30.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/455: write da/d3e/d31/f43 [3308171,33233] 0 2023-12-16T20:11:30.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/532: mkdir d4/d8/d15/d2c/d4c/d70/d71/db9 0 2023-12-16T20:11:30.645 INFO:tasks.workunit.client.0.smithi038.stdout:9/553: dread d9/f81 [0,4194304] 0 2023-12-16T20:11:30.645 INFO:tasks.workunit.client.0.smithi038.stdout:9/554: fsync d9/d1e/d40/d5e/d71/d83/f9f 0 2023-12-16T20:11:30.645 INFO:tasks.workunit.client.0.smithi038.stdout:9/555: write d9/d1e/f3c [1342921,21191] 0 2023-12-16T20:11:30.646 INFO:tasks.workunit.client.0.smithi038.stdout:5/561: sync 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.0.smithi038.stdout:5/562: chown d2/d14/d25/d2d/d17/da9 368015458 1 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/566: sync 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/567: write d1/d5/d16/f2e [1068049,25882] 0 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/568: write d1/df/d10/fb5 [600049,103514] 0 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/569: fdatasync d1/df/d21/d9a/fa3 0 2023-12-16T20:11:30.647 INFO:tasks.workunit.client.1.smithi141.stdout:6/225: rename d1/d3/l7 to d1/d12/d20/d3a/d45/d47/l56 0 2023-12-16T20:11:30.649 INFO:tasks.workunit.client.1.smithi141.stdout:6/226: unlink d1/f17 0 2023-12-16T20:11:30.652 INFO:tasks.workunit.client.0.smithi038.stdout:9/556: link l5 d9/d1f/d96/la5 0 2023-12-16T20:11:30.657 INFO:tasks.workunit.client.0.smithi038.stdout:5/563: truncate d2/d14/d25/d2d/d17/d51/f76 3772604 0 2023-12-16T20:11:30.660 INFO:tasks.workunit.client.0.smithi038.stdout:6/477: dwrite d1/f39 [0,4194304] 0 2023-12-16T20:11:30.662 INFO:tasks.workunit.client.1.smithi141.stdout:3/238: write d0/f8 [4088675,1364] 0 2023-12-16T20:11:30.662 INFO:tasks.workunit.client.1.smithi141.stdout:3/239: write d0/d1c/d40/f1d [3397349,37029] 0 2023-12-16T20:11:30.663 INFO:tasks.workunit.client.0.smithi038.stdout:2/570: link d1/d88/l99 d1/df/d21/d9a/db9/lbf 0 2023-12-16T20:11:30.664 INFO:tasks.workunit.client.1.smithi141.stdout:3/240: getdents d0/d1c/d40/d3c/d4b/d4c 0 2023-12-16T20:11:30.665 INFO:tasks.workunit.client.0.smithi038.stdout:9/557: mknod d9/d1f/d21/d3e/ca6 0 2023-12-16T20:11:30.666 INFO:tasks.workunit.client.1.smithi141.stdout:5/114: fsync d0/d9/d16/f21 0 2023-12-16T20:11:30.667 INFO:tasks.workunit.client.1.smithi141.stdout:3/241: unlink d0/l3 0 2023-12-16T20:11:30.668 INFO:tasks.workunit.client.0.smithi038.stdout:5/564: mkdir d2/d14/d25/d2d/d17/d51/daf 0 2023-12-16T20:11:30.669 INFO:tasks.workunit.client.1.smithi141.stdout:3/242: symlink d0/d1c/d40/d3c/l51 0 2023-12-16T20:11:30.671 INFO:tasks.workunit.client.1.smithi141.stdout:3/243: mkdir d0/d1c/d40/d3f/d52 0 2023-12-16T20:11:30.672 INFO:tasks.workunit.client.0.smithi038.stdout:6/478: rename d1/d4/d1d/d28/d2f/d85/f8b to d1/d4/d1d/d61/f9a 0 2023-12-16T20:11:30.674 INFO:tasks.workunit.client.0.smithi038.stdout:2/571: mkdir d1/d5/d16/dc0 0 2023-12-16T20:11:30.675 INFO:tasks.workunit.client.0.smithi038.stdout:2/572: readlink d1/df/d10/d2f/l76 0 2023-12-16T20:11:30.675 INFO:tasks.workunit.client.0.smithi038.stdout:9/558: creat d9/d1f/d21/d52/fa7 x:0 0 0 2023-12-16T20:11:30.676 INFO:tasks.workunit.client.0.smithi038.stdout:5/565: mkdir d2/d14/d25/d2d/d17/da9/db0 0 2023-12-16T20:11:30.677 INFO:tasks.workunit.client.0.smithi038.stdout:9/559: dread d9/d1e/d3d/f3f [0,4194304] 0 2023-12-16T20:11:30.677 INFO:tasks.workunit.client.0.smithi038.stdout:9/560: write d9/d1e/d3d/f6b [5089392,82770] 0 2023-12-16T20:11:30.677 INFO:tasks.workunit.client.0.smithi038.stdout:9/561: chown d9/c17 196731 1 2023-12-16T20:11:30.678 INFO:tasks.workunit.client.0.smithi038.stdout:2/573: creat d1/d5/d6c/d9f/fc1 x:0 0 0 2023-12-16T20:11:30.680 INFO:tasks.workunit.client.0.smithi038.stdout:5/566: unlink d2/d14/f22 0 2023-12-16T20:11:30.682 INFO:tasks.workunit.client.0.smithi038.stdout:9/562: mknod d9/d1f/d21/d3e/d4e/d64/ca8 0 2023-12-16T20:11:30.683 INFO:tasks.workunit.client.0.smithi038.stdout:9/563: dread - d9/d1f/d21/d3e/f94 zero size 2023-12-16T20:11:30.685 INFO:tasks.workunit.client.0.smithi038.stdout:2/574: symlink d1/df/d21/d82/d92/lc2 0 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/533: dwrite d4/d27/d23/d26/f68 [0,4194304] 0 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/567: rename d2/c48 to d2/df/d87/cb1 0 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/568: stat d2/d14/f40 0 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/569: chown d2/d14/d25/d2d/d17/d51/daf 1668881 1 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:7/456: dwrite da/d21/d2c/f47 [4194304,4194304] 0 2023-12-16T20:11:30.690 INFO:tasks.workunit.client.0.smithi038.stdout:9/564: symlink d9/d1f/d21/d3e/la9 0 2023-12-16T20:11:30.691 INFO:tasks.workunit.client.0.smithi038.stdout:9/565: truncate d9/d1e/d3d/d42/d59/f91 549783 0 2023-12-16T20:11:30.691 INFO:tasks.workunit.client.0.smithi038.stdout:9/566: chown d9/lc 41683 1 2023-12-16T20:11:30.691 INFO:tasks.workunit.client.0.smithi038.stdout:2/575: creat d1/d5/d3d/d9e/fc3 x:0 0 0 2023-12-16T20:11:30.692 INFO:tasks.workunit.client.0.smithi038.stdout:6/479: write d1/f39 [1597879,114658] 0 2023-12-16T20:11:30.692 INFO:tasks.workunit.client.1.smithi141.stdout:8/171: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:30.692 INFO:tasks.workunit.client.1.smithi141.stdout:8/172: truncate d14/d19/d1b/d30/d32/f33 883462 0 2023-12-16T20:11:30.692 INFO:tasks.workunit.client.1.smithi141.stdout:8/173: dread - d14/d19/d1b/d30/f34 zero size 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:2/84: dwrite d6/f17 [0,4194304] 0 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:2/85: rename d6/d12/d15 to d6/d12/d15/d1e 22 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:2/86: readlink d6/l8 0 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:5/115: dwrite d0/fe [0,4194304] 0 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:5/116: chown d0/d9/c1e 10665 1 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:5/117: dread - d0/d9/d16/f21 zero size 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:6/227: rmdir d1/d3 39 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:2/87: mkdir d6/d12/d1f 0 2023-12-16T20:11:30.693 INFO:tasks.workunit.client.1.smithi141.stdout:3/244: dwrite d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:30.700 INFO:tasks.workunit.client.1.smithi141.stdout:2/88: rename d6/da/d1b/d1c/lf to d6/d12/d1f/l20 0 2023-12-16T20:11:30.700 INFO:tasks.workunit.client.1.smithi141.stdout:2/89: truncate d6/f1d 253597 0 2023-12-16T20:11:30.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/245: creat d0/d1c/d40/d3c/d4b/f53 x:0 0 0 2023-12-16T20:11:30.706 INFO:tasks.workunit.client.0.smithi038.stdout:3/534: creat d4/d27/d2b/da0/fba x:0 0 0 2023-12-16T20:11:30.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/228: symlink d1/dd/d2f/l57 0 2023-12-16T20:11:30.709 INFO:tasks.workunit.client.1.smithi141.stdout:2/90: creat d6/f21 x:0 0 0 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.0.smithi038.stdout:5/570: unlink d2/df/d1a/f27 0 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/229: mknod d1/d3/d4b/c58 0 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/230: chown d1/d3/f10 304706 1 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/231: fsync d1/d3/f10 0 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/232: write d1/d12/f16 [677454,114975] 0 2023-12-16T20:11:30.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/233: chown d1/d12/d22/d25 3314400 1 2023-12-16T20:11:30.711 INFO:tasks.workunit.client.1.smithi141.stdout:6/234: chown d1/d3/c2d 184306405 1 2023-12-16T20:11:30.711 INFO:tasks.workunit.client.1.smithi141.stdout:6/235: readlink d1/d3/l49 0 2023-12-16T20:11:30.713 INFO:tasks.workunit.client.1.smithi141.stdout:6/236: rmdir d1/d12/d20/d3a 39 2023-12-16T20:11:30.713 INFO:tasks.workunit.client.1.smithi141.stdout:6/237: stat d1/d3 0 2023-12-16T20:11:30.715 INFO:tasks.workunit.client.0.smithi038.stdout:2/576: symlink d1/df/d21/lc4 0 2023-12-16T20:11:30.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/535: creat d4/d8/d15/d2c/fbb x:0 0 0 2023-12-16T20:11:30.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/571: rmdir d2/df/d1a/d1f/d4a 39 2023-12-16T20:11:30.720 INFO:tasks.workunit.client.0.smithi038.stdout:2/577: mknod d1/d5/d2a/d31/cc5 0 2023-12-16T20:11:30.720 INFO:tasks.workunit.client.0.smithi038.stdout:2/578: truncate d1/df/d21/d9a/db9/f64 1039014 0 2023-12-16T20:11:30.720 INFO:tasks.workunit.client.0.smithi038.stdout:2/579: chown d1/d73/l9c 1 1 2023-12-16T20:11:30.721 INFO:tasks.workunit.client.0.smithi038.stdout:3/536: symlink d4/d67/lbc 0 2023-12-16T20:11:30.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/572: mkdir d2/df/d1a/d1f/d4a/db2 0 2023-12-16T20:11:30.725 INFO:tasks.workunit.client.0.smithi038.stdout:3/537: mknod d4/d8/cbd 0 2023-12-16T20:11:30.726 INFO:tasks.workunit.client.1.smithi141.stdout:2/91: write d6/f17 [104694,55981] 0 2023-12-16T20:11:30.731 INFO:tasks.workunit.client.1.smithi141.stdout:8/174: dwrite ff [0,4194304] 0 2023-12-16T20:11:30.732 INFO:tasks.workunit.client.1.smithi141.stdout:6/238: write d1/d12/d22/d25/d38/f3e [4046326,124553] 0 2023-12-16T20:11:30.732 INFO:tasks.workunit.client.1.smithi141.stdout:6/239: write d1/d12/f33 [4207804,107498] 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/480: dwrite d1/d4/d1d/d28/d2f/d3d/f6a [0,4194304] 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:7/457: dwrite da/d21/d2c/f59 [0,4194304] 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/481: write d1/d4/d1d/f3b [4459509,18526] 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/482: fsync d1/f83 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/483: getdents d1/d2e/d94 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/484: truncate d1/f8f 1005358 0 2023-12-16T20:11:30.734 INFO:tasks.workunit.client.0.smithi038.stdout:6/485: fdatasync d1/f19 0 2023-12-16T20:11:30.735 INFO:tasks.workunit.client.0.smithi038.stdout:9/567: dwrite d9/d1e/f3c [0,4194304] 0 2023-12-16T20:11:30.735 INFO:tasks.workunit.client.1.smithi141.stdout:5/118: dwrite d0/d9/f20 [0,4194304] 0 2023-12-16T20:11:30.735 INFO:tasks.workunit.client.1.smithi141.stdout:5/119: dread - d0/df/f1d zero size 2023-12-16T20:11:30.736 INFO:tasks.workunit.client.0.smithi038.stdout:5/573: dread d2/df/d1a/d1f/f32 [0,4194304] 0 2023-12-16T20:11:30.736 INFO:tasks.workunit.client.0.smithi038.stdout:5/574: stat d2/df 0 2023-12-16T20:11:30.739 INFO:tasks.workunit.client.1.smithi141.stdout:3/246: dwrite d0/f29 [0,4194304] 0 2023-12-16T20:11:30.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/240: symlink d1/dd/d43/l59 0 2023-12-16T20:11:30.745 INFO:tasks.workunit.client.0.smithi038.stdout:2/580: dwrite d1/df/d10/f50 [0,4194304] 0 2023-12-16T20:11:30.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/458: rename da/d21/d61/c67 to da/d21/d2c/d76/c95 0 2023-12-16T20:11:30.751 INFO:tasks.workunit.client.1.smithi141.stdout:0/174: sync 2023-12-16T20:11:30.751 INFO:tasks.workunit.client.1.smithi141.stdout:0/175: creat d4/f3e x:0 0 0 2023-12-16T20:11:30.751 INFO:tasks.workunit.client.1.smithi141.stdout:0/176: write d4/f35 [759963,96888] 0 2023-12-16T20:11:30.752 INFO:tasks.workunit.client.1.smithi141.stdout:7/125: sync 2023-12-16T20:11:30.753 INFO:tasks.workunit.client.1.smithi141.stdout:7/126: truncate d5/f11 46280 0 2023-12-16T20:11:30.756 INFO:tasks.workunit.client.1.smithi141.stdout:2/92: rename d6/d12/d1f/l20 to d6/da/l22 0 2023-12-16T20:11:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:7/459: dread da/f1b [0,4194304] 0 2023-12-16T20:11:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:7/460: chown da/d21/d2c/f59 11818 1 2023-12-16T20:11:30.758 INFO:tasks.workunit.client.1.smithi141.stdout:8/175: rmdir d14/d19 39 2023-12-16T20:11:30.761 INFO:tasks.workunit.client.0.smithi038.stdout:6/486: dwrite d1/d4/f5e [0,4194304] 0 2023-12-16T20:11:30.766 INFO:tasks.workunit.client.1.smithi141.stdout:9/140: sync 2023-12-16T20:11:30.766 INFO:tasks.workunit.client.1.smithi141.stdout:9/141: chown d1 308201759 1 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.0.smithi038.stdout:5/575: creat d2/d14/d25/d2d/d17/da9/fb3 x:0 0 0 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.0.smithi038.stdout:5/576: chown d2/d81 0 1 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.0.smithi038.stdout:5/577: stat d2/d14/d25/d2d/d17/d51/l73 0 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.1.smithi141.stdout:2/93: link d6/l18 d6/d12/d15/l23 0 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.1.smithi141.stdout:1/160: sync 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.1.smithi141.stdout:1/161: readlink da/d25/l2d 0 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.1.smithi141.stdout:4/181: sync 2023-12-16T20:11:30.767 INFO:tasks.workunit.client.1.smithi141.stdout:4/182: chown c11 1048018 1 2023-12-16T20:11:30.769 INFO:tasks.workunit.client.0.smithi038.stdout:9/568: dwrite d9/d1e/d3d/d42/f53 [0,4194304] 0 2023-12-16T20:11:30.769 INFO:tasks.workunit.client.0.smithi038.stdout:9/569: dread - d9/d1f/d6a/f97 zero size 2023-12-16T20:11:30.769 INFO:tasks.workunit.client.0.smithi038.stdout:7/461: dread da/f5d [0,4194304] 0 2023-12-16T20:11:30.770 INFO:tasks.workunit.client.1.smithi141.stdout:8/176: creat d14/f36 x:0 0 0 2023-12-16T20:11:30.770 INFO:tasks.workunit.client.1.smithi141.stdout:8/177: fdatasync d14/f23 0 2023-12-16T20:11:30.772 INFO:tasks.workunit.client.1.smithi141.stdout:1/162: unlink da/c1e 0 2023-12-16T20:11:30.773 INFO:tasks.workunit.client.0.smithi038.stdout:5/578: dread d2/d14/d25/d2d/d17/d51/f80 [0,4194304] 0 2023-12-16T20:11:30.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/247: mkdir d0/d1c/d40/d54 0 2023-12-16T20:11:30.776 INFO:tasks.workunit.client.1.smithi141.stdout:8/178: creat d14/d19/d1b/d30/d32/f37 x:0 0 0 2023-12-16T20:11:30.776 INFO:tasks.workunit.client.1.smithi141.stdout:8/179: write d14/d19/f20 [472409,12304] 0 2023-12-16T20:11:30.777 INFO:tasks.workunit.client.1.smithi141.stdout:8/180: stat f11 0 2023-12-16T20:11:30.777 INFO:tasks.workunit.client.1.smithi141.stdout:5/120: dwrite d0/d9/d16/f21 [0,4194304] 0 2023-12-16T20:11:30.780 INFO:tasks.workunit.client.0.smithi038.stdout:2/581: symlink d1/d5/d95/d61/lc6 0 2023-12-16T20:11:30.780 INFO:tasks.workunit.client.0.smithi038.stdout:2/582: chown d1/df/d21/d82/d92 74963 1 2023-12-16T20:11:30.780 INFO:tasks.workunit.client.1.smithi141.stdout:2/94: dread d6/f7 [4194304,4194304] 0 2023-12-16T20:11:30.780 INFO:tasks.workunit.client.1.smithi141.stdout:2/95: dread - d6/f21 zero size 2023-12-16T20:11:30.781 INFO:tasks.workunit.client.1.smithi141.stdout:2/96: readlink d6/l8 0 2023-12-16T20:11:30.781 INFO:tasks.workunit.client.1.smithi141.stdout:2/97: rename d6/da/d1b to d6/da/d1b/d24 22 2023-12-16T20:11:30.782 INFO:tasks.workunit.client.1.smithi141.stdout:4/183: rmdir d1a/d2a 39 2023-12-16T20:11:30.782 INFO:tasks.workunit.client.1.smithi141.stdout:0/177: dwrite d4/d7/f1e [0,4194304] 0 2023-12-16T20:11:30.783 INFO:tasks.workunit.client.1.smithi141.stdout:6/241: dwrite d1/dd/d2f/f3b [0,4194304] 0 2023-12-16T20:11:30.784 INFO:tasks.workunit.client.1.smithi141.stdout:3/248: truncate d0/d1c/d40/f1d 2659677 0 2023-12-16T20:11:30.788 INFO:tasks.workunit.client.1.smithi141.stdout:4/184: getdents d1a/d2a 0 2023-12-16T20:11:30.788 INFO:tasks.workunit.client.1.smithi141.stdout:2/98: dread d6/f1d [0,4194304] 0 2023-12-16T20:11:30.788 INFO:tasks.workunit.client.1.smithi141.stdout:2/99: dread - d6/f21 zero size 2023-12-16T20:11:30.788 INFO:tasks.workunit.client.1.smithi141.stdout:2/100: readlink l5 0 2023-12-16T20:11:30.789 INFO:tasks.workunit.client.1.smithi141.stdout:0/178: mknod d4/d3a/d3b/c3f 0 2023-12-16T20:11:30.790 INFO:tasks.workunit.client.1.smithi141.stdout:3/249: creat d0/d1c/d40/d3c/d4b/d4c/f55 x:0 0 0 2023-12-16T20:11:30.792 INFO:tasks.workunit.client.1.smithi141.stdout:0/179: symlink d4/d3a/l40 0 2023-12-16T20:11:30.792 INFO:tasks.workunit.client.0.smithi038.stdout:1/541: sync 2023-12-16T20:11:30.793 INFO:tasks.workunit.client.1.smithi141.stdout:3/250: creat d0/f56 x:0 0 0 2023-12-16T20:11:30.794 INFO:tasks.workunit.client.1.smithi141.stdout:2/101: write d6/f7 [7452297,81736] 0 2023-12-16T20:11:30.794 INFO:tasks.workunit.client.1.smithi141.stdout:2/102: write d6/f21 [626606,106644] 0 2023-12-16T20:11:30.794 INFO:tasks.workunit.client.0.smithi038.stdout:6/487: mknod d1/d4/d1d/c9b 0 2023-12-16T20:11:30.794 INFO:tasks.workunit.client.0.smithi038.stdout:6/488: readlink d1/d4/l1a 0 2023-12-16T20:11:30.794 INFO:tasks.workunit.client.0.smithi038.stdout:6/489: truncate d1/d2e/f43 505555 0 2023-12-16T20:11:30.795 INFO:tasks.workunit.client.1.smithi141.stdout:4/185: dread d1a/f1b [0,4194304] 0 2023-12-16T20:11:30.796 INFO:tasks.workunit.client.1.smithi141.stdout:2/103: symlink d6/d12/d1f/l25 0 2023-12-16T20:11:30.796 INFO:tasks.workunit.client.1.smithi141.stdout:0/180: dread d4/f16 [0,4194304] 0 2023-12-16T20:11:30.796 INFO:tasks.workunit.client.0.smithi038.stdout:0/525: sync 2023-12-16T20:11:30.796 INFO:tasks.workunit.client.0.smithi038.stdout:8/381: sync 2023-12-16T20:11:30.797 INFO:tasks.workunit.client.1.smithi141.stdout:4/186: mknod d1a/d3c/c47 0 2023-12-16T20:11:30.797 INFO:tasks.workunit.client.1.smithi141.stdout:4/187: write f19 [4359065,48840] 0 2023-12-16T20:11:30.798 INFO:tasks.workunit.client.1.smithi141.stdout:6/242: dread d1/d12/d22/f2a [0,4194304] 0 2023-12-16T20:11:30.799 INFO:tasks.workunit.client.1.smithi141.stdout:2/104: creat d6/f26 x:0 0 0 2023-12-16T20:11:30.799 INFO:tasks.workunit.client.0.smithi038.stdout:9/570: mkdir d9/d1f/d21/d3e/d4e/d61/daa 0 2023-12-16T20:11:30.801 INFO:tasks.workunit.client.0.smithi038.stdout:7/462: link da/d21/d2c/f30 da/d24/f96 0 2023-12-16T20:11:30.802 INFO:tasks.workunit.client.1.smithi141.stdout:4/188: symlink d1a/d3c/l48 0 2023-12-16T20:11:30.802 INFO:tasks.workunit.client.1.smithi141.stdout:4/189: truncate d1a/f32 753744 0 2023-12-16T20:11:30.803 INFO:tasks.workunit.client.1.smithi141.stdout:2/105: rmdir d6/da 39 2023-12-16T20:11:30.803 INFO:tasks.workunit.client.0.smithi038.stdout:5/579: rename d2/d14/d25/d2d/d17/d51/d7b/d89/fa8 to d2/df/d1a/d1f/d4a/d53/d6e/d9e/fb4 0 2023-12-16T20:11:30.803 INFO:tasks.workunit.client.0.smithi038.stdout:5/580: chown d2/df/d1a/d1f/d4a/d53/d6e/f8d 93552 1 2023-12-16T20:11:30.805 INFO:tasks.workunit.client.1.smithi141.stdout:4/190: mknod d1a/d3c/c49 0 2023-12-16T20:11:30.808 INFO:tasks.workunit.client.0.smithi038.stdout:6/490: dread d1/d4/d1d/d28/d2f/d3d/f6a [0,4194304] 0 2023-12-16T20:11:30.808 INFO:tasks.workunit.client.0.smithi038.stdout:6/491: creat d1/d4/f9c x:0 0 0 2023-12-16T20:11:30.809 INFO:tasks.workunit.client.0.smithi038.stdout:6/492: fdatasync d1/d4/d1d/d28/d2f/d3d/f6a 0 2023-12-16T20:11:30.809 INFO:tasks.workunit.client.0.smithi038.stdout:2/583: creat d1/d5/fc7 x:0 0 0 2023-12-16T20:11:30.809 INFO:tasks.workunit.client.1.smithi141.stdout:5/121: dwrite d0/f4 [0,4194304] 0 2023-12-16T20:11:30.809 INFO:tasks.workunit.client.1.smithi141.stdout:5/122: fdatasync d0/df/f1d 0 2023-12-16T20:11:30.811 INFO:tasks.workunit.client.0.smithi038.stdout:1/542: symlink d15/d22/d52/lb4 0 2023-12-16T20:11:30.811 INFO:tasks.workunit.client.0.smithi038.stdout:1/543: write d15/d1e/f2d [5903994,39007] 0 2023-12-16T20:11:30.811 INFO:tasks.workunit.client.0.smithi038.stdout:7/463: write da/d3e/d31/f4a [2274976,19533] 0 2023-12-16T20:11:30.812 INFO:tasks.workunit.client.1.smithi141.stdout:4/191: rename d1a/d3c/l48 to d1a/l4a 0 2023-12-16T20:11:30.812 INFO:tasks.workunit.client.1.smithi141.stdout:6/243: dread d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:30.812 INFO:tasks.workunit.client.0.smithi038.stdout:4/527: sync 2023-12-16T20:11:30.812 INFO:tasks.workunit.client.0.smithi038.stdout:4/528: creat d13/d1f/fab x:0 0 0 2023-12-16T20:11:30.814 INFO:tasks.workunit.client.1.smithi141.stdout:9/142: dwrite d1/d10/f22 [0,4194304] 0 2023-12-16T20:11:30.814 INFO:tasks.workunit.client.1.smithi141.stdout:9/143: readlink d1/d10/d27/l2c 0 2023-12-16T20:11:30.814 INFO:tasks.workunit.client.1.smithi141.stdout:8/181: dwrite d14/f25 [0,4194304] 0 2023-12-16T20:11:30.814 INFO:tasks.workunit.client.1.smithi141.stdout:8/182: fsync d14/d19/d1b/d30/d32/f37 0 2023-12-16T20:11:30.815 INFO:tasks.workunit.client.0.smithi038.stdout:0/526: dread db/f44 [0,4194304] 0 2023-12-16T20:11:30.816 INFO:tasks.workunit.client.1.smithi141.stdout:6/244: mknod d1/d3/c5a 0 2023-12-16T20:11:30.816 INFO:tasks.workunit.client.0.smithi038.stdout:6/493: truncate d1/f22 3068148 0 2023-12-16T20:11:30.816 INFO:tasks.workunit.client.0.smithi038.stdout:2/584: symlink d1/df/d12/lc8 0 2023-12-16T20:11:30.817 INFO:tasks.workunit.client.1.smithi141.stdout:0/181: write d4/d7/f1e [2892214,58838] 0 2023-12-16T20:11:30.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/144: write d1/d10/d14/f25 [158560,42584] 0 2023-12-16T20:11:30.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/145: read d1/fc [240229,113540] 0 2023-12-16T20:11:30.819 INFO:tasks.workunit.client.1.smithi141.stdout:6/245: creat d1/d12/d20/d44/f5b x:0 0 0 2023-12-16T20:11:30.819 INFO:tasks.workunit.client.1.smithi141.stdout:3/251: dwrite d0/f56 [0,4194304] 0 2023-12-16T20:11:30.819 INFO:tasks.workunit.client.1.smithi141.stdout:5/123: dread d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:30.819 INFO:tasks.workunit.client.1.smithi141.stdout:5/124: write d0/d9/f15 [2280809,61010] 0 2023-12-16T20:11:30.820 INFO:tasks.workunit.client.1.smithi141.stdout:5/125: fdatasync d0/f4 0 2023-12-16T20:11:30.820 INFO:tasks.workunit.client.1.smithi141.stdout:0/182: mknod d4/c41 0 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:1/544: symlink d15/d22/d7b/lb5 0 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:1/545: dread - d15/d22/d52/f82 zero size 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:1/546: write d15/d1e/d23/da2/fa7 [730012,51546] 0 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/581: dread d2/d14/d25/d2d/d17/d51/d7b/fa1 [0,4194304] 0 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/582: fsync d2/df/d1a/d2a/d59/fad 0 2023-12-16T20:11:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:7/464: rename da/d21/d41/l80 to da/d21/d2c/d76/l97 0 2023-12-16T20:11:30.824 INFO:tasks.workunit.client.0.smithi038.stdout:8/382: unlink ld 0 2023-12-16T20:11:30.824 INFO:tasks.workunit.client.0.smithi038.stdout:8/383: dread - d17/d1b/f3f zero size 2023-12-16T20:11:30.824 INFO:tasks.workunit.client.0.smithi038.stdout:8/384: fdatasync d17/d1b/d25/f6b 0 2023-12-16T20:11:30.826 INFO:tasks.workunit.client.1.smithi141.stdout:3/252: chown d0/lc 3 1 2023-12-16T20:11:30.828 INFO:tasks.workunit.client.0.smithi038.stdout:0/527: creat db/d1a/d77/d95/da4/fb0 x:0 0 0 2023-12-16T20:11:30.829 INFO:tasks.workunit.client.0.smithi038.stdout:9/571: dwrite d9/d1e/f3c [0,4194304] 0 2023-12-16T20:11:30.829 INFO:tasks.workunit.client.0.smithi038.stdout:9/572: write d9/d1f/f29 [1430667,65071] 0 2023-12-16T20:11:30.831 INFO:tasks.workunit.client.1.smithi141.stdout:5/126: unlink d0/l8 0 2023-12-16T20:11:30.833 INFO:tasks.workunit.client.0.smithi038.stdout:2/585: truncate d1/d5/f7 307383 0 2023-12-16T20:11:30.833 INFO:tasks.workunit.client.1.smithi141.stdout:0/183: rename d4/f20 to d4/d7/f42 0 2023-12-16T20:11:30.837 INFO:tasks.workunit.client.0.smithi038.stdout:0/528: link db/l2f db/d16/d5a/d65/d90/lb1 0 2023-12-16T20:11:30.837 INFO:tasks.workunit.client.0.smithi038.stdout:0/529: readlink db/d16/d5a/l6e 0 2023-12-16T20:11:30.838 INFO:tasks.workunit.client.0.smithi038.stdout:0/530: chown db/f3d 251198 1 2023-12-16T20:11:30.839 INFO:tasks.workunit.client.1.smithi141.stdout:0/184: link d4/d7/cc d4/d3a/d3b/c43 0 2023-12-16T20:11:30.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/573: dread d9/d1f/f38 [0,4194304] 0 2023-12-16T20:11:30.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/574: write d9/d1f/d21/d52/f8c [4986961,115030] 0 2023-12-16T20:11:30.843 INFO:tasks.workunit.client.0.smithi038.stdout:1/547: getdents d15/d22/d62 0 2023-12-16T20:11:30.843 INFO:tasks.workunit.client.0.smithi038.stdout:1/548: creat d15/d1e/d3b/d48/fb6 x:0 0 0 2023-12-16T20:11:30.844 INFO:tasks.workunit.client.1.smithi141.stdout:8/183: dread d14/d19/d1b/d30/f34 [0,4194304] 0 2023-12-16T20:11:30.846 INFO:tasks.workunit.client.0.smithi038.stdout:9/575: dread d9/d1e/d40/d5e/f67 [0,4194304] 0 2023-12-16T20:11:30.846 INFO:tasks.workunit.client.0.smithi038.stdout:9/576: dread - d9/d1f/d21/d3e/d4e/d64/f93 zero size 2023-12-16T20:11:30.847 INFO:tasks.workunit.client.1.smithi141.stdout:5/127: write d0/d9/f20 [2686015,93908] 0 2023-12-16T20:11:30.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/465: rename da/d24/d4d/f6c to da/f98 0 2023-12-16T20:11:30.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/466: chown da/d21/d41/d6b 31048802 1 2023-12-16T20:11:30.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/529: rename d13/d17/d4b/d7d to d13/d17/d4b/d7d/d90/dac 22 2023-12-16T20:11:30.848 INFO:tasks.workunit.client.0.smithi038.stdout:7/467: chown da/d3e/l37 19 1 2023-12-16T20:11:30.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/530: fsync d13/d1f/d35/f38 0 2023-12-16T20:11:30.849 INFO:tasks.workunit.client.1.smithi141.stdout:0/185: mkdir d4/d7/d44 0 2023-12-16T20:11:30.850 INFO:tasks.workunit.client.0.smithi038.stdout:0/531: mknod db/d1a/d77/d95/cb2 0 2023-12-16T20:11:30.852 INFO:tasks.workunit.client.1.smithi141.stdout:8/184: unlink d14/d19/d1b/l22 0 2023-12-16T20:11:30.855 INFO:tasks.workunit.client.1.smithi141.stdout:0/186: unlink d4/d7/l14 0 2023-12-16T20:11:30.855 INFO:tasks.workunit.client.0.smithi038.stdout:9/577: creat d9/d1f/d21/d3e/d4e/d61/daa/fab x:0 0 0 2023-12-16T20:11:30.856 INFO:tasks.workunit.client.0.smithi038.stdout:7/468: unlink da/d3e/d31/d38/d65/c8c 0 2023-12-16T20:11:30.858 INFO:tasks.workunit.client.0.smithi038.stdout:9/578: read d9/d1e/d3d/d42/d59/f7d [1003037,94130] 0 2023-12-16T20:11:30.858 INFO:tasks.workunit.client.0.smithi038.stdout:9/579: write d9/d1f/d21/d52/f82 [5175036,73113] 0 2023-12-16T20:11:30.859 INFO:tasks.workunit.client.1.smithi141.stdout:0/187: rename d4/d7/l2b to d4/l45 0 2023-12-16T20:11:30.859 INFO:tasks.workunit.client.1.smithi141.stdout:0/188: write d4/f16 [1222730,100749] 0 2023-12-16T20:11:30.860 INFO:tasks.workunit.client.0.smithi038.stdout:0/532: mknod db/d16/d70/cb3 0 2023-12-16T20:11:30.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/533: chown db/d16/d19/d4e/dac 895 1 2023-12-16T20:11:30.861 INFO:tasks.workunit.client.1.smithi141.stdout:5/128: dread d0/d9/d16/f21 [0,4194304] 0 2023-12-16T20:11:30.861 INFO:tasks.workunit.client.1.smithi141.stdout:5/129: creat d0/d14/f22 x:0 0 0 2023-12-16T20:11:30.861 INFO:tasks.workunit.client.1.smithi141.stdout:5/130: creat d0/d14/f23 x:0 0 0 2023-12-16T20:11:30.863 INFO:tasks.workunit.client.1.smithi141.stdout:0/189: creat d4/d3a/f46 x:0 0 0 2023-12-16T20:11:30.863 INFO:tasks.workunit.client.0.smithi038.stdout:0/534: dread db/d16/d70/d7c/f7e [0,4194304] 0 2023-12-16T20:11:30.864 INFO:tasks.workunit.client.0.smithi038.stdout:7/469: creat da/d21/d41/d6b/f99 x:0 0 0 2023-12-16T20:11:30.866 INFO:tasks.workunit.client.0.smithi038.stdout:9/580: rmdir d9/d1f/d21/d3e/d4e/d61 39 2023-12-16T20:11:30.868 INFO:tasks.workunit.client.0.smithi038.stdout:6/494: rename d1/d4/d1d/d28/d2f/d3d to d1/d5b/d7d/d9d 0 2023-12-16T20:11:30.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/549: dread d15/d1e/d3b/d48/d37/f3c [0,4194304] 0 2023-12-16T20:11:30.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/550: write d15/d22/d62/fa6 [483051,81160] 0 2023-12-16T20:11:30.881 INFO:tasks.workunit.client.0.smithi038.stdout:0/535: dread db/d16/d1c/d5d/d64/f84 [0,4194304] 0 2023-12-16T20:11:30.885 INFO:tasks.workunit.client.1.smithi141.stdout:6/246: dwrite d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:30.894 INFO:tasks.workunit.client.1.smithi141.stdout:2/106: dwrite d6/f1d [0,4194304] 0 2023-12-16T20:11:30.894 INFO:tasks.workunit.client.1.smithi141.stdout:2/107: write d6/f7 [5590049,917] 0 2023-12-16T20:11:30.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/192: dwrite f9 [0,4194304] 0 2023-12-16T20:11:30.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/193: fdatasync d1a/d2a/d3b/f45 0 2023-12-16T20:11:30.899 INFO:tasks.workunit.client.1.smithi141.stdout:9/146: dwrite d1/d10/f15 [0,4194304] 0 2023-12-16T20:11:30.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/194: unlink d1a/f1e 0 2023-12-16T20:11:30.901 INFO:tasks.workunit.client.1.smithi141.stdout:3/253: dwrite d0/d1c/d40/d3c/d4b/d4c/f55 [0,4194304] 0 2023-12-16T20:11:30.902 INFO:tasks.workunit.client.1.smithi141.stdout:9/147: symlink d1/d10/l37 0 2023-12-16T20:11:30.902 INFO:tasks.workunit.client.1.smithi141.stdout:9/148: dread - d1/d10/d33/f34 zero size 2023-12-16T20:11:30.902 INFO:tasks.workunit.client.1.smithi141.stdout:9/149: creat d1/d10/d14/d20/da/f38 x:0 0 0 2023-12-16T20:11:30.904 INFO:tasks.workunit.client.1.smithi141.stdout:4/195: link f19 d1a/d2a/f4b 0 2023-12-16T20:11:30.904 INFO:tasks.workunit.client.1.smithi141.stdout:4/196: stat d1a/d3c/c46 0 2023-12-16T20:11:30.907 INFO:tasks.workunit.client.1.smithi141.stdout:4/197: symlink d1a/d2a/d3b/l4c 0 2023-12-16T20:11:30.908 INFO:tasks.workunit.client.1.smithi141.stdout:4/198: chown d1a/f32 282 1 2023-12-16T20:11:30.908 INFO:tasks.workunit.client.1.smithi141.stdout:4/199: readlink l3 0 2023-12-16T20:11:30.908 INFO:tasks.workunit.client.1.smithi141.stdout:3/254: getdents d0/d1c/d40/d3c/d4b 0 2023-12-16T20:11:30.908 INFO:tasks.workunit.client.1.smithi141.stdout:3/255: fdatasync d0/d1c/d2c/f49 0 2023-12-16T20:11:30.909 INFO:tasks.workunit.client.0.smithi038.stdout:8/385: dwrite d17/d34/d3d/d59/f6a [0,4194304] 0 2023-12-16T20:11:30.909 INFO:tasks.workunit.client.1.smithi141.stdout:8/185: dwrite d14/f25 [0,4194304] 0 2023-12-16T20:11:30.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/200: unlink d1a/d2a/d3b/l42 0 2023-12-16T20:11:30.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/201: chown l5 0 1 2023-12-16T20:11:30.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/202: write d1a/f1c [585023,82119] 0 2023-12-16T20:11:30.912 INFO:tasks.workunit.client.1.smithi141.stdout:3/256: readlink d0/l2a 0 2023-12-16T20:11:30.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/203: mknod d1a/d3c/c4d 0 2023-12-16T20:11:30.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/204: stat fd 0 2023-12-16T20:11:30.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/205: chown f9 0 1 2023-12-16T20:11:30.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/206: write d1a/f32 [1473266,21181] 0 2023-12-16T20:11:30.916 INFO:tasks.workunit.client.1.smithi141.stdout:4/207: write d1a/f35 [894392,125272] 0 2023-12-16T20:11:30.917 INFO:tasks.workunit.client.1.smithi141.stdout:3/257: mknod d0/d1c/d40/d3c/d4b/d4c/c57 0 2023-12-16T20:11:30.920 INFO:tasks.workunit.client.1.smithi141.stdout:0/190: dread d4/f16 [0,4194304] 0 2023-12-16T20:11:30.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/208: mkdir d1a/d4e 0 2023-12-16T20:11:30.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/209: write d1a/f1f [474517,15210] 0 2023-12-16T20:11:30.921 INFO:tasks.workunit.client.1.smithi141.stdout:3/258: symlink d0/d1c/d40/l58 0 2023-12-16T20:11:30.922 INFO:tasks.workunit.client.1.smithi141.stdout:5/131: dwrite d0/d14/f22 [0,4194304] 0 2023-12-16T20:11:30.923 INFO:tasks.workunit.client.1.smithi141.stdout:0/191: symlink d4/d3a/l47 0 2023-12-16T20:11:30.923 INFO:tasks.workunit.client.1.smithi141.stdout:0/192: readlink d4/d7/l3d 0 2023-12-16T20:11:30.923 INFO:tasks.workunit.client.1.smithi141.stdout:0/193: read d4/d7/f24 [2040343,74133] 0 2023-12-16T20:11:30.923 INFO:tasks.workunit.client.0.smithi038.stdout:4/531: dwrite fa [0,4194304] 0 2023-12-16T20:11:30.923 INFO:tasks.workunit.client.0.smithi038.stdout:4/532: stat d13/d17/d2e/d32/d4d/l60 0 2023-12-16T20:11:30.924 INFO:tasks.workunit.client.1.smithi141.stdout:4/210: symlink d1a/d2a/l4f 0 2023-12-16T20:11:30.925 INFO:tasks.workunit.client.1.smithi141.stdout:3/259: write d0/f3a [1823171,94747] 0 2023-12-16T20:11:30.930 INFO:tasks.workunit.client.1.smithi141.stdout:4/211: mknod d1a/d3c/c50 0 2023-12-16T20:11:30.933 INFO:tasks.workunit.client.1.smithi141.stdout:2/108: dwrite d6/f17 [0,4194304] 0 2023-12-16T20:11:30.934 INFO:tasks.workunit.client.1.smithi141.stdout:4/212: creat d1a/d4e/f51 x:0 0 0 2023-12-16T20:11:30.934 INFO:tasks.workunit.client.1.smithi141.stdout:4/213: dread - d1a/f29 zero size 2023-12-16T20:11:30.940 INFO:tasks.workunit.client.1.smithi141.stdout:8/186: dwrite f11 [0,4194304] 0 2023-12-16T20:11:30.940 INFO:tasks.workunit.client.1.smithi141.stdout:8/187: readlink d14/d19/d1b/d24/l29 0 2023-12-16T20:11:30.940 INFO:tasks.workunit.client.1.smithi141.stdout:8/188: creat d14/d19/d1b/d30/d32/f38 x:0 0 0 2023-12-16T20:11:30.943 INFO:tasks.workunit.client.0.smithi038.stdout:1/551: dwrite d15/d22/d62/fa8 [0,4194304] 0 2023-12-16T20:11:30.943 INFO:tasks.workunit.client.1.smithi141.stdout:4/214: mkdir d1a/d2a/d3b/d52 0 2023-12-16T20:11:30.944 INFO:tasks.workunit.client.1.smithi141.stdout:4/215: stat d1a/d2a/l3a 0 2023-12-16T20:11:30.944 INFO:tasks.workunit.client.0.smithi038.stdout:0/536: dwrite f5 [4194304,4194304] 0 2023-12-16T20:11:30.946 INFO:tasks.workunit.client.1.smithi141.stdout:6/247: dwrite d1/d12/d22/f53 [0,4194304] 0 2023-12-16T20:11:30.951 INFO:tasks.workunit.client.0.smithi038.stdout:7/470: truncate f5 102239 0 2023-12-16T20:11:30.952 INFO:tasks.workunit.client.0.smithi038.stdout:7/471: write da/d24/d4d/d51/f60 [3317102,36450] 0 2023-12-16T20:11:30.952 INFO:tasks.workunit.client.1.smithi141.stdout:9/150: dwrite d1/d10/d14/d20/da/f38 [0,4194304] 0 2023-12-16T20:11:30.952 INFO:tasks.workunit.client.0.smithi038.stdout:9/581: dwrite d9/d1f/d21/d55/f6f [4194304,4194304] 0 2023-12-16T20:11:30.955 INFO:tasks.workunit.client.0.smithi038.stdout:8/386: dwrite d17/d1b/d66/d73/d54/d69/f26 [0,4194304] 0 2023-12-16T20:11:30.957 INFO:tasks.workunit.client.0.smithi038.stdout:2/586: rename d1/d5/d95/d61/d75/f96 to d1/df/d21/d82/d92/fc9 0 2023-12-16T20:11:30.957 INFO:tasks.workunit.client.1.smithi141.stdout:9/151: mkdir d1/d10/d33/d39 0 2023-12-16T20:11:30.959 INFO:tasks.workunit.client.0.smithi038.stdout:5/583: rmdir d2/df/d1a/d1f/d4a/d53 39 2023-12-16T20:11:30.964 INFO:tasks.workunit.client.1.smithi141.stdout:6/248: dread d1/d3/f10 [0,4194304] 0 2023-12-16T20:11:30.964 INFO:tasks.workunit.client.1.smithi141.stdout:0/194: dwrite d4/d7/f42 [0,4194304] 0 2023-12-16T20:11:30.968 INFO:tasks.workunit.client.1.smithi141.stdout:4/216: unlink d1a/c21 0 2023-12-16T20:11:30.968 INFO:tasks.workunit.client.1.smithi141.stdout:3/260: dwrite d0/f56 [0,4194304] 0 2023-12-16T20:11:30.971 INFO:tasks.workunit.client.1.smithi141.stdout:6/249: link d1/d12/d20/d3a/d45/d47/l56 d1/d12/d22/d25/l5c 0 2023-12-16T20:11:30.973 INFO:tasks.workunit.client.1.smithi141.stdout:0/195: dread d4/d7/fd [0,4194304] 0 2023-12-16T20:11:30.974 INFO:tasks.workunit.client.1.smithi141.stdout:0/196: readlink d4/d7/l3d 0 2023-12-16T20:11:30.974 INFO:tasks.workunit.client.1.smithi141.stdout:0/197: chown d4/l1a 0 1 2023-12-16T20:11:30.974 INFO:tasks.workunit.client.0.smithi038.stdout:5/584: dread d2/d14/d25/d2d/d17/d51/f8e [0,4194304] 0 2023-12-16T20:11:30.976 INFO:tasks.workunit.client.1.smithi141.stdout:4/217: rmdir d1a/d2a/d3b/d52 0 2023-12-16T20:11:30.978 INFO:tasks.workunit.client.1.smithi141.stdout:3/261: rename d0/f56 to d0/d1c/d40/d3f/d52/f59 0 2023-12-16T20:11:30.978 INFO:tasks.workunit.client.1.smithi141.stdout:3/262: write d0/d1c/d40/f1e [5045390,48201] 0 2023-12-16T20:11:30.982 INFO:tasks.workunit.client.1.smithi141.stdout:2/109: dwrite d6/f21 [0,4194304] 0 2023-12-16T20:11:30.985 INFO:tasks.workunit.client.1.smithi141.stdout:5/132: dwrite d0/fe [0,4194304] 0 2023-12-16T20:11:30.986 INFO:tasks.workunit.client.1.smithi141.stdout:5/133: chown d0/c5 0 1 2023-12-16T20:11:30.987 INFO:tasks.workunit.client.1.smithi141.stdout:5/134: fdatasync d0/f4 0 2023-12-16T20:11:30.990 INFO:tasks.workunit.client.1.smithi141.stdout:4/218: getdents d1a/d2a 0 2023-12-16T20:11:30.990 INFO:tasks.workunit.client.1.smithi141.stdout:4/219: write d1a/d2a/f4b [4780312,25670] 0 2023-12-16T20:11:30.991 INFO:tasks.workunit.client.1.smithi141.stdout:4/220: readlink l5 0 2023-12-16T20:11:30.991 INFO:tasks.workunit.client.1.smithi141.stdout:4/221: read f14 [1343157,15848] 0 2023-12-16T20:11:30.991 INFO:tasks.workunit.client.1.smithi141.stdout:2/110: dread d6/f21 [0,4194304] 0 2023-12-16T20:11:30.995 INFO:tasks.workunit.client.1.smithi141.stdout:4/222: creat d1a/d2a/f53 x:0 0 0 2023-12-16T20:11:30.996 INFO:tasks.workunit.client.1.smithi141.stdout:8/189: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:30.996 INFO:tasks.workunit.client.1.smithi141.stdout:8/190: stat c6 0 2023-12-16T20:11:30.996 INFO:tasks.workunit.client.1.smithi141.stdout:9/152: dwrite d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:30.997 INFO:tasks.workunit.client.1.smithi141.stdout:6/250: dread d1/dd/d2f/f3b [0,4194304] 0 2023-12-16T20:11:30.998 INFO:tasks.workunit.client.1.smithi141.stdout:2/111: creat d6/da/d1b/f27 x:0 0 0 2023-12-16T20:11:30.998 INFO:tasks.workunit.client.1.smithi141.stdout:2/112: fdatasync d6/f26 0 2023-12-16T20:11:31.000 INFO:tasks.workunit.client.1.smithi141.stdout:8/191: mknod d14/c39 0 2023-12-16T20:11:31.005 INFO:tasks.workunit.client.1.smithi141.stdout:9/153: creat d1/d10/d27/d36/f3a x:0 0 0 2023-12-16T20:11:31.006 INFO:tasks.workunit.client.1.smithi141.stdout:8/192: truncate d14/d19/f1f 4235326 0 2023-12-16T20:11:31.007 INFO:tasks.workunit.client.1.smithi141.stdout:0/198: dwrite d4/fe [0,4194304] 0 2023-12-16T20:11:31.007 INFO:tasks.workunit.client.1.smithi141.stdout:9/154: mkdir d1/d10/d14/d20/d3b 0 2023-12-16T20:11:31.008 INFO:tasks.workunit.client.1.smithi141.stdout:0/199: rmdir d4/d3a/d3b 39 2023-12-16T20:11:31.010 INFO:tasks.workunit.client.1.smithi141.stdout:5/135: truncate d0/d9/f20 1878112 0 2023-12-16T20:11:31.011 INFO:tasks.workunit.client.1.smithi141.stdout:9/155: mkdir d1/d26/d3c 0 2023-12-16T20:11:31.012 INFO:tasks.workunit.client.1.smithi141.stdout:6/251: write d1/d12/d22/f53 [1758531,13903] 0 2023-12-16T20:11:31.013 INFO:tasks.workunit.client.1.smithi141.stdout:0/200: symlink d4/d7/l48 0 2023-12-16T20:11:31.013 INFO:tasks.workunit.client.1.smithi141.stdout:0/201: fdatasync d4/d7/f1e 0 2023-12-16T20:11:31.013 INFO:tasks.workunit.client.1.smithi141.stdout:0/202: chown d4/l27 43654 1 2023-12-16T20:11:31.013 INFO:tasks.workunit.client.1.smithi141.stdout:5/136: write d0/d14/f23 [798614,102327] 0 2023-12-16T20:11:31.014 INFO:tasks.workunit.client.1.smithi141.stdout:1/163: sync 2023-12-16T20:11:31.014 INFO:tasks.workunit.client.1.smithi141.stdout:7/127: sync 2023-12-16T20:11:31.015 INFO:tasks.workunit.client.1.smithi141.stdout:8/193: dread d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:31.015 INFO:tasks.workunit.client.1.smithi141.stdout:8/194: fdatasync d14/d19/d1b/d24/f31 0 2023-12-16T20:11:31.015 INFO:tasks.workunit.client.1.smithi141.stdout:8/195: chown d14/d19/f1f 560543039 1 2023-12-16T20:11:31.015 INFO:tasks.workunit.client.1.smithi141.stdout:7/128: write d5/fc [273912,99692] 0 2023-12-16T20:11:31.018 INFO:tasks.workunit.client.1.smithi141.stdout:0/203: unlink d4/d7/l3d 0 2023-12-16T20:11:31.021 INFO:tasks.workunit.client.1.smithi141.stdout:5/137: unlink d0/f4 0 2023-12-16T20:11:31.021 INFO:tasks.workunit.client.1.smithi141.stdout:3/263: dwrite d0/f3a [0,4194304] 0 2023-12-16T20:11:31.023 INFO:tasks.workunit.client.1.smithi141.stdout:1/164: unlink da/df/l17 0 2023-12-16T20:11:31.023 INFO:tasks.workunit.client.1.smithi141.stdout:1/165: dread - da/d1a/d1d/d22/d29/f32 zero size 2023-12-16T20:11:31.027 INFO:tasks.workunit.client.1.smithi141.stdout:8/196: creat d14/d19/d1b/f3a x:0 0 0 2023-12-16T20:11:31.028 INFO:tasks.workunit.client.1.smithi141.stdout:2/113: dwrite d6/f1d [4194304,4194304] 0 2023-12-16T20:11:31.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/252: dread d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:31.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/253: stat d1/d12/d20 0 2023-12-16T20:11:31.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/254: write d1/dd/f1e [421947,19895] 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:7/129: mknod d5/d1d/c26 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:3/264: stat d0/l9 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:1/166: symlink da/l35 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:8/197: symlink d14/d19/d1b/d30/d32/l3b 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:9/156: getdents d1/d26 0 2023-12-16T20:11:31.037 INFO:tasks.workunit.client.1.smithi141.stdout:8/198: readlink d14/d19/d1b/d24/l29 0 2023-12-16T20:11:31.038 INFO:tasks.workunit.client.0.smithi038.stdout:4/533: creat d13/d17/d2e/d32/d70/d84/fad x:0 0 0 2023-12-16T20:11:31.038 INFO:tasks.workunit.client.0.smithi038.stdout:4/534: chown d13/d17/l5b 5854 1 2023-12-16T20:11:31.040 INFO:tasks.workunit.client.1.smithi141.stdout:6/255: getdents d1/d12/d20/d3a 0 2023-12-16T20:11:31.040 INFO:tasks.workunit.client.1.smithi141.stdout:0/204: dwrite d4/f1c [0,4194304] 0 2023-12-16T20:11:31.042 INFO:tasks.workunit.client.1.smithi141.stdout:5/138: link d0/d9/c1e d0/df/c24 0 2023-12-16T20:11:31.044 INFO:tasks.workunit.client.1.smithi141.stdout:7/130: mkdir d5/d1d/d1e/d27 0 2023-12-16T20:11:31.044 INFO:tasks.workunit.client.1.smithi141.stdout:7/131: truncate d5/f10 382671 0 2023-12-16T20:11:31.046 INFO:tasks.workunit.client.1.smithi141.stdout:3/265: mkdir d0/d1c/d40/d3f/d52/d5a 0 2023-12-16T20:11:31.047 INFO:tasks.workunit.client.1.smithi141.stdout:1/167: mkdir da/d36 0 2023-12-16T20:11:31.048 INFO:tasks.workunit.client.1.smithi141.stdout:9/157: rmdir d1/d26 39 2023-12-16T20:11:31.048 INFO:tasks.workunit.client.1.smithi141.stdout:9/158: fsync d1/d10/d27/d36/f3a 0 2023-12-16T20:11:31.048 INFO:tasks.workunit.client.0.smithi038.stdout:4/535: read d13/d17/d2e/d32/d4e/f64 [3287028,88426] 0 2023-12-16T20:11:31.048 INFO:tasks.workunit.client.0.smithi038.stdout:4/536: truncate d13/d17/d2e/d75/f6d 476332 0 2023-12-16T20:11:31.049 INFO:tasks.workunit.client.1.smithi141.stdout:3/266: write d0/f3a [4897918,4066] 0 2023-12-16T20:11:31.049 INFO:tasks.workunit.client.1.smithi141.stdout:3/267: write d0/d1c/d2c/f48 [1038630,3629] 0 2023-12-16T20:11:31.049 INFO:tasks.workunit.client.1.smithi141.stdout:3/268: chown d0/d1c/d40/c18 6821 1 2023-12-16T20:11:31.050 INFO:tasks.workunit.client.1.smithi141.stdout:8/199: mknod d14/c3c 0 2023-12-16T20:11:31.050 INFO:tasks.workunit.client.1.smithi141.stdout:2/114: truncate d6/f21 1607694 0 2023-12-16T20:11:31.052 INFO:tasks.workunit.client.1.smithi141.stdout:0/205: truncate f1 3279520 0 2023-12-16T20:11:31.054 INFO:tasks.workunit.client.1.smithi141.stdout:7/132: creat d5/f28 x:0 0 0 2023-12-16T20:11:31.054 INFO:tasks.workunit.client.1.smithi141.stdout:7/133: fdatasync d5/f14 0 2023-12-16T20:11:31.054 INFO:tasks.workunit.client.1.smithi141.stdout:7/134: write d5/f8 [9321191,69436] 0 2023-12-16T20:11:31.054 INFO:tasks.workunit.client.1.smithi141.stdout:7/135: chown c4 2259325 1 2023-12-16T20:11:31.054 INFO:tasks.workunit.client.1.smithi141.stdout:7/136: chown d5/cb 0 1 2023-12-16T20:11:31.056 INFO:tasks.workunit.client.1.smithi141.stdout:1/168: truncate da/d25/f26 1533287 0 2023-12-16T20:11:31.056 INFO:tasks.workunit.client.1.smithi141.stdout:2/115: unlink d6/l19 0 2023-12-16T20:11:31.057 INFO:tasks.workunit.client.1.smithi141.stdout:2/116: dread - d6/f26 zero size 2023-12-16T20:11:31.058 INFO:tasks.workunit.client.1.smithi141.stdout:6/256: rename d1/dd/de/c18 to d1/d3/d4f/c5d 0 2023-12-16T20:11:31.059 INFO:tasks.workunit.client.1.smithi141.stdout:5/139: mkdir d0/d25 0 2023-12-16T20:11:31.060 INFO:tasks.workunit.client.1.smithi141.stdout:2/117: getdents d6/d12/d15 0 2023-12-16T20:11:31.060 INFO:tasks.workunit.client.1.smithi141.stdout:2/118: fdatasync d6/f21 0 2023-12-16T20:11:31.063 INFO:tasks.workunit.client.1.smithi141.stdout:0/206: getdents d4/d7 0 2023-12-16T20:11:31.064 INFO:tasks.workunit.client.1.smithi141.stdout:2/119: creat d6/da/f28 x:0 0 0 2023-12-16T20:11:31.066 INFO:tasks.workunit.client.1.smithi141.stdout:3/269: rename d0/d1c/f44 to d0/d1c/d2c/f5b 0 2023-12-16T20:11:31.066 INFO:tasks.workunit.client.1.smithi141.stdout:0/207: mkdir d4/d49 0 2023-12-16T20:11:31.066 INFO:tasks.workunit.client.1.smithi141.stdout:1/169: dread da/fc [0,4194304] 0 2023-12-16T20:11:31.066 INFO:tasks.workunit.client.1.smithi141.stdout:1/170: creat da/d1a/d1d/d22/d29/f37 x:0 0 0 2023-12-16T20:11:31.069 INFO:tasks.workunit.client.1.smithi141.stdout:5/140: getdents d0/d14 0 2023-12-16T20:11:31.069 INFO:tasks.workunit.client.1.smithi141.stdout:0/208: symlink d4/l4a 0 2023-12-16T20:11:31.070 INFO:tasks.workunit.client.1.smithi141.stdout:2/120: creat d6/d12/f29 x:0 0 0 2023-12-16T20:11:31.072 INFO:tasks.workunit.client.1.smithi141.stdout:0/209: unlink d4/c6 0 2023-12-16T20:11:31.074 INFO:tasks.workunit.client.1.smithi141.stdout:5/141: mkdir d0/d14/d26 0 2023-12-16T20:11:31.074 INFO:tasks.workunit.client.1.smithi141.stdout:5/142: dread - d0/d9/f13 zero size 2023-12-16T20:11:31.074 INFO:tasks.workunit.client.1.smithi141.stdout:5/143: stat d0/d14/f23 0 2023-12-16T20:11:31.075 INFO:tasks.workunit.client.1.smithi141.stdout:2/121: symlink d6/da/d1b/d1c/l2a 0 2023-12-16T20:11:31.075 INFO:tasks.workunit.client.1.smithi141.stdout:2/122: write d6/f26 [707662,91347] 0 2023-12-16T20:11:31.075 INFO:tasks.workunit.client.1.smithi141.stdout:2/123: readlink l5 0 2023-12-16T20:11:31.075 INFO:tasks.workunit.client.1.smithi141.stdout:2/124: chown d6/d12/f29 2 1 2023-12-16T20:11:31.075 INFO:tasks.workunit.client.1.smithi141.stdout:2/125: dread - d6/da/f28 zero size 2023-12-16T20:11:31.082 INFO:tasks.workunit.client.1.smithi141.stdout:8/200: rename d14/d19/d1b/d30/d32 to d14/d19/d1b/d3d 0 2023-12-16T20:11:31.082 INFO:tasks.workunit.client.1.smithi141.stdout:8/201: fdatasync d14/d19/d1b/d24/f31 0 2023-12-16T20:11:31.082 INFO:tasks.workunit.client.1.smithi141.stdout:8/202: chown d14/f25 12741 1 2023-12-16T20:11:31.082 INFO:tasks.workunit.client.1.smithi141.stdout:0/210: mkdir d4/d49/d4b 0 2023-12-16T20:11:31.083 INFO:tasks.workunit.client.1.smithi141.stdout:5/144: mknod d0/df/c27 0 2023-12-16T20:11:31.083 INFO:tasks.workunit.client.1.smithi141.stdout:9/159: dwrite d1/d10/d14/f25 [0,4194304] 0 2023-12-16T20:11:31.083 INFO:tasks.workunit.client.1.smithi141.stdout:9/160: write d1/d10/d14/d20/da/f32 [39090,95215] 0 2023-12-16T20:11:31.084 INFO:tasks.workunit.client.1.smithi141.stdout:5/145: rename d0/c5 to d0/df/c28 0 2023-12-16T20:11:31.087 INFO:tasks.workunit.client.1.smithi141.stdout:9/161: mknod d1/d26/d3c/c3d 0 2023-12-16T20:11:31.088 INFO:tasks.workunit.client.1.smithi141.stdout:5/146: symlink d0/d14/l29 0 2023-12-16T20:11:31.091 INFO:tasks.workunit.client.1.smithi141.stdout:0/211: read d4/f31 [443097,91496] 0 2023-12-16T20:11:31.091 INFO:tasks.workunit.client.1.smithi141.stdout:0/212: chown f1 69613 1 2023-12-16T20:11:31.091 INFO:tasks.workunit.client.1.smithi141.stdout:8/203: dread d14/d19/d1b/f2f [0,4194304] 0 2023-12-16T20:11:31.093 INFO:tasks.workunit.client.1.smithi141.stdout:8/204: creat d14/d19/d1b/d3d/f3e x:0 0 0 2023-12-16T20:11:31.093 INFO:tasks.workunit.client.1.smithi141.stdout:8/205: creat d14/d19/d1b/f3f x:0 0 0 2023-12-16T20:11:31.095 INFO:tasks.workunit.client.0.smithi038.stdout:7/472: mkdir da/d21/d2c/d76/d9a 0 2023-12-16T20:11:31.105 INFO:tasks.workunit.client.1.smithi141.stdout:7/137: dwrite d5/f11 [0,4194304] 0 2023-12-16T20:11:31.108 INFO:tasks.workunit.client.1.smithi141.stdout:8/206: dread d14/d19/f1c [0,4194304] 0 2023-12-16T20:11:31.110 INFO:tasks.workunit.client.1.smithi141.stdout:8/207: symlink d14/d35/l40 0 2023-12-16T20:11:31.110 INFO:tasks.workunit.client.1.smithi141.stdout:9/162: read d1/d26/f2f [611960,98188] 0 2023-12-16T20:11:31.110 INFO:tasks.workunit.client.1.smithi141.stdout:7/138: symlink d5/l29 0 2023-12-16T20:11:31.121 INFO:tasks.workunit.client.0.smithi038.stdout:8/387: creat d17/d1b/d53/f77 x:0 0 0 2023-12-16T20:11:31.124 INFO:tasks.workunit.client.1.smithi141.stdout:6/257: dwrite d1/dd/de/f27 [0,4194304] 0 2023-12-16T20:11:31.124 INFO:tasks.workunit.client.1.smithi141.stdout:6/258: write d1/d12/d20/d44/f5b [331028,5336] 0 2023-12-16T20:11:31.127 INFO:tasks.workunit.client.0.smithi038.stdout:2/587: creat d1/d5/d6c/d91/fca x:0 0 0 2023-12-16T20:11:31.130 INFO:tasks.workunit.client.1.smithi141.stdout:1/171: dwrite da/fc [0,4194304] 0 2023-12-16T20:11:31.133 INFO:tasks.workunit.client.1.smithi141.stdout:1/172: truncate da/df/f1b 376749 0 2023-12-16T20:11:31.134 INFO:tasks.workunit.client.1.smithi141.stdout:9/163: write d1/d10/f15 [3721057,127373] 0 2023-12-16T20:11:31.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/270: dwrite d0/d1c/d40/d3c/d4b/d4c/f55 [4194304,4194304] 0 2023-12-16T20:11:31.136 INFO:tasks.workunit.client.1.smithi141.stdout:1/173: rename da/c15 to da/d36/c38 0 2023-12-16T20:11:31.136 INFO:tasks.workunit.client.1.smithi141.stdout:0/213: dwrite d4/d7/f1e [0,4194304] 0 2023-12-16T20:11:31.140 INFO:tasks.workunit.client.1.smithi141.stdout:1/174: write da/d1a/d1d/d22/d29/f2a [634464,32341] 0 2023-12-16T20:11:31.141 INFO:tasks.workunit.client.1.smithi141.stdout:3/271: stat d0/c16 0 2023-12-16T20:11:31.142 INFO:tasks.workunit.client.1.smithi141.stdout:0/214: symlink d4/l4c 0 2023-12-16T20:11:31.144 INFO:tasks.workunit.client.1.smithi141.stdout:3/272: symlink d0/d1c/d40/d3c/d4b/l5c 0 2023-12-16T20:11:31.150 INFO:tasks.workunit.client.0.smithi038.stdout:2/588: mknod d1/df/d10/d2f/ccb 0 2023-12-16T20:11:31.150 INFO:tasks.workunit.client.0.smithi038.stdout:2/589: chown d1/d5/d2a/ca5 2902872 1 2023-12-16T20:11:31.150 INFO:tasks.workunit.client.0.smithi038.stdout:2/590: readlink d1/df/d6a/l90 0 2023-12-16T20:11:31.150 INFO:tasks.workunit.client.0.smithi038.stdout:5/585: getdents d2/df/d1a/d2a/d59 0 2023-12-16T20:11:31.151 INFO:tasks.workunit.client.1.smithi141.stdout:3/273: mkdir d0/d1c/d40/d3f/d52/d5d 0 2023-12-16T20:11:31.151 INFO:tasks.workunit.client.1.smithi141.stdout:7/139: dread d5/f8 [4194304,4194304] 0 2023-12-16T20:11:31.151 INFO:tasks.workunit.client.1.smithi141.stdout:7/140: truncate d5/f22 651002 0 2023-12-16T20:11:31.151 INFO:tasks.workunit.client.1.smithi141.stdout:7/141: fsync d5/f12 0 2023-12-16T20:11:31.151 INFO:tasks.workunit.client.1.smithi141.stdout:7/142: write d5/f14 [303477,38940] 0 2023-12-16T20:11:31.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/274: rename d0/c11 to d0/d1c/d40/d3c/c5e 0 2023-12-16T20:11:31.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/275: fsync d0/d1c/d40/f1b 0 2023-12-16T20:11:31.154 INFO:tasks.workunit.client.0.smithi038.stdout:4/537: symlink d13/d17/d4b/da4/lae 0 2023-12-16T20:11:31.154 INFO:tasks.workunit.client.1.smithi141.stdout:7/143: mkdir d5/d2a 0 2023-12-16T20:11:31.154 INFO:tasks.workunit.client.1.smithi141.stdout:1/175: dread da/f12 [0,4194304] 0 2023-12-16T20:11:31.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/473: dwrite da/d3e/f3a [8388608,4194304] 0 2023-12-16T20:11:31.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/474: stat da/d3e/d31/c8a 0 2023-12-16T20:11:31.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/475: truncate da/d24/f6f 483449 0 2023-12-16T20:11:31.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/476: fsync da/d21/f87 0 2023-12-16T20:11:31.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/477: chown da/d24/l5b 57123830 1 2023-12-16T20:11:31.156 INFO:tasks.workunit.client.1.smithi141.stdout:7/144: creat d5/d2a/f2b x:0 0 0 2023-12-16T20:11:31.156 INFO:tasks.workunit.client.1.smithi141.stdout:7/145: creat d5/d2a/f2c x:0 0 0 2023-12-16T20:11:31.156 INFO:tasks.workunit.client.1.smithi141.stdout:7/146: chown d5/d1d/d1e/l20 11252566 1 2023-12-16T20:11:31.156 INFO:tasks.workunit.client.1.smithi141.stdout:3/276: symlink d0/d1c/d40/l5f 0 2023-12-16T20:11:31.157 INFO:tasks.workunit.client.0.smithi038.stdout:8/388: mkdir d17/d1d/d78 0 2023-12-16T20:11:31.158 INFO:tasks.workunit.client.1.smithi141.stdout:1/176: symlink da/d1a/d31/l39 0 2023-12-16T20:11:31.158 INFO:tasks.workunit.client.1.smithi141.stdout:0/215: dread f1 [0,4194304] 0 2023-12-16T20:11:31.162 INFO:tasks.workunit.client.1.smithi141.stdout:7/147: unlink d5/l1c 0 2023-12-16T20:11:31.162 INFO:tasks.workunit.client.1.smithi141.stdout:7/148: dread - d5/f12 zero size 2023-12-16T20:11:31.162 INFO:tasks.workunit.client.1.smithi141.stdout:7/149: chown l2 463 1 2023-12-16T20:11:31.165 INFO:tasks.workunit.client.0.smithi038.stdout:2/591: rmdir d1/df/d12 39 2023-12-16T20:11:31.165 INFO:tasks.workunit.client.0.smithi038.stdout:2/592: readlink d1/d5/d3d/l48 0 2023-12-16T20:11:31.165 INFO:tasks.workunit.client.1.smithi141.stdout:3/277: symlink d0/d1c/d40/d3c/d4b/d4c/l60 0 2023-12-16T20:11:31.165 INFO:tasks.workunit.client.1.smithi141.stdout:7/150: write d5/f14 [21251,10] 0 2023-12-16T20:11:31.165 INFO:tasks.workunit.client.1.smithi141.stdout:7/151: creat d5/d2a/f2d x:0 0 0 2023-12-16T20:11:31.166 INFO:tasks.workunit.client.1.smithi141.stdout:0/216: symlink d4/d49/d4b/l4d 0 2023-12-16T20:11:31.169 INFO:tasks.workunit.client.1.smithi141.stdout:2/126: dwrite d6/f21 [0,4194304] 0 2023-12-16T20:11:31.169 INFO:tasks.workunit.client.1.smithi141.stdout:2/127: chown d6/d12/d15/l23 0 1 2023-12-16T20:11:31.171 INFO:tasks.workunit.client.1.smithi141.stdout:6/259: dwrite d1/dd/de/f27 [0,4194304] 0 2023-12-16T20:11:31.171 INFO:tasks.workunit.client.1.smithi141.stdout:3/278: truncate d0/f8 4903228 0 2023-12-16T20:11:31.173 INFO:tasks.workunit.client.1.smithi141.stdout:7/152: getdents d5/d16 0 2023-12-16T20:11:31.175 INFO:tasks.workunit.client.1.smithi141.stdout:8/208: rmdir d14/d19/d1b 39 2023-12-16T20:11:31.175 INFO:tasks.workunit.client.0.smithi038.stdout:5/586: creat d2/df/d1a/d1f/d4a/d53/d6e/d85/fb5 x:0 0 0 2023-12-16T20:11:31.176 INFO:tasks.workunit.client.0.smithi038.stdout:5/587: creat d2/d14/d25/d2d/d17/d51/fb6 x:0 0 0 2023-12-16T20:11:31.176 INFO:tasks.workunit.client.0.smithi038.stdout:5/588: write d2/d14/d25/d2d/d17/da9/fb3 [622963,96609] 0 2023-12-16T20:11:31.176 INFO:tasks.workunit.client.1.smithi141.stdout:6/260: write d1/dd/d2f/f30 [1171027,94367] 0 2023-12-16T20:11:31.177 INFO:tasks.workunit.client.1.smithi141.stdout:0/217: link d4/c26 d4/d49/d4b/c4e 0 2023-12-16T20:11:31.177 INFO:tasks.workunit.client.0.smithi038.stdout:4/538: creat d13/d17/d4b/d7d/d90/faf x:0 0 0 2023-12-16T20:11:31.181 INFO:tasks.workunit.client.1.smithi141.stdout:2/128: stat d6/da/l22 0 2023-12-16T20:11:31.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/478: symlink da/d21/d86/l9b 0 2023-12-16T20:11:31.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/479: read da/d21/d61/f66 [366984,39756] 0 2023-12-16T20:11:31.185 INFO:tasks.workunit.client.1.smithi141.stdout:8/209: symlink d14/d19/d1b/d30/l41 0 2023-12-16T20:11:31.188 INFO:tasks.workunit.client.0.smithi038.stdout:2/593: mkdir d1/df/d21/d82/dcc 0 2023-12-16T20:11:31.188 INFO:tasks.workunit.client.0.smithi038.stdout:2/594: fsync d1/df/d21/d9a/db9/d3a/f56 0 2023-12-16T20:11:31.190 INFO:tasks.workunit.client.1.smithi141.stdout:7/153: link d5/l6 d5/d1d/d1e/l2e 0 2023-12-16T20:11:31.191 INFO:tasks.workunit.client.1.smithi141.stdout:2/129: symlink d6/l2b 0 2023-12-16T20:11:31.191 INFO:tasks.workunit.client.1.smithi141.stdout:2/130: write d6/f26 [881102,115246] 0 2023-12-16T20:11:31.192 INFO:tasks.workunit.client.1.smithi141.stdout:2/131: stat d6/da 0 2023-12-16T20:11:31.192 INFO:tasks.workunit.client.1.smithi141.stdout:3/279: dread d0/d1c/d40/f43 [4194304,4194304] 0 2023-12-16T20:11:31.195 INFO:tasks.workunit.client.1.smithi141.stdout:2/132: creat d6/da/d1b/d1c/f2c x:0 0 0 2023-12-16T20:11:31.197 INFO:tasks.workunit.client.0.smithi038.stdout:2/595: mknod d1/df/d21/d82/ccd 0 2023-12-16T20:11:31.198 INFO:tasks.workunit.client.1.smithi141.stdout:8/210: dread d14/f25 [0,4194304] 0 2023-12-16T20:11:31.198 INFO:tasks.workunit.client.1.smithi141.stdout:8/211: fsync d14/d19/d1b/f21 0 2023-12-16T20:11:31.198 INFO:tasks.workunit.client.1.smithi141.stdout:8/212: rename d14/d19 to d14/d19/d1b/d3d/d42 22 2023-12-16T20:11:31.198 INFO:tasks.workunit.client.1.smithi141.stdout:2/133: link d6/c10 d6/d12/d1f/c2d 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:6/261: read d1/dd/d2f/f3b [2114211,126210] 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:1/177: dwrite da/fb [0,4194304] 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:9/164: dwrite d1/d10/d14/d20/da/f32 [0,4194304] 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:1/178: readlink da/l19 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:9/165: write d1/d10/f12 [4331211,95910] 0 2023-12-16T20:11:31.200 INFO:tasks.workunit.client.1.smithi141.stdout:9/166: chown d1/d26 246088381 1 2023-12-16T20:11:31.202 INFO:tasks.workunit.client.1.smithi141.stdout:8/213: dread d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:31.202 INFO:tasks.workunit.client.1.smithi141.stdout:8/214: fsync d14/f36 0 2023-12-16T20:11:31.203 INFO:tasks.workunit.client.0.smithi038.stdout:2/596: mkdir d1/d5/d6c/d91/dce 0 2023-12-16T20:11:31.208 INFO:tasks.workunit.client.1.smithi141.stdout:8/215: truncate d14/d19/f2e 1636312 0 2023-12-16T20:11:31.208 INFO:tasks.workunit.client.1.smithi141.stdout:8/216: write d14/f23 [1898802,35835] 0 2023-12-16T20:11:31.208 INFO:tasks.workunit.client.1.smithi141.stdout:8/217: creat d14/f43 x:0 0 0 2023-12-16T20:11:31.212 INFO:tasks.workunit.client.0.smithi038.stdout:9/582: link d9/d1e/f33 d9/d1f/fac 0 2023-12-16T20:11:31.213 INFO:tasks.workunit.client.1.smithi141.stdout:8/218: symlink d14/l44 0 2023-12-16T20:11:31.213 INFO:tasks.workunit.client.1.smithi141.stdout:2/134: dread d6/f7 [0,4194304] 0 2023-12-16T20:11:31.224 INFO:tasks.workunit.client.0.smithi038.stdout:8/389: read d17/d1d/f71 [3368516,38010] 0 2023-12-16T20:11:31.224 INFO:tasks.workunit.client.0.smithi038.stdout:8/390: write f1 [5013085,1892] 0 2023-12-16T20:11:31.224 INFO:tasks.workunit.client.0.smithi038.stdout:8/391: chown d17/d1b/d66/d73/d54/d69/l2f 174107 1 2023-12-16T20:11:31.224 INFO:tasks.workunit.client.1.smithi141.stdout:9/167: read d1/d10/d14/d20/da/f32 [1039855,109181] 0 2023-12-16T20:11:31.224 INFO:tasks.workunit.client.1.smithi141.stdout:1/179: fdatasync da/d1a/d1d/d22/d29/f2a 0 2023-12-16T20:11:31.226 INFO:tasks.workunit.client.1.smithi141.stdout:2/135: dread d6/f17 [0,4194304] 0 2023-12-16T20:11:31.226 INFO:tasks.workunit.client.1.smithi141.stdout:1/180: creat da/d1a/d1d/d33/f3a x:0 0 0 2023-12-16T20:11:31.227 INFO:tasks.workunit.client.1.smithi141.stdout:8/219: write d14/d19/d1b/f1a [453838,14928] 0 2023-12-16T20:11:31.230 INFO:tasks.workunit.client.1.smithi141.stdout:2/136: mknod d6/c2e 0 2023-12-16T20:11:31.230 INFO:tasks.workunit.client.1.smithi141.stdout:2/137: creat d6/da/d1b/d1c/f2f x:0 0 0 2023-12-16T20:11:31.230 INFO:tasks.workunit.client.0.smithi038.stdout:1/552: rename f10 to d15/fb7 0 2023-12-16T20:11:31.231 INFO:tasks.workunit.client.1.smithi141.stdout:2/138: creat d6/da/d1b/f30 x:0 0 0 2023-12-16T20:11:31.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/553: write d15/d1e/d23/d34/d79/f83 [167229,23191] 0 2023-12-16T20:11:31.234 INFO:tasks.workunit.client.1.smithi141.stdout:2/139: rename d6/da/f28 to d6/d12/d15/f31 0 2023-12-16T20:11:31.237 INFO:tasks.workunit.client.0.smithi038.stdout:9/583: rename d9/d1f/d21/d3e/f69 to d9/d1f/fad 0 2023-12-16T20:11:31.237 INFO:tasks.workunit.client.0.smithi038.stdout:9/584: truncate d9/d1f/d21/d52/fa7 24612 0 2023-12-16T20:11:31.240 INFO:tasks.workunit.client.1.smithi141.stdout:3/280: rmdir d0 39 2023-12-16T20:11:31.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/585: truncate d9/d1e/d3d/f6b 5092730 0 2023-12-16T20:11:31.243 INFO:tasks.workunit.client.0.smithi038.stdout:1/554: rename d15/d1e/d30/f59 to d15/d22/fb8 0 2023-12-16T20:11:31.244 INFO:tasks.workunit.client.1.smithi141.stdout:3/281: rmdir d0/d1c/d40/d54 0 2023-12-16T20:11:31.244 INFO:tasks.workunit.client.1.smithi141.stdout:3/282: chown d0/d1c/d2c/l3e 11729425 1 2023-12-16T20:11:31.245 INFO:tasks.workunit.client.0.smithi038.stdout:2/597: write d1/d5/d2a/d31/f36 [1590304,42288] 0 2023-12-16T20:11:31.245 INFO:tasks.workunit.client.0.smithi038.stdout:2/598: chown d1/d5/d95/c78 0 1 2023-12-16T20:11:31.245 INFO:tasks.workunit.client.0.smithi038.stdout:5/589: dwrite d2/d14/f92 [0,4194304] 0 2023-12-16T20:11:31.246 INFO:tasks.workunit.client.0.smithi038.stdout:9/586: truncate d9/d1e/d45/f4a 930160 0 2023-12-16T20:11:31.249 INFO:tasks.workunit.client.0.smithi038.stdout:4/539: dwrite d13/d1f/d35/f92 [0,4194304] 0 2023-12-16T20:11:31.249 INFO:tasks.workunit.client.1.smithi141.stdout:9/168: write d1/d10/d14/d20/da/f38 [2216546,58008] 0 2023-12-16T20:11:31.250 INFO:tasks.workunit.client.1.smithi141.stdout:3/283: mknod d0/d1c/d2c/c61 0 2023-12-16T20:11:31.250 INFO:tasks.workunit.client.1.smithi141.stdout:0/218: dwrite f1 [0,4194304] 0 2023-12-16T20:11:31.252 INFO:tasks.workunit.client.0.smithi038.stdout:1/555: dread d15/d1e/d3b/d48/d37/f47 [0,4194304] 0 2023-12-16T20:11:31.252 INFO:tasks.workunit.client.0.smithi038.stdout:2/599: mknod d1/d5/d6c/d91/ccf 0 2023-12-16T20:11:31.253 INFO:tasks.workunit.client.0.smithi038.stdout:2/600: readlink d1/df/d10/l19 0 2023-12-16T20:11:31.254 INFO:tasks.workunit.client.1.smithi141.stdout:3/284: rename d0/d1c/d2c/f4d to d0/d1c/d40/d3c/d4b/f62 0 2023-12-16T20:11:31.254 INFO:tasks.workunit.client.1.smithi141.stdout:3/285: chown d0/d1c/d40/f39 10398971 1 2023-12-16T20:11:31.255 INFO:tasks.workunit.client.0.smithi038.stdout:9/587: truncate d9/d1f/d21/f28 7768951 0 2023-12-16T20:11:31.255 INFO:tasks.workunit.client.1.smithi141.stdout:6/262: dwrite d1/d12/d22/f50 [4194304,4194304] 0 2023-12-16T20:11:31.255 INFO:tasks.workunit.client.1.smithi141.stdout:6/263: chown d1/dd/de/f27 39532 1 2023-12-16T20:11:31.255 INFO:tasks.workunit.client.1.smithi141.stdout:6/264: chown d1/d12/f16 205 1 2023-12-16T20:11:31.255 INFO:tasks.workunit.client.1.smithi141.stdout:6/265: chown d1/d12/d20/d44/f5b 43359 1 2023-12-16T20:11:31.256 INFO:tasks.workunit.client.1.smithi141.stdout:6/266: dread - d1/d12/d20/f3d zero size 2023-12-16T20:11:31.256 INFO:tasks.workunit.client.0.smithi038.stdout:1/556: truncate d15/d1e/d3b/d48/f87 1228495 0 2023-12-16T20:11:31.256 INFO:tasks.workunit.client.0.smithi038.stdout:1/557: creat d15/d1e/d3b/d5a/fb9 x:0 0 0 2023-12-16T20:11:31.258 INFO:tasks.workunit.client.0.smithi038.stdout:2/601: rename d1/df/d10/f50 to d1/d73/fd0 0 2023-12-16T20:11:31.258 INFO:tasks.workunit.client.0.smithi038.stdout:2/602: stat d1/df/d6a/f59 0 2023-12-16T20:11:31.258 INFO:tasks.workunit.client.0.smithi038.stdout:2/603: fsync d1/d5/f4d 0 2023-12-16T20:11:31.258 INFO:tasks.workunit.client.1.smithi141.stdout:3/286: mkdir d0/d1c/d40/d3f/d52/d63 0 2023-12-16T20:11:31.263 INFO:tasks.workunit.client.1.smithi141.stdout:0/219: creat d4/d7/d44/f4f x:0 0 0 2023-12-16T20:11:31.266 INFO:tasks.workunit.client.1.smithi141.stdout:0/220: creat d4/d7/f50 x:0 0 0 2023-12-16T20:11:31.266 INFO:tasks.workunit.client.1.smithi141.stdout:7/154: dwrite d5/f24 [0,4194304] 0 2023-12-16T20:11:31.267 INFO:tasks.workunit.client.0.smithi038.stdout:1/558: creat d15/d1e/d3b/d48/d37/fba x:0 0 0 2023-12-16T20:11:31.267 INFO:tasks.workunit.client.0.smithi038.stdout:1/559: read d15/d1e/d23/f39 [834519,128594] 0 2023-12-16T20:11:31.268 INFO:tasks.workunit.client.1.smithi141.stdout:0/221: symlink d4/d7/d44/l51 0 2023-12-16T20:11:31.270 INFO:tasks.workunit.client.0.smithi038.stdout:7/480: creat da/d21/d2c/f9c x:0 0 0 2023-12-16T20:11:31.272 INFO:tasks.workunit.client.0.smithi038.stdout:6/495: symlink d1/d4/d1d/l9e 0 2023-12-16T20:11:31.272 INFO:tasks.workunit.client.0.smithi038.stdout:6/496: stat d1/d5b/d7d/d9d/f48 0 2023-12-16T20:11:31.272 INFO:tasks.workunit.client.0.smithi038.stdout:6/497: write d1/d4/d1d/d28/f69 [382773,33196] 0 2023-12-16T20:11:31.272 INFO:tasks.workunit.client.1.smithi141.stdout:0/222: creat d4/d49/f52 x:0 0 0 2023-12-16T20:11:31.273 INFO:tasks.workunit.client.1.smithi141.stdout:7/155: getdents d5 0 2023-12-16T20:11:31.273 INFO:tasks.workunit.client.1.smithi141.stdout:7/156: getdents d5/d1d/d1e/d27 0 2023-12-16T20:11:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:2/604: creat d1/d5/d2a/fd1 x:0 0 0 2023-12-16T20:11:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:5/590: write d2/d14/f5a [2103249,6838] 0 2023-12-16T20:11:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:7/481: dread da/d21/d2c/f30 [0,4194304] 0 2023-12-16T20:11:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:7/482: creat da/d21/d61/f9d x:0 0 0 2023-12-16T20:11:31.276 INFO:tasks.workunit.client.1.smithi141.stdout:7/157: symlink d5/d16/d1a/l2f 0 2023-12-16T20:11:31.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/223: rename d4/d7/f42 to d4/d49/d4b/f53 0 2023-12-16T20:11:31.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/224: fsync d4/d3a/f46 0 2023-12-16T20:11:31.278 INFO:tasks.workunit.client.1.smithi141.stdout:7/158: mkdir d5/d16/d30 0 2023-12-16T20:11:31.280 INFO:tasks.workunit.client.1.smithi141.stdout:7/159: mknod d5/d2a/c31 0 2023-12-16T20:11:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:8/392: dwrite f13 [0,4194304] 0 2023-12-16T20:11:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:8/393: readlink d17/d34/d3d/l46 0 2023-12-16T20:11:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:8/394: fsync d17/d1b/d66/d73/d4e/f49 0 2023-12-16T20:11:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:2/605: mknod d1/df/d21/d82/d92/db3/cd2 0 2023-12-16T20:11:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:2/606: fsync d1/df/d21/d9a/db9/fb2 0 2023-12-16T20:11:31.286 INFO:tasks.workunit.client.0.smithi038.stdout:7/483: symlink da/d21/d41/d6b/l9e 0 2023-12-16T20:11:31.288 INFO:tasks.workunit.client.0.smithi038.stdout:8/395: truncate d17/d1b/d25/f3c 907119 0 2023-12-16T20:11:31.288 INFO:tasks.workunit.client.0.smithi038.stdout:8/396: creat d17/d1b/d57/f79 x:0 0 0 2023-12-16T20:11:31.294 INFO:tasks.workunit.client.1.smithi141.stdout:1/181: dwrite da/d1a/d1d/d22/d29/f32 [0,4194304] 0 2023-12-16T20:11:31.294 INFO:tasks.workunit.client.1.smithi141.stdout:1/182: truncate da/fb 4285627 0 2023-12-16T20:11:31.299 INFO:tasks.workunit.client.1.smithi141.stdout:8/220: getdents d14 0 2023-12-16T20:11:31.299 INFO:tasks.workunit.client.1.smithi141.stdout:8/221: getdents d14 0 2023-12-16T20:11:31.300 INFO:tasks.workunit.client.0.smithi038.stdout:8/397: dread d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:31.303 INFO:tasks.workunit.client.1.smithi141.stdout:6/267: fsync d1/dd/d2f/f30 0 2023-12-16T20:11:31.303 INFO:tasks.workunit.client.1.smithi141.stdout:1/183: symlink da/d1a/d1d/d33/l3b 0 2023-12-16T20:11:31.303 INFO:tasks.workunit.client.1.smithi141.stdout:1/184: write da/d1a/d1d/d33/f3a [929220,92359] 0 2023-12-16T20:11:31.304 INFO:tasks.workunit.client.0.smithi038.stdout:6/498: dread d1/d4/f8 [0,4194304] 0 2023-12-16T20:11:31.306 INFO:tasks.workunit.client.1.smithi141.stdout:8/222: link ca d14/c45 0 2023-12-16T20:11:31.307 INFO:tasks.workunit.client.0.smithi038.stdout:6/499: mknod d1/d4/d1d/d67/c9f 0 2023-12-16T20:11:31.308 INFO:tasks.workunit.client.1.smithi141.stdout:6/268: unlink d1/dd/d2f/f3b 0 2023-12-16T20:11:31.308 INFO:tasks.workunit.client.1.smithi141.stdout:8/223: fsync d14/d19/d1b/d3d/f38 0 2023-12-16T20:11:31.310 INFO:tasks.workunit.client.1.smithi141.stdout:2/140: dwrite d6/f7 [4194304,4194304] 0 2023-12-16T20:11:31.310 INFO:tasks.workunit.client.1.smithi141.stdout:2/141: stat d6/da/d1b/d1c 0 2023-12-16T20:11:31.310 INFO:tasks.workunit.client.1.smithi141.stdout:8/224: creat d14/d19/d1b/f46 x:0 0 0 2023-12-16T20:11:31.316 INFO:tasks.workunit.client.0.smithi038.stdout:2/607: dread d1/d5/d16/f2e [0,4194304] 0 2023-12-16T20:11:31.317 INFO:tasks.workunit.client.0.smithi038.stdout:2/608: readlink d1/d5/d16/l25 0 2023-12-16T20:11:31.317 INFO:tasks.workunit.client.0.smithi038.stdout:4/540: dwrite d13/d17/d4b/da4/d34/f58 [4194304,4194304] 0 2023-12-16T20:11:31.318 INFO:tasks.workunit.client.1.smithi141.stdout:1/185: write da/fc [3570617,58789] 0 2023-12-16T20:11:31.318 INFO:tasks.workunit.client.1.smithi141.stdout:1/186: write da/d1a/d1d/d33/f3a [1495031,10042] 0 2023-12-16T20:11:31.318 INFO:tasks.workunit.client.1.smithi141.stdout:1/187: chown da/f2c 7208160 1 2023-12-16T20:11:31.320 INFO:tasks.workunit.client.0.smithi038.stdout:4/541: mknod d13/d17/d2e/d32/d4d/cb0 0 2023-12-16T20:11:31.328 INFO:tasks.workunit.client.1.smithi141.stdout:3/287: dwrite d0/d1c/d40/d3c/f4a [0,4194304] 0 2023-12-16T20:11:31.329 INFO:tasks.workunit.client.0.smithi038.stdout:9/588: dwrite d9/d1f/f22 [4194304,4194304] 0 2023-12-16T20:11:31.329 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:31 smithi141 ceph-mon[88165]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:31.329 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:31 smithi141 ceph-mon[88165]: mgrmap e23: smithi141.cycgjd(active, since 2s) 2023-12-16T20:11:31.330 INFO:tasks.workunit.client.1.smithi141.stdout:8/225: read f11 [1508664,119115] 0 2023-12-16T20:11:31.330 INFO:tasks.workunit.client.1.smithi141.stdout:3/288: mknod d0/d1c/c64 0 2023-12-16T20:11:31.334 INFO:tasks.workunit.client.1.smithi141.stdout:8/226: mknod d14/d35/c47 0 2023-12-16T20:11:31.335 INFO:tasks.workunit.client.0.smithi038.stdout:9/589: symlink d9/d1f/d21/d3e/d4e/d64/lae 0 2023-12-16T20:11:31.335 INFO:tasks.workunit.client.0.smithi038.stdout:9/590: truncate d9/d1e/f74 1247678 0 2023-12-16T20:11:31.336 INFO:tasks.workunit.client.1.smithi141.stdout:8/227: fsync d14/f25 0 2023-12-16T20:11:31.336 INFO:tasks.workunit.client.1.smithi141.stdout:8/228: creat d14/d19/d1b/f48 x:0 0 0 2023-12-16T20:11:31.337 INFO:tasks.workunit.client.0.smithi038.stdout:9/591: mkdir d9/d1f/d21/d84/daf 0 2023-12-16T20:11:31.337 INFO:tasks.workunit.client.0.smithi038.stdout:4/542: write fa [6215218,36098] 0 2023-12-16T20:11:31.339 INFO:tasks.workunit.client.0.smithi038.stdout:9/592: creat d9/d1f/d21/d3e/d4e/d61/fb0 x:0 0 0 2023-12-16T20:11:31.340 INFO:tasks.workunit.client.1.smithi141.stdout:8/229: creat d14/d19/d1b/d24/f49 x:0 0 0 2023-12-16T20:11:31.341 INFO:tasks.workunit.client.1.smithi141.stdout:8/230: write d14/f16 [1148015,88896] 0 2023-12-16T20:11:31.342 INFO:tasks.workunit.client.1.smithi141.stdout:9/169: dwrite d1/d10/f12 [4194304,4194304] 0 2023-12-16T20:11:31.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/560: dwrite d15/f1d [4194304,4194304] 0 2023-12-16T20:11:31.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/561: fsync d15/d1e/d23/d7d/f9b 0 2023-12-16T20:11:31.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/562: write d15/d1e/d3b/d48/d37/fba [585198,43855] 0 2023-12-16T20:11:31.344 INFO:tasks.workunit.client.0.smithi038.stdout:7/484: dwrite da/f98 [4194304,4194304] 0 2023-12-16T20:11:31.344 INFO:tasks.workunit.client.0.smithi038.stdout:7/485: chown da/d3e/d31/f39 5148310 1 2023-12-16T20:11:31.344 INFO:tasks.workunit.client.0.smithi038.stdout:7/486: truncate da/d21/d41/d6b/f99 898442 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:8/231: mkdir d14/d19/d1b/d24/d4a 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:0/225: dwrite d4/f16 [0,4194304] 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:6/269: dwrite d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:8/232: mkdir d14/d19/d1b/d24/d4b 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:8/233: truncate d14/d19/f2e 1664770 0 2023-12-16T20:11:31.345 INFO:tasks.workunit.client.1.smithi141.stdout:8/234: dread - d14/d19/d1b/d3d/f37 zero size 2023-12-16T20:11:31.346 INFO:tasks.workunit.client.0.smithi038.stdout:8/398: dwrite d17/f38 [0,4194304] 0 2023-12-16T20:11:31.346 INFO:tasks.workunit.client.0.smithi038.stdout:6/500: dwrite d1/d4/f75 [0,4194304] 0 2023-12-16T20:11:31.346 INFO:tasks.workunit.client.0.smithi038.stdout:6/501: write d1/d4/f1c [2351459,107683] 0 2023-12-16T20:11:31.347 INFO:tasks.workunit.client.1.smithi141.stdout:8/235: symlink d14/d19/d1b/d24/d4b/l4c 0 2023-12-16T20:11:31.347 INFO:tasks.workunit.client.1.smithi141.stdout:8/236: chown d14/d19/d1b/f46 4223864 1 2023-12-16T20:11:31.348 INFO:tasks.workunit.client.1.smithi141.stdout:0/226: symlink d4/d7/l54 0 2023-12-16T20:11:31.348 INFO:tasks.workunit.client.0.smithi038.stdout:1/563: mkdir d15/d1e/d3b/dbb 0 2023-12-16T20:11:31.350 INFO:tasks.workunit.client.0.smithi038.stdout:6/502: write d1/d5b/d7d/d9d/f6a [2556398,84520] 0 2023-12-16T20:11:31.350 INFO:tasks.workunit.client.0.smithi038.stdout:6/503: chown d1/d5b/d7d/f84 12154 1 2023-12-16T20:11:31.350 INFO:tasks.workunit.client.1.smithi141.stdout:0/227: dread d4/f31 [0,4194304] 0 2023-12-16T20:11:31.351 INFO:tasks.workunit.client.1.smithi141.stdout:8/237: rename l3 to d14/d19/d1b/d24/d4b/l4d 0 2023-12-16T20:11:31.355 INFO:tasks.workunit.client.0.smithi038.stdout:7/487: rename da/d21/d41/f7a to da/d24/f9f 0 2023-12-16T20:11:31.356 INFO:tasks.workunit.client.0.smithi038.stdout:3/538: sync 2023-12-16T20:11:31.356 INFO:tasks.workunit.client.0.smithi038.stdout:0/537: sync 2023-12-16T20:11:31.362 INFO:tasks.workunit.client.0.smithi038.stdout:2/609: dwrite d1/d5/f4d [0,4194304] 0 2023-12-16T20:11:31.363 INFO:tasks.workunit.client.1.smithi141.stdout:9/170: write d1/d10/f12 [3702983,95020] 0 2023-12-16T20:11:31.364 INFO:tasks.workunit.client.1.smithi141.stdout:3/289: dwrite d0/f41 [0,4194304] 0 2023-12-16T20:11:31.365 INFO:tasks.workunit.client.0.smithi038.stdout:9/593: write d9/d1e/d45/f4a [762315,85178] 0 2023-12-16T20:11:31.367 INFO:tasks.workunit.client.0.smithi038.stdout:1/564: mkdir d15/d1e/d23/d42/d75/dbc 0 2023-12-16T20:11:31.367 INFO:tasks.workunit.client.1.smithi141.stdout:9/171: link d1/l7 d1/d10/d27/d36/l3e 0 2023-12-16T20:11:31.369 INFO:tasks.workunit.client.0.smithi038.stdout:2/610: dread d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:31.369 INFO:tasks.workunit.client.0.smithi038.stdout:2/611: creat d1/d5/d2a/fd3 x:0 0 0 2023-12-16T20:11:31.370 INFO:tasks.workunit.client.1.smithi141.stdout:1/188: truncate da/fb 3522036 0 2023-12-16T20:11:31.371 INFO:tasks.workunit.client.1.smithi141.stdout:3/290: creat d0/f65 x:0 0 0 2023-12-16T20:11:31.372 INFO:tasks.workunit.client.1.smithi141.stdout:9/172: mkdir d1/d10/d14/d20/da/d3f 0 2023-12-16T20:11:31.372 INFO:tasks.workunit.client.1.smithi141.stdout:9/173: dread - d1/d10/d33/f34 zero size 2023-12-16T20:11:31.373 INFO:tasks.workunit.client.1.smithi141.stdout:1/189: symlink da/d36/l3c 0 2023-12-16T20:11:31.375 INFO:tasks.workunit.client.1.smithi141.stdout:2/142: truncate d6/f21 3873768 0 2023-12-16T20:11:31.375 INFO:tasks.workunit.client.1.smithi141.stdout:2/143: chown d6/f7 505970440 1 2023-12-16T20:11:31.376 INFO:tasks.workunit.client.1.smithi141.stdout:3/291: chown d0/ce 0 1 2023-12-16T20:11:31.376 INFO:tasks.workunit.client.1.smithi141.stdout:9/174: creat d1/d10/d33/d39/f40 x:0 0 0 2023-12-16T20:11:31.376 INFO:tasks.workunit.client.1.smithi141.stdout:9/175: write d1/fc [1581573,65512] 0 2023-12-16T20:11:31.377 INFO:tasks.workunit.client.1.smithi141.stdout:5/147: sync 2023-12-16T20:11:31.377 INFO:tasks.workunit.client.1.smithi141.stdout:5/148: write d0/df/f1d [427785,63255] 0 2023-12-16T20:11:31.377 INFO:tasks.workunit.client.1.smithi141.stdout:5/149: chown d0/d9/l18 47 1 2023-12-16T20:11:31.377 INFO:tasks.workunit.client.1.smithi141.stdout:4/223: sync 2023-12-16T20:11:31.377 INFO:tasks.workunit.client.1.smithi141.stdout:4/224: truncate d1a/d2a/f31 577085 0 2023-12-16T20:11:31.378 INFO:tasks.workunit.client.1.smithi141.stdout:9/176: link d1/d10/d14/d20/da/f32 d1/d10/d14/d20/da/f41 0 2023-12-16T20:11:31.380 INFO:tasks.workunit.client.1.smithi141.stdout:5/150: getdents d0/d9 0 2023-12-16T20:11:31.380 INFO:tasks.workunit.client.1.smithi141.stdout:5/151: chown d0/d9/f20 1 1 2023-12-16T20:11:31.380 INFO:tasks.workunit.client.0.smithi038.stdout:3/539: dread d4/d27/d40/fac [0,4194304] 0 2023-12-16T20:11:31.380 INFO:tasks.workunit.client.0.smithi038.stdout:0/538: creat db/d1a/fb4 x:0 0 0 2023-12-16T20:11:31.381 INFO:tasks.workunit.client.0.smithi038.stdout:0/539: write db/d16/d1c/f2a [4700508,13028] 0 2023-12-16T20:11:31.381 INFO:tasks.workunit.client.0.smithi038.stdout:0/540: chown f8 1206323 1 2023-12-16T20:11:31.384 INFO:tasks.workunit.client.0.smithi038.stdout:4/543: dwrite d13/d1f/d35/f92 [0,4194304] 0 2023-12-16T20:11:31.386 INFO:tasks.workunit.client.0.smithi038.stdout:9/594: mknod d9/d1e/d45/cb1 0 2023-12-16T20:11:31.386 INFO:tasks.workunit.client.1.smithi141.stdout:6/270: dwrite d1/d12/d22/d25/d38/f3e [0,4194304] 0 2023-12-16T20:11:31.387 INFO:tasks.workunit.client.1.smithi141.stdout:5/152: dread d0/d9/d16/f21 [0,4194304] 0 2023-12-16T20:11:31.387 INFO:tasks.workunit.client.1.smithi141.stdout:6/271: truncate d1/d12/d22/d25/f55 518778 0 2023-12-16T20:11:31.389 INFO:tasks.workunit.client.1.smithi141.stdout:5/153: rename d0/d14/d26 to d0/d9/d16/d2a 0 2023-12-16T20:11:31.389 INFO:tasks.workunit.client.0.smithi038.stdout:0/541: write db/d16/d70/f55 [2770645,115417] 0 2023-12-16T20:11:31.390 INFO:tasks.workunit.client.1.smithi141.stdout:6/272: mkdir d1/d5e 0 2023-12-16T20:11:31.392 INFO:tasks.workunit.client.1.smithi141.stdout:6/273: creat d1/dd/d2f/f5f x:0 0 0 2023-12-16T20:11:31.393 INFO:tasks.workunit.client.1.smithi141.stdout:3/292: dread d0/f6 [4194304,4194304] 0 2023-12-16T20:11:31.393 INFO:tasks.workunit.client.1.smithi141.stdout:6/274: mkdir d1/d3/d4b/d60 0 2023-12-16T20:11:31.394 INFO:tasks.workunit.client.1.smithi141.stdout:0/228: dwrite d4/d7/f50 [0,4194304] 0 2023-12-16T20:11:31.394 INFO:tasks.workunit.client.1.smithi141.stdout:0/229: fdatasync d4/d49/d4b/f53 0 2023-12-16T20:11:31.396 INFO:tasks.workunit.client.1.smithi141.stdout:6/275: rename d1/d3/d4f/c5d to d1/d12/d22/d25/d38/c61 0 2023-12-16T20:11:31.397 INFO:tasks.workunit.client.0.smithi038.stdout:7/488: rename da/d3e/d31/d38/d90/l4e to da/la0 0 2023-12-16T20:11:31.399 INFO:tasks.workunit.client.1.smithi141.stdout:6/276: link d1/dd/d2f/l57 d1/d12/d20/d3a/l62 0 2023-12-16T20:11:31.399 INFO:tasks.workunit.client.1.smithi141.stdout:6/277: stat d1/d12/d20/d44/d4a 0 2023-12-16T20:11:31.399 INFO:tasks.workunit.client.1.smithi141.stdout:6/278: rename d1 to d1/d3/d4f/d63 22 2023-12-16T20:11:31.402 INFO:tasks.workunit.client.1.smithi141.stdout:4/225: dread d1a/f32 [0,4194304] 0 2023-12-16T20:11:31.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/595: mknod d9/d1f/d21/d3e/d4e/d61/daa/cb2 0 2023-12-16T20:11:31.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/596: chown d9/d1e/d3d/c88 86855546 1 2023-12-16T20:11:31.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/597: chown d9/l79 0 1 2023-12-16T20:11:31.406 INFO:tasks.workunit.client.0.smithi038.stdout:0/542: mkdir db/d16/db5 0 2023-12-16T20:11:31.407 INFO:tasks.workunit.client.1.smithi141.stdout:3/293: write d0/d1c/d40/f43 [259486,84193] 0 2023-12-16T20:11:31.412 INFO:tasks.workunit.client.1.smithi141.stdout:0/230: dread d4/fe [0,4194304] 0 2023-12-16T20:11:31.413 INFO:tasks.workunit.client.0.smithi038.stdout:1/565: mknod d15/d22/cbd 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:1/566: chown d15/d1e/d3b/d48/d3d/f58 16435583 1 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:1/567: chown d15/d1e/d30/d95 44038 1 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:6/504: rename d1/d4/d1d/d67/c9f to d1/d5b/d7d/ca0 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:0/543: mkdir db/db6 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:7/489: mknod da/d3e/d8e/ca1 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.0.smithi038.stdout:6/505: write d1/d16/d23/f6f [728282,111710] 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.1.smithi141.stdout:0/231: symlink d4/d7/l55 0 2023-12-16T20:11:31.414 INFO:tasks.workunit.client.1.smithi141.stdout:0/232: fsync f1 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:6/279: write d1/dd/de/f27 [3078541,10151] 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:6/280: getdents d1/d5e 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:6/281: creat d1/d12/d22/f64 x:0 0 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:6/282: write d1/d12/d22/d25/f55 [753089,15380] 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:0/233: getdents d4/d49 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:0/234: truncate f2 5241924 0 2023-12-16T20:11:31.417 INFO:tasks.workunit.client.1.smithi141.stdout:0/235: write d4/d3a/f46 [440309,50776] 0 2023-12-16T20:11:31.419 INFO:tasks.workunit.client.0.smithi038.stdout:0/544: mknod db/d16/d5a/cb7 0 2023-12-16T20:11:31.420 INFO:tasks.workunit.client.1.smithi141.stdout:6/283: mkdir d1/d12/d20/d44/d65 0 2023-12-16T20:11:31.421 INFO:tasks.workunit.client.0.smithi038.stdout:8/399: dwrite f13 [12582912,4194304] 0 2023-12-16T20:11:31.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/400: dread - d17/d1b/d57/f79 zero size 2023-12-16T20:11:31.423 INFO:tasks.workunit.client.1.smithi141.stdout:0/236: symlink d4/d7/d44/l56 0 2023-12-16T20:11:31.424 INFO:tasks.workunit.client.0.smithi038.stdout:6/506: unlink d1/d2e/l30 0 2023-12-16T20:11:31.424 INFO:tasks.workunit.client.0.smithi038.stdout:6/507: fdatasync d1/f8f 0 2023-12-16T20:11:31.424 INFO:tasks.workunit.client.1.smithi141.stdout:6/284: creat d1/d3/d4b/f66 x:0 0 0 2023-12-16T20:11:31.424 INFO:tasks.workunit.client.1.smithi141.stdout:2/144: dwrite d6/f7 [4194304,4194304] 0 2023-12-16T20:11:31.425 INFO:tasks.workunit.client.1.smithi141.stdout:6/285: read d1/d12/d22/d25/f55 [423408,29875] 0 2023-12-16T20:11:31.426 INFO:tasks.workunit.client.1.smithi141.stdout:0/237: symlink d4/d49/d4b/l57 0 2023-12-16T20:11:31.426 INFO:tasks.workunit.client.1.smithi141.stdout:0/238: truncate d4/d49/d4b/f53 4963408 0 2023-12-16T20:11:31.428 INFO:tasks.workunit.client.1.smithi141.stdout:5/154: dwrite d0/d9/f13 [0,4194304] 0 2023-12-16T20:11:31.429 INFO:tasks.workunit.client.0.smithi038.stdout:8/401: symlink d17/d1b/d66/d73/l7a 0 2023-12-16T20:11:31.430 INFO:tasks.workunit.client.1.smithi141.stdout:0/239: creat d4/d3a/d3b/f58 x:0 0 0 2023-12-16T20:11:31.437 INFO:tasks.workunit.client.1.smithi141.stdout:1/190: dwrite da/df/f27 [0,4194304] 0 2023-12-16T20:11:31.438 INFO:tasks.workunit.client.1.smithi141.stdout:6/286: write d1/d12/d22/d25/d38/f3e [2479167,52642] 0 2023-12-16T20:11:31.441 INFO:tasks.workunit.client.0.smithi038.stdout:2/612: rename d1/df to d1/d5/d95/d61/dd4 0 2023-12-16T20:11:31.446 INFO:tasks.workunit.client.0.smithi038.stdout:4/544: rename d13/d17/d2e/l5d to d13/d17/d2e/d32/d4d/d78/lb1 0 2023-12-16T20:11:31.446 INFO:tasks.workunit.client.0.smithi038.stdout:4/545: chown d13/d17/d2e/l8d 157428565 1 2023-12-16T20:11:31.447 INFO:tasks.workunit.client.1.smithi141.stdout:5/155: getdents d0 0 2023-12-16T20:11:31.451 INFO:tasks.workunit.client.0.smithi038.stdout:7/490: rename da/d24/l5b to da/d24/d4d/la2 0 2023-12-16T20:11:31.451 INFO:tasks.workunit.client.0.smithi038.stdout:7/491: chown da/d24/d4d/d51/c84 52 1 2023-12-16T20:11:31.451 INFO:tasks.workunit.client.1.smithi141.stdout:6/287: symlink d1/d12/d22/l67 0 2023-12-16T20:11:31.452 INFO:tasks.workunit.client.1.smithi141.stdout:6/288: fdatasync d1/d3/d4b/f66 0 2023-12-16T20:11:31.452 INFO:tasks.workunit.client.1.smithi141.stdout:5/156: creat d0/f2b x:0 0 0 2023-12-16T20:11:31.453 INFO:tasks.workunit.client.0.smithi038.stdout:4/546: rmdir d13/d17/d2e/d75/d97 0 2023-12-16T20:11:31.457 INFO:tasks.workunit.client.0.smithi038.stdout:8/402: write f13 [11942185,32825] 0 2023-12-16T20:11:31.457 INFO:tasks.workunit.client.0.smithi038.stdout:7/492: rename c3 to da/d21/d86/d92/ca3 0 2023-12-16T20:11:31.458 INFO:tasks.workunit.client.1.smithi141.stdout:5/157: chown d0/df/f1d 225 1 2023-12-16T20:11:31.459 INFO:tasks.workunit.client.0.smithi038.stdout:4/547: unlink d13/l30 0 2023-12-16T20:11:31.459 INFO:tasks.workunit.client.0.smithi038.stdout:6/508: read d1/f71 [3023913,73103] 0 2023-12-16T20:11:31.460 INFO:tasks.workunit.client.1.smithi141.stdout:3/294: dread d0/d1c/d40/f43 [0,4194304] 0 2023-12-16T20:11:31.462 INFO:tasks.workunit.client.1.smithi141.stdout:1/191: dread da/df/f18 [0,4194304] 0 2023-12-16T20:11:31.463 INFO:tasks.workunit.client.1.smithi141.stdout:1/192: chown da/f12 375665 1 2023-12-16T20:11:31.463 INFO:tasks.workunit.client.1.smithi141.stdout:3/295: mknod d0/d1c/d40/d3c/c66 0 2023-12-16T20:11:31.463 INFO:tasks.workunit.client.1.smithi141.stdout:4/226: dwrite f1 [0,4194304] 0 2023-12-16T20:11:31.464 INFO:tasks.workunit.client.1.smithi141.stdout:3/296: creat d0/d1c/f67 x:0 0 0 2023-12-16T20:11:31.464 INFO:tasks.workunit.client.1.smithi141.stdout:3/297: chown d0/d1c/d40/d3c/d4b/d4c/l60 2846029 1 2023-12-16T20:11:31.465 INFO:tasks.workunit.client.1.smithi141.stdout:4/227: mkdir d1a/d54 0 2023-12-16T20:11:31.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/289: dread d1/d12/d22/f50 [0,4194304] 0 2023-12-16T20:11:31.468 INFO:tasks.workunit.client.1.smithi141.stdout:1/193: write da/df/f1b [25036,31082] 0 2023-12-16T20:11:31.468 INFO:tasks.workunit.client.1.smithi141.stdout:4/228: link d1a/f1c d1a/d4e/f55 0 2023-12-16T20:11:31.468 INFO:tasks.workunit.client.1.smithi141.stdout:4/229: creat d1a/d4e/f56 x:0 0 0 2023-12-16T20:11:31.468 INFO:tasks.workunit.client.1.smithi141.stdout:6/290: truncate d1/d12/d22/f50 3315510 0 2023-12-16T20:11:31.471 INFO:tasks.workunit.client.1.smithi141.stdout:1/194: link da/d1a/d31/l39 da/d1a/d1d/d22/l3d 0 2023-12-16T20:11:31.471 INFO:tasks.workunit.client.1.smithi141.stdout:1/195: stat da/fb 0 2023-12-16T20:11:31.471 INFO:tasks.workunit.client.1.smithi141.stdout:1/196: fdatasync da/d1a/d1d/d33/f3a 0 2023-12-16T20:11:31.473 INFO:tasks.workunit.client.1.smithi141.stdout:4/230: link d1a/d2a/l4f d1a/d2a/d3b/l57 0 2023-12-16T20:11:31.473 INFO:tasks.workunit.client.1.smithi141.stdout:4/231: dread - d1a/d2a/d3b/f45 zero size 2023-12-16T20:11:31.473 INFO:tasks.workunit.client.1.smithi141.stdout:4/232: stat d1a/d2a/c44 0 2023-12-16T20:11:31.474 INFO:tasks.workunit.client.0.smithi038.stdout:4/548: write d13/d1f/f66 [3155670,88242] 0 2023-12-16T20:11:31.481 INFO:tasks.workunit.client.1.smithi141.stdout:0/240: dwrite d4/d49/f52 [0,4194304] 0 2023-12-16T20:11:31.481 INFO:tasks.workunit.client.1.smithi141.stdout:0/241: creat d4/d3a/d3b/f59 x:0 0 0 2023-12-16T20:11:31.482 INFO:tasks.workunit.client.1.smithi141.stdout:4/233: rename lb to d1a/l58 0 2023-12-16T20:11:31.483 INFO:tasks.workunit.client.1.smithi141.stdout:3/298: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:31.483 INFO:tasks.workunit.client.1.smithi141.stdout:3/299: fsync d0/d1c/d2c/f2f 0 2023-12-16T20:11:31.484 INFO:tasks.workunit.client.0.smithi038.stdout:8/403: dread d17/d1b/f22 [0,4194304] 0 2023-12-16T20:11:31.484 INFO:tasks.workunit.client.0.smithi038.stdout:8/404: write d17/f24 [720124,50336] 0 2023-12-16T20:11:31.484 INFO:tasks.workunit.client.0.smithi038.stdout:4/549: write d13/d17/d62/f9c [3607597,123081] 0 2023-12-16T20:11:31.485 INFO:tasks.workunit.client.1.smithi141.stdout:9/177: dwrite d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:31.486 INFO:tasks.workunit.client.0.smithi038.stdout:9/598: dwrite d9/d1f/f22 [0,4194304] 0 2023-12-16T20:11:31.488 INFO:tasks.workunit.client.0.smithi038.stdout:6/509: dread d1/f2c [4194304,4194304] 0 2023-12-16T20:11:31.488 INFO:tasks.workunit.client.0.smithi038.stdout:1/568: dwrite d15/d1e/d23/d34/f38 [0,4194304] 0 2023-12-16T20:11:31.488 INFO:tasks.workunit.client.0.smithi038.stdout:1/569: creat d15/d1e/d23/d34/fbe x:0 0 0 2023-12-16T20:11:31.488 INFO:tasks.workunit.client.0.smithi038.stdout:0/545: dwrite db/d16/d19/d27/f34 [0,4194304] 0 2023-12-16T20:11:31.489 INFO:tasks.workunit.client.0.smithi038.stdout:8/405: symlink d17/d34/d3d/d59/l7b 0 2023-12-16T20:11:31.491 INFO:tasks.workunit.client.1.smithi141.stdout:0/242: creat d4/d49/f5a x:0 0 0 2023-12-16T20:11:31.492 INFO:tasks.workunit.client.0.smithi038.stdout:4/550: mkdir d13/d17/d2e/d32/d70/db2 0 2023-12-16T20:11:31.493 INFO:tasks.workunit.client.0.smithi038.stdout:4/551: creat d13/d69/d7a/fb3 x:0 0 0 2023-12-16T20:11:31.495 INFO:tasks.workunit.client.1.smithi141.stdout:4/234: mkdir d1a/d59 0 2023-12-16T20:11:31.496 INFO:tasks.workunit.client.1.smithi141.stdout:4/235: chown d1a/d4e 1318496979 1 2023-12-16T20:11:31.498 INFO:tasks.workunit.client.1.smithi141.stdout:3/300: write d0/f3a [454455,48480] 0 2023-12-16T20:11:31.498 INFO:tasks.workunit.client.1.smithi141.stdout:3/301: write d0/d1c/d40/d3c/d4b/f62 [541725,128390] 0 2023-12-16T20:11:31.499 INFO:tasks.workunit.client.1.smithi141.stdout:4/236: rename d1a/f3e to d1a/d3c/f5a 0 2023-12-16T20:11:31.499 INFO:tasks.workunit.client.1.smithi141.stdout:4/237: write d1a/f32 [1926191,72104] 0 2023-12-16T20:11:31.500 INFO:tasks.workunit.client.1.smithi141.stdout:4/238: readlink l3 0 2023-12-16T20:11:31.502 INFO:tasks.workunit.client.0.smithi038.stdout:1/570: symlink d15/d1e/d23/d42/lbf 0 2023-12-16T20:11:31.504 INFO:tasks.workunit.client.1.smithi141.stdout:0/243: write d4/f35 [479326,125954] 0 2023-12-16T20:11:31.504 INFO:tasks.workunit.client.1.smithi141.stdout:2/145: write d6/f21 [1458873,101572] 0 2023-12-16T20:11:31.504 INFO:tasks.workunit.client.1.smithi141.stdout:2/146: write d6/da/d1b/d1c/f2c [943707,59983] 0 2023-12-16T20:11:31.509 INFO:tasks.workunit.client.0.smithi038.stdout:8/406: creat d17/d1d/d78/f7c x:0 0 0 2023-12-16T20:11:31.509 INFO:tasks.workunit.client.1.smithi141.stdout:2/147: stat d6/d12/d1f/c2d 0 2023-12-16T20:11:31.509 INFO:tasks.workunit.client.1.smithi141.stdout:4/239: mknod d1a/d2a/c5b 0 2023-12-16T20:11:31.509 INFO:tasks.workunit.client.1.smithi141.stdout:4/240: mknod d1a/d3c/c5c 0 2023-12-16T20:11:31.512 INFO:tasks.workunit.client.0.smithi038.stdout:4/552: rename d13/d1f/f9a to d13/d1f/fb4 0 2023-12-16T20:11:31.513 INFO:tasks.workunit.client.0.smithi038.stdout:9/599: dread d9/d1f/d21/d55/f56 [0,4194304] 0 2023-12-16T20:11:31.514 INFO:tasks.workunit.client.1.smithi141.stdout:1/197: dwrite da/df/f13 [4194304,4194304] 0 2023-12-16T20:11:31.514 INFO:tasks.workunit.client.0.smithi038.stdout:1/571: unlink d15/d22/d52/l57 0 2023-12-16T20:11:31.514 INFO:tasks.workunit.client.0.smithi038.stdout:1/572: fdatasync d15/d1e/d3b/d48/d37/f9f 0 2023-12-16T20:11:31.515 INFO:tasks.workunit.client.1.smithi141.stdout:6/291: dwrite d1/d12/d22/f64 [0,4194304] 0 2023-12-16T20:11:31.519 INFO:tasks.workunit.client.1.smithi141.stdout:1/198: rename da/d1a/d1d/d33/f3a to da/d1a/d1d/d22/d29/f3e 0 2023-12-16T20:11:31.521 INFO:tasks.workunit.client.0.smithi038.stdout:4/553: dread d13/d17/d4b/da4/f94 [0,4194304] 0 2023-12-16T20:11:31.521 INFO:tasks.workunit.client.0.smithi038.stdout:7/493: rmdir da/d24 39 2023-12-16T20:11:31.524 INFO:tasks.workunit.client.0.smithi038.stdout:4/554: mkdir d13/d17/d4b/da4/d9d/db5 0 2023-12-16T20:11:31.525 INFO:tasks.workunit.client.1.smithi141.stdout:4/241: dread f2 [0,4194304] 0 2023-12-16T20:11:31.525 INFO:tasks.workunit.client.1.smithi141.stdout:4/242: stat d1a/d2a 0 2023-12-16T20:11:31.525 INFO:tasks.workunit.client.1.smithi141.stdout:4/243: dread - d1a/d2a/f53 zero size 2023-12-16T20:11:31.527 INFO:tasks.workunit.client.0.smithi038.stdout:7/494: mknod da/d3e/d31/d38/d65/d81/ca4 0 2023-12-16T20:11:31.527 INFO:tasks.workunit.client.0.smithi038.stdout:7/495: read - da/d21/d2c/d76/f89 zero size 2023-12-16T20:11:31.528 INFO:tasks.workunit.client.0.smithi038.stdout:9/600: dread d9/d1e/d40/d5e/d71/d83/f9f [0,4194304] 0 2023-12-16T20:11:31.528 INFO:tasks.workunit.client.0.smithi038.stdout:9/601: chown d9/d1e/d3d/d42/f53 3 1 2023-12-16T20:11:31.528 INFO:tasks.workunit.client.1.smithi141.stdout:1/199: getdents da/d1a/d1d 0 2023-12-16T20:11:31.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/602: write d9/d1f/d21/d3e/d4e/d61/f99 [1437460,87005] 0 2023-12-16T20:11:31.531 INFO:tasks.workunit.client.1.smithi141.stdout:2/148: dread d6/f7 [4194304,4194304] 0 2023-12-16T20:11:31.532 INFO:tasks.workunit.client.0.smithi038.stdout:4/555: getdents d13/d17/d4b/da4/d34 0 2023-12-16T20:11:31.532 INFO:tasks.workunit.client.1.smithi141.stdout:4/244: creat d1a/d3c/f5d x:0 0 0 2023-12-16T20:11:31.534 INFO:tasks.workunit.client.1.smithi141.stdout:2/149: mkdir d6/d32 0 2023-12-16T20:11:31.534 INFO:tasks.workunit.client.1.smithi141.stdout:2/150: chown d6/da/ce 10756 1 2023-12-16T20:11:31.534 INFO:tasks.workunit.client.1.smithi141.stdout:2/151: stat d6/f21 0 2023-12-16T20:11:31.535 INFO:tasks.workunit.client.0.smithi038.stdout:4/556: dread d13/d17/d2e/d32/d70/fa3 [0,4194304] 0 2023-12-16T20:11:31.536 INFO:tasks.workunit.client.0.smithi038.stdout:4/557: getdents d13/d69/d7a/da5 0 2023-12-16T20:11:31.536 INFO:tasks.workunit.client.0.smithi038.stdout:7/496: creat da/d21/d2c/d76/d9a/fa5 x:0 0 0 2023-12-16T20:11:31.536 INFO:tasks.workunit.client.1.smithi141.stdout:2/152: mkdir d6/da/d33 0 2023-12-16T20:11:31.538 INFO:tasks.workunit.client.1.smithi141.stdout:1/200: read da/df/f18 [4011569,36636] 0 2023-12-16T20:11:31.540 INFO:tasks.workunit.client.1.smithi141.stdout:1/201: rename da/df/f18 to da/d36/f3f 0 2023-12-16T20:11:31.542 INFO:tasks.workunit.client.1.smithi141.stdout:1/202: getdents da/d25 0 2023-12-16T20:11:31.542 INFO:tasks.workunit.client.1.smithi141.stdout:1/203: readlink da/d36/l3c 0 2023-12-16T20:11:31.544 INFO:tasks.workunit.client.0.smithi038.stdout:0/546: dwrite db/f5b [0,4194304] 0 2023-12-16T20:11:31.544 INFO:tasks.workunit.client.0.smithi038.stdout:0/547: write db/d16/d1c/fae [2791,25300] 0 2023-12-16T20:11:31.544 INFO:tasks.workunit.client.0.smithi038.stdout:9/603: write d9/d1f/d21/d55/f65 [3365483,49302] 0 2023-12-16T20:11:31.548 INFO:tasks.workunit.client.0.smithi038.stdout:4/558: creat d13/d1f/d98/fb6 x:0 0 0 2023-12-16T20:11:31.548 INFO:tasks.workunit.client.0.smithi038.stdout:7/497: mkdir da/d21/da6 0 2023-12-16T20:11:31.552 INFO:tasks.workunit.client.0.smithi038.stdout:0/548: symlink db/d16/d1c/d5d/d64/lb8 0 2023-12-16T20:11:31.554 INFO:tasks.workunit.client.0.smithi038.stdout:8/407: dwrite d17/d1b/f3f [0,4194304] 0 2023-12-16T20:11:31.555 INFO:tasks.workunit.client.1.smithi141.stdout:9/178: dwrite d1/d10/d33/d39/f40 [0,4194304] 0 2023-12-16T20:11:31.555 INFO:tasks.workunit.client.0.smithi038.stdout:9/604: creat d9/d1f/d21/d84/fb3 x:0 0 0 2023-12-16T20:11:31.555 INFO:tasks.workunit.client.0.smithi038.stdout:9/605: write d9/d1e/d3d/d42/f48 [4802646,107913] 0 2023-12-16T20:11:31.556 INFO:tasks.workunit.client.0.smithi038.stdout:4/559: mkdir d13/d1f/db7 0 2023-12-16T20:11:31.556 INFO:tasks.workunit.client.0.smithi038.stdout:4/560: dread - d13/d17/d4b/f87 zero size 2023-12-16T20:11:31.557 INFO:tasks.workunit.client.0.smithi038.stdout:4/561: write d13/d1f/d35/f63 [5039940,80586] 0 2023-12-16T20:11:31.557 INFO:tasks.workunit.client.0.smithi038.stdout:4/562: write d13/d17/d2e/d32/d4e/fa9 [657400,93725] 0 2023-12-16T20:11:31.558 INFO:tasks.workunit.client.0.smithi038.stdout:7/498: link da/d21/d2c/d76/l7d da/d21/d2c/d76/d9a/la7 0 2023-12-16T20:11:31.561 INFO:tasks.workunit.client.1.smithi141.stdout:9/179: mknod d1/d10/d14/c42 0 2023-12-16T20:11:31.561 INFO:tasks.workunit.client.1.smithi141.stdout:9/180: fdatasync d1/d10/d14/f31 0 2023-12-16T20:11:31.562 INFO:tasks.workunit.client.0.smithi038.stdout:9/606: mknod d9/d1f/d21/d3e/d4e/d64/cb4 0 2023-12-16T20:11:31.564 INFO:tasks.workunit.client.0.smithi038.stdout:4/563: rename fa to d13/d1f/db7/fb8 0 2023-12-16T20:11:31.564 INFO:tasks.workunit.client.1.smithi141.stdout:6/292: dwrite d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:31.565 INFO:tasks.workunit.client.1.smithi141.stdout:6/293: write d1/d12/d20/f3d [601006,67360] 0 2023-12-16T20:11:31.565 INFO:tasks.workunit.client.1.smithi141.stdout:6/294: chown d1/f19 227719793 1 2023-12-16T20:11:31.565 INFO:tasks.workunit.client.1.smithi141.stdout:6/295: truncate d1/d12/d22/d25/f55 1212936 0 2023-12-16T20:11:31.565 INFO:tasks.workunit.client.1.smithi141.stdout:4/245: dwrite d1a/d4e/f51 [0,4194304] 0 2023-12-16T20:11:31.565 INFO:tasks.workunit.client.1.smithi141.stdout:4/246: chown f1 127289430 1 2023-12-16T20:11:31.567 INFO:tasks.workunit.client.0.smithi038.stdout:7/499: creat da/d3e/d31/fa8 x:0 0 0 2023-12-16T20:11:31.568 INFO:tasks.workunit.client.1.smithi141.stdout:9/181: mknod d1/d10/d14/d20/da/de/c43 0 2023-12-16T20:11:31.570 INFO:tasks.workunit.client.0.smithi038.stdout:4/564: mkdir d13/d1f/db7/db9 0 2023-12-16T20:11:31.570 INFO:tasks.workunit.client.0.smithi038.stdout:4/565: write d13/d1f/d35/f63 [1121214,84241] 0 2023-12-16T20:11:31.572 INFO:tasks.workunit.client.0.smithi038.stdout:4/566: truncate d13/d1f/d35/f38 2297433 0 2023-12-16T20:11:31.572 INFO:tasks.workunit.client.0.smithi038.stdout:4/567: creat d13/d17/d62/fba x:0 0 0 2023-12-16T20:11:31.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/568: getdents d13/d17/d4b/da4 0 2023-12-16T20:11:31.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/569: creat d13/d17/d62/fbb x:0 0 0 2023-12-16T20:11:31.575 INFO:tasks.workunit.client.1.smithi141.stdout:6/296: link d1/d3/l49 d1/d3/d4f/l68 0 2023-12-16T20:11:31.576 INFO:tasks.workunit.client.0.smithi038.stdout:7/500: dread da/d3e/d31/f4a [0,4194304] 0 2023-12-16T20:11:31.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/501: truncate da/d21/f50 1657179 0 2023-12-16T20:11:31.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/502: truncate da/d21/f55 703970 0 2023-12-16T20:11:31.581 INFO:tasks.workunit.client.1.smithi141.stdout:4/247: mknod d1a/d3c/c5e 0 2023-12-16T20:11:31.582 INFO:tasks.workunit.client.1.smithi141.stdout:9/182: creat d1/d10/d33/f44 x:0 0 0 2023-12-16T20:11:31.582 INFO:tasks.workunit.client.1.smithi141.stdout:9/183: chown d1/d26/f2f 1 1 2023-12-16T20:11:31.582 INFO:tasks.workunit.client.1.smithi141.stdout:9/184: chown d1/d10/d14/d20/da/de/c43 59069895 1 2023-12-16T20:11:31.585 INFO:tasks.workunit.client.1.smithi141.stdout:4/248: rename d1a/c28 to d1a/c5f 0 2023-12-16T20:11:31.586 INFO:tasks.workunit.client.0.smithi038.stdout:7/503: dread da/d3e/d31/d38/d90/ff [0,4194304] 0 2023-12-16T20:11:31.586 INFO:tasks.workunit.client.1.smithi141.stdout:4/249: chown d1a/c27 4155 1 2023-12-16T20:11:31.587 INFO:tasks.workunit.client.0.smithi038.stdout:8/408: dwrite d17/d1b/d25/f6b [0,4194304] 0 2023-12-16T20:11:31.587 INFO:tasks.workunit.client.0.smithi038.stdout:8/409: readlink d17/d1b/d57/l62 0 2023-12-16T20:11:31.587 INFO:tasks.workunit.client.0.smithi038.stdout:9/607: dwrite d9/d1f/d21/d3e/f94 [0,4194304] 0 2023-12-16T20:11:31.587 INFO:tasks.workunit.client.1.smithi141.stdout:4/250: symlink d1a/d54/l60 0 2023-12-16T20:11:31.588 INFO:tasks.workunit.client.0.smithi038.stdout:7/504: symlink da/d24/la9 0 2023-12-16T20:11:31.588 INFO:tasks.workunit.client.1.smithi141.stdout:4/251: symlink d1a/d59/l61 0 2023-12-16T20:11:31.588 INFO:tasks.workunit.client.1.smithi141.stdout:6/297: write d1/d12/d22/f2a [1312003,53047] 0 2023-12-16T20:11:31.590 INFO:tasks.workunit.client.1.smithi141.stdout:4/252: rmdir d1a/d2a/d3b 39 2023-12-16T20:11:31.591 INFO:tasks.workunit.client.1.smithi141.stdout:4/253: chown f9 19211520 1 2023-12-16T20:11:31.591 INFO:tasks.workunit.client.0.smithi038.stdout:8/410: mkdir d17/d34/d3d/d50/d7d 0 2023-12-16T20:11:31.591 INFO:tasks.workunit.client.0.smithi038.stdout:8/411: write d17/d1b/d53/f77 [875617,73262] 0 2023-12-16T20:11:31.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:31 smithi038 ceph-mon[80659]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:31.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:31 smithi038 ceph-mon[80659]: mgrmap e23: smithi141.cycgjd(active, since 2s) 2023-12-16T20:11:31.597 INFO:tasks.workunit.client.0.smithi038.stdout:8/412: creat d17/d1b/d66/d73/d54/d69/f7e x:0 0 0 2023-12-16T20:11:31.597 INFO:tasks.workunit.client.0.smithi038.stdout:9/608: getdents d9/d1e/d3d/d42/d59/d76 0 2023-12-16T20:11:31.606 INFO:tasks.workunit.client.0.smithi038.stdout:8/413: dread d17/d34/f36 [0,4194304] 0 2023-12-16T20:11:31.606 INFO:tasks.workunit.client.0.smithi038.stdout:8/414: fsync d17/f38 0 2023-12-16T20:11:31.607 INFO:tasks.workunit.client.0.smithi038.stdout:8/415: creat d17/d5a/f7f x:0 0 0 2023-12-16T20:11:31.607 INFO:tasks.workunit.client.0.smithi038.stdout:8/416: chown l12 93 1 2023-12-16T20:11:31.608 INFO:tasks.workunit.client.0.smithi038.stdout:8/417: mknod d17/d1b/d66/d73/c80 0 2023-12-16T20:11:31.609 INFO:tasks.workunit.client.0.smithi038.stdout:8/418: mknod d17/d1d/d78/c81 0 2023-12-16T20:11:31.613 INFO:tasks.workunit.client.1.smithi141.stdout:6/298: dwrite d1/d3/f10 [0,4194304] 0 2023-12-16T20:11:31.613 INFO:tasks.workunit.client.1.smithi141.stdout:6/299: getdents d1/d12/d20/d44/d65 0 2023-12-16T20:11:31.615 INFO:tasks.workunit.client.1.smithi141.stdout:6/300: getdents d1/d12/d22 0 2023-12-16T20:11:31.615 INFO:tasks.workunit.client.1.smithi141.stdout:6/301: write d1/d12/f16 [2865761,99338] 0 2023-12-16T20:11:31.616 INFO:tasks.workunit.client.1.smithi141.stdout:6/302: truncate d1/fa 1207790 0 2023-12-16T20:11:31.616 INFO:tasks.workunit.client.1.smithi141.stdout:6/303: getdents d1/d12/d22 0 2023-12-16T20:11:31.616 INFO:tasks.workunit.client.1.smithi141.stdout:6/304: chown d1/d12 33 1 2023-12-16T20:11:31.617 INFO:tasks.workunit.client.1.smithi141.stdout:6/305: mkdir d1/dd/d43/d69 0 2023-12-16T20:11:31.652 INFO:tasks.workunit.client.1.smithi141.stdout:0/244: dwrite d4/d49/f52 [0,4194304] 0 2023-12-16T20:11:31.652 INFO:tasks.workunit.client.1.smithi141.stdout:0/245: creat d4/d3a/f5b x:0 0 0 2023-12-16T20:11:31.652 INFO:tasks.workunit.client.1.smithi141.stdout:0/246: read - d4/d3a/f5b zero size 2023-12-16T20:11:31.659 INFO:tasks.workunit.client.1.smithi141.stdout:1/204: fsync da/d36/f3f 0 2023-12-16T20:11:31.659 INFO:tasks.workunit.client.1.smithi141.stdout:1/205: write da/d1a/d1d/d22/d29/f3e [1928313,39342] 0 2023-12-16T20:11:31.659 INFO:tasks.workunit.client.1.smithi141.stdout:1/206: readlink da/l19 0 2023-12-16T20:11:31.660 INFO:tasks.workunit.client.0.smithi038.stdout:0/549: write db/d16/d1c/f32 [1637711,98643] 0 2023-12-16T20:11:31.660 INFO:tasks.workunit.client.1.smithi141.stdout:1/207: creat da/d25/f40 x:0 0 0 2023-12-16T20:11:31.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/609: dwrite d9/d1f/f98 [0,4194304] 0 2023-12-16T20:11:31.669 INFO:tasks.workunit.client.0.smithi038.stdout:0/550: creat db/d1a/d77/d95/d9f/fb9 x:0 0 0 2023-12-16T20:11:31.670 INFO:tasks.workunit.client.1.smithi141.stdout:0/247: write d4/d49/d4b/f53 [770062,124953] 0 2023-12-16T20:11:31.672 INFO:tasks.workunit.client.1.smithi141.stdout:0/248: dread d4/d3a/f46 [0,4194304] 0 2023-12-16T20:11:31.672 INFO:tasks.workunit.client.1.smithi141.stdout:0/249: write d4/d7/d44/f4f [736626,20847] 0 2023-12-16T20:11:31.672 INFO:tasks.workunit.client.1.smithi141.stdout:0/250: readlink d4/l32 0 2023-12-16T20:11:31.674 INFO:tasks.workunit.client.1.smithi141.stdout:6/306: dread d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:31.674 INFO:tasks.workunit.client.1.smithi141.stdout:6/307: fdatasync d1/dd/d2f/f30 0 2023-12-16T20:11:31.674 INFO:tasks.workunit.client.1.smithi141.stdout:6/308: readlink d1/d12/d22/l40 0 2023-12-16T20:11:31.674 INFO:tasks.workunit.client.1.smithi141.stdout:6/309: chown d1/dd 1 1 2023-12-16T20:11:31.675 INFO:tasks.workunit.client.0.smithi038.stdout:9/610: mkdir d9/d1e/d40/d5e/db5 0 2023-12-16T20:11:31.677 INFO:tasks.workunit.client.1.smithi141.stdout:0/251: mkdir d4/d5c 0 2023-12-16T20:11:31.678 INFO:tasks.workunit.client.1.smithi141.stdout:0/252: getdents d4/d7/d44 0 2023-12-16T20:11:31.678 INFO:tasks.workunit.client.1.smithi141.stdout:0/253: fdatasync d4/f1c 0 2023-12-16T20:11:31.680 INFO:tasks.workunit.client.0.smithi038.stdout:0/551: mknod db/d16/d19/d27/d78/cba 0 2023-12-16T20:11:31.680 INFO:tasks.workunit.client.1.smithi141.stdout:0/254: mkdir d4/d7/d5d 0 2023-12-16T20:11:31.681 INFO:tasks.workunit.client.0.smithi038.stdout:9/611: link d9/d1e/d3d/d42/f53 d9/d1e/d3d/d42/d59/fb6 0 2023-12-16T20:11:31.683 INFO:tasks.workunit.client.0.smithi038.stdout:0/552: truncate db/d16/d70/f6c 232958 0 2023-12-16T20:11:31.685 INFO:tasks.workunit.client.1.smithi141.stdout:0/255: rmdir d4/d7/d5d 0 2023-12-16T20:11:31.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/505: dwrite da/d3e/d8e/f78 [0,4194304] 0 2023-12-16T20:11:31.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/612: dread d9/d1f/d21/d52/f8c [0,4194304] 0 2023-12-16T20:11:31.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/613: write d9/d1f/d21/d3e/f49 [829551,69064] 0 2023-12-16T20:11:31.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/614: write d9/d1e/d3d/d42/d59/f91 [1022329,23896] 0 2023-12-16T20:11:31.688 INFO:tasks.workunit.client.1.smithi141.stdout:1/208: dwrite da/d25/f40 [0,4194304] 0 2023-12-16T20:11:31.691 INFO:tasks.workunit.client.1.smithi141.stdout:0/256: mknod d4/d7/c5e 0 2023-12-16T20:11:31.694 INFO:tasks.workunit.client.1.smithi141.stdout:0/257: symlink d4/d3a/l5f 0 2023-12-16T20:11:31.695 INFO:tasks.workunit.client.1.smithi141.stdout:4/254: getdents d1a/d3c 0 2023-12-16T20:11:31.697 INFO:tasks.workunit.client.1.smithi141.stdout:0/258: mknod d4/d3a/c60 0 2023-12-16T20:11:31.702 INFO:tasks.workunit.client.1.smithi141.stdout:1/209: write da/df/f27 [3653172,44371] 0 2023-12-16T20:11:31.702 INFO:tasks.workunit.client.1.smithi141.stdout:1/210: dread - da/df/f34 zero size 2023-12-16T20:11:31.702 INFO:tasks.workunit.client.1.smithi141.stdout:6/310: truncate d1/f19 850676 0 2023-12-16T20:11:31.703 INFO:tasks.workunit.client.1.smithi141.stdout:9/185: dwrite d1/d10/d14/f31 [4194304,4194304] 0 2023-12-16T20:11:31.705 INFO:tasks.workunit.client.1.smithi141.stdout:1/211: mknod da/d36/c41 0 2023-12-16T20:11:31.708 INFO:tasks.workunit.client.1.smithi141.stdout:9/186: symlink d1/d10/d14/d20/da/d3f/l45 0 2023-12-16T20:11:31.709 INFO:tasks.workunit.client.0.smithi038.stdout:8/419: write d17/d1b/f3f [5175954,42662] 0 2023-12-16T20:11:31.713 INFO:tasks.workunit.client.0.smithi038.stdout:9/615: creat d9/d1f/d96/fb7 x:0 0 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:9/187: creat d1/d10/d14/d20/d3b/f46 x:0 0 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:9/188: readlink d1/l23 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/212: link da/df/f13 da/d1a/f42 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:9/189: mkdir d1/d10/d33/d47 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:9/190: fdatasync d1/d10/d33/f34 0 2023-12-16T20:11:31.714 INFO:tasks.workunit.client.1.smithi141.stdout:9/191: fsync d1/d10/d33/f44 0 2023-12-16T20:11:31.715 INFO:tasks.workunit.client.1.smithi141.stdout:9/192: rmdir d1/d10/d14/d20/da/d3f 39 2023-12-16T20:11:31.717 INFO:tasks.workunit.client.0.smithi038.stdout:8/420: mkdir d17/d1d/d82 0 2023-12-16T20:11:31.717 INFO:tasks.workunit.client.1.smithi141.stdout:9/193: symlink d1/d10/d14/d20/da/de/l48 0 2023-12-16T20:11:31.718 INFO:tasks.workunit.client.1.smithi141.stdout:9/194: symlink d1/d26/l49 0 2023-12-16T20:11:31.719 INFO:tasks.workunit.client.0.smithi038.stdout:8/421: symlink d17/d1b/d66/d73/d54/l83 0 2023-12-16T20:11:31.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/422: write d17/d1b/d25/f3c [1140308,18228] 0 2023-12-16T20:11:31.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/423: chown d17/d1b/d66/d73/d54/d69/l2f 0 1 2023-12-16T20:11:31.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/424: creat d17/d34/f84 x:0 0 0 2023-12-16T20:11:31.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/425: creat d17/d5a/f85 x:0 0 0 2023-12-16T20:11:31.721 INFO:tasks.workunit.client.0.smithi038.stdout:9/616: write d9/d1e/d3d/d42/d59/fb6 [1477311,122669] 0 2023-12-16T20:11:31.722 INFO:tasks.workunit.client.0.smithi038.stdout:7/506: write da/d21/f50 [2112453,51263] 0 2023-12-16T20:11:31.722 INFO:tasks.workunit.client.0.smithi038.stdout:7/507: truncate da/d21/f87 2234302 0 2023-12-16T20:11:31.722 INFO:tasks.workunit.client.0.smithi038.stdout:7/508: chown da/d21/l54 9978683 1 2023-12-16T20:11:31.725 INFO:tasks.workunit.client.1.smithi141.stdout:0/259: dwrite d4/f31 [0,4194304] 0 2023-12-16T20:11:31.728 INFO:tasks.workunit.client.0.smithi038.stdout:8/426: read d17/d1b/d66/d73/d54/d69/f26 [3448081,77139] 0 2023-12-16T20:11:31.728 INFO:tasks.workunit.client.0.smithi038.stdout:0/553: dwrite db/d16/d19/d27/f34 [4194304,4194304] 0 2023-12-16T20:11:31.728 INFO:tasks.workunit.client.0.smithi038.stdout:0/554: fsync db/d16/d19/f4b 0 2023-12-16T20:11:31.728 INFO:tasks.workunit.client.0.smithi038.stdout:0/555: stat db/d16/d1c/d5d/d64 0 2023-12-16T20:11:31.729 INFO:tasks.workunit.client.0.smithi038.stdout:7/509: mknod da/d3e/d31/d38/d65/d81/caa 0 2023-12-16T20:11:31.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/260: symlink d4/l61 0 2023-12-16T20:11:31.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/261: chown d4/d49/f52 0 1 2023-12-16T20:11:31.732 INFO:tasks.workunit.client.1.smithi141.stdout:6/311: dwrite d1/d12/d20/f3d [0,4194304] 0 2023-12-16T20:11:31.733 INFO:tasks.workunit.client.1.smithi141.stdout:9/195: dread d1/d10/d14/d20/da/f32 [0,4194304] 0 2023-12-16T20:11:31.736 INFO:tasks.workunit.client.1.smithi141.stdout:7/160: sync 2023-12-16T20:11:31.740 INFO:tasks.workunit.client.0.smithi038.stdout:7/510: read da/d3e/d31/d38/d90/f3c [1123227,6649] 0 2023-12-16T20:11:31.741 INFO:tasks.workunit.client.0.smithi038.stdout:7/511: fdatasync da/d21/d61/f9d 0 2023-12-16T20:11:31.741 INFO:tasks.workunit.client.0.smithi038.stdout:8/427: dread f13 [12582912,4194304] 0 2023-12-16T20:11:31.743 INFO:tasks.workunit.client.0.smithi038.stdout:7/512: rename da/d21/f29 to da/d21/d86/d92/fab 0 2023-12-16T20:11:31.746 INFO:tasks.workunit.client.0.smithi038.stdout:9/617: dread d9/d1f/d21/d55/f6f [4194304,4194304] 0 2023-12-16T20:11:31.746 INFO:tasks.workunit.client.0.smithi038.stdout:9/618: creat d9/d1f/d21/d52/fb8 x:0 0 0 2023-12-16T20:11:31.746 INFO:tasks.workunit.client.0.smithi038.stdout:9/619: write d9/d1e/d40/d5e/d71/d83/f9f [3019238,117039] 0 2023-12-16T20:11:31.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/513: creat da/d21/fac x:0 0 0 2023-12-16T20:11:31.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/514: read - da/d21/d61/f9d zero size 2023-12-16T20:11:31.748 INFO:tasks.workunit.client.1.smithi141.stdout:9/196: dread d1/d10/f15 [0,4194304] 0 2023-12-16T20:11:31.748 INFO:tasks.workunit.client.1.smithi141.stdout:9/197: readlink d1/d26/l49 0 2023-12-16T20:11:31.749 INFO:tasks.workunit.client.0.smithi038.stdout:8/428: mknod d17/d1d/c86 0 2023-12-16T20:11:31.749 INFO:tasks.workunit.client.0.smithi038.stdout:8/429: fdatasync d17/f38 0 2023-12-16T20:11:31.749 INFO:tasks.workunit.client.0.smithi038.stdout:8/430: chown d17/d5a/f85 32 1 2023-12-16T20:11:31.753 INFO:tasks.workunit.client.1.smithi141.stdout:9/198: rmdir d1/d10/d14 39 2023-12-16T20:11:31.753 INFO:tasks.workunit.client.1.smithi141.stdout:9/199: readlink d1/l2d 0 2023-12-16T20:11:31.753 INFO:tasks.workunit.client.1.smithi141.stdout:9/200: write d1/d26/f2f [3862991,7398] 0 2023-12-16T20:11:31.753 INFO:tasks.workunit.client.1.smithi141.stdout:0/262: write d4/f31 [3796925,42757] 0 2023-12-16T20:11:31.753 INFO:tasks.workunit.client.1.smithi141.stdout:9/201: mkdir d1/d26/d4a 0 2023-12-16T20:11:31.755 INFO:tasks.workunit.client.1.smithi141.stdout:9/202: creat d1/d10/d27/f4b x:0 0 0 2023-12-16T20:11:31.755 INFO:tasks.workunit.client.1.smithi141.stdout:9/203: readlink d1/d10/d27/l2c 0 2023-12-16T20:11:31.755 INFO:tasks.workunit.client.1.smithi141.stdout:9/204: readlink d1/d10/d14/d20/da/d3f/l45 0 2023-12-16T20:11:31.756 INFO:tasks.workunit.client.0.smithi038.stdout:9/620: link d9/l1d d9/d1e/d40/d5e/d71/d83/lb9 0 2023-12-16T20:11:31.756 INFO:tasks.workunit.client.0.smithi038.stdout:9/621: chown d9/d1f/f5b 92 1 2023-12-16T20:11:31.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/515: creat da/d21/d2c/d76/fad x:0 0 0 2023-12-16T20:11:31.757 INFO:tasks.workunit.client.0.smithi038.stdout:8/431: symlink d17/d34/l87 0 2023-12-16T20:11:31.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/622: truncate d9/d1f/d21/d55/f65 2175903 0 2023-12-16T20:11:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:7/516: mkdir da/d24/d4d/dae 0 2023-12-16T20:11:31.762 INFO:tasks.workunit.client.0.smithi038.stdout:9/623: rename d9/d1e/d3d/d42/d59/f7d to d9/d1f/d96/fba 0 2023-12-16T20:11:31.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/624: mknod d9/d1f/d21/d84/daf/cbb 0 2023-12-16T20:11:31.770 INFO:tasks.workunit.client.1.smithi141.stdout:6/312: dread d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:31.772 INFO:tasks.workunit.client.0.smithi038.stdout:0/556: dwrite db/d1a/d77/d95/d9f/fb9 [0,4194304] 0 2023-12-16T20:11:31.772 INFO:tasks.workunit.client.0.smithi038.stdout:0/557: stat db/db6 0 2023-12-16T20:11:31.772 INFO:tasks.workunit.client.0.smithi038.stdout:0/558: chown db/d1a/f71 30860800 1 2023-12-16T20:11:31.774 INFO:tasks.workunit.client.0.smithi038.stdout:9/625: creat d9/d1e/d3d/d42/d59/d76/d8d/fbc x:0 0 0 2023-12-16T20:11:31.783 INFO:tasks.workunit.client.0.smithi038.stdout:0/559: symlink db/d16/d19/d80/lbb 0 2023-12-16T20:11:31.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/626: dread d9/d1e/f74 [0,4194304] 0 2023-12-16T20:11:31.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/627: chown d9/d1f/d21/c32 1670206 1 2023-12-16T20:11:31.793 INFO:tasks.workunit.client.1.smithi141.stdout:1/213: dwrite da/d1a/d1d/d22/d29/f3e [0,4194304] 0 2023-12-16T20:11:31.796 INFO:tasks.workunit.client.1.smithi141.stdout:1/214: dread f6 [0,4194304] 0 2023-12-16T20:11:31.806 INFO:tasks.workunit.client.0.smithi038.stdout:8/432: dwrite f16 [0,4194304] 0 2023-12-16T20:11:31.806 INFO:tasks.workunit.client.0.smithi038.stdout:8/433: fsync d17/d5a/f7f 0 2023-12-16T20:11:31.808 INFO:tasks.workunit.client.0.smithi038.stdout:8/434: link d17/d34/d3d/d50/f6e d17/d1b/d66/d73/d4e/f88 0 2023-12-16T20:11:31.808 INFO:tasks.workunit.client.0.smithi038.stdout:8/435: chown d17/d1b/d66/d73/d54/d69/f7e 103 1 2023-12-16T20:11:31.815 INFO:tasks.workunit.client.0.smithi038.stdout:8/436: dread d17/f40 [0,4194304] 0 2023-12-16T20:11:31.816 INFO:tasks.workunit.client.0.smithi038.stdout:8/437: chown d17/d5a/f7f 19381356 1 2023-12-16T20:11:31.818 INFO:tasks.workunit.client.0.smithi038.stdout:7/517: dwrite da/f19 [0,4194304] 0 2023-12-16T20:11:31.818 INFO:tasks.workunit.client.1.smithi141.stdout:0/263: dwrite f1 [0,4194304] 0 2023-12-16T20:11:31.818 INFO:tasks.workunit.client.1.smithi141.stdout:6/313: dwrite d1/d12/d20/f3d [0,4194304] 0 2023-12-16T20:11:31.819 INFO:tasks.workunit.client.0.smithi038.stdout:9/628: dwrite d9/d1f/d21/d3e/d4e/d61/f89 [0,4194304] 0 2023-12-16T20:11:31.819 INFO:tasks.workunit.client.0.smithi038.stdout:9/629: chown d9/d1e/d3d/d42/d59/fb6 187952 1 2023-12-16T20:11:31.819 INFO:tasks.workunit.client.1.smithi141.stdout:9/205: dwrite d1/d10/d14/d20/da/f38 [0,4194304] 0 2023-12-16T20:11:31.822 INFO:tasks.workunit.client.0.smithi038.stdout:7/518: unlink da/f1b 0 2023-12-16T20:11:31.822 INFO:tasks.workunit.client.1.smithi141.stdout:0/264: truncate d4/d7/fd 621851 0 2023-12-16T20:11:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:9/630: dread d9/d1e/d45/f4a [0,4194304] 0 2023-12-16T20:11:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:9/631: chown d9/d1f/d21/d84/daf 107768 1 2023-12-16T20:11:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:9/632: write d9/d1f/d21/d52/fa7 [981355,47201] 0 2023-12-16T20:11:31.825 INFO:tasks.workunit.client.0.smithi038.stdout:7/519: truncate da/d21/d2c/f47 4689297 0 2023-12-16T20:11:31.826 INFO:tasks.workunit.client.1.smithi141.stdout:1/215: dwrite da/f12 [0,4194304] 0 2023-12-16T20:11:31.826 INFO:tasks.workunit.client.1.smithi141.stdout:0/265: symlink d4/d7/l62 0 2023-12-16T20:11:31.827 INFO:tasks.workunit.client.0.smithi038.stdout:9/633: creat d9/d1e/d45/fbd x:0 0 0 2023-12-16T20:11:31.827 INFO:tasks.workunit.client.0.smithi038.stdout:9/634: chown d9/d1e/l26 156 1 2023-12-16T20:11:31.831 INFO:tasks.workunit.client.0.smithi038.stdout:9/635: symlink d9/d1e/d40/d5e/d71/d83/lbe 0 2023-12-16T20:11:31.831 INFO:tasks.workunit.client.0.smithi038.stdout:9/636: write d9/d1f/d21/f7e [4426943,79761] 0 2023-12-16T20:11:31.832 INFO:tasks.workunit.client.0.smithi038.stdout:9/637: write d9/d1e/f33 [1106039,61288] 0 2023-12-16T20:11:31.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/560: truncate db/d1a/d77/d95/d9f/fb9 3210604 0 2023-12-16T20:11:31.834 INFO:tasks.workunit.client.1.smithi141.stdout:6/314: truncate d1/d12/d20/f3d 3317843 0 2023-12-16T20:11:31.837 INFO:tasks.workunit.client.0.smithi038.stdout:0/561: mknod db/d16/d5a/d65/d90/da7/cbc 0 2023-12-16T20:11:31.837 INFO:tasks.workunit.client.0.smithi038.stdout:0/562: creat db/d16/d19/d80/fbd x:0 0 0 2023-12-16T20:11:31.842 INFO:tasks.workunit.client.0.smithi038.stdout:0/563: rename db/d16/d19/f2b to db/d1a/d77/d95/da4/fbe 0 2023-12-16T20:11:31.842 INFO:tasks.workunit.client.0.smithi038.stdout:0/564: fsync db/d16/d70/d79/fa8 0 2023-12-16T20:11:31.845 INFO:tasks.workunit.client.0.smithi038.stdout:0/565: unlink db/d16/d1c/d5d/f61 0 2023-12-16T20:11:31.846 INFO:tasks.workunit.client.0.smithi038.stdout:0/566: symlink db/d16/d5a/d65/d90/da7/lbf 0 2023-12-16T20:11:31.846 INFO:tasks.workunit.client.0.smithi038.stdout:0/567: creat db/d16/d1c/fc0 x:0 0 0 2023-12-16T20:11:31.850 INFO:tasks.workunit.client.0.smithi038.stdout:9/638: write d9/d1f/f98 [3286167,66100] 0 2023-12-16T20:11:31.854 INFO:tasks.workunit.client.1.smithi141.stdout:8/238: sync 2023-12-16T20:11:31.857 INFO:tasks.workunit.client.0.smithi038.stdout:1/573: sync 2023-12-16T20:11:31.857 INFO:tasks.workunit.client.0.smithi038.stdout:1/574: chown d15/d1e/d3b/d48/d37 482 1 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/575: creat d15/d4a/fc0 x:0 0 0 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/576: write d15/f1a [773077,126932] 0 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:2/613: sync 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:2/614: stat d1/d5/fc7 0 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:3/540: sync 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:3/541: write d4/d6c/fa6 [975356,59017] 0 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:5/591: sync 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:4/570: sync 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:4/571: dread - d13/d1f/d98/fb6 zero size 2023-12-16T20:11:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:6/510: sync 2023-12-16T20:11:31.859 INFO:tasks.workunit.client.1.smithi141.stdout:8/239: truncate d14/f23 176217 0 2023-12-16T20:11:31.859 INFO:tasks.workunit.client.0.smithi038.stdout:7/520: dwrite da/d24/f6f [0,4194304] 0 2023-12-16T20:11:31.859 INFO:tasks.workunit.client.0.smithi038.stdout:7/521: fsync da/d21/d41/f7b 0 2023-12-16T20:11:31.860 INFO:tasks.workunit.client.1.smithi141.stdout:0/266: dwrite f1 [0,4194304] 0 2023-12-16T20:11:31.860 INFO:tasks.workunit.client.1.smithi141.stdout:0/267: readlink d4/d7/l62 0 2023-12-16T20:11:31.861 INFO:tasks.workunit.client.1.smithi141.stdout:9/206: dwrite d1/d10/d27/f4b [0,4194304] 0 2023-12-16T20:11:31.861 INFO:tasks.workunit.client.1.smithi141.stdout:8/240: rmdir d14/d19 39 2023-12-16T20:11:31.861 INFO:tasks.workunit.client.1.smithi141.stdout:8/241: chown d14/d19/d1b 86 1 2023-12-16T20:11:31.862 INFO:tasks.workunit.client.1.smithi141.stdout:8/242: dread - d14/d19/d1b/d24/f31 zero size 2023-12-16T20:11:31.862 INFO:tasks.workunit.client.1.smithi141.stdout:8/243: fsync d14/d19/d1b/d24/f28 0 2023-12-16T20:11:31.862 INFO:tasks.workunit.client.1.smithi141.stdout:8/244: dread - d14/d19/d1b/d24/f49 zero size 2023-12-16T20:11:31.862 INFO:tasks.workunit.client.1.smithi141.stdout:8/245: chown d14/d19/f1f 3110 1 2023-12-16T20:11:31.862 INFO:tasks.workunit.client.1.smithi141.stdout:1/216: dwrite da/d1a/d1d/d22/d29/f3e [0,4194304] 0 2023-12-16T20:11:31.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/615: mkdir d1/d5/d95/d61/dd4/d6a/dd5 0 2023-12-16T20:11:31.864 INFO:tasks.workunit.client.0.smithi038.stdout:2/616: dread - d1/d5/d95/fb7 zero size 2023-12-16T20:11:31.864 INFO:tasks.workunit.client.0.smithi038.stdout:2/617: fdatasync d1/d5/f4e 0 2023-12-16T20:11:31.864 INFO:tasks.workunit.client.0.smithi038.stdout:3/542: mknod d4/dab/cbe 0 2023-12-16T20:11:31.865 INFO:tasks.workunit.client.1.smithi141.stdout:8/246: creat d14/d19/f4e x:0 0 0 2023-12-16T20:11:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:5/592: creat d2/d14/d25/fb7 x:0 0 0 2023-12-16T20:11:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:4/572: truncate d13/d17/d2e/f52 3735986 0 2023-12-16T20:11:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:5/593: truncate d2/df/d1a/d1f/d4a/d53/d6e/d9e/fb4 262063 0 2023-12-16T20:11:31.867 INFO:tasks.workunit.client.1.smithi141.stdout:8/247: mknod d14/d19/d1b/c4f 0 2023-12-16T20:11:31.869 INFO:tasks.workunit.client.0.smithi038.stdout:1/577: mkdir d15/d1e/d23/d42/d75/dc1 0 2023-12-16T20:11:31.870 INFO:tasks.workunit.client.1.smithi141.stdout:1/217: getdents da/df 0 2023-12-16T20:11:31.871 INFO:tasks.workunit.client.1.smithi141.stdout:8/248: creat d14/d19/d1b/d3d/f50 x:0 0 0 2023-12-16T20:11:31.872 INFO:tasks.workunit.client.0.smithi038.stdout:3/543: rmdir d4/d8/d15/d1e 39 2023-12-16T20:11:31.874 INFO:tasks.workunit.client.0.smithi038.stdout:4/573: link d13/d17/d4b/f43 d13/d69/fbc 0 2023-12-16T20:11:31.875 INFO:tasks.workunit.client.0.smithi038.stdout:4/574: creat d13/d17/d2e/d32/d4e/fbd x:0 0 0 2023-12-16T20:11:31.876 INFO:tasks.workunit.client.0.smithi038.stdout:5/594: creat d2/d14/d25/d2d/d2f/fb8 x:0 0 0 2023-12-16T20:11:31.876 INFO:tasks.workunit.client.0.smithi038.stdout:5/595: truncate d2/df/d1a/d1f/d4a/d53/f82 711653 0 2023-12-16T20:11:31.877 INFO:tasks.workunit.client.0.smithi038.stdout:1/578: mknod d15/d4a/cc2 0 2023-12-16T20:11:31.877 INFO:tasks.workunit.client.0.smithi038.stdout:1/579: truncate d15/d1e/d23/d34/d86/fa0 654792 0 2023-12-16T20:11:31.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/596: mknod d2/d14/d25/d2d/d2f/d98/cb9 0 2023-12-16T20:11:31.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/597: stat d2/df/d1a/d2a/f50 0 2023-12-16T20:11:31.881 INFO:tasks.workunit.client.0.smithi038.stdout:5/598: fdatasync d2/d14/d25/d2d/d17/d93/fab 0 2023-12-16T20:11:31.882 INFO:tasks.workunit.client.1.smithi141.stdout:9/207: dread d1/d10/d14/d20/da/f38 [0,4194304] 0 2023-12-16T20:11:31.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/580: creat d15/d1e/d23/d42/d75/dbc/fc3 x:0 0 0 2023-12-16T20:11:31.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/581: rename d15/d1e to d15/d1e/d3b/dbb/dc4 22 2023-12-16T20:11:31.884 INFO:tasks.workunit.client.0.smithi038.stdout:4/575: dread d13/d1f/f66 [0,4194304] 0 2023-12-16T20:11:31.884 INFO:tasks.workunit.client.1.smithi141.stdout:1/218: write da/d1a/d1d/d22/d29/f3e [3396317,24584] 0 2023-12-16T20:11:31.885 INFO:tasks.workunit.client.1.smithi141.stdout:1/219: read da/d1a/f42 [3983774,81820] 0 2023-12-16T20:11:31.885 INFO:tasks.workunit.client.1.smithi141.stdout:1/220: creat da/d1a/d1d/d33/f43 x:0 0 0 2023-12-16T20:11:31.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/582: creat d15/d1e/d23/d42/fc5 x:0 0 0 2023-12-16T20:11:31.887 INFO:tasks.workunit.client.1.smithi141.stdout:9/208: mknod d1/d26/d4a/c4c 0 2023-12-16T20:11:31.888 INFO:tasks.workunit.client.0.smithi038.stdout:1/583: mkdir d15/d1e/d23/d42/d75/dc6 0 2023-12-16T20:11:31.890 INFO:tasks.workunit.client.0.smithi038.stdout:1/584: symlink d15/d1e/d23/d42/d75/dbc/lc7 0 2023-12-16T20:11:31.891 INFO:tasks.workunit.client.1.smithi141.stdout:8/249: write ff [3056622,93111] 0 2023-12-16T20:11:31.892 INFO:tasks.workunit.client.0.smithi038.stdout:1/585: mkdir d15/d1e/d3b/d48/d3d/dc8 0 2023-12-16T20:11:31.893 INFO:tasks.workunit.client.1.smithi141.stdout:1/221: link da/l35 da/l44 0 2023-12-16T20:11:31.894 INFO:tasks.workunit.client.1.smithi141.stdout:0/268: write d4/d7/f50 [2016129,105043] 0 2023-12-16T20:11:31.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/586: mkdir d15/d1e/d23/d7d/daa/dc9 0 2023-12-16T20:11:31.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/587: creat d15/d1e/d23/d34/d79/fca x:0 0 0 2023-12-16T20:11:31.896 INFO:tasks.workunit.client.1.smithi141.stdout:9/209: creat d1/d26/f4d x:0 0 0 2023-12-16T20:11:31.896 INFO:tasks.workunit.client.1.smithi141.stdout:9/210: truncate d1/d10/d14/d20/da/f41 4379968 0 2023-12-16T20:11:31.897 INFO:tasks.workunit.client.0.smithi038.stdout:1/588: rmdir d15/d1e/d23/d7d/daa 39 2023-12-16T20:11:31.897 INFO:tasks.workunit.client.0.smithi038.stdout:0/568: dwrite f3 [0,4194304] 0 2023-12-16T20:11:31.897 INFO:tasks.workunit.client.0.smithi038.stdout:0/569: chown db/f5b 15139335 1 2023-12-16T20:11:31.897 INFO:tasks.workunit.client.0.smithi038.stdout:1/589: creat d15/d22/fcb x:0 0 0 2023-12-16T20:11:31.898 INFO:tasks.workunit.client.0.smithi038.stdout:1/590: stat d15/cad 0 2023-12-16T20:11:31.898 INFO:tasks.workunit.client.1.smithi141.stdout:1/222: rmdir da/d1a/d1d/d22 39 2023-12-16T20:11:31.902 INFO:tasks.workunit.client.0.smithi038.stdout:1/591: creat d15/d1e/d3b/fcc x:0 0 0 2023-12-16T20:11:31.902 INFO:tasks.workunit.client.0.smithi038.stdout:1/592: chown d15/d22/d71 168865010 1 2023-12-16T20:11:31.902 INFO:tasks.workunit.client.1.smithi141.stdout:9/211: rmdir d1/d10/d27/d36 39 2023-12-16T20:11:31.903 INFO:tasks.workunit.client.0.smithi038.stdout:5/599: dwrite d2/d14/d25/f5b [0,4194304] 0 2023-12-16T20:11:31.904 INFO:tasks.workunit.client.1.smithi141.stdout:1/223: fdatasync da/d1a/d1d/d22/d29/f3e 0 2023-12-16T20:11:31.904 INFO:tasks.workunit.client.1.smithi141.stdout:1/224: stat da/d36/l3c 0 2023-12-16T20:11:31.904 INFO:tasks.workunit.client.1.smithi141.stdout:1/225: getdents da/d1a/d31 0 2023-12-16T20:11:31.907 INFO:tasks.workunit.client.0.smithi038.stdout:1/593: read d15/d1e/d30/fac [508834,15436] 0 2023-12-16T20:11:31.908 INFO:tasks.workunit.client.1.smithi141.stdout:1/226: truncate da/d1a/f42 1339768 0 2023-12-16T20:11:31.910 INFO:tasks.workunit.client.0.smithi038.stdout:5/600: link d2/d14/f5a d2/fba 0 2023-12-16T20:11:31.910 INFO:tasks.workunit.client.0.smithi038.stdout:5/601: creat d2/d14/d25/d2d/d17/d55/fbb x:0 0 0 2023-12-16T20:11:31.912 INFO:tasks.workunit.client.0.smithi038.stdout:6/511: dwrite d1/d4/f62 [0,4194304] 0 2023-12-16T20:11:31.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/512: creat d1/d16/d23/fa1 x:0 0 0 2023-12-16T20:11:31.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/513: stat d1/f45 0 2023-12-16T20:11:31.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/514: fsync d1/d4/f7c 0 2023-12-16T20:11:31.913 INFO:tasks.workunit.client.0.smithi038.stdout:1/594: unlink d15/l70 0 2023-12-16T20:11:31.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/602: dread d2/df/d1a/d2a/f75 [0,4194304] 0 2023-12-16T20:11:31.919 INFO:tasks.workunit.client.0.smithi038.stdout:5/603: stat d2/df/d1a/d2a/f50 0 2023-12-16T20:11:31.921 INFO:tasks.workunit.client.0.smithi038.stdout:3/544: dwrite d4/d18/f8b [0,4194304] 0 2023-12-16T20:11:31.926 INFO:tasks.workunit.client.0.smithi038.stdout:9/639: dwrite d9/d1f/d6a/f77 [0,4194304] 0 2023-12-16T20:11:31.926 INFO:tasks.workunit.client.0.smithi038.stdout:1/595: dread d15/d1e/d3b/d48/f6f [0,4194304] 0 2023-12-16T20:11:31.929 INFO:tasks.workunit.client.0.smithi038.stdout:7/522: dwrite da/d21/d2c/d76/f89 [0,4194304] 0 2023-12-16T20:11:31.932 INFO:tasks.workunit.client.0.smithi038.stdout:5/604: dread d2/d14/d25/d2d/d17/d55/f57 [0,4194304] 0 2023-12-16T20:11:31.935 INFO:tasks.workunit.client.0.smithi038.stdout:2/618: dwrite d1/d5/d95/d61/dd4/d6a/d43/fb0 [0,4194304] 0 2023-12-16T20:11:31.935 INFO:tasks.workunit.client.0.smithi038.stdout:9/640: creat d9/d1e/d40/d5e/d71/fbf x:0 0 0 2023-12-16T20:11:31.935 INFO:tasks.workunit.client.0.smithi038.stdout:4/576: write d13/d17/d2e/d32/d70/fa3 [3141925,7691] 0 2023-12-16T20:11:31.943 INFO:tasks.workunit.client.0.smithi038.stdout:7/523: creat da/d24/faf x:0 0 0 2023-12-16T20:11:31.944 INFO:tasks.workunit.client.0.smithi038.stdout:2/619: write d1/d5/d95/d61/dd4/d21/f45 [2269358,97867] 0 2023-12-16T20:11:31.948 INFO:tasks.workunit.client.0.smithi038.stdout:4/577: creat d13/d17/d4b/da4/d9d/db5/fbe x:0 0 0 2023-12-16T20:11:31.952 INFO:tasks.workunit.client.0.smithi038.stdout:7/524: rename da/d3e/f7c to da/d21/d86/fb0 0 2023-12-16T20:11:31.952 INFO:tasks.workunit.client.0.smithi038.stdout:7/525: chown da/d21/d61 31 1 2023-12-16T20:11:31.954 INFO:tasks.workunit.client.0.smithi038.stdout:2/620: mkdir d1/d5/d95/d61/dd4/d6a/d43/d57/dd6 0 2023-12-16T20:11:31.955 INFO:tasks.workunit.client.0.smithi038.stdout:2/621: truncate d1/d5/d95/d61/dd4/d6a/d43/d57/f5a 1134020 0 2023-12-16T20:11:31.955 INFO:tasks.workunit.client.0.smithi038.stdout:2/622: write d1/d5/d6c/d9f/fc1 [19556,64283] 0 2023-12-16T20:11:31.956 INFO:tasks.workunit.client.0.smithi038.stdout:4/578: symlink d13/d1f/db7/db9/lbf 0 2023-12-16T20:11:31.957 INFO:tasks.workunit.client.1.smithi141.stdout:0/269: dwrite d4/d49/f5a [0,4194304] 0 2023-12-16T20:11:31.957 INFO:tasks.workunit.client.1.smithi141.stdout:9/212: dwrite d1/d10/d14/f25 [4194304,4194304] 0 2023-12-16T20:11:31.957 INFO:tasks.workunit.client.1.smithi141.stdout:9/213: write d1/d10/d14/d20/d3b/f46 [1018904,82708] 0 2023-12-16T20:11:31.957 INFO:tasks.workunit.client.0.smithi038.stdout:7/526: creat da/d3e/d31/d38/d90/fb1 x:0 0 0 2023-12-16T20:11:31.958 INFO:tasks.workunit.client.0.smithi038.stdout:4/579: getdents d13/d1f 0 2023-12-16T20:11:31.960 INFO:tasks.workunit.client.1.smithi141.stdout:9/214: write d1/d10/d14/d20/d3b/f46 [475213,86428] 0 2023-12-16T20:11:31.960 INFO:tasks.workunit.client.0.smithi038.stdout:7/527: unlink da/d3e/d31/d38/f62 0 2023-12-16T20:11:31.971 INFO:tasks.workunit.client.0.smithi038.stdout:6/515: dwrite d1/d16/d23/fa1 [0,4194304] 0 2023-12-16T20:11:31.973 INFO:tasks.workunit.client.0.smithi038.stdout:1/596: rmdir d15/d1e/d23/d34/d79 39 2023-12-16T20:11:31.973 INFO:tasks.workunit.client.0.smithi038.stdout:1/597: creat d15/d1e/d23/d34/fcd x:0 0 0 2023-12-16T20:11:31.973 INFO:tasks.workunit.client.0.smithi038.stdout:1/598: write d15/d1e/d23/d46/f72 [902399,24572] 0 2023-12-16T20:11:31.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/227: dwrite da/f2c [0,4194304] 0 2023-12-16T20:11:31.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/228: write da/d1a/d1d/d22/d29/f37 [813922,82725] 0 2023-12-16T20:11:31.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/229: fdatasync da/df/f1b 0 2023-12-16T20:11:31.977 INFO:tasks.workunit.client.0.smithi038.stdout:0/570: dwrite db/d16/d1c/fae [0,4194304] 0 2023-12-16T20:11:31.979 INFO:tasks.workunit.client.0.smithi038.stdout:6/516: mkdir d1/d4/d1d/d28/d2f/d85/da2 0 2023-12-16T20:11:31.979 INFO:tasks.workunit.client.0.smithi038.stdout:6/517: fsync d1/d5b/f99 0 2023-12-16T20:11:31.981 INFO:tasks.workunit.client.1.smithi141.stdout:1/230: dread da/df/f1b [0,4194304] 0 2023-12-16T20:11:31.981 INFO:tasks.workunit.client.1.smithi141.stdout:1/231: readlink da/l19 0 2023-12-16T20:11:31.981 INFO:tasks.workunit.client.1.smithi141.stdout:1/232: write da/df/f1b [468495,102369] 0 2023-12-16T20:11:31.982 INFO:tasks.workunit.client.0.smithi038.stdout:1/599: creat d15/d22/d62/fce x:0 0 0 2023-12-16T20:11:31.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/605: dwrite d2/df/d1a/d2a/f6c [0,4194304] 0 2023-12-16T20:11:31.983 INFO:tasks.workunit.client.1.smithi141.stdout:1/233: creat da/d1a/f45 x:0 0 0 2023-12-16T20:11:31.983 INFO:tasks.workunit.client.1.smithi141.stdout:1/234: rename da to da/d1a/d1d/d22/d29/d46 22 2023-12-16T20:11:31.984 INFO:tasks.workunit.client.0.smithi038.stdout:3/545: dwrite d4/f6 [4194304,4194304] 0 2023-12-16T20:11:31.984 INFO:tasks.workunit.client.0.smithi038.stdout:3/546: readlink d4/d8/d15/d6d/l73 0 2023-12-16T20:11:31.984 INFO:tasks.workunit.client.0.smithi038.stdout:3/547: dread - d4/d27/d23/f57 zero size 2023-12-16T20:11:31.984 INFO:tasks.workunit.client.0.smithi038.stdout:3/548: chown d4/d6c/d80/fb3 7328 1 2023-12-16T20:11:31.984 INFO:tasks.workunit.client.1.smithi141.stdout:1/235: getdents da/d36 0 2023-12-16T20:11:31.985 INFO:tasks.workunit.client.1.smithi141.stdout:1/236: creat da/d1a/d31/f47 x:0 0 0 2023-12-16T20:11:31.985 INFO:tasks.workunit.client.1.smithi141.stdout:1/237: creat da/d1a/d1d/d33/f48 x:0 0 0 2023-12-16T20:11:31.986 INFO:tasks.workunit.client.0.smithi038.stdout:0/571: creat db/d16/d5a/d65/d90/da7/fc1 x:0 0 0 2023-12-16T20:11:31.986 INFO:tasks.workunit.client.0.smithi038.stdout:0/572: getdents db/db6 0 2023-12-16T20:11:31.987 INFO:tasks.workunit.client.0.smithi038.stdout:6/518: mknod d1/d4/d1d/d67/ca3 0 2023-12-16T20:11:31.988 INFO:tasks.workunit.client.0.smithi038.stdout:5/606: getdents d2/df/d1a/d1f/d4a/d53/d6e/d9e 0 2023-12-16T20:11:31.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/528: dread da/d21/d2c/d76/f89 [0,4194304] 0 2023-12-16T20:11:31.989 INFO:tasks.workunit.client.0.smithi038.stdout:3/549: symlink d4/d8/d15/d6d/d7a/daf/lbf 0 2023-12-16T20:11:31.991 INFO:tasks.workunit.client.0.smithi038.stdout:3/550: write d4/d27/d40/f5f [39548,27147] 0 2023-12-16T20:11:31.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/573: rename db/d16/d19/c28 to db/d16/d1c/d5d/d64/cc2 0 2023-12-16T20:11:31.993 INFO:tasks.workunit.client.0.smithi038.stdout:1/600: mkdir d15/d1e/d23/d42/dcf 0 2023-12-16T20:11:31.994 INFO:tasks.workunit.client.0.smithi038.stdout:6/519: write d1/d4/d1d/f59 [3088500,39021] 0 2023-12-16T20:11:31.995 INFO:tasks.workunit.client.0.smithi038.stdout:5/607: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d9e/dbc 0 2023-12-16T20:11:31.995 INFO:tasks.workunit.client.0.smithi038.stdout:5/608: creat d2/d14/d25/fbd x:0 0 0 2023-12-16T20:11:31.995 INFO:tasks.workunit.client.0.smithi038.stdout:6/520: write d1/f8f [584841,92696] 0 2023-12-16T20:11:31.995 INFO:tasks.workunit.client.0.smithi038.stdout:6/521: chown d1/d4/d1d/c9b 2063347485 1 2023-12-16T20:11:31.996 INFO:tasks.workunit.client.0.smithi038.stdout:3/551: mknod d4/d27/cc0 0 2023-12-16T20:11:31.999 INFO:tasks.workunit.client.0.smithi038.stdout:0/574: creat db/fc3 x:0 0 0 2023-12-16T20:11:32.001 INFO:tasks.workunit.client.0.smithi038.stdout:1/601: symlink d15/d1e/d23/d34/d86/d99/ld0 0 2023-12-16T20:11:32.001 INFO:tasks.workunit.client.0.smithi038.stdout:1/602: fdatasync d15/d1e/d23/d7d/f9b 0 2023-12-16T20:11:32.001 INFO:tasks.workunit.client.1.smithi141.stdout:1/238: dread da/f12 [0,4194304] 0 2023-12-16T20:11:32.001 INFO:tasks.workunit.client.1.smithi141.stdout:1/239: creat da/d1a/d31/f49 x:0 0 0 2023-12-16T20:11:32.002 INFO:tasks.workunit.client.1.smithi141.stdout:0/270: dwrite d4/d7/fd [0,4194304] 0 2023-12-16T20:11:32.006 INFO:tasks.workunit.client.1.smithi141.stdout:1/240: link da/d1a/c1f da/d25/c4a 0 2023-12-16T20:11:32.007 INFO:tasks.workunit.client.1.smithi141.stdout:5/158: sync 2023-12-16T20:11:32.008 INFO:tasks.workunit.client.1.smithi141.stdout:3/302: sync 2023-12-16T20:11:32.010 INFO:tasks.workunit.client.1.smithi141.stdout:9/215: dwrite d1/d10/d33/f44 [0,4194304] 0 2023-12-16T20:11:32.011 INFO:tasks.workunit.client.1.smithi141.stdout:3/303: getdents d0/d1c/d2c 0 2023-12-16T20:11:32.014 INFO:tasks.workunit.client.1.smithi141.stdout:9/216: creat d1/d10/d14/d20/da/de/f4e x:0 0 0 2023-12-16T20:11:32.014 INFO:tasks.workunit.client.0.smithi038.stdout:6/522: rename d1/d5b/d7d/d96 to d1/d4/d1d/d61/da4 0 2023-12-16T20:11:32.014 INFO:tasks.workunit.client.0.smithi038.stdout:0/575: symlink db/d1a/d77/lc4 0 2023-12-16T20:11:32.014 INFO:tasks.workunit.client.1.smithi141.stdout:3/304: dread d0/d1c/d2c/f48 [0,4194304] 0 2023-12-16T20:11:32.015 INFO:tasks.workunit.client.0.smithi038.stdout:1/603: symlink d15/d1e/d3b/ld1 0 2023-12-16T20:11:32.016 INFO:tasks.workunit.client.0.smithi038.stdout:1/604: write d15/d22/fb8 [1002664,111227] 0 2023-12-16T20:11:32.016 INFO:tasks.workunit.client.0.smithi038.stdout:4/580: dwrite d13/d69/fbc [0,4194304] 0 2023-12-16T20:11:32.017 INFO:tasks.workunit.client.1.smithi141.stdout:3/305: creat d0/f68 x:0 0 0 2023-12-16T20:11:32.018 INFO:tasks.workunit.client.1.smithi141.stdout:3/306: creat d0/d1c/d40/f69 x:0 0 0 2023-12-16T20:11:32.020 INFO:tasks.workunit.client.1.smithi141.stdout:1/241: dread da/d36/f3f [0,4194304] 0 2023-12-16T20:11:32.021 INFO:tasks.workunit.client.0.smithi038.stdout:6/523: mkdir d1/d4/d1d/d28/d2f/d85/da2/da5 0 2023-12-16T20:11:32.022 INFO:tasks.workunit.client.1.smithi141.stdout:3/307: mkdir d0/d1c/d6a 0 2023-12-16T20:11:32.022 INFO:tasks.workunit.client.0.smithi038.stdout:0/576: mkdir db/d16/d5a/dc5 0 2023-12-16T20:11:32.023 INFO:tasks.workunit.client.1.smithi141.stdout:1/242: mkdir da/d36/d4b 0 2023-12-16T20:11:32.023 INFO:tasks.workunit.client.0.smithi038.stdout:1/605: symlink d15/d22/d7b/ld2 0 2023-12-16T20:11:32.024 INFO:tasks.workunit.client.1.smithi141.stdout:3/308: symlink d0/d1c/d40/d3c/d4b/l6b 0 2023-12-16T20:11:32.025 INFO:tasks.workunit.client.1.smithi141.stdout:1/243: creat da/df/f4c x:0 0 0 2023-12-16T20:11:32.026 INFO:tasks.workunit.client.0.smithi038.stdout:7/529: dwrite da/d21/d2c/d76/f89 [0,4194304] 0 2023-12-16T20:11:32.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/581: truncate d13/d17/d2e/d32/d4e/f64 2363498 0 2023-12-16T20:11:32.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/577: mknod db/d16/d19/d80/cc6 0 2023-12-16T20:11:32.029 INFO:tasks.workunit.client.0.smithi038.stdout:0/578: truncate db/d1a/d77/d95/da4/fbe 971568 0 2023-12-16T20:11:32.029 INFO:tasks.workunit.client.0.smithi038.stdout:3/552: dwrite d4/d8/d15/d2c/d4c/d70/fa4 [0,4194304] 0 2023-12-16T20:11:32.029 INFO:tasks.workunit.client.0.smithi038.stdout:3/553: dread - d4/d27/d23/f57 zero size 2023-12-16T20:11:32.029 INFO:tasks.workunit.client.0.smithi038.stdout:3/554: fsync d4/d6c/d80/f83 0 2023-12-16T20:11:32.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/606: link d15/d1e/d23/d46/f72 d15/d1e/d3b/d48/d3d/fd3 0 2023-12-16T20:11:32.030 INFO:tasks.workunit.client.0.smithi038.stdout:1/607: fdatasync d15/d1e/d23/d34/d79/f83 0 2023-12-16T20:11:32.030 INFO:tasks.workunit.client.1.smithi141.stdout:1/244: mkdir da/d36/d4b/d4d 0 2023-12-16T20:11:32.034 INFO:tasks.workunit.client.0.smithi038.stdout:6/524: dread d1/f45 [0,4194304] 0 2023-12-16T20:11:32.034 INFO:tasks.workunit.client.0.smithi038.stdout:6/525: read - d1/d4/f9c zero size 2023-12-16T20:11:32.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/555: mknod d4/d27/d2b/da0/cc1 0 2023-12-16T20:11:32.034 INFO:tasks.workunit.client.0.smithi038.stdout:1/608: symlink d15/d1e/d23/d34/d86/d99/ld4 0 2023-12-16T20:11:32.035 INFO:tasks.workunit.client.0.smithi038.stdout:5/609: dwrite d2/d14/d25/f3f [0,4194304] 0 2023-12-16T20:11:32.036 INFO:tasks.workunit.client.0.smithi038.stdout:7/530: getdents da/d3e/d31 0 2023-12-16T20:11:32.042 INFO:tasks.workunit.client.0.smithi038.stdout:3/556: symlink d4/d6c/d80/lc2 0 2023-12-16T20:11:32.042 INFO:tasks.workunit.client.0.smithi038.stdout:3/557: truncate d4/d6c/d80/fa3 424043 0 2023-12-16T20:11:32.044 INFO:tasks.workunit.client.1.smithi141.stdout:0/271: dwrite d4/f16 [0,4194304] 0 2023-12-16T20:11:32.045 INFO:tasks.workunit.client.0.smithi038.stdout:1/609: symlink d15/d1e/d3b/d5a/ld5 0 2023-12-16T20:11:32.045 INFO:tasks.workunit.client.0.smithi038.stdout:1/610: truncate d15/d1e/d23/d34/f9d 871383 0 2023-12-16T20:11:32.045 INFO:tasks.workunit.client.1.smithi141.stdout:5/159: dwrite d0/df/f1d [0,4194304] 0 2023-12-16T20:11:32.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/272: symlink d4/d3a/l63 0 2023-12-16T20:11:32.047 INFO:tasks.workunit.client.0.smithi038.stdout:6/526: dread d1/d16/d23/f57 [0,4194304] 0 2023-12-16T20:11:32.048 INFO:tasks.workunit.client.0.smithi038.stdout:3/558: symlink d4/d8/d15/lc3 0 2023-12-16T20:11:32.051 INFO:tasks.workunit.client.1.smithi141.stdout:0/273: symlink d4/d3a/d3b/l64 0 2023-12-16T20:11:32.051 INFO:tasks.workunit.client.1.smithi141.stdout:0/274: symlink d4/d5c/l65 0 2023-12-16T20:11:32.052 INFO:tasks.workunit.client.1.smithi141.stdout:0/275: creat d4/d49/d4b/f66 x:0 0 0 2023-12-16T20:11:32.053 INFO:tasks.workunit.client.1.smithi141.stdout:0/276: link d4/d49/f52 d4/d3a/d3b/f67 0 2023-12-16T20:11:32.053 INFO:tasks.workunit.client.1.smithi141.stdout:0/277: dread - d4/d3a/d3b/f59 zero size 2023-12-16T20:11:32.054 INFO:tasks.workunit.client.1.smithi141.stdout:0/278: creat d4/d5c/f68 x:0 0 0 2023-12-16T20:11:32.055 INFO:tasks.workunit.client.1.smithi141.stdout:0/279: chown d4/d7/l54 546961 1 2023-12-16T20:11:32.055 INFO:tasks.workunit.client.1.smithi141.stdout:3/309: dwrite d0/f65 [0,4194304] 0 2023-12-16T20:11:32.056 INFO:tasks.workunit.client.1.smithi141.stdout:0/280: symlink d4/d49/l69 0 2023-12-16T20:11:32.057 INFO:tasks.workunit.client.1.smithi141.stdout:1/245: dwrite da/d25/f26 [0,4194304] 0 2023-12-16T20:11:32.057 INFO:tasks.workunit.client.1.smithi141.stdout:1/246: creat da/d1a/d1d/d33/f4e x:0 0 0 2023-12-16T20:11:32.057 INFO:tasks.workunit.client.1.smithi141.stdout:1/247: getdents da/d1a/d1d 0 2023-12-16T20:11:32.057 INFO:tasks.workunit.client.1.smithi141.stdout:1/248: write da/d1a/d1d/d33/f43 [905792,24901] 0 2023-12-16T20:11:32.058 INFO:tasks.workunit.client.1.smithi141.stdout:3/310: creat d0/d1c/d40/d3f/d52/d5a/f6c x:0 0 0 2023-12-16T20:11:32.058 INFO:tasks.workunit.client.0.smithi038.stdout:3/559: mkdir d4/dc4 0 2023-12-16T20:11:32.058 INFO:tasks.workunit.client.0.smithi038.stdout:6/527: dread d1/f22 [0,4194304] 0 2023-12-16T20:11:32.060 INFO:tasks.workunit.client.0.smithi038.stdout:1/611: rename d15/d1e/d3b/d48/fb6 to d15/d1e/d3b/d48/d37/fd6 0 2023-12-16T20:11:32.060 INFO:tasks.workunit.client.0.smithi038.stdout:1/612: creat d15/d1e/d23/d34/d86/d9a/fd7 x:0 0 0 2023-12-16T20:11:32.063 INFO:tasks.workunit.client.1.smithi141.stdout:3/311: rename d0/d1c/d40/l50 to d0/d1c/d40/d3f/d52/d5a/l6d 0 2023-12-16T20:11:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:1/613: read d15/d22/d62/fa6 [333404,99179] 0 2023-12-16T20:11:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:6/528: creat d1/d4/d1d/d67/fa6 x:0 0 0 2023-12-16T20:11:32.067 INFO:tasks.workunit.client.0.smithi038.stdout:4/582: truncate d13/d17/d4b/f43 851108 0 2023-12-16T20:11:32.067 INFO:tasks.workunit.client.1.smithi141.stdout:5/160: write d0/df/f1d [780379,109521] 0 2023-12-16T20:11:32.069 INFO:tasks.workunit.client.1.smithi141.stdout:5/161: chown d0/d9/d16 6 1 2023-12-16T20:11:32.073 INFO:tasks.workunit.client.0.smithi038.stdout:0/579: dwrite db/d16/d70/f55 [4194304,4194304] 0 2023-12-16T20:11:32.074 INFO:tasks.workunit.client.0.smithi038.stdout:0/580: stat db/d16/d1c/d5d/f8d 0 2023-12-16T20:11:32.074 INFO:tasks.workunit.client.1.smithi141.stdout:0/281: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:32.076 INFO:tasks.workunit.client.1.smithi141.stdout:0/282: mknod d4/d49/d4b/c6a 0 2023-12-16T20:11:32.076 INFO:tasks.workunit.client.0.smithi038.stdout:1/614: creat d15/d1e/d23/d42/fd8 x:0 0 0 2023-12-16T20:11:32.076 INFO:tasks.workunit.client.0.smithi038.stdout:1/615: truncate d15/d1e/d23/d42/fd8 45863 0 2023-12-16T20:11:32.076 INFO:tasks.workunit.client.0.smithi038.stdout:1/616: chown d15/d1e/d23/d42/d75/dbc 495128 1 2023-12-16T20:11:32.076 INFO:tasks.workunit.client.0.smithi038.stdout:1/617: dread - d15/d1e/d23/d34/fbe zero size 2023-12-16T20:11:32.078 INFO:tasks.workunit.client.1.smithi141.stdout:0/283: mknod d4/d3a/c6b 0 2023-12-16T20:11:32.084 INFO:tasks.workunit.client.1.smithi141.stdout:5/162: dread d0/df/f1d [0,4194304] 0 2023-12-16T20:11:32.084 INFO:tasks.workunit.client.1.smithi141.stdout:1/249: dwrite da/df/f27 [0,4194304] 0 2023-12-16T20:11:32.087 INFO:tasks.workunit.client.1.smithi141.stdout:5/163: mkdir d0/d14/d2c 0 2023-12-16T20:11:32.089 INFO:tasks.workunit.client.1.smithi141.stdout:5/164: getdents d0/d9/d16 0 2023-12-16T20:11:32.090 INFO:tasks.workunit.client.1.smithi141.stdout:0/284: dread d4/f16 [0,4194304] 0 2023-12-16T20:11:32.091 INFO:tasks.workunit.client.1.smithi141.stdout:5/165: creat d0/d9/d16/f2d x:0 0 0 2023-12-16T20:11:32.092 INFO:tasks.workunit.client.1.smithi141.stdout:0/285: rename d4/d7/d44/l51 to d4/d5c/l6c 0 2023-12-16T20:11:32.094 INFO:tasks.workunit.client.1.smithi141.stdout:0/286: truncate d4/d49/f5a 1186861 0 2023-12-16T20:11:32.094 INFO:tasks.workunit.client.1.smithi141.stdout:0/287: fdatasync d4/d3a/d3b/f59 0 2023-12-16T20:11:32.095 INFO:tasks.workunit.client.0.smithi038.stdout:0/581: rename db/d1a/l6f to db/d16/da6/lc7 0 2023-12-16T20:11:32.096 INFO:tasks.workunit.client.0.smithi038.stdout:1/618: mknod d15/d1e/cd9 0 2023-12-16T20:11:32.098 INFO:tasks.workunit.client.0.smithi038.stdout:0/582: link db/d1a/d77/c8e db/d16/d1c/d5d/d64/cc8 0 2023-12-16T20:11:32.098 INFO:tasks.workunit.client.0.smithi038.stdout:0/583: readlink db/d16/d1c/d5d/d64/la3 0 2023-12-16T20:11:32.098 INFO:tasks.workunit.client.1.smithi141.stdout:0/288: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:32.098 INFO:tasks.workunit.client.1.smithi141.stdout:0/289: chown d4/d5c 146 1 2023-12-16T20:11:32.099 INFO:tasks.workunit.client.0.smithi038.stdout:1/619: mknod d15/d22/d62/cda 0 2023-12-16T20:11:32.100 INFO:tasks.workunit.client.0.smithi038.stdout:3/560: dwrite d4/f4a [0,4194304] 0 2023-12-16T20:11:32.101 INFO:tasks.workunit.client.0.smithi038.stdout:0/584: unlink db/l47 0 2023-12-16T20:11:32.102 INFO:tasks.workunit.client.0.smithi038.stdout:3/561: dread d4/d6c/fa6 [0,4194304] 0 2023-12-16T20:11:32.103 INFO:tasks.workunit.client.0.smithi038.stdout:1/620: link d15/d1e/d3b/ld1 d15/d22/d7b/ldb 0 2023-12-16T20:11:32.109 INFO:tasks.workunit.client.1.smithi141.stdout:2/153: sync 2023-12-16T20:11:32.109 INFO:tasks.workunit.client.1.smithi141.stdout:2/154: readlink d6/l8 0 2023-12-16T20:11:32.109 INFO:tasks.workunit.client.1.smithi141.stdout:7/161: sync 2023-12-16T20:11:32.109 INFO:tasks.workunit.client.1.smithi141.stdout:4/255: sync 2023-12-16T20:11:32.110 INFO:tasks.workunit.client.1.smithi141.stdout:6/315: sync 2023-12-16T20:11:32.110 INFO:tasks.workunit.client.1.smithi141.stdout:6/316: fsync d1/d12/d22/d25/f55 0 2023-12-16T20:11:32.110 INFO:tasks.workunit.client.1.smithi141.stdout:3/312: dwrite d0/d1c/d40/f45 [0,4194304] 0 2023-12-16T20:11:32.112 INFO:tasks.workunit.client.0.smithi038.stdout:3/562: dread d4/d27/d23/d26/f68 [0,4194304] 0 2023-12-16T20:11:32.112 INFO:tasks.workunit.client.0.smithi038.stdout:3/563: chown d4/d8/d15/c55 33654 1 2023-12-16T20:11:32.112 INFO:tasks.workunit.client.1.smithi141.stdout:2/155: creat d6/d32/f34 x:0 0 0 2023-12-16T20:11:32.112 INFO:tasks.workunit.client.1.smithi141.stdout:2/156: creat d6/da/f35 x:0 0 0 2023-12-16T20:11:32.113 INFO:tasks.workunit.client.0.smithi038.stdout:6/529: dwrite d1/d4/f1c [4194304,4194304] 0 2023-12-16T20:11:32.113 INFO:tasks.workunit.client.1.smithi141.stdout:7/162: creat d5/d16/d30/f32 x:0 0 0 2023-12-16T20:11:32.114 INFO:tasks.workunit.client.1.smithi141.stdout:7/163: readlink l2 0 2023-12-16T20:11:32.114 INFO:tasks.workunit.client.1.smithi141.stdout:7/164: chown d5/f24 2 1 2023-12-16T20:11:32.116 INFO:tasks.workunit.client.1.smithi141.stdout:6/317: creat d1/d12/d20/f6a x:0 0 0 2023-12-16T20:11:32.117 INFO:tasks.workunit.client.0.smithi038.stdout:3/564: creat d4/d8/d15/d6d/d7a/daf/fc5 x:0 0 0 2023-12-16T20:11:32.118 INFO:tasks.workunit.client.0.smithi038.stdout:3/565: stat d4/d27/d2b/da0/cc1 0 2023-12-16T20:11:32.121 INFO:tasks.workunit.client.1.smithi141.stdout:1/250: dwrite da/d36/f3f [0,4194304] 0 2023-12-16T20:11:32.127 INFO:tasks.workunit.client.0.smithi038.stdout:3/566: link d4/d6c/d80/lc2 d4/d8/d15/d2c/d4c/lc6 0 2023-12-16T20:11:32.128 INFO:tasks.workunit.client.0.smithi038.stdout:0/585: dwrite db/d1a/f7b [0,4194304] 0 2023-12-16T20:11:32.129 INFO:tasks.workunit.client.1.smithi141.stdout:7/165: stat l2 0 2023-12-16T20:11:32.130 INFO:tasks.workunit.client.0.smithi038.stdout:0/586: mknod db/d16/d5a/d65/d90/cc9 0 2023-12-16T20:11:32.130 INFO:tasks.workunit.client.0.smithi038.stdout:0/587: fdatasync db/d16/d19/d27/d56/f87 0 2023-12-16T20:11:32.130 INFO:tasks.workunit.client.0.smithi038.stdout:0/588: fsync db/d16/d1c/f24 0 2023-12-16T20:11:32.130 INFO:tasks.workunit.client.0.smithi038.stdout:1/621: dwrite d15/d1e/d3b/d48/d37/fd6 [0,4194304] 0 2023-12-16T20:11:32.131 INFO:tasks.workunit.client.1.smithi141.stdout:6/318: rename d1/d12/d20/f3d to d1/d12/d20/d44/f6b 0 2023-12-16T20:11:32.131 INFO:tasks.workunit.client.0.smithi038.stdout:0/589: mkdir db/d16/d5a/d65/d90/dca 0 2023-12-16T20:11:32.132 INFO:tasks.workunit.client.1.smithi141.stdout:1/251: unlink da/d1a/c1f 0 2023-12-16T20:11:32.134 INFO:tasks.workunit.client.1.smithi141.stdout:7/166: symlink d5/d16/l33 0 2023-12-16T20:11:32.134 INFO:tasks.workunit.client.1.smithi141.stdout:7/167: creat d5/d2a/f34 x:0 0 0 2023-12-16T20:11:32.134 INFO:tasks.workunit.client.1.smithi141.stdout:7/168: fsync d5/f28 0 2023-12-16T20:11:32.134 INFO:tasks.workunit.client.1.smithi141.stdout:7/169: chown d5/f22 1365263 1 2023-12-16T20:11:32.134 INFO:tasks.workunit.client.1.smithi141.stdout:7/170: dread d5/f22 [0,4194304] 0 2023-12-16T20:11:32.135 INFO:tasks.workunit.client.1.smithi141.stdout:7/171: dread - d5/d16/d1a/f1f zero size 2023-12-16T20:11:32.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/313: dwrite d0/d1c/d40/d3f/d52/f59 [0,4194304] 0 2023-12-16T20:11:32.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/314: creat d0/d1c/f6e x:0 0 0 2023-12-16T20:11:32.136 INFO:tasks.workunit.client.0.smithi038.stdout:1/622: link d15/f19 d15/d1e/d23/da2/fdc 0 2023-12-16T20:11:32.136 INFO:tasks.workunit.client.0.smithi038.stdout:1/623: write d15/d1e/d30/fac [426583,27889] 0 2023-12-16T20:11:32.137 INFO:tasks.workunit.client.1.smithi141.stdout:1/252: rename da/d1a/d1d/d33/f48 to da/d1a/d1d/f4f 0 2023-12-16T20:11:32.138 INFO:tasks.workunit.client.0.smithi038.stdout:3/567: dread d4/d27/d40/f7f [0,4194304] 0 2023-12-16T20:11:32.138 INFO:tasks.workunit.client.1.smithi141.stdout:2/157: dwrite d6/f1d [0,4194304] 0 2023-12-16T20:11:32.139 INFO:tasks.workunit.client.0.smithi038.stdout:0/590: unlink db/d16/d1c/d5d/l60 0 2023-12-16T20:11:32.139 INFO:tasks.workunit.client.0.smithi038.stdout:0/591: read - db/d1a/fb4 zero size 2023-12-16T20:11:32.140 INFO:tasks.workunit.client.1.smithi141.stdout:7/172: mkdir d5/d1d/d1e/d35 0 2023-12-16T20:11:32.142 INFO:tasks.workunit.client.1.smithi141.stdout:3/315: mkdir d0/d1c/d40/d3c/d6f 0 2023-12-16T20:11:32.142 INFO:tasks.workunit.client.1.smithi141.stdout:3/316: write d0/d1c/d40/f1b [279659,97671] 0 2023-12-16T20:11:32.143 INFO:tasks.workunit.client.1.smithi141.stdout:0/290: rmdir d4/d49 39 2023-12-16T20:11:32.143 INFO:tasks.workunit.client.1.smithi141.stdout:0/291: chown f1 11 1 2023-12-16T20:11:32.144 INFO:tasks.workunit.client.0.smithi038.stdout:3/568: mkdir d4/d8/dc7 0 2023-12-16T20:11:32.144 INFO:tasks.workunit.client.0.smithi038.stdout:3/569: chown d4/d8/d15/d2c/d4c/d70/d71 8279 1 2023-12-16T20:11:32.145 INFO:tasks.workunit.client.1.smithi141.stdout:1/253: unlink da/d1a/d1d/d33/l3b 0 2023-12-16T20:11:32.145 INFO:tasks.workunit.client.1.smithi141.stdout:1/254: readlink da/df/l11 0 2023-12-16T20:11:32.145 INFO:tasks.workunit.client.1.smithi141.stdout:1/255: write da/d1a/d1d/d22/f30 [795090,65529] 0 2023-12-16T20:11:32.147 INFO:tasks.workunit.client.1.smithi141.stdout:2/158: rename d6/d12/d15/f31 to d6/d12/d1f/f36 0 2023-12-16T20:11:32.147 INFO:tasks.workunit.client.0.smithi038.stdout:0/592: mkdir db/d16/d19/d4e/dcb 0 2023-12-16T20:11:32.148 INFO:tasks.workunit.client.1.smithi141.stdout:7/173: mkdir d5/d16/d30/d36 0 2023-12-16T20:11:32.148 INFO:tasks.workunit.client.1.smithi141.stdout:7/174: stat d5/f13 0 2023-12-16T20:11:32.148 INFO:tasks.workunit.client.1.smithi141.stdout:7/175: creat d5/d2a/f37 x:0 0 0 2023-12-16T20:11:32.148 INFO:tasks.workunit.client.1.smithi141.stdout:7/176: fdatasync d5/d16/f17 0 2023-12-16T20:11:32.149 INFO:tasks.workunit.client.1.smithi141.stdout:3/317: truncate d0/f37 1067626 0 2023-12-16T20:11:32.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/624: symlink d15/ldd 0 2023-12-16T20:11:32.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/625: fsync d15/d1e/d23/d34/d79/fca 0 2023-12-16T20:11:32.155 INFO:tasks.workunit.client.0.smithi038.stdout:8/438: sync 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/177: mkdir d5/d38 0 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/178: chown d5/l6 29510811 1 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/179: chown d5/d2a/f2c 4110474 1 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/180: fdatasync d5/d16/d1a/f25 0 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/181: getdents d5/d38 0 2023-12-16T20:11:32.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/182: fsync d5/f14 0 2023-12-16T20:11:32.158 INFO:tasks.workunit.client.0.smithi038.stdout:3/570: rmdir d4/d18/d8d 0 2023-12-16T20:11:32.159 INFO:tasks.workunit.client.1.smithi141.stdout:3/318: symlink d0/d1c/d2c/l70 0 2023-12-16T20:11:32.162 INFO:tasks.workunit.client.1.smithi141.stdout:6/319: getdents d1/d12/d20/d44 0 2023-12-16T20:11:32.162 INFO:tasks.workunit.client.0.smithi038.stdout:3/571: unlink d4/d8/d15/d2c/d4c/d58/l6b 0 2023-12-16T20:11:32.162 INFO:tasks.workunit.client.0.smithi038.stdout:3/572: fdatasync f1 0 2023-12-16T20:11:32.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/573: mkdir d4/d8/dc8 0 2023-12-16T20:11:32.166 INFO:tasks.workunit.client.1.smithi141.stdout:7/183: unlink d5/f10 0 2023-12-16T20:11:32.166 INFO:tasks.workunit.client.1.smithi141.stdout:7/184: chown d5/d16/d1a/f1f 12 1 2023-12-16T20:11:32.166 INFO:tasks.workunit.client.1.smithi141.stdout:7/185: write d5/f22 [1267676,101515] 0 2023-12-16T20:11:32.169 INFO:tasks.workunit.client.1.smithi141.stdout:3/319: unlink d0/l2a 0 2023-12-16T20:11:32.169 INFO:tasks.workunit.client.1.smithi141.stdout:3/320: creat d0/d1c/d40/d3f/d52/d5a/f71 x:0 0 0 2023-12-16T20:11:32.171 INFO:tasks.workunit.client.1.smithi141.stdout:6/320: link d1/d3/f10 d1/dd/d43/f6c 0 2023-12-16T20:11:32.172 INFO:tasks.workunit.client.1.smithi141.stdout:3/321: mkdir d0/d1c/d2c/d72 0 2023-12-16T20:11:32.173 INFO:tasks.workunit.client.0.smithi038.stdout:8/439: write d17/d1b/d25/f6b [4137436,99867] 0 2023-12-16T20:11:32.173 INFO:tasks.workunit.client.0.smithi038.stdout:8/440: fsync d17/d1b/d57/f65 0 2023-12-16T20:11:32.174 INFO:tasks.workunit.client.1.smithi141.stdout:1/256: dwrite da/df/f13 [0,4194304] 0 2023-12-16T20:11:32.174 INFO:tasks.workunit.client.1.smithi141.stdout:1/257: fdatasync da/df/f27 0 2023-12-16T20:11:32.175 INFO:tasks.workunit.client.1.smithi141.stdout:0/292: dwrite d4/f1c [0,4194304] 0 2023-12-16T20:11:32.175 INFO:tasks.workunit.client.1.smithi141.stdout:3/322: dread d0/d1c/d2c/f48 [0,4194304] 0 2023-12-16T20:11:32.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/441: creat d17/f89 x:0 0 0 2023-12-16T20:11:32.178 INFO:tasks.workunit.client.1.smithi141.stdout:6/321: link d1/d3/d4b/f66 d1/d12/d20/d3a/f6d 0 2023-12-16T20:11:32.178 INFO:tasks.workunit.client.1.smithi141.stdout:6/322: stat d1/d12/d22/f53 0 2023-12-16T20:11:32.179 INFO:tasks.workunit.client.0.smithi038.stdout:8/442: truncate f10 4495743 0 2023-12-16T20:11:32.180 INFO:tasks.workunit.client.1.smithi141.stdout:6/323: write d1/d12/d20/d44/f5b [44869,95478] 0 2023-12-16T20:11:32.180 INFO:tasks.workunit.client.1.smithi141.stdout:1/258: symlink da/l50 0 2023-12-16T20:11:32.181 INFO:tasks.workunit.client.1.smithi141.stdout:1/259: write da/d1a/d1d/d33/f4e [647807,92302] 0 2023-12-16T20:11:32.181 INFO:tasks.workunit.client.1.smithi141.stdout:1/260: write da/d1a/d1d/d22/d29/f2a [12069,99252] 0 2023-12-16T20:11:32.182 INFO:tasks.workunit.client.0.smithi038.stdout:8/443: link d17/f89 d17/d1b/d66/f8a 0 2023-12-16T20:11:32.182 INFO:tasks.workunit.client.0.smithi038.stdout:8/444: dread - d17/d1b/d66/d73/d4e/f88 zero size 2023-12-16T20:11:32.185 INFO:tasks.workunit.client.0.smithi038.stdout:1/626: dwrite f7 [0,4194304] 0 2023-12-16T20:11:32.187 INFO:tasks.workunit.client.1.smithi141.stdout:6/324: dread d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:32.187 INFO:tasks.workunit.client.1.smithi141.stdout:6/325: readlink d1/d12/d22/l40 0 2023-12-16T20:11:32.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/445: symlink d17/l8b 0 2023-12-16T20:11:32.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/446: dread - d17/d5a/f85 zero size 2023-12-16T20:11:32.189 INFO:tasks.workunit.client.0.smithi038.stdout:8/447: creat d17/d1b/d66/d73/d54/f8c x:0 0 0 2023-12-16T20:11:32.189 INFO:tasks.workunit.client.1.smithi141.stdout:2/159: truncate d6/f1d 2010770 0 2023-12-16T20:11:32.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/627: dread d15/d1e/d23/f78 [0,4194304] 0 2023-12-16T20:11:32.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/628: chown d15/d1e/d23/d34/f7a 3852276 1 2023-12-16T20:11:32.190 INFO:tasks.workunit.client.1.smithi141.stdout:0/293: fdatasync d4/d7/f1e 0 2023-12-16T20:11:32.197 INFO:tasks.workunit.client.0.smithi038.stdout:3/574: dwrite d4/d8/d15/d2c/d4c/d58/d9a/fb7 [0,4194304] 0 2023-12-16T20:11:32.197 INFO:tasks.workunit.client.1.smithi141.stdout:6/326: truncate d1/d12/d22/f53 2409186 0 2023-12-16T20:11:32.198 INFO:tasks.workunit.client.0.smithi038.stdout:1/629: rename d15/d1e/d23/d42 to d15/d1e/d3b/d48/d37/dde 0 2023-12-16T20:11:32.201 INFO:tasks.workunit.client.0.smithi038.stdout:0/593: dwrite db/f14 [0,4194304] 0 2023-12-16T20:11:32.205 INFO:tasks.workunit.client.0.smithi038.stdout:3/575: link d4/d6c/cad d4/dab/cc9 0 2023-12-16T20:11:32.205 INFO:tasks.workunit.client.0.smithi038.stdout:3/576: truncate d4/f5 5113828 0 2023-12-16T20:11:32.205 INFO:tasks.workunit.client.1.smithi141.stdout:1/261: rename da/f12 to da/d1a/f51 0 2023-12-16T20:11:32.206 INFO:tasks.workunit.client.0.smithi038.stdout:0/594: read db/d1a/f71 [222311,90402] 0 2023-12-16T20:11:32.206 INFO:tasks.workunit.client.0.smithi038.stdout:0/595: write db/fc3 [241250,46491] 0 2023-12-16T20:11:32.206 INFO:tasks.workunit.client.0.smithi038.stdout:0/596: dread - db/d16/d19/d80/f92 zero size 2023-12-16T20:11:32.206 INFO:tasks.workunit.client.0.smithi038.stdout:0/597: getdents db/d16/d5a/d65 0 2023-12-16T20:11:32.209 INFO:tasks.workunit.client.1.smithi141.stdout:3/323: rmdir d0/d1c/d40/d3f/d52/d5a 39 2023-12-16T20:11:32.210 INFO:tasks.workunit.client.0.smithi038.stdout:3/577: creat d4/d8/d15/d2c/d4c/d70/fca x:0 0 0 2023-12-16T20:11:32.210 INFO:tasks.workunit.client.0.smithi038.stdout:3/578: chown d4/d8/d15/d1e/f22 14 1 2023-12-16T20:11:32.216 INFO:tasks.workunit.client.0.smithi038.stdout:0/598: symlink db/d16/d5a/dc5/lcc 0 2023-12-16T20:11:32.216 INFO:tasks.workunit.client.0.smithi038.stdout:0/599: stat db/d16/d1c/f32 0 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/250: sync 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/251: read - d14/d19/d1b/d3d/f50 zero size 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/252: truncate d14/f25 4349500 0 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/253: fsync d14/d19/d1b/f21 0 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/254: creat d14/d19/d1b/d3d/f51 x:0 0 0 2023-12-16T20:11:32.217 INFO:tasks.workunit.client.1.smithi141.stdout:8/255: creat d14/d19/d1b/d24/f52 x:0 0 0 2023-12-16T20:11:32.218 INFO:tasks.workunit.client.0.smithi038.stdout:0/600: truncate db/d1a/f33 3744089 0 2023-12-16T20:11:32.219 INFO:tasks.workunit.client.0.smithi038.stdout:0/601: creat db/d1a/fcd x:0 0 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:8/256: rename l13 to d14/l53 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:8/257: truncate d14/d19/d1b/f3a 189686 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:6/327: dread d1/d3/f10 [0,4194304] 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:8/258: write d14/f23 [804530,56400] 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:6/328: fsync d1/dd/f1e 0 2023-12-16T20:11:32.224 INFO:tasks.workunit.client.1.smithi141.stdout:6/329: fdatasync d1/d12/d20/f6a 0 2023-12-16T20:11:32.229 INFO:tasks.workunit.client.1.smithi141.stdout:6/330: rmdir d1/d12/d22/d25 39 2023-12-16T20:11:32.229 INFO:tasks.workunit.client.1.smithi141.stdout:6/331: truncate d1/dd/d43/f6c 4877637 0 2023-12-16T20:11:32.230 INFO:tasks.workunit.client.1.smithi141.stdout:2/160: dwrite d6/f17 [4194304,4194304] 0 2023-12-16T20:11:32.230 INFO:tasks.workunit.client.0.smithi038.stdout:8/448: dwrite d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:32.230 INFO:tasks.workunit.client.0.smithi038.stdout:0/602: write db/d16/d5a/d65/f6a [1252086,61697] 0 2023-12-16T20:11:32.240 INFO:tasks.workunit.client.0.smithi038.stdout:0/603: rename db/d16/d70/d79 to db/d16/d5a/dce 0 2023-12-16T20:11:32.240 INFO:tasks.workunit.client.0.smithi038.stdout:0/604: chown db/d16 9179883 1 2023-12-16T20:11:32.240 INFO:tasks.workunit.client.0.smithi038.stdout:0/605: chown db/d1a/fcd 569492186 1 2023-12-16T20:11:32.240 INFO:tasks.workunit.client.1.smithi141.stdout:3/324: write d0/d1c/d40/d3c/f4a [251433,44319] 0 2023-12-16T20:11:32.242 INFO:tasks.workunit.client.0.smithi038.stdout:0/606: unlink db/d16/d70/fa1 0 2023-12-16T20:11:32.255 INFO:tasks.workunit.client.1.smithi141.stdout:0/294: dwrite d4/d5c/f68 [0,4194304] 0 2023-12-16T20:11:32.257 INFO:tasks.workunit.client.0.smithi038.stdout:1/630: dwrite d15/d1e/d3b/d48/f87 [0,4194304] 0 2023-12-16T20:11:32.261 INFO:tasks.workunit.client.1.smithi141.stdout:0/295: rename d4/d7/l19 to d4/d7/l6d 0 2023-12-16T20:11:32.270 INFO:tasks.workunit.client.0.smithi038.stdout:3/579: dwrite d4/d8/d15/d1e/f3d [4194304,4194304] 0 2023-12-16T20:11:32.272 INFO:tasks.workunit.client.0.smithi038.stdout:3/580: creat d4/d8/dc7/fcb x:0 0 0 2023-12-16T20:11:32.272 INFO:tasks.workunit.client.0.smithi038.stdout:3/581: stat d4/d27/d40/c93 0 2023-12-16T20:11:32.278 INFO:tasks.workunit.client.1.smithi141.stdout:8/259: truncate d14/d19/d1b/f3a 52323 0 2023-12-16T20:11:32.290 INFO:tasks.workunit.client.1.smithi141.stdout:8/260: dread d14/d19/f1f [0,4194304] 0 2023-12-16T20:11:32.291 INFO:tasks.workunit.client.1.smithi141.stdout:1/262: dwrite da/d1a/f51 [0,4194304] 0 2023-12-16T20:11:32.291 INFO:tasks.workunit.client.1.smithi141.stdout:2/161: dwrite d6/da/d1b/d1c/f2c [0,4194304] 0 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:6/332: dwrite d1/dd/d43/f6c [4194304,4194304] 0 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:3/325: dwrite d0/f65 [0,4194304] 0 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:3/326: readlink d0/d1c/d2c/l3e 0 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:8/261: mknod d14/d19/d1b/d24/c54 0 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:8/262: chown d14/d35/c47 84876 1 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:8/263: chown d14/d19/d1b/d24/l2b 15640 1 2023-12-16T20:11:32.292 INFO:tasks.workunit.client.1.smithi141.stdout:8/264: readlink d14/d19/d1b/d3d/l3b 0 2023-12-16T20:11:32.293 INFO:tasks.workunit.client.1.smithi141.stdout:8/265: dread d14/d19/d1b/d3d/f33 [0,4194304] 0 2023-12-16T20:11:32.293 INFO:tasks.workunit.client.0.smithi038.stdout:8/449: dwrite d17/d1b/f22 [4194304,4194304] 0 2023-12-16T20:11:32.293 INFO:tasks.workunit.client.0.smithi038.stdout:8/450: readlink d17/d1b/d66/d73/d4e/l4f 0 2023-12-16T20:11:32.294 INFO:tasks.workunit.client.0.smithi038.stdout:3/582: mkdir d4/d8/d15/d2c/d4c/d58/dcc 0 2023-12-16T20:11:32.295 INFO:tasks.workunit.client.0.smithi038.stdout:0/607: dwrite f6 [4194304,4194304] 0 2023-12-16T20:11:32.297 INFO:tasks.workunit.client.1.smithi141.stdout:1/263: creat da/f52 x:0 0 0 2023-12-16T20:11:32.297 INFO:tasks.workunit.client.1.smithi141.stdout:1/264: chown da/d1a/f51 1461770 1 2023-12-16T20:11:32.297 INFO:tasks.workunit.client.1.smithi141.stdout:1/265: chown da/fc 68142533 1 2023-12-16T20:11:32.297 INFO:tasks.workunit.client.1.smithi141.stdout:1/266: creat da/d1a/d1d/d22/d29/f53 x:0 0 0 2023-12-16T20:11:32.298 INFO:tasks.workunit.client.0.smithi038.stdout:3/583: dread d4/d18/f2a [0,4194304] 0 2023-12-16T20:11:32.302 INFO:tasks.workunit.client.1.smithi141.stdout:3/327: creat d0/d1c/d40/d3f/f73 x:0 0 0 2023-12-16T20:11:32.302 INFO:tasks.workunit.client.1.smithi141.stdout:3/328: fsync d0/d1c/d2c/f48 0 2023-12-16T20:11:32.305 INFO:tasks.workunit.client.0.smithi038.stdout:8/451: getdents d17/d1b/d66/d73/d4e 0 2023-12-16T20:11:32.305 INFO:tasks.workunit.client.0.smithi038.stdout:8/452: creat d17/d1b/d25/f8d x:0 0 0 2023-12-16T20:11:32.305 INFO:tasks.workunit.client.0.smithi038.stdout:8/453: fsync f16 0 2023-12-16T20:11:32.312 INFO:tasks.workunit.client.0.smithi038.stdout:8/454: mkdir d17/d1b/d66/d8e 0 2023-12-16T20:11:32.315 INFO:tasks.workunit.client.1.smithi141.stdout:8/266: dwrite d14/d19/d1b/d24/f31 [0,4194304] 0 2023-12-16T20:11:32.315 INFO:tasks.workunit.client.1.smithi141.stdout:8/267: chown d14/l53 29 1 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/268: chown d14/d19/d1b/l1d 309008 1 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/269: fsync d14/d19/d1b/f3a 0 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/270: creat d14/d19/d1b/d24/f55 x:0 0 0 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/271: creat d14/d19/d1b/d3d/f56 x:0 0 0 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/272: truncate d14/d19/d1b/d3d/f3e 802389 0 2023-12-16T20:11:32.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/273: stat d14/d19/d1b/d24/f49 0 2023-12-16T20:11:32.319 INFO:tasks.workunit.client.1.smithi141.stdout:9/217: sync 2023-12-16T20:11:32.325 INFO:tasks.workunit.client.1.smithi141.stdout:9/218: truncate d1/d10/f12 7366290 0 2023-12-16T20:11:32.325 INFO:tasks.workunit.client.0.smithi038.stdout:9/641: sync 2023-12-16T20:11:32.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/608: dwrite db/d1a/d77/d95/da4/fb0 [0,4194304] 0 2023-12-16T20:11:32.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/609: write db/d1a/f59 [1467680,91976] 0 2023-12-16T20:11:32.329 INFO:tasks.workunit.client.0.smithi038.stdout:3/584: dwrite d4/d27/d23/d6e/f87 [0,4194304] 0 2023-12-16T20:11:32.330 INFO:tasks.workunit.client.1.smithi141.stdout:9/219: write d1/d10/d14/d20/da/f38 [3705540,20127] 0 2023-12-16T20:11:32.335 INFO:tasks.workunit.client.1.smithi141.stdout:1/267: dwrite da/df/f4c [0,4194304] 0 2023-12-16T20:11:32.343 INFO:tasks.workunit.client.0.smithi038.stdout:8/455: dwrite d17/d1b/d25/f8d [0,4194304] 0 2023-12-16T20:11:32.347 INFO:tasks.workunit.client.0.smithi038.stdout:8/456: getdents d17/d1b/d66/d73/d54 0 2023-12-16T20:11:32.347 INFO:tasks.workunit.client.0.smithi038.stdout:8/457: creat d17/d1b/d66/d73/d54/d69/f8f x:0 0 0 2023-12-16T20:11:32.347 INFO:tasks.workunit.client.1.smithi141.stdout:9/220: dread d1/d10/d14/f25 [4194304,4194304] 0 2023-12-16T20:11:32.348 INFO:tasks.workunit.client.0.smithi038.stdout:0/610: write db/f44 [2933110,95515] 0 2023-12-16T20:11:32.348 INFO:tasks.workunit.client.1.smithi141.stdout:9/221: getdents d1/d10/d27/d36 0 2023-12-16T20:11:32.348 INFO:tasks.workunit.client.1.smithi141.stdout:9/222: chown d1/d10/d33/f44 3144 1 2023-12-16T20:11:32.350 INFO:tasks.workunit.client.0.smithi038.stdout:0/611: getdents db/d1a/d77/d95/da4 0 2023-12-16T20:11:32.350 INFO:tasks.workunit.client.1.smithi141.stdout:9/223: getdents d1/d10/d14/d20/da/de 0 2023-12-16T20:11:32.355 INFO:tasks.workunit.client.1.smithi141.stdout:3/329: dwrite d0/d1c/d40/d3c/d4b/d4c/f4f [0,4194304] 0 2023-12-16T20:11:32.355 INFO:tasks.workunit.client.1.smithi141.stdout:3/330: readlink d0/d1c/d40/l58 0 2023-12-16T20:11:32.356 INFO:tasks.workunit.client.0.smithi038.stdout:8/458: dread d17/d34/d3d/f4c [0,4194304] 0 2023-12-16T20:11:32.357 INFO:tasks.workunit.client.1.smithi141.stdout:8/274: dwrite d14/d19/f4e [0,4194304] 0 2023-12-16T20:11:32.358 INFO:tasks.workunit.client.1.smithi141.stdout:8/275: truncate d14/d19/d1b/d24/f49 647629 0 2023-12-16T20:11:32.358 INFO:tasks.workunit.client.1.smithi141.stdout:3/331: unlink d0/d1c/d40/f69 0 2023-12-16T20:11:32.362 INFO:tasks.workunit.client.1.smithi141.stdout:8/276: write d14/d19/f1f [2110582,28482] 0 2023-12-16T20:11:32.362 INFO:tasks.workunit.client.1.smithi141.stdout:8/277: chown d14/d19/d1b/d24/f28 8551 1 2023-12-16T20:11:32.362 INFO:tasks.workunit.client.1.smithi141.stdout:9/224: write d1/d10/d14/f31 [4050700,58748] 0 2023-12-16T20:11:32.363 INFO:tasks.workunit.client.1.smithi141.stdout:1/268: dwrite da/d1a/d1d/d22/d29/f32 [0,4194304] 0 2023-12-16T20:11:32.364 INFO:tasks.workunit.client.1.smithi141.stdout:8/278: rename d14/d19/d1b/d3d to d14/d19/d1b/d3d/d57 22 2023-12-16T20:11:32.364 INFO:tasks.workunit.client.1.smithi141.stdout:3/332: rename d0/d1c/d40/d3c/d6f to d0/d1c/d2c/d72/d74 0 2023-12-16T20:11:32.368 INFO:tasks.workunit.client.1.smithi141.stdout:9/225: link d1/l2d d1/d10/d33/d47/l4f 0 2023-12-16T20:11:32.370 INFO:tasks.workunit.client.1.smithi141.stdout:1/269: creat da/d36/d4b/d4d/f54 x:0 0 0 2023-12-16T20:11:32.371 INFO:tasks.workunit.client.1.smithi141.stdout:1/270: creat da/d1a/d1d/d33/f55 x:0 0 0 2023-12-16T20:11:32.371 INFO:tasks.workunit.client.1.smithi141.stdout:8/279: mkdir d14/d19/d1b/d24/d4a/d58 0 2023-12-16T20:11:32.373 INFO:tasks.workunit.client.1.smithi141.stdout:3/333: creat d0/d1c/d40/d3f/d52/f75 x:0 0 0 2023-12-16T20:11:32.374 INFO:tasks.workunit.client.1.smithi141.stdout:9/226: creat d1/d10/d27/d36/f50 x:0 0 0 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/271: chown da/d25/f2f 26 1 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/272: write da/d1a/d1d/d22/d29/f32 [4892577,73070] 0 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/273: stat da/d1a/d1d/f4f 0 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/274: chown da/d36/c41 5053 1 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/275: creat da/d36/d4b/d4d/f56 x:0 0 0 2023-12-16T20:11:32.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/276: creat da/d1a/d1d/d22/d29/f57 x:0 0 0 2023-12-16T20:11:32.377 INFO:tasks.workunit.client.1.smithi141.stdout:8/280: unlink d14/d19/d1b/f46 0 2023-12-16T20:11:32.377 INFO:tasks.workunit.client.0.smithi038.stdout:8/459: dwrite d17/d34/f84 [0,4194304] 0 2023-12-16T20:11:32.378 INFO:tasks.workunit.client.1.smithi141.stdout:3/334: mkdir d0/d1c/d6a/d76 0 2023-12-16T20:11:32.379 INFO:tasks.workunit.client.0.smithi038.stdout:0/612: dwrite db/d16/d1c/d5d/f8d [0,4194304] 0 2023-12-16T20:11:32.379 INFO:tasks.workunit.client.0.smithi038.stdout:0/613: creat db/d1a/fcf x:0 0 0 2023-12-16T20:11:32.379 INFO:tasks.workunit.client.0.smithi038.stdout:0/614: write db/d16/d19/d27/d78/faf [656965,54509] 0 2023-12-16T20:11:32.379 INFO:tasks.workunit.client.0.smithi038.stdout:0/615: truncate db/d16/d19/d4e/f9d 579823 0 2023-12-16T20:11:32.379 INFO:tasks.workunit.client.1.smithi141.stdout:9/227: link d1/d10/d14/d20/c13 d1/d10/d14/d20/d3b/c51 0 2023-12-16T20:11:32.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/460: mkdir d17/d1b/d57/d90 0 2023-12-16T20:11:32.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/461: dread - d17/d1b/d66/d73/d54/f8c zero size 2023-12-16T20:11:32.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/462: chown d17/d1d/d82 216538586 1 2023-12-16T20:11:32.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/463: creat d17/d1b/d66/d8e/f91 x:0 0 0 2023-12-16T20:11:32.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/464: chown d17/d34/d3d/d59/l7b 7117 1 2023-12-16T20:11:32.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/465: write d17/d1b/d25/f6b [378334,19913] 0 2023-12-16T20:11:32.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/466: truncate d17/d34/f61 750714 0 2023-12-16T20:11:32.384 INFO:tasks.workunit.client.1.smithi141.stdout:3/335: link d0/f68 d0/d1c/d40/d3c/d4b/f77 0 2023-12-16T20:11:32.385 INFO:tasks.workunit.client.1.smithi141.stdout:9/228: creat d1/d10/d14/d20/d3b/f52 x:0 0 0 2023-12-16T20:11:32.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/277: symlink da/d1a/l58 0 2023-12-16T20:11:32.386 INFO:tasks.workunit.client.1.smithi141.stdout:8/281: dread d14/d19/d1b/f21 [0,4194304] 0 2023-12-16T20:11:32.386 INFO:tasks.workunit.client.1.smithi141.stdout:3/336: symlink d0/d1c/d6a/d76/l78 0 2023-12-16T20:11:32.388 INFO:tasks.workunit.client.1.smithi141.stdout:1/278: creat da/d1a/f59 x:0 0 0 2023-12-16T20:11:32.389 INFO:tasks.workunit.client.1.smithi141.stdout:8/282: symlink d14/d19/l59 0 2023-12-16T20:11:32.389 INFO:tasks.workunit.client.1.smithi141.stdout:8/283: chown cc 113 1 2023-12-16T20:11:32.390 INFO:tasks.workunit.client.1.smithi141.stdout:9/229: mknod d1/c53 0 2023-12-16T20:11:32.390 INFO:tasks.workunit.client.1.smithi141.stdout:9/230: readlink d1/d26/l49 0 2023-12-16T20:11:32.390 INFO:tasks.workunit.client.1.smithi141.stdout:9/231: chown d1/d10/d33/f34 15 1 2023-12-16T20:11:32.390 INFO:tasks.workunit.client.1.smithi141.stdout:1/279: fsync da/d25/f40 0 2023-12-16T20:11:32.393 INFO:tasks.workunit.client.1.smithi141.stdout:1/280: unlink da/d1a/d1d/d22/d29/f57 0 2023-12-16T20:11:32.394 INFO:tasks.workunit.client.0.smithi038.stdout:0/616: dread db/d16/d19/d27/d56/f82 [0,4194304] 0 2023-12-16T20:11:32.394 INFO:tasks.workunit.client.0.smithi038.stdout:0/617: write db/d16/d5a/d65/d90/da7/fc1 [596117,86973] 0 2023-12-16T20:11:32.397 INFO:tasks.workunit.client.0.smithi038.stdout:0/618: mkdir db/d16/d1c/d5d/d64/dd0 0 2023-12-16T20:11:32.400 INFO:tasks.workunit.client.0.smithi038.stdout:0/619: rename db/d16/d19/d27/d56/l67 to db/d16/d70/ld1 0 2023-12-16T20:11:32.400 INFO:tasks.workunit.client.0.smithi038.stdout:0/620: chown db/c13 237300273 1 2023-12-16T20:11:32.403 INFO:tasks.workunit.client.0.smithi038.stdout:0/621: mkdir db/d16/d70/dd2 0 2023-12-16T20:11:32.407 INFO:tasks.workunit.client.0.smithi038.stdout:0/622: mknod db/d16/d1c/d5d/cd3 0 2023-12-16T20:11:32.411 INFO:tasks.workunit.client.0.smithi038.stdout:0/623: dread db/fc3 [0,4194304] 0 2023-12-16T20:11:32.413 INFO:tasks.workunit.client.0.smithi038.stdout:0/624: mkdir db/d16/d19/d80/dd4 0 2023-12-16T20:11:32.420 INFO:tasks.workunit.client.1.smithi141.stdout:8/284: dwrite d14/d19/d1b/d30/f34 [0,4194304] 0 2023-12-16T20:11:32.422 INFO:tasks.workunit.client.1.smithi141.stdout:8/285: rename d14/d19/d1b/d24/f52 to d14/d19/d1b/d24/d4a/f5a 0 2023-12-16T20:11:32.423 INFO:tasks.workunit.client.1.smithi141.stdout:3/337: dwrite d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:32.423 INFO:tasks.workunit.client.1.smithi141.stdout:3/338: stat d0/f3a 0 2023-12-16T20:11:32.423 INFO:tasks.workunit.client.1.smithi141.stdout:1/281: dwrite da/d25/f2f [0,4194304] 0 2023-12-16T20:11:32.423 INFO:tasks.workunit.client.1.smithi141.stdout:8/286: stat cd 0 2023-12-16T20:11:32.423 INFO:tasks.workunit.client.1.smithi141.stdout:8/287: chown d14/d19/d1b/f2f 222858 1 2023-12-16T20:11:32.429 INFO:tasks.workunit.client.0.smithi038.stdout:0/625: dwrite db/d16/d1c/f2a [4194304,4194304] 0 2023-12-16T20:11:32.438 INFO:tasks.workunit.client.0.smithi038.stdout:0/626: dread f8 [0,4194304] 0 2023-12-16T20:11:32.444 INFO:tasks.workunit.client.0.smithi038.stdout:0/627: dread db/d16/d19/d27/f34 [4194304,4194304] 0 2023-12-16T20:11:32.445 INFO:tasks.workunit.client.0.smithi038.stdout:0/628: mkdir db/d16/d19/d27/d78/dd5 0 2023-12-16T20:11:32.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/629: symlink db/d1a/d77/d95/da4/ld6 0 2023-12-16T20:11:32.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/630: write db/d1a/fb4 [244471,19062] 0 2023-12-16T20:11:32.447 INFO:tasks.workunit.client.0.smithi038.stdout:0/631: stat db/d16/d19/d27/f3b 0 2023-12-16T20:11:32.460 INFO:tasks.workunit.client.0.smithi038.stdout:2/623: sync 2023-12-16T20:11:32.460 INFO:tasks.workunit.client.0.smithi038.stdout:2/624: fdatasync d1/d5/d2a/fd3 0 2023-12-16T20:11:32.464 INFO:tasks.workunit.client.1.smithi141.stdout:1/282: creat da/d36/d4b/f5a x:0 0 0 2023-12-16T20:11:32.468 INFO:tasks.workunit.client.0.smithi038.stdout:0/632: dwrite db/d16/d19/d80/f92 [0,4194304] 0 2023-12-16T20:11:32.468 INFO:tasks.workunit.client.1.smithi141.stdout:8/288: unlink d14/d19/d1b/d3d/f50 0 2023-12-16T20:11:32.470 INFO:tasks.workunit.client.1.smithi141.stdout:3/339: truncate d0/f29 3697799 0 2023-12-16T20:11:32.470 INFO:tasks.workunit.client.1.smithi141.stdout:3/340: readlink d0/d1c/d2c/l70 0 2023-12-16T20:11:32.471 INFO:tasks.workunit.client.0.smithi038.stdout:0/633: creat db/d1a/d77/d95/da4/fd7 x:0 0 0 2023-12-16T20:11:32.471 INFO:tasks.workunit.client.0.smithi038.stdout:0/634: write db/d16/d19/d4e/f9d [656834,48728] 0 2023-12-16T20:11:32.474 INFO:tasks.workunit.client.1.smithi141.stdout:3/341: creat d0/d1c/d40/d3f/d52/d5d/f79 x:0 0 0 2023-12-16T20:11:32.478 INFO:tasks.workunit.client.0.smithi038.stdout:2/625: dwrite d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:32.480 INFO:tasks.workunit.client.0.smithi038.stdout:2/626: write d1/d5/d95/d61/dd4/d6a/f59 [962118,28712] 0 2023-12-16T20:11:32.481 INFO:tasks.workunit.client.0.smithi038.stdout:2/627: write d1/d5/d95/d61/dd4/d10/f71 [1299939,5781] 0 2023-12-16T20:11:32.483 INFO:tasks.workunit.client.0.smithi038.stdout:2/628: getdents d1/d5/d95/d61/dd4/d6a/d7a 0 2023-12-16T20:11:32.483 INFO:tasks.workunit.client.0.smithi038.stdout:2/629: write d1/d5/d95/d61/dd4/d21/d82/fba [263406,58280] 0 2023-12-16T20:11:32.483 INFO:tasks.workunit.client.0.smithi038.stdout:2/630: creat d1/d5/fd7 x:0 0 0 2023-12-16T20:11:32.483 INFO:tasks.workunit.client.0.smithi038.stdout:2/631: chown d1/d5/d95/d61/dd4/d21/d82/fba 19 1 2023-12-16T20:11:32.487 INFO:tasks.workunit.client.1.smithi141.stdout:8/289: rmdir d14/d19/d1b/d3d 39 2023-12-16T20:11:32.487 INFO:tasks.workunit.client.1.smithi141.stdout:8/290: read ff [850718,60144] 0 2023-12-16T20:11:32.488 INFO:tasks.workunit.client.1.smithi141.stdout:8/291: dread d14/d19/d1b/f3a [0,4194304] 0 2023-12-16T20:11:32.490 INFO:tasks.workunit.client.1.smithi141.stdout:8/292: mkdir d14/d19/d1b/d24/d4a/d5b 0 2023-12-16T20:11:32.490 INFO:tasks.workunit.client.1.smithi141.stdout:8/293: chown d14/f23 30914 1 2023-12-16T20:11:32.492 INFO:tasks.workunit.client.0.smithi038.stdout:0/635: dwrite db/d16/d19/d4e/f9d [0,4194304] 0 2023-12-16T20:11:32.492 INFO:tasks.workunit.client.1.smithi141.stdout:8/294: creat d14/d19/d1b/d24/d4b/f5c x:0 0 0 2023-12-16T20:11:32.492 INFO:tasks.workunit.client.1.smithi141.stdout:8/295: chown d14/d19/d1b/f3a 4026 1 2023-12-16T20:11:32.493 INFO:tasks.workunit.client.1.smithi141.stdout:8/296: stat d14/c45 0 2023-12-16T20:11:32.495 INFO:tasks.workunit.client.1.smithi141.stdout:8/297: rename d14/d19/d1b/f2f to d14/d19/d1b/d24/d4a/d5b/f5d 0 2023-12-16T20:11:32.498 INFO:tasks.workunit.client.1.smithi141.stdout:8/298: mkdir d14/d19/d1b/d3d/d5e 0 2023-12-16T20:11:32.498 INFO:tasks.workunit.client.0.smithi038.stdout:2/632: dwrite d1/d5/d95/d61/dd4/d6a/d43/d57/f5a [0,4194304] 0 2023-12-16T20:11:32.499 INFO:tasks.workunit.client.1.smithi141.stdout:8/299: readlink d14/l44 0 2023-12-16T20:11:32.501 INFO:tasks.workunit.client.1.smithi141.stdout:8/300: truncate d14/d19/d1b/d30/f34 3127749 0 2023-12-16T20:11:32.503 INFO:tasks.workunit.client.1.smithi141.stdout:3/342: dread d0/f29 [0,4194304] 0 2023-12-16T20:11:32.503 INFO:tasks.workunit.client.0.smithi038.stdout:2/633: link d1/c4 d1/d5/d2a/cd8 0 2023-12-16T20:11:32.503 INFO:tasks.workunit.client.1.smithi141.stdout:8/301: mknod d14/d19/d1b/d30/c5f 0 2023-12-16T20:11:32.505 INFO:tasks.workunit.client.0.smithi038.stdout:2/634: creat d1/d5/d95/d61/dd4/fd9 x:0 0 0 2023-12-16T20:11:32.506 INFO:tasks.workunit.client.1.smithi141.stdout:8/302: link d14/d19/d1b/d24/l2b d14/d19/d1b/d24/d4a/d5b/l60 0 2023-12-16T20:11:32.506 INFO:tasks.workunit.client.1.smithi141.stdout:8/303: readlink d14/d19/d1b/l2a 0 2023-12-16T20:11:32.506 INFO:tasks.workunit.client.1.smithi141.stdout:8/304: fsync d14/d19/f20 0 2023-12-16T20:11:32.513 INFO:tasks.workunit.client.1.smithi141.stdout:5/166: sync 2023-12-16T20:11:32.517 INFO:tasks.workunit.client.1.smithi141.stdout:5/167: truncate d0/d9/d16/f21 2706487 0 2023-12-16T20:11:32.517 INFO:tasks.workunit.client.1.smithi141.stdout:5/168: stat d0/f2b 0 2023-12-16T20:11:32.518 INFO:tasks.workunit.client.1.smithi141.stdout:7/186: sync 2023-12-16T20:11:32.518 INFO:tasks.workunit.client.1.smithi141.stdout:4/256: sync 2023-12-16T20:11:32.521 INFO:tasks.workunit.client.1.smithi141.stdout:7/187: creat d5/d16/d30/d36/f39 x:0 0 0 2023-12-16T20:11:32.521 INFO:tasks.workunit.client.1.smithi141.stdout:7/188: read - d5/d16/d30/f32 zero size 2023-12-16T20:11:32.523 INFO:tasks.workunit.client.1.smithi141.stdout:7/189: rmdir d5/d1d/d1e/d35 0 2023-12-16T20:11:32.524 INFO:tasks.workunit.client.1.smithi141.stdout:4/257: rename l3 to d1a/l62 0 2023-12-16T20:11:32.525 INFO:tasks.workunit.client.1.smithi141.stdout:7/190: mkdir d5/d16/d1a/d3a 0 2023-12-16T20:11:32.530 INFO:tasks.workunit.client.1.smithi141.stdout:5/169: rename d0/d9/f13 to d0/d25/f2e 0 2023-12-16T20:11:32.530 INFO:tasks.workunit.client.1.smithi141.stdout:4/258: mkdir d1a/d4e/d63 0 2023-12-16T20:11:32.530 INFO:tasks.workunit.client.1.smithi141.stdout:4/259: write d1a/f25 [248746,41170] 0 2023-12-16T20:11:32.532 INFO:tasks.workunit.client.0.smithi038.stdout:2/635: dwrite d1/d5/d95/d61/dd4/d21/f45 [0,4194304] 0 2023-12-16T20:11:32.536 INFO:tasks.workunit.client.0.smithi038.stdout:2/636: rename d1/d5/d95/d61/dd4/fd9 to d1/d5/d3d/fda 0 2023-12-16T20:11:32.536 INFO:tasks.workunit.client.0.smithi038.stdout:2/637: creat d1/d5/d6c/da7/fdb x:0 0 0 2023-12-16T20:11:32.536 INFO:tasks.workunit.client.0.smithi038.stdout:2/638: write d1/d5/d2a/fd1 [230017,128003] 0 2023-12-16T20:11:32.537 INFO:tasks.workunit.client.0.smithi038.stdout:0/636: dwrite db/d1a/f73 [0,4194304] 0 2023-12-16T20:11:32.538 INFO:tasks.workunit.client.1.smithi141.stdout:3/343: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:32.540 INFO:tasks.workunit.client.1.smithi141.stdout:3/344: mknod d0/d1c/d6a/c7a 0 2023-12-16T20:11:32.540 INFO:tasks.workunit.client.0.smithi038.stdout:2/639: mkdir d1/d5/d3d/ddc 0 2023-12-16T20:11:32.543 INFO:tasks.workunit.client.0.smithi038.stdout:2/640: dread d1/d5/d95/d61/dd4/d10/fb5 [0,4194304] 0 2023-12-16T20:11:32.543 INFO:tasks.workunit.client.0.smithi038.stdout:2/641: getdents d1/d5/d95/d61/dd4/d6a/d43/d57/dd6 0 2023-12-16T20:11:32.543 INFO:tasks.workunit.client.0.smithi038.stdout:2/642: chown d1/d5/d2a/ca5 66146217 1 2023-12-16T20:11:32.543 INFO:tasks.workunit.client.0.smithi038.stdout:0/637: mkdir db/d1a/d77/d95/dd8 0 2023-12-16T20:11:32.544 INFO:tasks.workunit.client.0.smithi038.stdout:2/643: mkdir d1/d5/d95/d61/d66/ddd 0 2023-12-16T20:11:32.548 INFO:tasks.workunit.client.0.smithi038.stdout:2/644: rename d1/d5/d95/d61/dd4/d6d/f69 to d1/fde 0 2023-12-16T20:11:32.551 INFO:tasks.workunit.client.0.smithi038.stdout:0/638: write db/d16/d19/f46 [2489047,121604] 0 2023-12-16T20:11:32.557 INFO:tasks.workunit.client.0.smithi038.stdout:2/645: dread d1/d5/d95/d61/dd4/d21/f93 [0,4194304] 0 2023-12-16T20:11:32.557 INFO:tasks.workunit.client.0.smithi038.stdout:2/646: dread - d1/d5/d3d/d9e/fc3 zero size 2023-12-16T20:11:32.558 INFO:tasks.workunit.client.0.smithi038.stdout:2/647: truncate d1/d5/d3d/d9e/fc3 984612 0 2023-12-16T20:11:32.558 INFO:tasks.workunit.client.0.smithi038.stdout:2/648: chown d1/d5/d16/l80 12957566 1 2023-12-16T20:11:32.566 INFO:tasks.workunit.client.0.smithi038.stdout:2/649: write d1/d5/d6c/da7/fa9 [2182938,80366] 0 2023-12-16T20:11:32.569 INFO:tasks.workunit.client.0.smithi038.stdout:2/650: rename d1/d5/d95/d61/dd4/d6a/d43/d57/l86 to d1/d5/ldf 0 2023-12-16T20:11:32.574 INFO:tasks.workunit.client.1.smithi141.stdout:5/170: dwrite d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:32.575 INFO:tasks.workunit.client.1.smithi141.stdout:5/171: chown d0/df/c28 15469367 1 2023-12-16T20:11:32.576 INFO:tasks.workunit.client.1.smithi141.stdout:7/191: dwrite d5/d16/f17 [0,4194304] 0 2023-12-16T20:11:32.577 INFO:tasks.workunit.client.1.smithi141.stdout:5/172: symlink d0/d9/d16/d2a/l2f 0 2023-12-16T20:11:32.577 INFO:tasks.workunit.client.1.smithi141.stdout:5/173: write d0/d9/f15 [2269790,55088] 0 2023-12-16T20:11:32.577 INFO:tasks.workunit.client.1.smithi141.stdout:4/260: dwrite f2 [0,4194304] 0 2023-12-16T20:11:32.577 INFO:tasks.workunit.client.1.smithi141.stdout:4/261: fdatasync d1a/f29 0 2023-12-16T20:11:32.578 INFO:tasks.workunit.client.1.smithi141.stdout:3/345: dwrite d0/d1c/d40/d3f/f73 [0,4194304] 0 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.1.smithi141.stdout:7/192: unlink d5/d16/f17 0 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.1.smithi141.stdout:7/193: truncate d5/f12 778883 0 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.1.smithi141.stdout:7/194: dread - d5/d2a/f2b zero size 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.1.smithi141.stdout:7/195: readlink d5/d1d/l21 0 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.1.smithi141.stdout:7/196: chown d5/l29 82449 1 2023-12-16T20:11:32.579 INFO:tasks.workunit.client.0.smithi038.stdout:0/639: dwrite db/d1a/d77/d95/da4/fd7 [0,4194304] 0 2023-12-16T20:11:32.580 INFO:tasks.workunit.client.0.smithi038.stdout:0/640: dread db/d1a/d77/d95/da4/fbe [0,4194304] 0 2023-12-16T20:11:32.580 INFO:tasks.workunit.client.0.smithi038.stdout:0/641: creat db/d16/d1c/fd9 x:0 0 0 2023-12-16T20:11:32.581 INFO:tasks.workunit.client.1.smithi141.stdout:7/197: write d5/f12 [348357,47569] 0 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/610: sync 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/611: write d2/f10 [5071831,9280] 0 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/612: creat d2/d14/d25/d2d/d17/d55/fbe x:0 0 0 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/613: dread - d2/d4/f58 zero size 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:7/531: sync 2023-12-16T20:11:32.586 INFO:tasks.workunit.client.0.smithi038.stdout:4/583: sync 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/584: fdatasync d13/d17/d4b/f43 0 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/530: sync 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/531: chown d1/d4/d1d/d67/c92 1024882 1 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/532: truncate d1/d4/d1d/f60 68727 0 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/533: write d1/d4/d1d/d28/f7a [648586,26706] 0 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/534: truncate d1/f19 6065979 0 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:0/642: rename db/d16/d5a/dce/lab to db/d16/d19/d4e/dcb/lda 0 2023-12-16T20:11:32.587 INFO:tasks.workunit.client.0.smithi038.stdout:0/643: write db/d16/d1c/f2a [8981076,120802] 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.0.smithi038.stdout:2/651: dwrite d1/d5/d6c/d91/fca [0,4194304] 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:7/198: creat d5/f3b x:0 0 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:3/346: getdents d0/d1c/d40/d3f/d52/d5d 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:7/199: write d5/f12 [1140126,60470] 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:7/200: write d5/d2a/f2c [715180,54418] 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:3/347: creat d0/d1c/d40/d3f/d52/f7b x:0 0 0 2023-12-16T20:11:32.589 INFO:tasks.workunit.client.1.smithi141.stdout:3/348: write d0/f68 [4145,35143] 0 2023-12-16T20:11:32.598 INFO:tasks.workunit.client.1.smithi141.stdout:3/349: link d0/d1c/d40/l58 d0/d1c/d2c/d72/d74/l7c 0 2023-12-16T20:11:32.601 INFO:tasks.workunit.client.1.smithi141.stdout:5/174: getdents d0/d9/d16/d2a 0 2023-12-16T20:11:32.603 INFO:tasks.workunit.client.1.smithi141.stdout:5/175: mkdir d0/d25/d30 0 2023-12-16T20:11:32.604 INFO:tasks.workunit.client.0.smithi038.stdout:4/585: truncate d13/d17/f95 736184 0 2023-12-16T20:11:32.604 INFO:tasks.workunit.client.0.smithi038.stdout:9/642: sync 2023-12-16T20:11:32.604 INFO:tasks.workunit.client.0.smithi038.stdout:1/631: sync 2023-12-16T20:11:32.606 INFO:tasks.workunit.client.1.smithi141.stdout:5/176: creat d0/d14/f31 x:0 0 0 2023-12-16T20:11:32.606 INFO:tasks.workunit.client.1.smithi141.stdout:5/177: fdatasync d0/d9/f20 0 2023-12-16T20:11:32.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/614: rename d2/d14/f33 to d2/d14/d25/fbf 0 2023-12-16T20:11:32.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/615: readlink d2/d4/l28 0 2023-12-16T20:11:32.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/644: rmdir db/d16/da6 39 2023-12-16T20:11:32.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/645: chown db/d1a/d77/d95/da4 492805815 1 2023-12-16T20:11:32.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/646: dread - db/d16/d19/d27/f51 zero size 2023-12-16T20:11:32.607 INFO:tasks.workunit.client.1.smithi141.stdout:5/178: symlink d0/df/l32 0 2023-12-16T20:11:32.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/179: creat d0/d14/d2c/f33 x:0 0 0 2023-12-16T20:11:32.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/180: fsync d0/df/f1d 0 2023-12-16T20:11:32.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/181: truncate d0/d9/d16/f2d 859964 0 2023-12-16T20:11:32.613 INFO:tasks.workunit.client.0.smithi038.stdout:7/532: getdents da/d21 0 2023-12-16T20:11:32.614 INFO:tasks.workunit.client.0.smithi038.stdout:7/533: read da/d24/d4d/d51/f60 [1604677,60584] 0 2023-12-16T20:11:32.614 INFO:tasks.workunit.client.1.smithi141.stdout:0/296: sync 2023-12-16T20:11:32.614 INFO:tasks.workunit.client.1.smithi141.stdout:6/333: sync 2023-12-16T20:11:32.614 INFO:tasks.workunit.client.1.smithi141.stdout:8/305: sync 2023-12-16T20:11:32.615 INFO:tasks.workunit.client.0.smithi038.stdout:1/632: truncate d15/d1e/d30/f50 1451783 0 2023-12-16T20:11:32.616 INFO:tasks.workunit.client.0.smithi038.stdout:6/535: dwrite d1/d5b/d7d/f84 [0,4194304] 0 2023-12-16T20:11:32.616 INFO:tasks.workunit.client.1.smithi141.stdout:1/283: sync 2023-12-16T20:11:32.616 INFO:tasks.workunit.client.1.smithi141.stdout:1/284: write f6 [1073188,108494] 0 2023-12-16T20:11:32.617 INFO:tasks.workunit.client.1.smithi141.stdout:2/162: sync 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:9/232: sync 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:8/306: write d14/f23 [740933,43550] 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:8/307: readlink d14/l44 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:8/308: write d14/d19/d1b/d3d/f51 [805026,79091] 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:6/334: mkdir d1/d12/d22/d25/d6e 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:6/335: chown d1/dd/f1e 0 1 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:6/336: write d1/d12/d22/d25/f2e [186907,8955] 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:6/337: write d1/dd/d2f/f5f [4565839,1277] 0 2023-12-16T20:11:32.618 INFO:tasks.workunit.client.1.smithi141.stdout:4/262: dwrite f9 [0,4194304] 0 2023-12-16T20:11:32.619 INFO:tasks.workunit.client.0.smithi038.stdout:9/643: mkdir d9/d1f/d6a/dc0 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.0.smithi038.stdout:9/644: fdatasync d9/f81 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.0.smithi038.stdout:5/616: link d2/df/d1a/d2a/f91 d2/d14/d25/d2d/d17/d93/fc0 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.1.smithi141.stdout:7/201: dwrite d5/d2a/f37 [0,4194304] 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.1.smithi141.stdout:0/297: unlink d4/d7/l13 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.1.smithi141.stdout:0/298: stat d4/fe 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.0.smithi038.stdout:0/647: rename db/d16/d19/f46 to db/db6/fdb 0 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.0.smithi038.stdout:0/648: chown db/d16/d1c/d5d/d64/la3 3 1 2023-12-16T20:11:32.620 INFO:tasks.workunit.client.0.smithi038.stdout:0/649: creat db/d1a/fdc x:0 0 0 2023-12-16T20:11:32.621 INFO:tasks.workunit.client.1.smithi141.stdout:9/233: creat d1/d10/d14/d20/f54 x:0 0 0 2023-12-16T20:11:32.624 INFO:tasks.workunit.client.1.smithi141.stdout:8/309: creat d14/d35/f61 x:0 0 0 2023-12-16T20:11:32.624 INFO:tasks.workunit.client.1.smithi141.stdout:8/310: creat d14/d19/d1b/d24/d4b/f62 x:0 0 0 2023-12-16T20:11:32.626 INFO:tasks.workunit.client.0.smithi038.stdout:7/534: link da/d21/l91 da/d21/d86/d92/lb2 0 2023-12-16T20:11:32.628 INFO:tasks.workunit.client.1.smithi141.stdout:6/338: creat d1/dd/de/f6f x:0 0 0 2023-12-16T20:11:32.628 INFO:tasks.workunit.client.1.smithi141.stdout:5/182: getdents d0/d25 0 2023-12-16T20:11:32.628 INFO:tasks.workunit.client.1.smithi141.stdout:5/183: chown d0/d9/d16/f2d 56744157 1 2023-12-16T20:11:32.629 INFO:tasks.workunit.client.0.smithi038.stdout:1/633: symlink d15/d1e/d30/ldf 0 2023-12-16T20:11:32.629 INFO:tasks.workunit.client.1.smithi141.stdout:2/163: dread d6/f21 [0,4194304] 0 2023-12-16T20:11:32.630 INFO:tasks.workunit.client.1.smithi141.stdout:4/263: symlink d1a/d3c/l64 0 2023-12-16T20:11:32.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/202: creat d5/d16/f3c x:0 0 0 2023-12-16T20:11:32.634 INFO:tasks.workunit.client.1.smithi141.stdout:0/299: truncate d4/f33 662504 0 2023-12-16T20:11:32.634 INFO:tasks.workunit.client.1.smithi141.stdout:0/300: chown d4/d49/f52 2 1 2023-12-16T20:11:32.634 INFO:tasks.workunit.client.1.smithi141.stdout:0/301: readlink d4/lf 0 2023-12-16T20:11:32.634 INFO:tasks.workunit.client.1.smithi141.stdout:3/350: dwrite d0/f8 [0,4194304] 0 2023-12-16T20:11:32.635 INFO:tasks.workunit.client.1.smithi141.stdout:4/264: dread d1a/d4e/f55 [0,4194304] 0 2023-12-16T20:11:32.635 INFO:tasks.workunit.client.1.smithi141.stdout:9/234: link d1/d10/d14/d20/l11 d1/d10/d27/l55 0 2023-12-16T20:11:32.637 INFO:tasks.workunit.client.1.smithi141.stdout:6/339: mknod d1/c70 0 2023-12-16T20:11:32.638 INFO:tasks.workunit.client.1.smithi141.stdout:1/285: dwrite da/d36/d4b/d4d/f54 [0,4194304] 0 2023-12-16T20:11:32.638 INFO:tasks.workunit.client.1.smithi141.stdout:1/286: fsync da/d1a/f51 0 2023-12-16T20:11:32.638 INFO:tasks.workunit.client.0.smithi038.stdout:9/645: mknod d9/d1e/d45/cc1 0 2023-12-16T20:11:32.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/617: mknod d2/d14/d25/d2d/d17/d51/cc1 0 2023-12-16T20:11:32.639 INFO:tasks.workunit.client.1.smithi141.stdout:2/164: rename d6/d12/c1a to d6/da/d1b/d1c/c37 0 2023-12-16T20:11:32.642 INFO:tasks.workunit.client.0.smithi038.stdout:6/536: dwrite d1/f2c [0,4194304] 0 2023-12-16T20:11:32.642 INFO:tasks.workunit.client.0.smithi038.stdout:0/650: symlink db/d16/d19/d4e/dac/ldd 0 2023-12-16T20:11:32.642 INFO:tasks.workunit.client.0.smithi038.stdout:0/651: chown ca 18525 1 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.0.smithi038.stdout:0/652: truncate db/d1a/f85 211567 0 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.1.smithi141.stdout:0/302: link d4/d7/l6d d4/d7/d44/l6e 0 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.1.smithi141.stdout:3/351: truncate d0/f65 3871781 0 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.1.smithi141.stdout:3/352: dread - d0/d1c/d40/d3f/d52/f7b zero size 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.1.smithi141.stdout:3/353: dread - d0/d1c/d40/d3f/d52/f7b zero size 2023-12-16T20:11:32.643 INFO:tasks.workunit.client.1.smithi141.stdout:3/354: fdatasync d0/f3a 0 2023-12-16T20:11:32.644 INFO:tasks.workunit.client.1.smithi141.stdout:4/265: creat d1a/d3c/f65 x:0 0 0 2023-12-16T20:11:32.645 INFO:tasks.workunit.client.0.smithi038.stdout:1/634: creat d15/d1e/d3b/d48/d37/dde/fe0 x:0 0 0 2023-12-16T20:11:32.645 INFO:tasks.workunit.client.0.smithi038.stdout:1/635: write d15/d1e/d23/d34/f7a [1601288,55530] 0 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/636: chown d15/d1e/d23/f39 1 1 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/637: chown d15/d1e/d3b/d48/f97 67000 1 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/638: readlink d15/d1e/d3b/d48/d3d/l44 0 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.0.smithi038.stdout:3/585: sync 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.1.smithi141.stdout:0/303: dread d4/d7/d44/f4f [0,4194304] 0 2023-12-16T20:11:32.646 INFO:tasks.workunit.client.0.smithi038.stdout:9/646: mkdir d9/d1f/d21/d3e/d4e/d61/d9e/dc2 0 2023-12-16T20:11:32.647 INFO:tasks.workunit.client.1.smithi141.stdout:9/235: unlink d1/d10/d14/l16 0 2023-12-16T20:11:32.648 INFO:tasks.workunit.client.1.smithi141.stdout:9/236: creat d1/d10/d33/d39/f56 x:0 0 0 2023-12-16T20:11:32.648 INFO:tasks.workunit.client.1.smithi141.stdout:9/237: dread - d1/d10/d27/d36/f50 zero size 2023-12-16T20:11:32.649 INFO:tasks.workunit.client.0.smithi038.stdout:5/618: mkdir d2/df/d1a/d1f/d4a/d53/d6e/dc2 0 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.0.smithi038.stdout:5/619: write d2/d14/d25/d2d/d17/d93/fc0 [395358,112430] 0 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/467: sync 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/468: read d17/d1b/d66/d73/d54/d69/f26 [2885432,3358] 0 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/469: creat d17/d34/f92 x:0 0 0 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/470: write d17/d34/d3d/f4b [2439504,85683] 0 2023-12-16T20:11:32.650 INFO:tasks.workunit.client.1.smithi141.stdout:6/340: mknod d1/d12/c71 0 2023-12-16T20:11:32.651 INFO:tasks.workunit.client.1.smithi141.stdout:6/341: fdatasync d1/dd/f1e 0 2023-12-16T20:11:32.653 INFO:tasks.workunit.client.1.smithi141.stdout:1/287: truncate da/d1a/d1d/d22/d29/f37 219648 0 2023-12-16T20:11:32.654 INFO:tasks.workunit.client.1.smithi141.stdout:1/288: chown da/d36/d4b/d4d/f56 23 1 2023-12-16T20:11:32.654 INFO:tasks.workunit.client.0.smithi038.stdout:6/537: link d1/d4/d1d/d28/f37 d1/d16/fa7 0 2023-12-16T20:11:32.655 INFO:tasks.workunit.client.0.smithi038.stdout:7/535: dwrite da/d21/d86/fb0 [4194304,4194304] 0 2023-12-16T20:11:32.655 INFO:tasks.workunit.client.0.smithi038.stdout:0/653: mknod db/d1a/cde 0 2023-12-16T20:11:32.657 INFO:tasks.workunit.client.1.smithi141.stdout:2/165: link d6/f26 d6/d12/d15/f38 0 2023-12-16T20:11:32.658 INFO:tasks.workunit.client.0.smithi038.stdout:1/639: symlink d15/d1e/d3b/d48/d3d/le1 0 2023-12-16T20:11:32.660 INFO:tasks.workunit.client.1.smithi141.stdout:1/289: dread da/d1a/d1d/d22/d29/f3e [0,4194304] 0 2023-12-16T20:11:32.661 INFO:tasks.workunit.client.1.smithi141.stdout:8/311: dwrite d14/f25 [0,4194304] 0 2023-12-16T20:11:32.663 INFO:tasks.workunit.client.1.smithi141.stdout:3/355: mknod d0/d1c/d40/d3c/c7d 0 2023-12-16T20:11:32.663 INFO:tasks.workunit.client.1.smithi141.stdout:3/356: write d0/d1c/d2c/f2f [4276553,67317] 0 2023-12-16T20:11:32.663 INFO:tasks.workunit.client.1.smithi141.stdout:3/357: chown d0/f41 0 1 2023-12-16T20:11:32.663 INFO:tasks.workunit.client.1.smithi141.stdout:3/358: write d0/d1c/d40/d3c/d4b/d4c/f4f [4302306,81897] 0 2023-12-16T20:11:32.664 INFO:tasks.workunit.client.1.smithi141.stdout:0/304: dwrite d4/f31 [4194304,4194304] 0 2023-12-16T20:11:32.664 INFO:tasks.workunit.client.1.smithi141.stdout:0/305: write d4/d3a/f5b [382148,71270] 0 2023-12-16T20:11:32.669 INFO:tasks.workunit.client.1.smithi141.stdout:9/238: link d1/d10/d27/l28 d1/d10/d27/d36/l57 0 2023-12-16T20:11:32.672 INFO:tasks.workunit.client.0.smithi038.stdout:8/471: symlink d17/d1b/d66/d73/l93 0 2023-12-16T20:11:32.672 INFO:tasks.workunit.client.1.smithi141.stdout:2/166: read d6/f7 [3609885,25922] 0 2023-12-16T20:11:32.674 INFO:tasks.workunit.client.1.smithi141.stdout:1/290: write da/df/f4c [1961913,102802] 0 2023-12-16T20:11:32.675 INFO:tasks.workunit.client.1.smithi141.stdout:0/306: read d4/d3a/f46 [100378,68560] 0 2023-12-16T20:11:32.678 INFO:tasks.workunit.client.0.smithi038.stdout:6/538: rmdir d1/d4/d1d/d8a 0 2023-12-16T20:11:32.678 INFO:tasks.workunit.client.0.smithi038.stdout:1/640: dwrite d15/f1d [4194304,4194304] 0 2023-12-16T20:11:32.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/536: mknod da/d3e/d8e/cb3 0 2023-12-16T20:11:32.682 INFO:tasks.workunit.client.1.smithi141.stdout:8/312: mknod d14/d19/d1b/d3d/d5e/c63 0 2023-12-16T20:11:32.683 INFO:tasks.workunit.client.1.smithi141.stdout:8/313: truncate d14/d19/d1b/d24/f55 639718 0 2023-12-16T20:11:32.684 INFO:tasks.workunit.client.0.smithi038.stdout:0/654: rmdir db/db6 39 2023-12-16T20:11:32.684 INFO:tasks.workunit.client.0.smithi038.stdout:0/655: dread - db/d1a/fcf zero size 2023-12-16T20:11:32.685 INFO:tasks.workunit.client.1.smithi141.stdout:3/359: mknod d0/d1c/d6a/d76/c7e 0 2023-12-16T20:11:32.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/647: getdents d9/d1f/d21/d3e/d4e/d61/d9b 0 2023-12-16T20:11:32.689 INFO:tasks.workunit.client.1.smithi141.stdout:9/239: mknod d1/d10/d14/c58 0 2023-12-16T20:11:32.689 INFO:tasks.workunit.client.0.smithi038.stdout:5/620: getdents d2/d14/d25/d2d/d17/d55 0 2023-12-16T20:11:32.691 INFO:tasks.workunit.client.1.smithi141.stdout:1/291: truncate da/df/f13 807938 0 2023-12-16T20:11:32.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/537: mknod da/d21/d61/cb4 0 2023-12-16T20:11:32.694 INFO:tasks.workunit.client.1.smithi141.stdout:8/314: creat d14/f64 x:0 0 0 2023-12-16T20:11:32.697 INFO:tasks.workunit.client.1.smithi141.stdout:0/307: dwrite d4/f3e [0,4194304] 0 2023-12-16T20:11:32.699 INFO:tasks.workunit.client.1.smithi141.stdout:9/240: rename d1/d10/d14/d20/l11 to d1/d10/d14/d20/l59 0 2023-12-16T20:11:32.699 INFO:tasks.workunit.client.1.smithi141.stdout:3/360: creat d0/d1c/d6a/f7f x:0 0 0 2023-12-16T20:11:32.699 INFO:tasks.workunit.client.1.smithi141.stdout:3/361: fdatasync d0/d1c/d2c/f48 0 2023-12-16T20:11:32.699 INFO:tasks.workunit.client.1.smithi141.stdout:1/292: symlink da/l5b 0 2023-12-16T20:11:32.700 INFO:tasks.workunit.client.0.smithi038.stdout:4/586: truncate d13/d17/f95 610026 0 2023-12-16T20:11:32.704 INFO:tasks.workunit.client.0.smithi038.stdout:3/586: rename d4/d8/d15/d2c/d4c/d58 to d4/dcd 0 2023-12-16T20:11:32.705 INFO:tasks.workunit.client.0.smithi038.stdout:8/472: getdents d17/d1b/d53 0 2023-12-16T20:11:32.705 INFO:tasks.workunit.client.0.smithi038.stdout:8/473: write d17/f89 [746876,12542] 0 2023-12-16T20:11:32.709 INFO:tasks.workunit.client.0.smithi038.stdout:4/587: write d13/d17/d4b/da4/f94 [345915,93253] 0 2023-12-16T20:11:32.709 INFO:tasks.workunit.client.0.smithi038.stdout:4/588: write d13/d17/d2e/f52 [3196923,41312] 0 2023-12-16T20:11:32.712 INFO:tasks.workunit.client.0.smithi038.stdout:9/648: rename d9/d1e/d45/c57 to d9/d1f/d21/d52/cc3 0 2023-12-16T20:11:32.712 INFO:tasks.workunit.client.1.smithi141.stdout:0/308: mknod d4/d49/c6f 0 2023-12-16T20:11:32.714 INFO:tasks.workunit.client.1.smithi141.stdout:2/167: dwrite d6/f21 [0,4194304] 0 2023-12-16T20:11:32.714 INFO:tasks.workunit.client.1.smithi141.stdout:2/168: creat d6/d32/f39 x:0 0 0 2023-12-16T20:11:32.715 INFO:tasks.workunit.client.1.smithi141.stdout:9/241: symlink d1/d10/d27/l5a 0 2023-12-16T20:11:32.718 INFO:tasks.workunit.client.0.smithi038.stdout:7/538: unlink da/l13 0 2023-12-16T20:11:32.719 INFO:tasks.workunit.client.1.smithi141.stdout:3/362: link d0/d1c/d6a/f7f d0/d1c/d40/d3f/f80 0 2023-12-16T20:11:32.719 INFO:tasks.workunit.client.1.smithi141.stdout:3/363: fsync d0/d1c/d40/f43 0 2023-12-16T20:11:32.719 INFO:tasks.workunit.client.1.smithi141.stdout:0/309: write d4/fe [1369070,105915] 0 2023-12-16T20:11:32.725 INFO:tasks.workunit.client.1.smithi141.stdout:0/310: mknod d4/d5c/c70 0 2023-12-16T20:11:32.725 INFO:tasks.workunit.client.1.smithi141.stdout:0/311: fsync f2 0 2023-12-16T20:11:32.726 INFO:tasks.workunit.client.0.smithi038.stdout:4/589: mkdir d13/d17/d4b/d7d/dc0 0 2023-12-16T20:11:32.730 INFO:tasks.workunit.client.1.smithi141.stdout:0/312: creat d4/d49/f71 x:0 0 0 2023-12-16T20:11:32.730 INFO:tasks.workunit.client.1.smithi141.stdout:0/313: chown d4/l5 31219707 1 2023-12-16T20:11:32.732 INFO:tasks.workunit.client.0.smithi038.stdout:9/649: unlink d9/d1e/d3d/d42/d59/f91 0 2023-12-16T20:11:32.733 INFO:tasks.workunit.client.0.smithi038.stdout:3/587: getdents d4/d8/d15/d2c/d4c/d70 0 2023-12-16T20:11:32.739 INFO:tasks.workunit.client.1.smithi141.stdout:1/293: write da/d25/f26 [3575808,40363] 0 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:6/539: dwrite d1/d5b/d7d/d9d/f46 [4194304,4194304] 0 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:6/540: read - d1/d4/d1d/d28/f78 zero size 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:4/590: rename d13/d69/c86 to d13/cc1 0 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:4/591: dread d13/f37 [0,4194304] 0 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:9/650: rmdir d9/d1f/d21/d3e/d4e/d61 39 2023-12-16T20:11:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:3/588: getdents d4/d6c 0 2023-12-16T20:11:32.741 INFO:tasks.workunit.client.1.smithi141.stdout:1/294: write da/d1a/d1d/d22/f30 [142175,80037] 0 2023-12-16T20:11:32.741 INFO:tasks.workunit.client.1.smithi141.stdout:1/295: write da/d1a/d31/f47 [704802,59613] 0 2023-12-16T20:11:32.741 INFO:tasks.workunit.client.0.smithi038.stdout:3/589: mknod d4/d27/d23/cce 0 2023-12-16T20:11:32.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/169: rename d6/da/d1b/d1c to d6/d3a 0 2023-12-16T20:11:32.743 INFO:tasks.workunit.client.0.smithi038.stdout:3/590: getdents d4/dab 0 2023-12-16T20:11:32.746 INFO:tasks.workunit.client.0.smithi038.stdout:1/641: dwrite d15/d1e/d23/d34/f7a [0,4194304] 0 2023-12-16T20:11:32.746 INFO:tasks.workunit.client.0.smithi038.stdout:9/651: dread d9/d1f/d21/d55/f56 [0,4194304] 0 2023-12-16T20:11:32.746 INFO:tasks.workunit.client.0.smithi038.stdout:0/656: dwrite db/d16/d1c/f2a [4194304,4194304] 0 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.1.smithi141.stdout:1/296: creat da/d36/f5c x:0 0 0 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.1.smithi141.stdout:1/297: write da/d1a/d1d/d33/f55 [443354,47814] 0 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.0.smithi038.stdout:0/657: creat db/d16/d19/d80/dd4/fdf x:0 0 0 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.0.smithi038.stdout:0/658: fsync db/d16/d1c/fae 0 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.0.smithi038.stdout:0/659: chown db/d16/d5a/d65/d90/da7/lbf 700 1 2023-12-16T20:11:32.749 INFO:tasks.workunit.client.0.smithi038.stdout:0/660: read - db/d16/fa0 zero size 2023-12-16T20:11:32.751 INFO:tasks.workunit.client.1.smithi141.stdout:2/170: rename d6/c2e to d6/da/d33/c3b 0 2023-12-16T20:11:32.757 INFO:tasks.workunit.client.0.smithi038.stdout:6/541: dread d1/d4/f5e [0,4194304] 0 2023-12-16T20:11:32.757 INFO:tasks.workunit.client.0.smithi038.stdout:6/542: getdents d1/d4/d1d/d61/da4 0 2023-12-16T20:11:32.757 INFO:tasks.workunit.client.0.smithi038.stdout:5/621: dwrite d2/d14/d25/d2d/d17/d51/f76 [0,4194304] 0 2023-12-16T20:11:32.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/298: creat da/d1a/d1d/f5d x:0 0 0 2023-12-16T20:11:32.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/299: write da/df/f24 [1668719,56058] 0 2023-12-16T20:11:32.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/652: write d9/d1f/d21/d3e/d4e/d61/f89 [3105453,101583] 0 2023-12-16T20:11:32.759 INFO:tasks.workunit.client.1.smithi141.stdout:2/171: getdents d6/d12 0 2023-12-16T20:11:32.760 INFO:tasks.workunit.client.0.smithi038.stdout:5/622: rmdir d2/df/d1a/d2a/d59 39 2023-12-16T20:11:32.761 INFO:tasks.workunit.client.0.smithi038.stdout:7/539: dwrite da/d21/fac [0,4194304] 0 2023-12-16T20:11:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:1/642: write d15/d1e/d3b/d48/d37/f47 [3949029,127142] 0 2023-12-16T20:11:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:9/653: unlink d9/d1f/d21/d3e/d4e/d61/fb0 0 2023-12-16T20:11:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:1/643: fdatasync d15/f1d 0 2023-12-16T20:11:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:9/654: fdatasync d9/d1f/f5b 0 2023-12-16T20:11:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:1/644: fsync d15/d22/d62/fa6 0 2023-12-16T20:11:32.766 INFO:tasks.workunit.client.0.smithi038.stdout:5/623: truncate d2/df/d1a/d2a/f41 137782 0 2023-12-16T20:11:32.771 INFO:tasks.workunit.client.0.smithi038.stdout:7/540: creat da/d21/fb5 x:0 0 0 2023-12-16T20:11:32.771 INFO:tasks.workunit.client.1.smithi141.stdout:8/315: dwrite d14/d19/d1b/d24/f49 [0,4194304] 0 2023-12-16T20:11:32.775 INFO:tasks.workunit.client.0.smithi038.stdout:4/592: rename d13/cc1 to d13/d69/d7a/cc2 0 2023-12-16T20:11:32.778 INFO:tasks.workunit.client.0.smithi038.stdout:5/624: mknod d2/d14/d25/d2d/d17/d55/d6b/cc3 0 2023-12-16T20:11:32.778 INFO:tasks.workunit.client.1.smithi141.stdout:9/242: dwrite d1/d10/d14/f25 [4194304,4194304] 0 2023-12-16T20:11:32.778 INFO:tasks.workunit.client.1.smithi141.stdout:9/243: write d1/d10/d33/f34 [393150,129812] 0 2023-12-16T20:11:32.779 INFO:tasks.workunit.client.0.smithi038.stdout:8/474: dwrite d17/f24 [0,4194304] 0 2023-12-16T20:11:32.780 INFO:tasks.workunit.client.0.smithi038.stdout:7/541: symlink da/d21/d41/lb6 0 2023-12-16T20:11:32.781 INFO:tasks.workunit.client.1.smithi141.stdout:8/316: symlink d14/d19/d1b/d24/d4b/l65 0 2023-12-16T20:11:32.781 INFO:tasks.workunit.client.0.smithi038.stdout:1/645: getdents d15/d1e/d23/d34 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.0.smithi038.stdout:7/542: dread da/d21/f55 [0,4194304] 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/317: write d14/d19/d1b/f1a [1011376,107202] 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/318: chown d14/d19/d1b/d3d 0 1 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/319: getdents d14/d19/d1b/d24/d4a/d58 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/320: write d14/d19/d1b/f21 [4993579,1052] 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/321: write f11 [5172316,76279] 0 2023-12-16T20:11:32.782 INFO:tasks.workunit.client.1.smithi141.stdout:8/322: readlink d14/d19/d1b/d24/d4b/l4c 0 2023-12-16T20:11:32.783 INFO:tasks.workunit.client.1.smithi141.stdout:9/244: creat d1/d10/d33/d47/f5b x:0 0 0 2023-12-16T20:11:32.783 INFO:tasks.workunit.client.1.smithi141.stdout:9/245: write d1/d10/d33/f34 [514828,126297] 0 2023-12-16T20:11:32.784 INFO:tasks.workunit.client.1.smithi141.stdout:9/246: creat d1/d10/d14/d20/d3b/f5c x:0 0 0 2023-12-16T20:11:32.784 INFO:tasks.workunit.client.0.smithi038.stdout:9/655: fdatasync d9/d1f/d21/d3e/d4e/d61/f89 0 2023-12-16T20:11:32.784 INFO:tasks.workunit.client.0.smithi038.stdout:1/646: dread d15/d1e/d23/d34/d86/fa0 [0,4194304] 0 2023-12-16T20:11:32.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/543: dread da/d21/f55 [0,4194304] 0 2023-12-16T20:11:32.784 INFO:tasks.workunit.client.0.smithi038.stdout:4/593: mkdir d13/d17/d2e/d32/d70/d84/d88/dc3 0 2023-12-16T20:11:32.785 INFO:tasks.workunit.client.1.smithi141.stdout:0/314: dwrite d4/d7/f1e [0,4194304] 0 2023-12-16T20:11:32.787 INFO:tasks.workunit.client.0.smithi038.stdout:3/591: rename d4/d8/f42 to d4/dcd/fcf 0 2023-12-16T20:11:32.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/661: rename db/d16/d70 to db/d16/d70/d7c/de0 22 2023-12-16T20:11:32.789 INFO:tasks.workunit.client.0.smithi038.stdout:5/625: unlink d2/d14/d25/d2d/d17/d51/cc1 0 2023-12-16T20:11:32.789 INFO:tasks.workunit.client.0.smithi038.stdout:5/626: write d2/d14/d25/f79 [923593,18877] 0 2023-12-16T20:11:32.790 INFO:tasks.workunit.client.0.smithi038.stdout:5/627: write d2/d14/d25/d2d/d17/d51/f9c [55297,40463] 0 2023-12-16T20:11:32.790 INFO:tasks.workunit.client.0.smithi038.stdout:5/628: dread - d2/d14/d25/d2d/d17/d55/faa zero size 2023-12-16T20:11:32.790 INFO:tasks.workunit.client.0.smithi038.stdout:6/543: dwrite d1/d5b/f76 [0,4194304] 0 2023-12-16T20:11:32.791 INFO:tasks.workunit.client.1.smithi141.stdout:3/364: dwrite d0/f3a [0,4194304] 0 2023-12-16T20:11:32.791 INFO:tasks.workunit.client.1.smithi141.stdout:3/365: readlink d0/d1c/d6a/d76/l78 0 2023-12-16T20:11:32.792 INFO:tasks.workunit.client.1.smithi141.stdout:9/247: rename d1/d10/d14/d20/da/l2b to d1/d10/d27/l5d 0 2023-12-16T20:11:32.795 INFO:tasks.workunit.client.1.smithi141.stdout:0/315: rmdir d4/d49/d4b 39 2023-12-16T20:11:32.797 INFO:tasks.workunit.client.1.smithi141.stdout:3/366: creat d0/d1c/d40/f81 x:0 0 0 2023-12-16T20:11:32.803 INFO:tasks.workunit.client.0.smithi038.stdout:8/475: creat d17/d1b/d66/f94 x:0 0 0 2023-12-16T20:11:32.804 INFO:tasks.workunit.client.0.smithi038.stdout:9/656: unlink d9/d1f/f38 0 2023-12-16T20:11:32.805 INFO:tasks.workunit.client.0.smithi038.stdout:1/647: creat d15/d1e/d3b/d48/d37/dde/d75/fe2 x:0 0 0 2023-12-16T20:11:32.807 INFO:tasks.workunit.client.1.smithi141.stdout:2/172: dwrite d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:32.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/592: symlink d4/dcd/ld0 0 2023-12-16T20:11:32.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/593: write d4/d27/d23/f57 [521680,13797] 0 2023-12-16T20:11:32.808 INFO:tasks.workunit.client.1.smithi141.stdout:8/323: dwrite d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:32.808 INFO:tasks.workunit.client.1.smithi141.stdout:9/248: creat d1/d10/d14/d20/da/de/f5e x:0 0 0 2023-12-16T20:11:32.808 INFO:tasks.workunit.client.1.smithi141.stdout:8/324: creat d14/d35/f66 x:0 0 0 2023-12-16T20:11:32.808 INFO:tasks.workunit.client.0.smithi038.stdout:4/594: dwrite d13/d17/f36 [0,4194304] 0 2023-12-16T20:11:32.808 INFO:tasks.workunit.client.0.smithi038.stdout:4/595: fsync d13/d17/d62/fba 0 2023-12-16T20:11:32.809 INFO:tasks.workunit.client.0.smithi038.stdout:0/662: mknod db/d16/d19/d27/d78/ce1 0 2023-12-16T20:11:32.809 INFO:tasks.workunit.client.1.smithi141.stdout:0/316: link d4/d7/f1e d4/d5c/f72 0 2023-12-16T20:11:32.810 INFO:tasks.workunit.client.0.smithi038.stdout:0/663: write db/d16/d5a/d65/d90/da7/fc1 [212022,86725] 0 2023-12-16T20:11:32.810 INFO:tasks.workunit.client.0.smithi038.stdout:0/664: fsync db/db6/fdb 0 2023-12-16T20:11:32.816 INFO:tasks.workunit.client.1.smithi141.stdout:2/173: mkdir d6/d12/d3c 0 2023-12-16T20:11:32.816 INFO:tasks.workunit.client.1.smithi141.stdout:2/174: dread - d6/da/f35 zero size 2023-12-16T20:11:32.817 INFO:tasks.workunit.client.0.smithi038.stdout:6/544: creat d1/fa8 x:0 0 0 2023-12-16T20:11:32.818 INFO:tasks.workunit.client.0.smithi038.stdout:8/476: mknod d17/d1b/d25/c95 0 2023-12-16T20:11:32.818 INFO:tasks.workunit.client.0.smithi038.stdout:8/477: chown l12 81 1 2023-12-16T20:11:32.819 INFO:tasks.workunit.client.0.smithi038.stdout:9/657: mkdir d9/d1e/d3d/d42/d59/dc4 0 2023-12-16T20:11:32.820 INFO:tasks.workunit.client.0.smithi038.stdout:3/594: write d4/d18/f8b [442788,48463] 0 2023-12-16T20:11:32.821 INFO:tasks.workunit.client.1.smithi141.stdout:8/325: write d14/d19/d1b/d24/f49 [903151,110476] 0 2023-12-16T20:11:32.821 INFO:tasks.workunit.client.1.smithi141.stdout:8/326: creat d14/d35/f67 x:0 0 0 2023-12-16T20:11:32.821 INFO:tasks.workunit.client.0.smithi038.stdout:7/544: rmdir da/d21/d2c/d76/d9a 39 2023-12-16T20:11:32.824 INFO:tasks.workunit.client.1.smithi141.stdout:9/249: unlink d1/d10/d14/d20/d3b/c51 0 2023-12-16T20:11:32.824 INFO:tasks.workunit.client.1.smithi141.stdout:9/250: creat d1/d10/d33/d47/f5f x:0 0 0 2023-12-16T20:11:32.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/648: dwrite d15/d1e/d3b/d48/d37/dde/d75/fe2 [0,4194304] 0 2023-12-16T20:11:32.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/649: truncate d15/d1e/d23/d34/fbe 23318 0 2023-12-16T20:11:32.826 INFO:tasks.workunit.client.1.smithi141.stdout:0/317: unlink f1 0 2023-12-16T20:11:32.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/596: creat d13/d1f/fc4 x:0 0 0 2023-12-16T20:11:32.828 INFO:tasks.workunit.client.1.smithi141.stdout:3/367: rename d0/d1c/d40/c2e to d0/d1c/d6a/c82 0 2023-12-16T20:11:32.828 INFO:tasks.workunit.client.1.smithi141.stdout:3/368: dread - d0/d1c/d40/d3f/d52/f75 zero size 2023-12-16T20:11:32.829 INFO:tasks.workunit.client.0.smithi038.stdout:5/629: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4 0 2023-12-16T20:11:32.829 INFO:tasks.workunit.client.0.smithi038.stdout:5/630: creat d2/d14/d25/d2d/d17/da9/fc5 x:0 0 0 2023-12-16T20:11:32.831 INFO:tasks.workunit.client.1.smithi141.stdout:8/327: symlink d14/d19/d1b/d3d/l68 0 2023-12-16T20:11:32.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/665: symlink db/d16/d19/d4e/le2 0 2023-12-16T20:11:32.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/666: dread - db/d1a/fdc zero size 2023-12-16T20:11:32.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/667: write db/d16/d19/d27/f3b [1790362,109375] 0 2023-12-16T20:11:32.832 INFO:tasks.workunit.client.0.smithi038.stdout:8/478: mkdir d17/d34/d3d/d50/d96 0 2023-12-16T20:11:32.833 INFO:tasks.workunit.client.0.smithi038.stdout:8/479: write d17/d34/d3d/f4b [1670376,91639] 0 2023-12-16T20:11:32.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/658: creat d9/d1f/d21/d84/daf/fc5 x:0 0 0 2023-12-16T20:11:32.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/659: fdatasync d9/d1e/d3d/d42/d59/d76/f9a 0 2023-12-16T20:11:32.835 INFO:tasks.workunit.client.1.smithi141.stdout:8/328: dread d14/d19/d1b/d3d/f3e [0,4194304] 0 2023-12-16T20:11:32.835 INFO:tasks.workunit.client.1.smithi141.stdout:8/329: getdents d14/d19/d1b/d24/d4a/d58 0 2023-12-16T20:11:32.836 INFO:tasks.workunit.client.0.smithi038.stdout:2/652: sync 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:4/597: fsync d13/f19 0 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:4/598: creat d13/d1f/d98/fc5 x:0 0 0 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:4/599: write d13/d69/fbc [60326,105294] 0 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:4/600: creat d13/d69/d7a/fc6 x:0 0 0 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/595: symlink d4/d8/d15/ld1 0 2023-12-16T20:11:32.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/596: chown d4/d8/d15/d2c/d4c/dae 0 1 2023-12-16T20:11:32.839 INFO:tasks.workunit.client.1.smithi141.stdout:3/369: mknod d0/d1c/d40/d3c/d4b/c83 0 2023-12-16T20:11:32.839 INFO:tasks.workunit.client.1.smithi141.stdout:3/370: fdatasync d0/f29 0 2023-12-16T20:11:32.844 INFO:tasks.workunit.client.1.smithi141.stdout:0/318: rename d4/d3a to d4/d49/d73 0 2023-12-16T20:11:32.844 INFO:tasks.workunit.client.0.smithi038.stdout:5/631: truncate d2/df/d1a/d1f/d4a/d53/d6e/f8d 2786901 0 2023-12-16T20:11:32.847 INFO:tasks.workunit.client.0.smithi038.stdout:8/480: mkdir d17/d1b/d66/d8e/d97 0 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/660: unlink d9/d1e/d40/d5e/d71/fbf 0 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/661: fdatasync f2 0 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/662: readlink d9/d1e/d40/l8b 0 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/663: dread - d9/d1f/d6a/f97 zero size 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/664: write d9/d1e/d40/f41 [642469,3228] 0 2023-12-16T20:11:32.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/665: dread - d9/d1e/d45/fbd zero size 2023-12-16T20:11:32.851 INFO:tasks.workunit.client.0.smithi038.stdout:2/653: creat d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fe0 x:0 0 0 2023-12-16T20:11:32.851 INFO:tasks.workunit.client.0.smithi038.stdout:2/654: fdatasync d1/d5/d95/d61/dd4/d10/f4f 0 2023-12-16T20:11:32.851 INFO:tasks.workunit.client.0.smithi038.stdout:2/655: readlink d1/d5/d95/d61/dd4/d21/lc4 0 2023-12-16T20:11:32.851 INFO:tasks.workunit.client.0.smithi038.stdout:2/656: chown d1/d5/d95/d61/d66 1075 1 2023-12-16T20:11:32.851 INFO:tasks.workunit.client.1.smithi141.stdout:3/371: write d0/d1c/d40/d3f/d52/f59 [131784,4926] 0 2023-12-16T20:11:32.852 INFO:tasks.workunit.client.0.smithi038.stdout:4/601: stat d13/d17/d4b/da4/l4c 0 2023-12-16T20:11:32.853 INFO:tasks.workunit.client.1.smithi141.stdout:3/372: symlink d0/d1c/d2c/d72/l84 0 2023-12-16T20:11:32.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/373: write d0/d1c/d2c/f49 [160122,39108] 0 2023-12-16T20:11:32.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/374: truncate d0/d1c/d40/f45 4286822 0 2023-12-16T20:11:32.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/375: dread - d0/d1c/d40/d3f/f80 zero size 2023-12-16T20:11:32.855 INFO:tasks.workunit.client.1.smithi141.stdout:5/184: sync 2023-12-16T20:11:32.855 INFO:tasks.workunit.client.0.smithi038.stdout:1/650: getdents d15/d1e/d3b/d5a 0 2023-12-16T20:11:32.855 INFO:tasks.workunit.client.0.smithi038.stdout:1/651: write d15/d1e/d3b/d48/d37/dde/d75/f90 [849919,115126] 0 2023-12-16T20:11:32.856 INFO:tasks.workunit.client.1.smithi141.stdout:0/319: write d4/d49/d73/d3b/f67 [2811509,49816] 0 2023-12-16T20:11:32.859 INFO:tasks.workunit.client.0.smithi038.stdout:2/657: unlink d1/d5/d3d/l52 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/203: sync 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:4/266: sync 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:6/342: sync 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/204: creat d5/d2a/f3d x:0 0 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/205: write d5/d16/d1a/f1f [883723,114472] 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/206: fsync d5/f24 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/207: write d5/f11 [4370399,44266] 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/208: creat d5/d2a/f3e x:0 0 0 2023-12-16T20:11:32.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/209: truncate d5/d2a/f2c 1482667 0 2023-12-16T20:11:32.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/658: mknod d1/d5/d3d/d9e/ce1 0 2023-12-16T20:11:32.868 INFO:tasks.workunit.client.0.smithi038.stdout:6/545: dwrite d1/f71 [0,4194304] 0 2023-12-16T20:11:32.868 INFO:tasks.workunit.client.0.smithi038.stdout:5/632: dread d2/df/d1a/d2a/f50 [0,4194304] 0 2023-12-16T20:11:32.870 INFO:tasks.workunit.client.0.smithi038.stdout:9/666: dread d9/d1f/d21/f7e [0,4194304] 0 2023-12-16T20:11:32.870 INFO:tasks.workunit.client.0.smithi038.stdout:9/667: chown d9/d1f/d21/d3e/d4e/d64/cb4 40 1 2023-12-16T20:11:32.871 INFO:tasks.workunit.client.0.smithi038.stdout:9/668: creat d9/d1e/d40/fc6 x:0 0 0 2023-12-16T20:11:32.871 INFO:tasks.workunit.client.0.smithi038.stdout:5/633: dread d2/d14/d25/d2d/f63 [0,4194304] 0 2023-12-16T20:11:32.871 INFO:tasks.workunit.client.0.smithi038.stdout:7/545: dwrite da/d3e/d8e/f78 [0,4194304] 0 2023-12-16T20:11:32.871 INFO:tasks.workunit.client.0.smithi038.stdout:7/546: stat da/d21/l49 0 2023-12-16T20:11:32.873 INFO:tasks.workunit.client.1.smithi141.stdout:9/251: dwrite d1/d10/d33/d47/f5b [0,4194304] 0 2023-12-16T20:11:32.873 INFO:tasks.workunit.client.1.smithi141.stdout:9/252: rename d1 to d1/d26/d4a/d60 22 2023-12-16T20:11:32.879 INFO:tasks.workunit.client.0.smithi038.stdout:9/669: mknod d9/d1e/d3d/d42/d59/d76/cc7 0 2023-12-16T20:11:32.879 INFO:tasks.workunit.client.0.smithi038.stdout:9/670: creat d9/d1f/d21/d84/daf/fc8 x:0 0 0 2023-12-16T20:11:32.880 INFO:tasks.workunit.client.0.smithi038.stdout:6/546: getdents d1/d5b 0 2023-12-16T20:11:32.883 INFO:tasks.workunit.client.0.smithi038.stdout:7/547: mkdir da/d24/db7 0 2023-12-16T20:11:32.883 INFO:tasks.workunit.client.0.smithi038.stdout:0/668: getdents db/d16/d19/d4e 0 2023-12-16T20:11:32.885 INFO:tasks.workunit.client.1.smithi141.stdout:5/185: creat d0/d9/f34 x:0 0 0 2023-12-16T20:11:32.885 INFO:tasks.workunit.client.1.smithi141.stdout:5/186: write d0/d9/f15 [2785199,96671] 0 2023-12-16T20:11:32.885 INFO:tasks.workunit.client.1.smithi141.stdout:3/376: read d0/d1c/d40/d3c/d4b/d4c/f4f [64125,39321] 0 2023-12-16T20:11:32.886 INFO:tasks.workunit.client.0.smithi038.stdout:8/481: dwrite d17/d5a/f85 [0,4194304] 0 2023-12-16T20:11:32.886 INFO:tasks.workunit.client.0.smithi038.stdout:8/482: chown d17/d34/d3d/l75 3320466 1 2023-12-16T20:11:32.886 INFO:tasks.workunit.client.0.smithi038.stdout:8/483: creat d17/d1b/d66/f98 x:0 0 0 2023-12-16T20:11:32.886 INFO:tasks.workunit.client.0.smithi038.stdout:8/484: chown d17/d1d/d78/f7c 343 1 2023-12-16T20:11:32.886 INFO:tasks.workunit.client.0.smithi038.stdout:8/485: stat d17/d1b/d66/d73/d54/l5d 0 2023-12-16T20:11:32.887 INFO:tasks.workunit.client.0.smithi038.stdout:6/547: rename d1/d2e/c52 to d1/d4/d1d/d28/d2f/d85/da2/ca9 0 2023-12-16T20:11:32.887 INFO:tasks.workunit.client.0.smithi038.stdout:6/548: chown d1/d2e/l68 260052 1 2023-12-16T20:11:32.891 INFO:tasks.workunit.client.1.smithi141.stdout:0/320: chown d4/d7/l48 6094 1 2023-12-16T20:11:32.891 INFO:tasks.workunit.client.1.smithi141.stdout:0/321: write d4/d49/f71 [655779,128880] 0 2023-12-16T20:11:32.891 INFO:tasks.workunit.client.1.smithi141.stdout:0/322: stat d4/l5 0 2023-12-16T20:11:32.892 INFO:tasks.workunit.client.0.smithi038.stdout:7/548: symlink da/d24/d4d/dae/lb8 0 2023-12-16T20:11:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:9/671: write d9/d1f/d21/d55/f56 [3859364,109379] 0 2023-12-16T20:11:32.898 INFO:tasks.workunit.client.1.smithi141.stdout:4/267: symlink d1a/d4e/d63/l66 0 2023-12-16T20:11:32.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/602: dwrite d13/d17/d4b/da4/d9d/f9b [0,4194304] 0 2023-12-16T20:11:32.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/549: mknod d1/d4/d1d/d28/d2f/d85/da2/da5/caa 0 2023-12-16T20:11:32.901 INFO:tasks.workunit.client.0.smithi038.stdout:7/549: mknod da/d21/d2c/d76/cb9 0 2023-12-16T20:11:32.902 INFO:tasks.workunit.client.1.smithi141.stdout:5/187: read d0/d25/f2e [2659670,112613] 0 2023-12-16T20:11:32.904 INFO:tasks.workunit.client.0.smithi038.stdout:9/672: creat d9/d1f/d21/d3e/d72/d8a/fc9 x:0 0 0 2023-12-16T20:11:32.904 INFO:tasks.workunit.client.0.smithi038.stdout:9/673: fsync d9/d1f/d21/d3e/d72/f86 0 2023-12-16T20:11:32.904 INFO:tasks.workunit.client.0.smithi038.stdout:9/674: creat d9/d1e/d3d/d42/d59/d76/d8d/fca x:0 0 0 2023-12-16T20:11:32.906 INFO:tasks.workunit.client.0.smithi038.stdout:2/659: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f56 [4194304,4194304] 0 2023-12-16T20:11:32.907 INFO:tasks.workunit.client.0.smithi038.stdout:2/660: dread - d1/d5/fc7 zero size 2023-12-16T20:11:32.907 INFO:tasks.workunit.client.0.smithi038.stdout:1/652: dwrite d15/d1e/f4c [0,4194304] 0 2023-12-16T20:11:32.907 INFO:tasks.workunit.client.1.smithi141.stdout:7/210: dwrite d5/fc [0,4194304] 0 2023-12-16T20:11:32.907 INFO:tasks.workunit.client.1.smithi141.stdout:7/211: write d5/d2a/f3d [856834,44965] 0 2023-12-16T20:11:32.908 INFO:tasks.workunit.client.0.smithi038.stdout:3/597: dwrite d4/d27/d23/f57 [0,4194304] 0 2023-12-16T20:11:32.908 INFO:tasks.workunit.client.0.smithi038.stdout:8/486: rename d17/d1b/d66/d73/d54/d69/l43 to d17/d1d/l99 0 2023-12-16T20:11:32.911 INFO:tasks.workunit.client.1.smithi141.stdout:9/253: mknod d1/d10/d33/d39/c61 0 2023-12-16T20:11:32.911 INFO:tasks.workunit.client.1.smithi141.stdout:9/254: write d1/fc [2083567,70896] 0 2023-12-16T20:11:32.911 INFO:tasks.workunit.client.0.smithi038.stdout:4/603: creat d13/d17/d2e/d32/d4d/d78/fc7 x:0 0 0 2023-12-16T20:11:32.912 INFO:tasks.workunit.client.0.smithi038.stdout:7/550: rmdir da/d21/d2c/d76/d9a 39 2023-12-16T20:11:32.914 INFO:tasks.workunit.client.0.smithi038.stdout:7/551: write da/d24/f96 [952797,68903] 0 2023-12-16T20:11:32.917 INFO:tasks.workunit.client.0.smithi038.stdout:9/675: mknod d9/d1e/d3d/d42/d59/dc4/ccb 0 2023-12-16T20:11:32.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/661: creat d1/d5/d95/d61/dd4/d21/d82/d92/fe2 x:0 0 0 2023-12-16T20:11:32.922 INFO:tasks.workunit.client.0.smithi038.stdout:2/662: readlink d1/d5/d95/d61/dd4/d21/d82/d92/lc2 0 2023-12-16T20:11:32.928 INFO:tasks.workunit.client.0.smithi038.stdout:7/552: dread f6 [4194304,4194304] 0 2023-12-16T20:11:32.931 INFO:tasks.workunit.client.1.smithi141.stdout:5/188: mkdir d0/d9/d16/d2a/d35 0 2023-12-16T20:11:32.937 INFO:tasks.workunit.client.0.smithi038.stdout:6/550: rename d1/d4/d1d/d28/c3f to d1/d4/d1d/d67/d73/cab 0 2023-12-16T20:11:32.937 INFO:tasks.workunit.client.0.smithi038.stdout:6/551: dread - d1/d4/d1d/d28/f79 zero size 2023-12-16T20:11:32.941 INFO:tasks.workunit.client.1.smithi141.stdout:9/255: dwrite d1/d10/d33/d39/f40 [4194304,4194304] 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/256: truncate d1/d10/d33/d47/f5b 5222937 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/257: write d1/d10/f15 [1460600,69923] 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/258: write d1/d26/f4d [415138,24030] 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/259: creat d1/d10/d33/d39/f62 x:0 0 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/260: write d1/fc [2925674,37405] 0 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:9/261: dread - d1/d10/d33/d39/f62 zero size 2023-12-16T20:11:32.942 INFO:tasks.workunit.client.1.smithi141.stdout:3/377: rename d0/d1c/d40/d3c/d4b to d0/d1c/d40/d85 0 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:4/604: mkdir d13/d17/d2e/d32/d4d/d78/dc8 0 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:4/605: read - d13/d17/d62/fba zero size 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:8/487: dwrite d17/f40 [4194304,4194304] 0 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:8/488: creat d17/d1b/d66/d8e/f9a x:0 0 0 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:2/663: rmdir d1/d5/d16/dc0 0 2023-12-16T20:11:32.943 INFO:tasks.workunit.client.0.smithi038.stdout:2/664: stat d1/d5/d95/d61/dd4/d21/d82/d92/fe2 0 2023-12-16T20:11:32.944 INFO:tasks.workunit.client.1.smithi141.stdout:5/189: link d0/d14/f31 d0/d25/d30/f36 0 2023-12-16T20:11:32.945 INFO:tasks.workunit.client.0.smithi038.stdout:6/552: rmdir d1/d5b 39 2023-12-16T20:11:32.946 INFO:tasks.workunit.client.0.smithi038.stdout:6/553: read - d1/d4/f9c zero size 2023-12-16T20:11:32.947 INFO:tasks.workunit.client.0.smithi038.stdout:4/606: creat d13/d17/d2e/d32/d70/db2/fc9 x:0 0 0 2023-12-16T20:11:32.947 INFO:tasks.workunit.client.0.smithi038.stdout:4/607: fsync d13/d69/fbc 0 2023-12-16T20:11:32.948 INFO:tasks.workunit.client.1.smithi141.stdout:9/262: mkdir d1/d10/d14/d20/d3b/d63 0 2023-12-16T20:11:32.948 INFO:tasks.workunit.client.1.smithi141.stdout:9/263: fdatasync d1/d10/f12 0 2023-12-16T20:11:32.951 INFO:tasks.workunit.client.1.smithi141.stdout:3/378: write d0/f6 [6461581,91718] 0 2023-12-16T20:11:32.953 INFO:tasks.workunit.client.0.smithi038.stdout:8/489: mkdir d17/d1d/d82/d9b 0 2023-12-16T20:11:32.953 INFO:tasks.workunit.client.0.smithi038.stdout:2/665: mknod d1/d5/d16/ce3 0 2023-12-16T20:11:32.953 INFO:tasks.workunit.client.0.smithi038.stdout:2/666: write d1/d5/d95/d61/dd4/d6a/d43/faa [1248340,7709] 0 2023-12-16T20:11:32.953 INFO:tasks.workunit.client.0.smithi038.stdout:7/553: mkdir da/d3e/dba 0 2023-12-16T20:11:32.954 INFO:tasks.workunit.client.0.smithi038.stdout:7/554: write da/d24/faf [40288,78078] 0 2023-12-16T20:11:32.954 INFO:tasks.workunit.client.0.smithi038.stdout:1/653: dwrite d15/d1e/d3b/d48/d37/f88 [0,4194304] 0 2023-12-16T20:11:32.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/554: creat d1/d16/d23/d5f/fac x:0 0 0 2023-12-16T20:11:32.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/555: write d1/d4/f8 [7283149,87108] 0 2023-12-16T20:11:32.955 INFO:tasks.workunit.client.0.smithi038.stdout:6/556: dread - d1/d4/d1d/d28/f79 zero size 2023-12-16T20:11:32.956 INFO:tasks.workunit.client.1.smithi141.stdout:5/190: read d0/d14/f1b [94050,9579] 0 2023-12-16T20:11:32.956 INFO:tasks.workunit.client.1.smithi141.stdout:5/191: creat d0/d14/f37 x:0 0 0 2023-12-16T20:11:32.956 INFO:tasks.workunit.client.0.smithi038.stdout:8/490: mknod d17/d5a/c9c 0 2023-12-16T20:11:32.956 INFO:tasks.workunit.client.0.smithi038.stdout:8/491: chown d17/d1b/d66/d73/d54/l5d 472787744 1 2023-12-16T20:11:32.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/667: link d1/d5/d95/d61/dd4/d10/d2f/ccb d1/d5/d95/d61/d66/ce4 0 2023-12-16T20:11:32.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/668: read - d1/d5/d95/fb7 zero size 2023-12-16T20:11:32.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/555: dread da/d3e/d31/d38/d90/f2d [0,4194304] 0 2023-12-16T20:11:32.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/556: readlink da/d3e/d31/l8b 0 2023-12-16T20:11:32.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/654: fsync d15/d1e/d3b/d48/d37/f6a 0 2023-12-16T20:11:32.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/655: chown d15/d22/d62/fa8 16078434 1 2023-12-16T20:11:32.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/656: write d15/d22/d52/f91 [699815,85996] 0 2023-12-16T20:11:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/492: symlink d17/d1b/d66/l9d 0 2023-12-16T20:11:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/493: write d17/d1b/d25/f41 [36468,87053] 0 2023-12-16T20:11:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/494: write d17/d1b/d66/d73/d54/d69/f7e [27190,11512] 0 2023-12-16T20:11:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/495: stat d17/d34/d3d/d50/d7d 0 2023-12-16T20:11:32.961 INFO:tasks.workunit.client.1.smithi141.stdout:4/268: rename d1a/c27 to d1a/d2a/c67 0 2023-12-16T20:11:32.964 INFO:tasks.workunit.client.0.smithi038.stdout:2/669: creat d1/d5/d95/d61/dd4/d21/d9a/db9/fe5 x:0 0 0 2023-12-16T20:11:32.965 INFO:tasks.workunit.client.0.smithi038.stdout:7/557: symlink da/d21/d86/lbb 0 2023-12-16T20:11:32.965 INFO:tasks.workunit.client.0.smithi038.stdout:7/558: chown da/d3e/d31/c88 115993767 1 2023-12-16T20:11:32.966 INFO:tasks.workunit.client.1.smithi141.stdout:3/379: symlink d0/d1c/d40/d3f/d52/d5a/l86 0 2023-12-16T20:11:32.966 INFO:tasks.workunit.client.0.smithi038.stdout:1/657: symlink d15/d1e/d3b/d48/d3d/dc8/le3 0 2023-12-16T20:11:32.966 INFO:tasks.workunit.client.0.smithi038.stdout:1/658: dread - d15/d1e/d3b/d48/d3d/f54 zero size 2023-12-16T20:11:32.966 INFO:tasks.workunit.client.0.smithi038.stdout:6/557: write d1/d4/f62 [3871565,63760] 0 2023-12-16T20:11:32.967 INFO:tasks.workunit.client.0.smithi038.stdout:1/659: fdatasync d15/f24 0 2023-12-16T20:11:32.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/496: unlink d17/d1b/d66/d73/d54/d69/l2f 0 2023-12-16T20:11:32.968 INFO:tasks.workunit.client.0.smithi038.stdout:7/559: truncate da/d24/f9f 1236059 0 2023-12-16T20:11:32.969 INFO:tasks.workunit.client.1.smithi141.stdout:9/264: dwrite d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:32.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/660: creat d15/d22/d71/fe4 x:0 0 0 2023-12-16T20:11:32.971 INFO:tasks.workunit.client.1.smithi141.stdout:7/212: rename d5/d1d/l21 to d5/d16/d30/d36/l3f 0 2023-12-16T20:11:32.973 INFO:tasks.workunit.client.1.smithi141.stdout:4/269: mknod d1a/d4e/d63/c68 0 2023-12-16T20:11:32.973 INFO:tasks.workunit.client.1.smithi141.stdout:4/270: write d1a/d4e/f56 [714705,74766] 0 2023-12-16T20:11:32.974 INFO:tasks.workunit.client.0.smithi038.stdout:1/661: truncate d15/d1e/d3b/d48/d37/f40 1910725 0 2023-12-16T20:11:32.974 INFO:tasks.workunit.client.1.smithi141.stdout:3/380: creat d0/d1c/d2c/f87 x:0 0 0 2023-12-16T20:11:32.974 INFO:tasks.workunit.client.1.smithi141.stdout:3/381: write d0/d1c/d2c/f48 [1129366,77022] 0 2023-12-16T20:11:32.976 INFO:tasks.workunit.client.0.smithi038.stdout:7/560: getdents da/d3e/d31/d38/d65 0 2023-12-16T20:11:32.976 INFO:tasks.workunit.client.0.smithi038.stdout:7/561: write da/d21/d41/d6b/f7f [175217,60085] 0 2023-12-16T20:11:32.976 INFO:tasks.workunit.client.1.smithi141.stdout:9/265: mknod d1/d10/d27/d36/c64 0 2023-12-16T20:11:32.977 INFO:tasks.workunit.client.1.smithi141.stdout:5/192: dwrite d0/d14/f22 [0,4194304] 0 2023-12-16T20:11:32.978 INFO:tasks.workunit.client.1.smithi141.stdout:4/271: mkdir d1a/d2a/d3b/d69 0 2023-12-16T20:11:32.980 INFO:tasks.workunit.client.1.smithi141.stdout:3/382: symlink d0/d1c/d6a/d76/l88 0 2023-12-16T20:11:32.980 INFO:tasks.workunit.client.1.smithi141.stdout:4/272: read d1a/f35 [521282,46812] 0 2023-12-16T20:11:32.980 INFO:tasks.workunit.client.1.smithi141.stdout:4/273: write f14 [322718,44632] 0 2023-12-16T20:11:32.984 INFO:tasks.workunit.client.0.smithi038.stdout:7/562: write da/d21/f50 [350902,3363] 0 2023-12-16T20:11:32.984 INFO:tasks.workunit.client.0.smithi038.stdout:7/563: creat da/d21/d61/fbc x:0 0 0 2023-12-16T20:11:32.985 INFO:tasks.workunit.client.1.smithi141.stdout:9/266: symlink d1/d10/d33/d39/l65 0 2023-12-16T20:11:32.985 INFO:tasks.workunit.client.0.smithi038.stdout:7/564: dread da/d21/f55 [0,4194304] 0 2023-12-16T20:11:32.987 INFO:tasks.workunit.client.1.smithi141.stdout:5/193: mknod d0/d9/c38 0 2023-12-16T20:11:32.987 INFO:tasks.workunit.client.1.smithi141.stdout:5/194: readlink d0/d14/l29 0 2023-12-16T20:11:32.989 INFO:tasks.workunit.client.1.smithi141.stdout:4/274: creat d1a/d54/f6a x:0 0 0 2023-12-16T20:11:32.989 INFO:tasks.workunit.client.1.smithi141.stdout:4/275: read - d1a/f29 zero size 2023-12-16T20:11:32.989 INFO:tasks.workunit.client.1.smithi141.stdout:4/276: creat d1a/d2a/f6b x:0 0 0 2023-12-16T20:11:32.989 INFO:tasks.workunit.client.1.smithi141.stdout:4/277: creat d1a/d2a/f6c x:0 0 0 2023-12-16T20:11:32.991 INFO:tasks.workunit.client.1.smithi141.stdout:7/213: dwrite d5/f22 [0,4194304] 0 2023-12-16T20:11:32.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/267: mkdir d1/d10/d14/d20/da/d3f/d66 0 2023-12-16T20:11:32.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/268: fdatasync d1/d10/f12 0 2023-12-16T20:11:32.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/269: truncate d1/d10/d14/d20/d3b/f46 1313889 0 2023-12-16T20:11:32.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/270: write d1/d10/d14/d20/da/f38 [5004598,70307] 0 2023-12-16T20:11:32.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/271: chown d1/d10/d14/d20/da/f38 92764 1 2023-12-16T20:11:32.993 INFO:tasks.workunit.client.1.smithi141.stdout:9/272: creat d1/d10/d14/d20/d3b/f67 x:0 0 0 2023-12-16T20:11:32.993 INFO:tasks.workunit.client.1.smithi141.stdout:9/273: fdatasync d1/d10/d33/f34 0 2023-12-16T20:11:32.993 INFO:tasks.workunit.client.1.smithi141.stdout:9/274: fsync d1/d10/d14/d20/da/de/f5e 0 2023-12-16T20:11:32.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/195: mknod d0/d14/c39 0 2023-12-16T20:11:32.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/196: creat d0/df/f3a x:0 0 0 2023-12-16T20:11:33.001 INFO:tasks.workunit.client.0.smithi038.stdout:8/497: write d17/d1d/f71 [3968055,102721] 0 2023-12-16T20:11:33.001 INFO:tasks.workunit.client.0.smithi038.stdout:8/498: chown d17/d1b/d66/d73/d55 436 1 2023-12-16T20:11:33.002 INFO:tasks.workunit.client.0.smithi038.stdout:8/499: dread - d17/d34/f92 zero size 2023-12-16T20:11:33.002 INFO:tasks.workunit.client.0.smithi038.stdout:1/662: dwrite d15/d1e/d23/f35 [0,4194304] 0 2023-12-16T20:11:33.004 INFO:tasks.workunit.client.1.smithi141.stdout:7/214: truncate d5/f24 1158946 0 2023-12-16T20:11:33.005 INFO:tasks.workunit.client.0.smithi038.stdout:1/663: dread d15/d22/d52/f89 [0,4194304] 0 2023-12-16T20:11:33.008 INFO:tasks.workunit.client.0.smithi038.stdout:1/664: creat d15/d1e/d3b/d48/d37/dde/d75/dc6/fe5 x:0 0 0 2023-12-16T20:11:33.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/665: rmdir d15/d22/d52 39 2023-12-16T20:11:33.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/666: fsync d15/d1e/d23/d34/f5d 0 2023-12-16T20:11:33.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/667: stat d15/d1e/d3b/d48/f97 0 2023-12-16T20:11:33.012 INFO:tasks.workunit.client.0.smithi038.stdout:1/668: write d15/d1e/d23/d34/d86/fa0 [198954,50405] 0 2023-12-16T20:11:33.013 INFO:tasks.workunit.client.0.smithi038.stdout:1/669: mknod d15/d1e/db0/ce6 0 2023-12-16T20:11:33.018 INFO:tasks.workunit.client.1.smithi141.stdout:7/215: write d5/f11 [3934115,84610] 0 2023-12-16T20:11:33.037 INFO:tasks.workunit.client.1.smithi141.stdout:9/275: dwrite d1/d10/d14/d20/d3b/f67 [0,4194304] 0 2023-12-16T20:11:33.090 INFO:tasks.workunit.client.0.smithi038.stdout:7/565: dwrite da/d3e/d31/d38/d90/f16 [4194304,4194304] 0 2023-12-16T20:11:33.094 INFO:tasks.workunit.client.1.smithi141.stdout:5/197: dwrite d0/d9/f34 [0,4194304] 0 2023-12-16T20:11:33.094 INFO:tasks.workunit.client.1.smithi141.stdout:5/198: fsync d0/d9/d16/f2d 0 2023-12-16T20:11:33.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/500: dwrite d17/d1b/d66/d8e/f9a [0,4194304] 0 2023-12-16T20:11:33.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/501: getdents d17/d1b/d66/d8e/d97 0 2023-12-16T20:11:33.097 INFO:tasks.workunit.client.0.smithi038.stdout:1/670: dwrite d15/d1e/f67 [0,4194304] 0 2023-12-16T20:11:33.097 INFO:tasks.workunit.client.0.smithi038.stdout:1/671: creat d15/d22/d62/fe7 x:0 0 0 2023-12-16T20:11:33.098 INFO:tasks.workunit.client.0.smithi038.stdout:7/566: write da/d3e/d31/d38/d90/f15 [2609493,125524] 0 2023-12-16T20:11:33.098 INFO:tasks.workunit.client.1.smithi141.stdout:4/278: getdents d1a/d3c 0 2023-12-16T20:11:33.098 INFO:tasks.workunit.client.1.smithi141.stdout:4/279: chown d1a/d2a/c38 10467 1 2023-12-16T20:11:33.101 INFO:tasks.workunit.client.0.smithi038.stdout:1/672: getdents d15/d1e/d3b/d48 0 2023-12-16T20:11:33.101 INFO:tasks.workunit.client.0.smithi038.stdout:1/673: chown d15/d1e/d23/d34/d79/f9c 42152 1 2023-12-16T20:11:33.101 INFO:tasks.workunit.client.1.smithi141.stdout:7/216: mkdir d5/d16/d1a/d40 0 2023-12-16T20:11:33.102 INFO:tasks.workunit.client.1.smithi141.stdout:7/217: chown d5/d1d/d1e 11207 1 2023-12-16T20:11:33.102 INFO:tasks.workunit.client.1.smithi141.stdout:7/218: creat d5/d2a/f41 x:0 0 0 2023-12-16T20:11:33.102 INFO:tasks.workunit.client.1.smithi141.stdout:9/276: creat d1/d10/d14/d20/da/d3f/f68 x:0 0 0 2023-12-16T20:11:33.102 INFO:tasks.workunit.client.1.smithi141.stdout:9/277: readlink d1/d10/d27/l55 0 2023-12-16T20:11:33.103 INFO:tasks.workunit.client.0.smithi038.stdout:7/567: mkdir da/d3e/d31/d38/d65/d81/dbd 0 2023-12-16T20:11:33.105 INFO:tasks.workunit.client.0.smithi038.stdout:1/674: getdents d15/d22/d52/d7f 0 2023-12-16T20:11:33.107 INFO:tasks.workunit.client.0.smithi038.stdout:8/502: rename d17/d1d/d78 to d17/d1b/d66/d73/d9e 0 2023-12-16T20:11:33.107 INFO:tasks.workunit.client.0.smithi038.stdout:8/503: truncate d17/d1b/d66/d73/d54/f8c 46231 0 2023-12-16T20:11:33.107 INFO:tasks.workunit.client.1.smithi141.stdout:1/300: sync 2023-12-16T20:11:33.107 INFO:tasks.workunit.client.0.smithi038.stdout:7/568: truncate da/d21/d61/f66 649604 0 2023-12-16T20:11:33.108 INFO:tasks.workunit.client.0.smithi038.stdout:7/569: dread - da/d3e/d31/d38/d65/f77 zero size 2023-12-16T20:11:33.109 INFO:tasks.workunit.client.0.smithi038.stdout:1/675: mknod d15/d1e/d3b/d48/d37/dde/d75/dbc/ce8 0 2023-12-16T20:11:33.111 INFO:tasks.workunit.client.0.smithi038.stdout:1/676: mkdir d15/d1e/d23/d7d/de9 0 2023-12-16T20:11:33.112 INFO:tasks.workunit.client.0.smithi038.stdout:1/677: truncate d15/d1e/d23/f78 866195 0 2023-12-16T20:11:33.115 INFO:tasks.workunit.client.1.smithi141.stdout:7/219: symlink d5/d1d/d1e/d27/l42 0 2023-12-16T20:11:33.116 INFO:tasks.workunit.client.1.smithi141.stdout:1/301: dread da/d25/f40 [0,4194304] 0 2023-12-16T20:11:33.118 INFO:tasks.workunit.client.1.smithi141.stdout:5/199: rename d0/lb to d0/d9/d16/d2a/l3b 0 2023-12-16T20:11:33.118 INFO:tasks.workunit.client.1.smithi141.stdout:5/200: truncate d0/f2b 680658 0 2023-12-16T20:11:33.119 INFO:tasks.workunit.client.1.smithi141.stdout:5/201: write d0/f2b [1362657,80411] 0 2023-12-16T20:11:33.119 INFO:tasks.workunit.client.0.smithi038.stdout:7/570: write da/d3e/d31/d38/d90/f16 [214036,108366] 0 2023-12-16T20:11:33.120 INFO:tasks.workunit.client.1.smithi141.stdout:4/280: mknod d1a/c6d 0 2023-12-16T20:11:33.122 INFO:tasks.workunit.client.0.smithi038.stdout:7/571: dread da/d21/d61/f66 [0,4194304] 0 2023-12-16T20:11:33.122 INFO:tasks.workunit.client.0.smithi038.stdout:8/504: dwrite d17/d34/d3d/d50/f6e [0,4194304] 0 2023-12-16T20:11:33.124 INFO:tasks.workunit.client.1.smithi141.stdout:7/220: symlink d5/d16/d30/l43 0 2023-12-16T20:11:33.126 INFO:tasks.workunit.client.1.smithi141.stdout:1/302: creat da/d25/f5e x:0 0 0 2023-12-16T20:11:33.127 INFO:tasks.workunit.client.1.smithi141.stdout:4/281: rmdir d1a/d59 39 2023-12-16T20:11:33.128 INFO:tasks.workunit.client.1.smithi141.stdout:4/282: truncate d1a/d54/f6a 545275 0 2023-12-16T20:11:33.128 INFO:tasks.workunit.client.0.smithi038.stdout:8/505: rename d17/d1b/d66/d73/d4e/f49 to d17/d1b/d66/d73/d4e/f9f 0 2023-12-16T20:11:33.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/506: rename d17/c4a to d17/d1b/d66/d8e/d97/ca0 0 2023-12-16T20:11:33.132 INFO:tasks.workunit.client.1.smithi141.stdout:7/221: getdents d5 0 2023-12-16T20:11:33.133 INFO:tasks.workunit.client.0.smithi038.stdout:8/507: getdents d17/d1b/d66/d73 0 2023-12-16T20:11:33.133 INFO:tasks.workunit.client.1.smithi141.stdout:7/222: mknod d5/d16/c44 0 2023-12-16T20:11:33.134 INFO:tasks.workunit.client.0.smithi038.stdout:8/508: mknod d17/d1b/d66/d73/d54/ca1 0 2023-12-16T20:11:33.136 INFO:tasks.workunit.client.1.smithi141.stdout:7/223: rename d5/d38 to d5/d2a/d45 0 2023-12-16T20:11:33.136 INFO:tasks.workunit.client.0.smithi038.stdout:8/509: creat d17/d1b/d66/d73/d4e/fa2 x:0 0 0 2023-12-16T20:11:33.136 INFO:tasks.workunit.client.0.smithi038.stdout:8/510: truncate d17/d1b/d25/f41 649496 0 2023-12-16T20:11:33.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/511: symlink d17/d1b/d66/d8e/d97/la3 0 2023-12-16T20:11:33.138 INFO:tasks.workunit.client.0.smithi038.stdout:8/512: creat d17/d1d/d82/fa4 x:0 0 0 2023-12-16T20:11:33.138 INFO:tasks.workunit.client.1.smithi141.stdout:7/224: mkdir d5/d16/d46 0 2023-12-16T20:11:33.139 INFO:tasks.workunit.client.0.smithi038.stdout:8/513: mkdir d17/d1b/d66/d73/d55/da5 0 2023-12-16T20:11:33.140 INFO:tasks.workunit.client.1.smithi141.stdout:1/303: write da/fb [1170977,78504] 0 2023-12-16T20:11:33.141 INFO:tasks.workunit.client.1.smithi141.stdout:7/225: write d5/f24 [1442095,43799] 0 2023-12-16T20:11:33.141 INFO:tasks.workunit.client.1.smithi141.stdout:7/226: readlink d5/d16/d30/d36/l3f 0 2023-12-16T20:11:33.141 INFO:tasks.workunit.client.1.smithi141.stdout:7/227: readlink d5/d16/d1a/l1b 0 2023-12-16T20:11:33.144 INFO:tasks.workunit.client.1.smithi141.stdout:7/228: creat d5/f47 x:0 0 0 2023-12-16T20:11:33.147 INFO:tasks.workunit.client.0.smithi038.stdout:1/678: dwrite d15/d1e/f4c [0,4194304] 0 2023-12-16T20:11:33.149 INFO:tasks.workunit.client.1.smithi141.stdout:1/304: write da/d25/f2f [3697834,57926] 0 2023-12-16T20:11:33.150 INFO:tasks.workunit.client.1.smithi141.stdout:1/305: write da/d1a/d1d/d22/d29/f37 [435674,47993] 0 2023-12-16T20:11:33.151 INFO:tasks.workunit.client.1.smithi141.stdout:5/202: dwrite d0/d9/d16/f2d [0,4194304] 0 2023-12-16T20:11:33.151 INFO:tasks.workunit.client.1.smithi141.stdout:5/203: fdatasync d0/d9/d16/f21 0 2023-12-16T20:11:33.151 INFO:tasks.workunit.client.0.smithi038.stdout:7/572: dwrite da/d21/f34 [0,4194304] 0 2023-12-16T20:11:33.151 INFO:tasks.workunit.client.0.smithi038.stdout:7/573: readlink da/d21/d2c/l71 0 2023-12-16T20:11:33.152 INFO:tasks.workunit.client.1.smithi141.stdout:1/306: mknod da/d36/d4b/c5f 0 2023-12-16T20:11:33.153 INFO:tasks.workunit.client.0.smithi038.stdout:1/679: dread d15/d1e/d3b/d48/d37/f47 [0,4194304] 0 2023-12-16T20:11:33.155 INFO:tasks.workunit.client.0.smithi038.stdout:1/680: creat d15/d1e/d23/d34/d86/d99/fea x:0 0 0 2023-12-16T20:11:33.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/229: read d5/d2a/f37 [3397533,19998] 0 2023-12-16T20:11:33.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/230: fsync d5/f3b 0 2023-12-16T20:11:33.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/231: fdatasync d5/d2a/f37 0 2023-12-16T20:11:33.157 INFO:tasks.workunit.client.1.smithi141.stdout:7/232: dread - d5/d2a/f34 zero size 2023-12-16T20:11:33.159 INFO:tasks.workunit.client.0.smithi038.stdout:1/681: rename d15/d22/d71 to d15/d1e/d3b/d48/d37/deb 0 2023-12-16T20:11:33.162 INFO:tasks.workunit.client.1.smithi141.stdout:5/204: mknod d0/d14/c3c 0 2023-12-16T20:11:33.164 INFO:tasks.workunit.client.1.smithi141.stdout:1/307: rename da/d1a/d1d/d33/f55 to da/d1a/d1d/d22/f60 0 2023-12-16T20:11:33.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/205: chown d0/l7 3 1 2023-12-16T20:11:33.165 INFO:tasks.workunit.client.1.smithi141.stdout:5/206: chown d0/d14/f37 1 1 2023-12-16T20:11:33.166 INFO:tasks.workunit.client.0.smithi038.stdout:8/514: dwrite f1 [0,4194304] 0 2023-12-16T20:11:33.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/308: mkdir da/d1a/d1d/d22/d29/d61 0 2023-12-16T20:11:33.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/309: write da/d1a/f59 [610534,89632] 0 2023-12-16T20:11:33.167 INFO:tasks.workunit.client.1.smithi141.stdout:5/207: mknod d0/df/c3d 0 2023-12-16T20:11:33.168 INFO:tasks.workunit.client.0.smithi038.stdout:7/574: write da/d21/d86/d92/fab [3864371,65687] 0 2023-12-16T20:11:33.168 INFO:tasks.workunit.client.0.smithi038.stdout:7/575: chown da/d3e/d31/d38/d65/d81/ca4 4042310 1 2023-12-16T20:11:33.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/515: mkdir d17/d1b/d66/d73/d55/da5/da6 0 2023-12-16T20:11:33.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/516: write d17/d1b/d66/d8e/f91 [936474,25373] 0 2023-12-16T20:11:33.170 INFO:tasks.workunit.client.1.smithi141.stdout:1/310: unlink da/df/f13 0 2023-12-16T20:11:33.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/576: creat da/d3e/d31/d38/fbe x:0 0 0 2023-12-16T20:11:33.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/577: stat da/d21/d61/f66 0 2023-12-16T20:11:33.173 INFO:tasks.workunit.client.1.smithi141.stdout:7/233: dwrite d5/f13 [0,4194304] 0 2023-12-16T20:11:33.174 INFO:tasks.workunit.client.0.smithi038.stdout:7/578: link da/d3e/d31/f43 da/d21/da6/fbf 0 2023-12-16T20:11:33.176 INFO:tasks.workunit.client.1.smithi141.stdout:7/234: symlink d5/l48 0 2023-12-16T20:11:33.177 INFO:tasks.workunit.client.1.smithi141.stdout:7/235: readlink d5/l29 0 2023-12-16T20:11:33.178 INFO:tasks.workunit.client.0.smithi038.stdout:5/634: sync 2023-12-16T20:11:33.178 INFO:tasks.workunit.client.1.smithi141.stdout:7/236: mknod d5/d16/d46/c49 0 2023-12-16T20:11:33.179 INFO:tasks.workunit.client.0.smithi038.stdout:5/635: rmdir d2/df/d1a/d1f/d4a/d53 39 2023-12-16T20:11:33.179 INFO:tasks.workunit.client.0.smithi038.stdout:5/636: chown d2/df/d87/cb1 25769 1 2023-12-16T20:11:33.179 INFO:tasks.workunit.client.0.smithi038.stdout:5/637: chown d2/df/d1a/c38 190398814 1 2023-12-16T20:11:33.180 INFO:tasks.workunit.client.1.smithi141.stdout:1/311: truncate da/fb 2113181 0 2023-12-16T20:11:33.181 INFO:tasks.workunit.client.1.smithi141.stdout:1/312: creat da/d1a/d1d/d33/f62 x:0 0 0 2023-12-16T20:11:33.181 INFO:tasks.workunit.client.1.smithi141.stdout:1/313: fdatasync da/d1a/d1d/d22/f60 0 2023-12-16T20:11:33.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/638: symlink d2/df/d1a/d1f/d4a/db2/lc6 0 2023-12-16T20:11:33.181 INFO:tasks.workunit.client.0.smithi038.stdout:5/639: write d2/d14/d25/d2d/d2f/fb8 [255677,19685] 0 2023-12-16T20:11:33.182 INFO:tasks.workunit.client.1.smithi141.stdout:7/237: rename d5/f3b to d5/f4a 0 2023-12-16T20:11:33.183 INFO:tasks.workunit.client.0.smithi038.stdout:5/640: mknod d2/d14/d25/d2d/d17/da9/cc7 0 2023-12-16T20:11:33.184 INFO:tasks.workunit.client.1.smithi141.stdout:8/330: sync 2023-12-16T20:11:33.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/343: sync 2023-12-16T20:11:33.184 INFO:tasks.workunit.client.1.smithi141.stdout:2/175: sync 2023-12-16T20:11:33.184 INFO:tasks.workunit.client.1.smithi141.stdout:0/323: sync 2023-12-16T20:11:33.184 INFO:tasks.workunit.client.1.smithi141.stdout:0/324: write d4/d49/d73/d3b/f59 [931411,100033] 0 2023-12-16T20:11:33.185 INFO:tasks.workunit.client.0.smithi038.stdout:8/517: dwrite d17/d1b/d66/f8a [0,4194304] 0 2023-12-16T20:11:33.185 INFO:tasks.workunit.client.0.smithi038.stdout:8/518: getdents d17/d34/d3d/d50/d7d 0 2023-12-16T20:11:33.186 INFO:tasks.workunit.client.1.smithi141.stdout:7/238: dread d5/d2a/f2c [0,4194304] 0 2023-12-16T20:11:33.186 INFO:tasks.workunit.client.1.smithi141.stdout:7/239: creat d5/d16/d30/d36/f4b x:0 0 0 2023-12-16T20:11:33.186 INFO:tasks.workunit.client.1.smithi141.stdout:1/314: rename da/d1a/f42 to da/d36/d4b/f63 0 2023-12-16T20:11:33.186 INFO:tasks.workunit.client.0.smithi038.stdout:7/579: rename da/d21/da6 to da/d21/dc0 0 2023-12-16T20:11:33.188 INFO:tasks.workunit.client.1.smithi141.stdout:8/331: mkdir d14/d19/d1b/d24/d4a/d69 0 2023-12-16T20:11:33.188 INFO:tasks.workunit.client.0.smithi038.stdout:7/580: truncate da/d24/f6f 3076738 0 2023-12-16T20:11:33.189 INFO:tasks.workunit.client.0.smithi038.stdout:7/581: creat da/d3e/d31/d38/fc1 x:0 0 0 2023-12-16T20:11:33.189 INFO:tasks.workunit.client.0.smithi038.stdout:7/582: write f5 [706760,7571] 0 2023-12-16T20:11:33.190 INFO:tasks.workunit.client.0.smithi038.stdout:7/583: symlink da/d21/dc0/lc2 0 2023-12-16T20:11:33.190 INFO:tasks.workunit.client.0.smithi038.stdout:7/584: creat da/d21/d61/fc3 x:0 0 0 2023-12-16T20:11:33.190 INFO:tasks.workunit.client.1.smithi141.stdout:6/344: creat d1/d12/d20/d44/f72 x:0 0 0 2023-12-16T20:11:33.192 INFO:tasks.workunit.client.1.smithi141.stdout:2/176: mknod d6/d12/d1f/c3d 0 2023-12-16T20:11:33.192 INFO:tasks.workunit.client.1.smithi141.stdout:6/345: dread d1/d12/d22/d25/f2e [0,4194304] 0 2023-12-16T20:11:33.193 INFO:tasks.workunit.client.0.smithi038.stdout:7/585: rename da/d3e/d31/d38/d90/f5f to da/d3e/fc4 0 2023-12-16T20:11:33.194 INFO:tasks.workunit.client.1.smithi141.stdout:0/325: mkdir d4/d74 0 2023-12-16T20:11:33.196 INFO:tasks.workunit.client.0.smithi038.stdout:5/641: dwrite d2/df/d1a/d1f/d4a/d53/d6e/d85/fb5 [0,4194304] 0 2023-12-16T20:11:33.197 INFO:tasks.workunit.client.0.smithi038.stdout:8/519: write d17/d5a/f85 [3554973,45219] 0 2023-12-16T20:11:33.198 INFO:tasks.workunit.client.1.smithi141.stdout:7/240: rename d5/d16/d1a/l1b to d5/d16/d46/l4c 0 2023-12-16T20:11:33.200 INFO:tasks.workunit.client.1.smithi141.stdout:8/332: link d14/d19/d1b/d24/c54 d14/d19/d1b/c6a 0 2023-12-16T20:11:33.203 INFO:tasks.workunit.client.1.smithi141.stdout:0/326: rmdir d4/d49/d73/d3b 39 2023-12-16T20:11:33.204 INFO:tasks.workunit.client.0.smithi038.stdout:5/642: mkdir d2/df/d1a/d1f/d4a/dc8 0 2023-12-16T20:11:33.205 INFO:tasks.workunit.client.0.smithi038.stdout:7/586: rename da/d3e/d31 to da/d24/d4d/dc5 0 2023-12-16T20:11:33.206 INFO:tasks.workunit.client.1.smithi141.stdout:7/241: symlink d5/d16/d46/l4d 0 2023-12-16T20:11:33.207 INFO:tasks.workunit.client.1.smithi141.stdout:2/177: dwrite d6/f17 [8388608,4194304] 0 2023-12-16T20:11:33.207 INFO:tasks.workunit.client.0.smithi038.stdout:8/520: unlink d17/d1b/d53/f77 0 2023-12-16T20:11:33.207 INFO:tasks.workunit.client.1.smithi141.stdout:8/333: mknod d14/d19/d1b/d24/c6b 0 2023-12-16T20:11:33.208 INFO:tasks.workunit.client.0.smithi038.stdout:7/587: creat da/d24/d4d/dc5/d38/fc6 x:0 0 0 2023-12-16T20:11:33.208 INFO:tasks.workunit.client.0.smithi038.stdout:7/588: fsync da/d3e/d8e/f74 0 2023-12-16T20:11:33.209 INFO:tasks.workunit.client.1.smithi141.stdout:6/346: getdents d1/dd/d2f 0 2023-12-16T20:11:33.209 INFO:tasks.workunit.client.0.smithi038.stdout:8/521: mknod d17/d1b/d66/d8e/ca7 0 2023-12-16T20:11:33.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/589: mknod da/d24/d4d/dc5/cc7 0 2023-12-16T20:11:33.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/590: chown da/d24/d4d/dc5/d38/d65/d81/ca4 3005741 1 2023-12-16T20:11:33.211 INFO:tasks.workunit.client.1.smithi141.stdout:0/327: symlink d4/d7/d44/l75 0 2023-12-16T20:11:33.211 INFO:tasks.workunit.client.1.smithi141.stdout:0/328: readlink d4/d7/l48 0 2023-12-16T20:11:33.212 INFO:tasks.workunit.client.0.smithi038.stdout:7/591: mknod da/d21/d86/d92/cc8 0 2023-12-16T20:11:33.213 INFO:tasks.workunit.client.1.smithi141.stdout:1/315: rename da/d25/c4a to da/d1a/d1d/d33/c64 0 2023-12-16T20:11:33.213 INFO:tasks.workunit.client.1.smithi141.stdout:1/316: fdatasync da/d1a/d1d/d22/d29/f32 0 2023-12-16T20:11:33.214 INFO:tasks.workunit.client.0.smithi038.stdout:5/643: dread d2/d14/d25/f5b [0,4194304] 0 2023-12-16T20:11:33.214 INFO:tasks.workunit.client.0.smithi038.stdout:7/592: mkdir da/d21/d2c/d76/dc9 0 2023-12-16T20:11:33.214 INFO:tasks.workunit.client.0.smithi038.stdout:7/593: chown da/d21/d41/f7b 115629192 1 2023-12-16T20:11:33.215 INFO:tasks.workunit.client.1.smithi141.stdout:6/347: write d1/fa [198687,128802] 0 2023-12-16T20:11:33.218 INFO:tasks.workunit.client.0.smithi038.stdout:5/644: rmdir d2/df/d1a/d1f/d4a/d53/d6e/dc2 0 2023-12-16T20:11:33.218 INFO:tasks.workunit.client.0.smithi038.stdout:5/645: stat d2/d14/d25/d2d/d17/d55/f57 0 2023-12-16T20:11:33.218 INFO:tasks.workunit.client.0.smithi038.stdout:5/646: readlink d2/d14/d25/d2d/d17/d51/l7d 0 2023-12-16T20:11:33.222 INFO:tasks.workunit.client.1.smithi141.stdout:2/178: creat d6/da/d33/f3e x:0 0 0 2023-12-16T20:11:33.222 INFO:tasks.workunit.client.1.smithi141.stdout:2/179: truncate d6/f1d 2694886 0 2023-12-16T20:11:33.222 INFO:tasks.workunit.client.1.smithi141.stdout:1/317: write da/d1a/f51 [1282075,75032] 0 2023-12-16T20:11:33.225 INFO:tasks.workunit.client.1.smithi141.stdout:8/334: truncate d14/f16 333243 0 2023-12-16T20:11:33.232 INFO:tasks.workunit.client.1.smithi141.stdout:7/242: rename d5/d16/d1a/d3a to d5/d16/d30/d4e 0 2023-12-16T20:11:33.232 INFO:tasks.workunit.client.1.smithi141.stdout:7/243: write d5/d2a/f2b [321111,2847] 0 2023-12-16T20:11:33.235 INFO:tasks.workunit.client.1.smithi141.stdout:6/348: symlink d1/d12/d20/d44/l73 0 2023-12-16T20:11:33.236 INFO:tasks.workunit.client.1.smithi141.stdout:6/349: truncate d1/d12/d20/f6a 390616 0 2023-12-16T20:11:33.242 INFO:tasks.workunit.client.1.smithi141.stdout:2/180: symlink d6/da/l3f 0 2023-12-16T20:11:33.242 INFO:tasks.workunit.client.1.smithi141.stdout:2/181: chown d6/l18 818829 1 2023-12-16T20:11:33.243 INFO:tasks.workunit.client.1.smithi141.stdout:1/318: unlink da/d36/l3c 0 2023-12-16T20:11:33.245 INFO:tasks.workunit.client.1.smithi141.stdout:0/329: link d4/d7/c12 d4/d7/d44/c76 0 2023-12-16T20:11:33.245 INFO:tasks.workunit.client.1.smithi141.stdout:0/330: chown d4/d7/f1e 45282 1 2023-12-16T20:11:33.246 INFO:tasks.workunit.client.1.smithi141.stdout:0/331: truncate d4/d49/d73/f5b 1088121 0 2023-12-16T20:11:33.246 INFO:tasks.workunit.client.0.smithi038.stdout:8/522: dwrite d17/d5a/f85 [0,4194304] 0 2023-12-16T20:11:33.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/594: dwrite da/d24/f96 [0,4194304] 0 2023-12-16T20:11:33.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/595: chown da/d21/d41/l72 136280 1 2023-12-16T20:11:33.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/596: creat da/d21/d2c/d76/fca x:0 0 0 2023-12-16T20:11:33.250 INFO:tasks.workunit.client.0.smithi038.stdout:7/597: creat da/d24/d4d/dc5/d38/d65/d81/fcb x:0 0 0 2023-12-16T20:11:33.250 INFO:tasks.workunit.client.0.smithi038.stdout:7/598: dread - da/d21/d2c/d76/d9a/fa5 zero size 2023-12-16T20:11:33.253 INFO:tasks.workunit.client.0.smithi038.stdout:7/599: mknod da/d24/db7/ccc 0 2023-12-16T20:11:33.254 INFO:tasks.workunit.client.1.smithi141.stdout:2/182: rename d6/d12/d15/l23 to d6/d12/d1f/l40 0 2023-12-16T20:11:33.254 INFO:tasks.workunit.client.1.smithi141.stdout:2/183: chown d6/d32/f39 926807069 1 2023-12-16T20:11:33.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/319: link da/d36/f3f da/d1a/d1d/d22/d29/d61/f65 0 2023-12-16T20:11:33.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/320: creat da/d36/f66 x:0 0 0 2023-12-16T20:11:33.256 INFO:tasks.workunit.client.0.smithi038.stdout:7/600: rename da/d21/d41 to da/d21/d61/dcd 0 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.1.smithi141.stdout:8/335: symlink d14/l6c 0 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.1.smithi141.stdout:7/244: dwrite d5/d2a/f34 [0,4194304] 0 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.1.smithi141.stdout:7/245: write d5/d2a/f41 [939032,55055] 0 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/647: dwrite d2/df/d1a/d2a/f95 [0,4194304] 0 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/648: chown d2/df/d1a/d1f/d4a/d53/c5d 436400 1 2023-12-16T20:11:33.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/649: fsync d2/d14/d25/d2d/d17/d51/f80 0 2023-12-16T20:11:33.258 INFO:tasks.workunit.client.0.smithi038.stdout:5/650: chown d2/d14/d25/d2d/d17/d55/d6b/cc3 176734318 1 2023-12-16T20:11:33.258 INFO:tasks.workunit.client.0.smithi038.stdout:5/651: chown d2/d4/ld 329591 1 2023-12-16T20:11:33.258 INFO:tasks.workunit.client.0.smithi038.stdout:7/601: truncate da/f98 6755588 0 2023-12-16T20:11:33.259 INFO:tasks.workunit.client.1.smithi141.stdout:0/332: symlink d4/d49/d73/l77 0 2023-12-16T20:11:33.259 INFO:tasks.workunit.client.1.smithi141.stdout:7/246: dread d5/d2a/f2c [0,4194304] 0 2023-12-16T20:11:33.259 INFO:tasks.workunit.client.1.smithi141.stdout:7/247: fsync d5/d2a/f37 0 2023-12-16T20:11:33.260 INFO:tasks.workunit.client.1.smithi141.stdout:6/350: mknod d1/dd/c74 0 2023-12-16T20:11:33.262 INFO:tasks.workunit.client.1.smithi141.stdout:2/184: link d6/c10 d6/d12/c41 0 2023-12-16T20:11:33.263 INFO:tasks.workunit.client.1.smithi141.stdout:2/185: write d6/d32/f39 [453712,12656] 0 2023-12-16T20:11:33.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/523: dwrite d17/d1b/d25/f5c [0,4194304] 0 2023-12-16T20:11:33.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/524: creat d17/d34/fa8 x:0 0 0 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/652: symlink d2/d14/d25/d2d/d17/d55/lc9 0 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/653: chown d2/d14/d25/d2d/d17/da9/db0 523500 1 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/654: dread - d2/d14/d25/d2d/d17/da9/fc5 zero size 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/655: write d2/d14/d25/d2d/d17/d51/f8e [1479418,75244] 0 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/656: chown d2 29717953 1 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/657: truncate d2/d14/d25/d2d/d17/d51/f9c 745935 0 2023-12-16T20:11:33.270 INFO:tasks.workunit.client.0.smithi038.stdout:5/658: creat d2/d14/d25/fca x:0 0 0 2023-12-16T20:11:33.271 INFO:tasks.workunit.client.0.smithi038.stdout:7/602: mkdir da/d21/d2c/d76/dce 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/333: truncate d4/fe 2462643 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/334: truncate d4/d49/f5a 2162899 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/335: write d4/d7/f24 [1833335,126119] 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/336: truncate d4/d49/f71 1029136 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/337: getdents d4/d74 0 2023-12-16T20:11:33.277 INFO:tasks.workunit.client.1.smithi141.stdout:7/248: creat d5/d2a/d45/f4f x:0 0 0 2023-12-16T20:11:33.278 INFO:tasks.workunit.client.1.smithi141.stdout:7/249: creat d5/d16/d30/f50 x:0 0 0 2023-12-16T20:11:33.279 INFO:tasks.workunit.client.1.smithi141.stdout:3/383: sync 2023-12-16T20:11:33.279 INFO:tasks.workunit.client.1.smithi141.stdout:6/351: creat d1/d12/d22/d31/f75 x:0 0 0 2023-12-16T20:11:33.279 INFO:tasks.workunit.client.1.smithi141.stdout:2/186: truncate d6/f7 8382637 0 2023-12-16T20:11:33.285 INFO:tasks.workunit.client.1.smithi141.stdout:6/352: creat d1/d3/f76 x:0 0 0 2023-12-16T20:11:33.286 INFO:tasks.workunit.client.0.smithi038.stdout:7/603: mkdir da/dcf 0 2023-12-16T20:11:33.287 INFO:tasks.workunit.client.0.smithi038.stdout:3/598: sync 2023-12-16T20:11:33.287 INFO:tasks.workunit.client.0.smithi038.stdout:0/669: sync 2023-12-16T20:11:33.287 INFO:tasks.workunit.client.0.smithi038.stdout:3/599: chown d4/d27/d2b/d64/c81 0 1 2023-12-16T20:11:33.287 INFO:tasks.workunit.client.0.smithi038.stdout:3/600: write d4/d18/f4b [4370326,33445] 0 2023-12-16T20:11:33.288 INFO:tasks.workunit.client.1.smithi141.stdout:8/336: dwrite d14/d19/d1b/d24/f31 [0,4194304] 0 2023-12-16T20:11:33.289 INFO:tasks.workunit.client.1.smithi141.stdout:8/337: chown d14/c45 87831971 1 2023-12-16T20:11:33.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/601: dread d4/d8/d15/f54 [0,4194304] 0 2023-12-16T20:11:33.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/602: write d4/d18/f8b [3566950,74199] 0 2023-12-16T20:11:33.290 INFO:tasks.workunit.client.0.smithi038.stdout:8/525: rename d17/d34/d3d to d17/d1d/d82/da9 0 2023-12-16T20:11:33.290 INFO:tasks.workunit.client.0.smithi038.stdout:8/526: chown d17/d1d/c86 1328393790 1 2023-12-16T20:11:33.290 INFO:tasks.workunit.client.0.smithi038.stdout:7/604: mkdir da/d21/d2c/dd0 0 2023-12-16T20:11:33.291 INFO:tasks.workunit.client.0.smithi038.stdout:7/605: write da/f5e [548399,51949] 0 2023-12-16T20:11:33.291 INFO:tasks.workunit.client.1.smithi141.stdout:1/321: rename da/d25 to da/d67 0 2023-12-16T20:11:33.291 INFO:tasks.workunit.client.1.smithi141.stdout:3/384: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:33.291 INFO:tasks.workunit.client.1.smithi141.stdout:8/338: dread d14/d19/d1b/d24/f55 [0,4194304] 0 2023-12-16T20:11:33.292 INFO:tasks.workunit.client.1.smithi141.stdout:3/385: stat d0/l9 0 2023-12-16T20:11:33.294 INFO:tasks.workunit.client.1.smithi141.stdout:8/339: creat d14/d19/d1b/d24/d4a/f6d x:0 0 0 2023-12-16T20:11:33.295 INFO:tasks.workunit.client.1.smithi141.stdout:3/386: rename d0/d1c/l25 to d0/d1c/d6a/d76/l89 0 2023-12-16T20:11:33.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/250: write d5/d16/d1a/f1f [174234,107093] 0 2023-12-16T20:11:33.296 INFO:tasks.workunit.client.0.smithi038.stdout:5/659: dwrite d2/d14/d25/f79 [0,4194304] 0 2023-12-16T20:11:33.296 INFO:tasks.workunit.client.1.smithi141.stdout:3/387: chown d0/l2d 42445714 1 2023-12-16T20:11:33.298 INFO:tasks.workunit.client.1.smithi141.stdout:7/251: dread d5/d2a/f2c [0,4194304] 0 2023-12-16T20:11:33.298 INFO:tasks.workunit.client.1.smithi141.stdout:3/388: creat d0/d1c/d40/d85/d4c/f8a x:0 0 0 2023-12-16T20:11:33.298 INFO:tasks.workunit.client.1.smithi141.stdout:3/389: chown d0/f3a 31460 1 2023-12-16T20:11:33.299 INFO:tasks.workunit.client.1.smithi141.stdout:7/252: symlink d5/d16/d30/d36/l51 0 2023-12-16T20:11:33.300 INFO:tasks.workunit.client.1.smithi141.stdout:3/390: mkdir d0/d1c/d2c/d72/d74/d8b 0 2023-12-16T20:11:33.301 INFO:tasks.workunit.client.0.smithi038.stdout:3/603: rename d4/d18/l89 to d4/d27/d2b/d64/ld2 0 2023-12-16T20:11:33.301 INFO:tasks.workunit.client.0.smithi038.stdout:3/604: fdatasync d4/d8/d15/d2c/f53 0 2023-12-16T20:11:33.301 INFO:tasks.workunit.client.0.smithi038.stdout:3/605: stat d4/d27/d23/db6 0 2023-12-16T20:11:33.301 INFO:tasks.workunit.client.1.smithi141.stdout:7/253: creat d5/d1d/d1e/f52 x:0 0 0 2023-12-16T20:11:33.303 INFO:tasks.workunit.client.1.smithi141.stdout:7/254: creat d5/d16/d46/f53 x:0 0 0 2023-12-16T20:11:33.304 INFO:tasks.workunit.client.0.smithi038.stdout:7/606: symlink da/d24/d4d/ld1 0 2023-12-16T20:11:33.305 INFO:tasks.workunit.client.1.smithi141.stdout:3/391: mknod d0/d1c/d40/c8c 0 2023-12-16T20:11:33.305 INFO:tasks.workunit.client.1.smithi141.stdout:1/322: dread da/d1a/d1d/d33/f4e [0,4194304] 0 2023-12-16T20:11:33.305 INFO:tasks.workunit.client.1.smithi141.stdout:7/255: rmdir d5/d1d 39 2023-12-16T20:11:33.308 INFO:tasks.workunit.client.0.smithi038.stdout:5/660: mknod d2/d14/d25/d2d/d17/d51/daf/ccb 0 2023-12-16T20:11:33.308 INFO:tasks.workunit.client.0.smithi038.stdout:5/661: truncate d2/d14/d25/d2d/d17/d93/fab 907497 0 2023-12-16T20:11:33.308 INFO:tasks.workunit.client.1.smithi141.stdout:3/392: truncate d0/d1c/d2c/f2f 817818 0 2023-12-16T20:11:33.309 INFO:tasks.workunit.client.0.smithi038.stdout:3/606: rename d4/d8/c9b to d4/dcd/dcc/cd3 0 2023-12-16T20:11:33.310 INFO:tasks.workunit.client.1.smithi141.stdout:7/256: rename d5/f4a to d5/d1d/f54 0 2023-12-16T20:11:33.310 INFO:tasks.workunit.client.1.smithi141.stdout:7/257: dread - d5/d16/d46/f53 zero size 2023-12-16T20:11:33.311 INFO:tasks.workunit.client.0.smithi038.stdout:7/607: creat da/d24/d4d/fd2 x:0 0 0 2023-12-16T20:11:33.313 INFO:tasks.workunit.client.0.smithi038.stdout:5/662: rmdir d2/d14/d25/d2d/d2f/d98 39 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:1/323: creat da/d67/f68 x:0 0 0 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:1/324: write da/df/f1b [1026323,40075] 0 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/393: chown d0/l26 265458116 1 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/394: creat d0/d1c/d6a/f8d x:0 0 0 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/395: write d0/d1c/d6a/f8d [185708,50228] 0 2023-12-16T20:11:33.314 INFO:tasks.workunit.client.1.smithi141.stdout:8/340: dread d14/d19/d1b/d24/f31 [0,4194304] 0 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/258: mkdir d5/d16/d1a/d55 0 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/259: creat d5/d16/f56 x:0 0 0 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/260: chown d5/d1d/d1e/l20 40936520 1 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/261: dread - d5/d16/d1a/f25 zero size 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.0.smithi038.stdout:3/607: getdents d4/d8/d15/d2c/d4c 0 2023-12-16T20:11:33.315 INFO:tasks.workunit.client.0.smithi038.stdout:3/608: rmdir d4/dcd 39 2023-12-16T20:11:33.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/609: write d4/d8/d15/d6d/d7a/daf/fc5 [776801,39995] 0 2023-12-16T20:11:33.316 INFO:tasks.workunit.client.1.smithi141.stdout:3/396: creat d0/d1c/d2c/d72/f8e x:0 0 0 2023-12-16T20:11:33.318 INFO:tasks.workunit.client.1.smithi141.stdout:8/341: stat cb 0 2023-12-16T20:11:33.318 INFO:tasks.workunit.client.1.smithi141.stdout:8/342: fdatasync d14/d19/d1b/f3a 0 2023-12-16T20:11:33.323 INFO:tasks.workunit.client.1.smithi141.stdout:7/262: unlink d5/d16/d30/d36/l3f 0 2023-12-16T20:11:33.326 INFO:tasks.workunit.client.1.smithi141.stdout:7/263: unlink d5/d16/c44 0 2023-12-16T20:11:33.326 INFO:tasks.workunit.client.1.smithi141.stdout:7/264: truncate d5/d2a/f3d 990885 0 2023-12-16T20:11:33.326 INFO:tasks.workunit.client.1.smithi141.stdout:7/265: creat d5/d16/d30/f57 x:0 0 0 2023-12-16T20:11:33.329 INFO:tasks.workunit.client.1.smithi141.stdout:2/187: dwrite d6/f26 [0,4194304] 0 2023-12-16T20:11:33.332 INFO:tasks.workunit.client.1.smithi141.stdout:7/266: dread d5/f12 [0,4194304] 0 2023-12-16T20:11:33.333 INFO:tasks.workunit.client.1.smithi141.stdout:0/338: dwrite d4/d49/f52 [4194304,4194304] 0 2023-12-16T20:11:33.336 INFO:tasks.workunit.client.1.smithi141.stdout:7/267: link d5/d16/f56 d5/d16/d1a/d40/f58 0 2023-12-16T20:11:33.343 INFO:tasks.workunit.client.1.smithi141.stdout:7/268: dread d5/f8 [4194304,4194304] 0 2023-12-16T20:11:33.343 INFO:tasks.workunit.client.1.smithi141.stdout:7/269: chown d5/fc 465469939 1 2023-12-16T20:11:33.345 INFO:tasks.workunit.client.1.smithi141.stdout:7/270: creat d5/d1d/f59 x:0 0 0 2023-12-16T20:11:33.346 INFO:tasks.workunit.client.1.smithi141.stdout:2/188: dread d6/d3a/f2c [0,4194304] 0 2023-12-16T20:11:33.346 INFO:tasks.workunit.client.1.smithi141.stdout:1/325: dwrite da/d1a/f59 [0,4194304] 0 2023-12-16T20:11:33.348 INFO:tasks.workunit.client.0.smithi038.stdout:8/527: dwrite d17/d1b/d66/d73/d4e/f88 [4194304,4194304] 0 2023-12-16T20:11:33.348 INFO:tasks.workunit.client.1.smithi141.stdout:2/189: creat d6/da/d1b/f42 x:0 0 0 2023-12-16T20:11:33.349 INFO:tasks.workunit.client.0.smithi038.stdout:0/670: dwrite db/d1a/fdc [0,4194304] 0 2023-12-16T20:11:33.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/528: mkdir d17/d1d/d82/daa 0 2023-12-16T20:11:33.354 INFO:tasks.workunit.client.0.smithi038.stdout:0/671: mknod db/d1a/ce3 0 2023-12-16T20:11:33.355 INFO:tasks.workunit.client.0.smithi038.stdout:8/529: symlink d17/d1d/d82/da9/lab 0 2023-12-16T20:11:33.358 INFO:tasks.workunit.client.0.smithi038.stdout:0/672: rename db/d16/d70/d7c/ca2 to db/d16/d19/d80/ce4 0 2023-12-16T20:11:33.367 INFO:tasks.workunit.client.0.smithi038.stdout:7/608: dwrite da/d24/d4d/dc5/f39 [0,4194304] 0 2023-12-16T20:11:33.367 INFO:tasks.workunit.client.0.smithi038.stdout:7/609: creat da/d21/d86/d92/fd3 x:0 0 0 2023-12-16T20:11:33.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/610: creat da/dcf/fd4 x:0 0 0 2023-12-16T20:11:33.373 INFO:tasks.workunit.client.0.smithi038.stdout:7/611: dread da/d24/d4d/dc5/d38/d90/f3c [0,4194304] 0 2023-12-16T20:11:33.382 INFO:tasks.workunit.client.0.smithi038.stdout:0/673: read db/d1a/f7b [2092219,72221] 0 2023-12-16T20:11:33.383 INFO:tasks.workunit.client.0.smithi038.stdout:0/674: symlink db/d1a/d77/d95/d9e/le5 0 2023-12-16T20:11:33.384 INFO:tasks.workunit.client.0.smithi038.stdout:3/610: dwrite d4/d18/f34 [4194304,4194304] 0 2023-12-16T20:11:33.385 INFO:tasks.workunit.client.1.smithi141.stdout:8/343: dwrite d14/f36 [0,4194304] 0 2023-12-16T20:11:33.385 INFO:tasks.workunit.client.1.smithi141.stdout:8/344: chown d14/d19/d1b/d3d/f37 236567813 1 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/663: dwrite d2/df/d1a/d2a/f6c [0,4194304] 0 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/664: write d2/d14/d25/d2d/f31 [5073861,49949] 0 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/665: write d2/d14/d25/d2d/d17/d55/fbe [660630,103081] 0 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/666: truncate d2/df/d1a/d2a/f41 742110 0 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/667: chown d2/df/d1a/c38 9554 1 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/612: getdents da/d24/d4d 0 2023-12-16T20:11:33.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/613: stat da/d24/d4d/d51 0 2023-12-16T20:11:33.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/611: link d4/dcd/d9a/fb7 d4/d8/d15/d2c/fd4 0 2023-12-16T20:11:33.388 INFO:tasks.workunit.client.0.smithi038.stdout:5/668: mknod d2/d14/d25/ccc 0 2023-12-16T20:11:33.389 INFO:tasks.workunit.client.0.smithi038.stdout:7/614: symlink da/d24/d4d/dc5/d38/d65/d81/ld5 0 2023-12-16T20:11:33.390 INFO:tasks.workunit.client.0.smithi038.stdout:3/612: creat d4/d8/d15/d2c/d7d/fd5 x:0 0 0 2023-12-16T20:11:33.392 INFO:tasks.workunit.client.0.smithi038.stdout:7/615: link da/l6a da/d21/dc0/ld6 0 2023-12-16T20:11:33.395 INFO:tasks.workunit.client.0.smithi038.stdout:3/613: link d4/dcd/c5e d4/d8/d15/d2c/d4c/d70/cd6 0 2023-12-16T20:11:33.396 INFO:tasks.workunit.client.1.smithi141.stdout:4/283: sync 2023-12-16T20:11:33.397 INFO:tasks.workunit.client.1.smithi141.stdout:9/278: sync 2023-12-16T20:11:33.397 INFO:tasks.workunit.client.1.smithi141.stdout:9/279: stat d1/d10/d14/d20/d3b/d63 0 2023-12-16T20:11:33.398 INFO:tasks.workunit.client.1.smithi141.stdout:1/326: dwrite da/fb [0,4194304] 0 2023-12-16T20:11:33.398 INFO:tasks.workunit.client.1.smithi141.stdout:1/327: chown da/d1a/d1d/d33/f43 1883356 1 2023-12-16T20:11:33.398 INFO:tasks.workunit.client.1.smithi141.stdout:4/284: symlink d1a/d2a/d3b/l6e 0 2023-12-16T20:11:33.399 INFO:tasks.workunit.client.1.smithi141.stdout:9/280: mknod d1/d10/d33/d47/c69 0 2023-12-16T20:11:33.400 INFO:tasks.workunit.client.1.smithi141.stdout:1/328: creat da/d1a/d1d/d22/f69 x:0 0 0 2023-12-16T20:11:33.400 INFO:tasks.workunit.client.1.smithi141.stdout:1/329: fdatasync da/d1a/d1d/d22/d29/d61/f65 0 2023-12-16T20:11:33.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/614: unlink d4/l1d 0 2023-12-16T20:11:33.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/615: write d4/d8/f16 [1905794,42043] 0 2023-12-16T20:11:33.402 INFO:tasks.workunit.client.1.smithi141.stdout:9/281: mkdir d1/d10/d33/d6a 0 2023-12-16T20:11:33.402 INFO:tasks.workunit.client.1.smithi141.stdout:9/282: creat d1/d10/d14/d20/d3b/f6b x:0 0 0 2023-12-16T20:11:33.402 INFO:tasks.workunit.client.1.smithi141.stdout:9/283: write d1/d10/f15 [680927,116086] 0 2023-12-16T20:11:33.402 INFO:tasks.workunit.client.0.smithi038.stdout:0/675: write db/d16/d1c/d5d/f8d [3199476,74322] 0 2023-12-16T20:11:33.402 INFO:tasks.workunit.client.0.smithi038.stdout:8/530: dwrite d17/d1b/d66/f98 [0,4194304] 0 2023-12-16T20:11:33.403 INFO:tasks.workunit.client.0.smithi038.stdout:9/676: sync 2023-12-16T20:11:33.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/345: dread d14/f36 [0,4194304] 0 2023-12-16T20:11:33.403 INFO:tasks.workunit.client.1.smithi141.stdout:3/397: dwrite d0/d1c/d2c/f2f [0,4194304] 0 2023-12-16T20:11:33.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/346: readlink d14/d19/d1b/d24/d4b/l65 0 2023-12-16T20:11:33.403 INFO:tasks.workunit.client.1.smithi141.stdout:7/271: dwrite d5/d16/d30/d36/f39 [0,4194304] 0 2023-12-16T20:11:33.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/616: unlink d4/d18/f8b 0 2023-12-16T20:11:33.406 INFO:tasks.workunit.client.0.smithi038.stdout:3/617: stat d4/d8/d15/d2c/d4c/d70/d71 0 2023-12-16T20:11:33.408 INFO:tasks.workunit.client.1.smithi141.stdout:3/398: stat d0/ca 0 2023-12-16T20:11:33.409 INFO:tasks.workunit.client.1.smithi141.stdout:4/285: read f19 [2931651,75713] 0 2023-12-16T20:11:33.410 INFO:tasks.workunit.client.1.smithi141.stdout:1/330: getdents da/d36/d4b/d4d 0 2023-12-16T20:11:33.410 INFO:tasks.workunit.client.1.smithi141.stdout:1/331: dread - da/d1a/d1d/f4f zero size 2023-12-16T20:11:33.412 INFO:tasks.workunit.client.1.smithi141.stdout:3/399: mkdir d0/d1c/d6a/d8f 0 2023-12-16T20:11:33.412 INFO:tasks.workunit.client.1.smithi141.stdout:3/400: truncate d0/d1c/d40/d3f/d52/d5a/f6c 930488 0 2023-12-16T20:11:33.413 INFO:tasks.workunit.client.0.smithi038.stdout:0/676: mkdir db/d16/db5/de6 0 2023-12-16T20:11:33.413 INFO:tasks.workunit.client.0.smithi038.stdout:0/677: write db/d16/d19/d27/d56/f87 [869213,128547] 0 2023-12-16T20:11:33.415 INFO:tasks.workunit.client.0.smithi038.stdout:8/531: creat d17/d1d/d82/da9/d50/d96/fac x:0 0 0 2023-12-16T20:11:33.415 INFO:tasks.workunit.client.0.smithi038.stdout:8/532: stat d17/d1b/d66 0 2023-12-16T20:11:33.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/272: getdents d5/d16/d30/d36 0 2023-12-16T20:11:33.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/273: chown d5/d16/d30/f57 20 1 2023-12-16T20:11:33.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/274: dread - d5/d16/d30/f50 zero size 2023-12-16T20:11:33.416 INFO:tasks.workunit.client.1.smithi141.stdout:8/347: getdents d14/d19/d1b/d24 0 2023-12-16T20:11:33.417 INFO:tasks.workunit.client.0.smithi038.stdout:9/677: creat d9/d1e/d3d/d42/d59/d76/fcc x:0 0 0 2023-12-16T20:11:33.417 INFO:tasks.workunit.client.0.smithi038.stdout:9/678: truncate d9/d1f/d21/d52/fb8 402778 0 2023-12-16T20:11:33.419 INFO:tasks.workunit.client.0.smithi038.stdout:3/618: creat d4/d8/d15/d2c/d4c/fd7 x:0 0 0 2023-12-16T20:11:33.419 INFO:tasks.workunit.client.0.smithi038.stdout:3/619: chown d4/d27/d2b/d64/ld2 37 1 2023-12-16T20:11:33.419 INFO:tasks.workunit.client.1.smithi141.stdout:7/275: mkdir d5/d2a/d45/d5a 0 2023-12-16T20:11:33.419 INFO:tasks.workunit.client.1.smithi141.stdout:7/276: getdents d5/d16/d1a/d55 0 2023-12-16T20:11:33.419 INFO:tasks.workunit.client.1.smithi141.stdout:1/332: unlink da/d1a/d1d/d22/d29/f3e 0 2023-12-16T20:11:33.423 INFO:tasks.workunit.client.1.smithi141.stdout:7/277: creat d5/d1d/d1e/d27/f5b x:0 0 0 2023-12-16T20:11:33.423 INFO:tasks.workunit.client.1.smithi141.stdout:1/333: readlink da/d67/l2d 0 2023-12-16T20:11:33.425 INFO:tasks.workunit.client.1.smithi141.stdout:1/334: mknod da/d1a/d31/c6a 0 2023-12-16T20:11:33.429 INFO:tasks.workunit.client.1.smithi141.stdout:1/335: mknod da/d1a/d31/c6b 0 2023-12-16T20:11:33.429 INFO:tasks.workunit.client.1.smithi141.stdout:1/336: fsync da/d1a/d1d/d22/d29/f53 0 2023-12-16T20:11:33.429 INFO:tasks.workunit.client.1.smithi141.stdout:7/278: write d5/d2a/f41 [930613,110351] 0 2023-12-16T20:11:33.432 INFO:tasks.workunit.client.1.smithi141.stdout:7/279: symlink d5/d2a/l5c 0 2023-12-16T20:11:33.433 INFO:tasks.workunit.client.1.smithi141.stdout:7/280: fsync d5/f13 0 2023-12-16T20:11:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/678: dread db/d1a/d77/d95/d9f/fb9 [0,4194304] 0 2023-12-16T20:11:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/679: readlink db/d1a/l21 0 2023-12-16T20:11:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/669: dwrite d2/fba [0,4194304] 0 2023-12-16T20:11:33.447 INFO:tasks.workunit.client.1.smithi141.stdout:9/284: dwrite d1/d10/d33/d39/f62 [0,4194304] 0 2023-12-16T20:11:33.447 INFO:tasks.workunit.client.1.smithi141.stdout:9/285: fdatasync d1/d26/f2f 0 2023-12-16T20:11:33.448 INFO:tasks.workunit.client.0.smithi038.stdout:0/680: write db/d1a/d77/d95/da4/fd7 [2708684,58562] 0 2023-12-16T20:11:33.448 INFO:tasks.workunit.client.0.smithi038.stdout:0/681: fdatasync db/f44 0 2023-12-16T20:11:33.449 INFO:tasks.workunit.client.0.smithi038.stdout:7/616: dwrite da/d21/f55 [0,4194304] 0 2023-12-16T20:11:33.453 INFO:tasks.workunit.client.0.smithi038.stdout:0/682: unlink db/d16/d1c/f48 0 2023-12-16T20:11:33.460 INFO:tasks.workunit.client.0.smithi038.stdout:0/683: symlink db/d16/d19/le7 0 2023-12-16T20:11:33.463 INFO:tasks.workunit.client.0.smithi038.stdout:0/684: rename db/d1a to db/d16/d5a/d65/de8 0 2023-12-16T20:11:33.464 INFO:tasks.workunit.client.0.smithi038.stdout:0/685: symlink db/d16/d5a/d65/le9 0 2023-12-16T20:11:33.483 INFO:tasks.workunit.client.0.smithi038.stdout:8/533: dwrite d17/d34/f92 [0,4194304] 0 2023-12-16T20:11:33.483 INFO:tasks.workunit.client.0.smithi038.stdout:8/534: fdatasync d17/d1b/f3f 0 2023-12-16T20:11:33.497 INFO:tasks.workunit.client.0.smithi038.stdout:7/617: write da/f98 [1067124,118779] 0 2023-12-16T20:11:33.505 INFO:tasks.workunit.client.1.smithi141.stdout:4/286: dwrite f14 [0,4194304] 0 2023-12-16T20:11:33.511 INFO:tasks.workunit.client.1.smithi141.stdout:8/348: dwrite d14/d19/d1b/f21 [0,4194304] 0 2023-12-16T20:11:33.512 INFO:tasks.workunit.client.1.smithi141.stdout:8/349: chown f11 323 1 2023-12-16T20:11:33.512 INFO:tasks.workunit.client.1.smithi141.stdout:3/401: dwrite d0/d1c/d40/d3f/f73 [0,4194304] 0 2023-12-16T20:11:33.512 INFO:tasks.workunit.client.0.smithi038.stdout:0/686: dwrite db/d16/d19/d27/f4c [0,4194304] 0 2023-12-16T20:11:33.512 INFO:tasks.workunit.client.0.smithi038.stdout:9/679: dwrite d9/d1f/d21/f28 [0,4194304] 0 2023-12-16T20:11:33.513 INFO:tasks.workunit.client.1.smithi141.stdout:8/350: rmdir d14/d19/d1b/d24/d4b 39 2023-12-16T20:11:33.514 INFO:tasks.workunit.client.1.smithi141.stdout:8/351: chown d14/d35 1727 1 2023-12-16T20:11:33.515 INFO:tasks.workunit.client.0.smithi038.stdout:9/680: mknod d9/d1f/d21/d84/daf/ccd 0 2023-12-16T20:11:33.517 INFO:tasks.workunit.client.0.smithi038.stdout:0/687: write db/d16/d19/f43 [3879576,97580] 0 2023-12-16T20:11:33.517 INFO:tasks.workunit.client.1.smithi141.stdout:4/287: write d1a/f20 [410123,6142] 0 2023-12-16T20:11:33.517 INFO:tasks.workunit.client.1.smithi141.stdout:8/352: dread d14/f23 [0,4194304] 0 2023-12-16T20:11:33.518 INFO:tasks.workunit.client.0.smithi038.stdout:9/681: symlink d9/d1e/d40/d5e/db5/lce 0 2023-12-16T20:11:33.520 INFO:tasks.workunit.client.0.smithi038.stdout:5/670: dwrite d2/df/d1a/d1f/d4a/d53/d6e/d85/f9d [0,4194304] 0 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.0.smithi038.stdout:0/688: unlink db/f26 0 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.0.smithi038.stdout:0/689: getdents db/d16/d19/d27/d78/dd5 0 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.0.smithi038.stdout:8/535: dwrite d17/d1b/d66/f8a [0,4194304] 0 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.0.smithi038.stdout:8/536: chown d17/d1d/d82/da9/d50 533898 1 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.0.smithi038.stdout:3/620: dwrite d4/d8/d15/d2c/d4c/fd7 [0,4194304] 0 2023-12-16T20:11:33.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/286: dwrite d1/d26/f4d [0,4194304] 0 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.1.smithi141.stdout:1/337: dwrite da/d1a/d1d/d22/f69 [0,4194304] 0 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.1.smithi141.stdout:9/287: chown d1/d10/d14/f25 1 1 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.1.smithi141.stdout:9/288: fdatasync d1/d26/f4d 0 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.1.smithi141.stdout:4/288: dread d1a/f25 [0,4194304] 0 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.0.smithi038.stdout:7/618: dwrite da/d24/d4d/dc5/d38/d90/f27 [0,4194304] 0 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.0.smithi038.stdout:7/619: dread - da/d24/d4d/dc5/d38/d65/d81/fcb zero size 2023-12-16T20:11:33.523 INFO:tasks.workunit.client.0.smithi038.stdout:9/682: link d9/d1f/d21/d3e/f49 d9/d1f/d21/d3e/d4e/d61/daa/fcf 0 2023-12-16T20:11:33.527 INFO:tasks.workunit.client.0.smithi038.stdout:0/690: creat db/d16/d5a/d65/de8/d77/d95/d9f/fea x:0 0 0 2023-12-16T20:11:33.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/670: sync 2023-12-16T20:11:33.527 INFO:tasks.workunit.client.0.smithi038.stdout:4/608: sync 2023-12-16T20:11:33.527 INFO:tasks.workunit.client.0.smithi038.stdout:1/682: sync 2023-12-16T20:11:33.530 INFO:tasks.workunit.client.0.smithi038.stdout:8/537: rename f1 to d17/d1d/d82/fad 0 2023-12-16T20:11:33.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/558: sync 2023-12-16T20:11:33.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/559: write d1/d4/d1d/f60 [471624,84576] 0 2023-12-16T20:11:33.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/560: fdatasync d1/d2e/f47 0 2023-12-16T20:11:33.533 INFO:tasks.workunit.client.1.smithi141.stdout:1/338: dread - da/d36/d4b/f5a zero size 2023-12-16T20:11:33.533 INFO:tasks.workunit.client.0.smithi038.stdout:5/671: dread d2/df/d1a/d1f/d4a/d53/d6e/f8d [0,4194304] 0 2023-12-16T20:11:33.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/289: symlink d1a/d2a/l6f 0 2023-12-16T20:11:33.534 INFO:tasks.workunit.client.1.smithi141.stdout:7/281: rmdir d5/d2a 39 2023-12-16T20:11:33.535 INFO:tasks.workunit.client.0.smithi038.stdout:3/621: dread d4/d8/f24 [4194304,4194304] 0 2023-12-16T20:11:33.535 INFO:tasks.workunit.client.0.smithi038.stdout:7/620: creat da/d24/d4d/dae/fd7 x:0 0 0 2023-12-16T20:11:33.535 INFO:tasks.workunit.client.0.smithi038.stdout:3/622: fsync d4/dcd/fcf 0 2023-12-16T20:11:33.535 INFO:tasks.workunit.client.0.smithi038.stdout:7/621: creat da/d21/d2c/d76/fd8 x:0 0 0 2023-12-16T20:11:33.536 INFO:tasks.workunit.client.0.smithi038.stdout:9/683: truncate d9/d1e/d40/d5e/d71/d83/f9f 219310 0 2023-12-16T20:11:33.536 INFO:tasks.workunit.client.0.smithi038.stdout:0/691: getdents db/d16/d5a/d65/d90 0 2023-12-16T20:11:33.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/671: dread d1/d5/d6c/d91/fca [0,4194304] 0 2023-12-16T20:11:33.538 INFO:tasks.workunit.client.0.smithi038.stdout:4/609: symlink d13/d69/d7a/da5/lca 0 2023-12-16T20:11:33.538 INFO:tasks.workunit.client.0.smithi038.stdout:1/683: creat d15/d1e/d3b/d48/d37/dde/d75/dc1/fec x:0 0 0 2023-12-16T20:11:33.539 INFO:tasks.workunit.client.0.smithi038.stdout:8/538: creat d17/d1b/fae x:0 0 0 2023-12-16T20:11:33.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/672: creat d2/d14/d25/d2d/d2f/d98/fcd x:0 0 0 2023-12-16T20:11:33.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/673: dread - d2/d14/d25/d2d/d17/d51/fb6 zero size 2023-12-16T20:11:33.542 INFO:tasks.workunit.client.1.smithi141.stdout:8/353: dwrite d14/d35/f66 [0,4194304] 0 2023-12-16T20:11:33.543 INFO:tasks.workunit.client.1.smithi141.stdout:1/339: mkdir da/d1a/d1d/d22/d29/d6c 0 2023-12-16T20:11:33.543 INFO:tasks.workunit.client.1.smithi141.stdout:1/340: chown da/d67/f40 106 1 2023-12-16T20:11:33.543 INFO:tasks.workunit.client.1.smithi141.stdout:4/290: rmdir d1a/d59 39 2023-12-16T20:11:33.545 INFO:tasks.workunit.client.1.smithi141.stdout:7/282: rename d5/d2a/f2b to d5/d16/d46/f5d 0 2023-12-16T20:11:33.546 INFO:tasks.workunit.client.0.smithi038.stdout:3/623: mkdir d4/d8/d15/d2c/d4c/d70/d71/db9/dd8 0 2023-12-16T20:11:33.546 INFO:tasks.workunit.client.0.smithi038.stdout:7/622: rmdir da/d24/d4d/dc5 39 2023-12-16T20:11:33.546 INFO:tasks.workunit.client.0.smithi038.stdout:6/561: write d1/d5b/d7d/f84 [1804719,12621] 0 2023-12-16T20:11:33.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/684: symlink d9/d1f/d21/d3e/ld0 0 2023-12-16T20:11:33.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/685: fsync d9/d1e/d3d/f3f 0 2023-12-16T20:11:33.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/686: write d9/d1e/f74 [1721580,83983] 0 2023-12-16T20:11:33.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/687: readlink d9/d1f/d21/d3e/la9 0 2023-12-16T20:11:33.550 INFO:tasks.workunit.client.0.smithi038.stdout:6/562: dread d1/d4/d1d/d28/f7a [0,4194304] 0 2023-12-16T20:11:33.550 INFO:tasks.workunit.client.1.smithi141.stdout:8/354: symlink d14/d19/d1b/d24/d4a/d5b/l6e 0 2023-12-16T20:11:33.555 INFO:tasks.workunit.client.0.smithi038.stdout:7/623: write da/d21/f25 [2670335,1210] 0 2023-12-16T20:11:33.555 INFO:tasks.workunit.client.0.smithi038.stdout:7/624: chown da/d21/d61/dcd/d6b 82 1 2023-12-16T20:11:33.555 INFO:tasks.workunit.client.0.smithi038.stdout:7/625: fdatasync f5 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:7/626: fdatasync da/d21/d2c/f30 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:6/563: dread d1/f8f [0,4194304] 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:6/564: stat d1/fa8 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:2/672: unlink d1/d73/fd0 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:2/673: truncate d1/d5/d2a/fd3 679976 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.0.smithi038.stdout:2/674: write d1/d5/d2a/fd1 [638811,99965] 0 2023-12-16T20:11:33.556 INFO:tasks.workunit.client.1.smithi141.stdout:1/341: unlink da/d67/f40 0 2023-12-16T20:11:33.557 INFO:tasks.workunit.client.1.smithi141.stdout:4/291: mkdir d1a/d3c/d70 0 2023-12-16T20:11:33.557 INFO:tasks.workunit.client.1.smithi141.stdout:1/342: creat da/d1a/d1d/d22/f6d x:0 0 0 2023-12-16T20:11:33.557 INFO:tasks.workunit.client.0.smithi038.stdout:4/610: rename d13/d17/d2e/f52 to d13/d17/d4b/da4/d34/fcb 0 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:8/355: chown d14/l2d 1 1 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:8/356: chown d14/d19/d1b/c2c 15091140 1 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:6/353: sync 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:5/208: sync 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:5/209: write d0/d9/f15 [3047939,24043] 0 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.1.smithi141.stdout:5/210: dread - d0/df/f3a zero size 2023-12-16T20:11:33.559 INFO:tasks.workunit.client.0.smithi038.stdout:1/684: mkdir d15/d4a/ded 0 2023-12-16T20:11:33.560 INFO:tasks.workunit.client.0.smithi038.stdout:8/539: symlink d17/d1b/d66/d73/d55/da5/da6/laf 0 2023-12-16T20:11:33.560 INFO:tasks.workunit.client.0.smithi038.stdout:5/674: mknod d2/d14/d25/d2d/d17/d51/cce 0 2023-12-16T20:11:33.561 INFO:tasks.workunit.client.1.smithi141.stdout:4/292: mknod d1a/d3c/c71 0 2023-12-16T20:11:33.562 INFO:tasks.workunit.client.0.smithi038.stdout:3/624: creat d4/d6c/d80/da8/fd9 x:0 0 0 2023-12-16T20:11:33.563 INFO:tasks.workunit.client.0.smithi038.stdout:0/692: rmdir db/d16/d70/d7c 39 2023-12-16T20:11:33.563 INFO:tasks.workunit.client.0.smithi038.stdout:0/693: write db/d16/f8c [5191030,85901] 0 2023-12-16T20:11:33.564 INFO:tasks.workunit.client.1.smithi141.stdout:1/343: rename da/d1a/d1d/d33/c64 to da/d1a/d1d/d22/d29/c6e 0 2023-12-16T20:11:33.564 INFO:tasks.workunit.client.1.smithi141.stdout:1/344: creat da/df/f6f x:0 0 0 2023-12-16T20:11:33.564 INFO:tasks.workunit.client.1.smithi141.stdout:1/345: dread - da/d67/f5e zero size 2023-12-16T20:11:33.565 INFO:tasks.workunit.client.1.smithi141.stdout:6/354: truncate d1/d12/d20/d44/f6b 696906 0 2023-12-16T20:11:33.565 INFO:tasks.workunit.client.0.smithi038.stdout:7/627: mkdir da/d3e/dba/dd9 0 2023-12-16T20:11:33.567 INFO:tasks.workunit.client.1.smithi141.stdout:5/211: creat d0/f3e x:0 0 0 2023-12-16T20:11:33.567 INFO:tasks.workunit.client.1.smithi141.stdout:5/212: write d0/d14/f1b [4852015,24051] 0 2023-12-16T20:11:33.567 INFO:tasks.workunit.client.0.smithi038.stdout:6/565: symlink d1/d4/d1d/d28/d2f/d85/lad 0 2023-12-16T20:11:33.568 INFO:tasks.workunit.client.1.smithi141.stdout:4/293: creat d1a/d2a/d3b/d69/f72 x:0 0 0 2023-12-16T20:11:33.572 INFO:tasks.workunit.client.1.smithi141.stdout:8/357: symlink d14/l6f 0 2023-12-16T20:11:33.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/694: dread db/d16/d5a/d65/de8/f33 [0,4194304] 0 2023-12-16T20:11:33.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/695: write db/d16/d19/d27/d56/f82 [2556797,35846] 0 2023-12-16T20:11:33.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/696: fdatasync db/d16/d5a/d65/de8/d77/d95/d9f/fb9 0 2023-12-16T20:11:33.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/697: readlink db/d16/d19/d27/l91 0 2023-12-16T20:11:33.573 INFO:tasks.workunit.client.0.smithi038.stdout:2/675: rename d1/d5/d95/d61/dd4/d6a/c53 to d1/d5/d95/ce6 0 2023-12-16T20:11:33.574 INFO:tasks.workunit.client.1.smithi141.stdout:5/213: creat d0/d9/d16/d2a/d35/f3f x:0 0 0 2023-12-16T20:11:33.575 INFO:tasks.workunit.client.0.smithi038.stdout:4/611: link d13/d17/d4b/da4/d9d/f9b d13/d17/d4b/fcc 0 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:1/346: read da/d67/f26 [2794898,59529] 0 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:1/347: chown da/d1a/d1d/d22/d29/d61/f65 37388866 1 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:1/348: fdatasync da/df/f24 0 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:6/355: write d1/d3/f10 [1909253,123239] 0 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:6/356: write d1/dd/d2f/f30 [1617776,109791] 0 2023-12-16T20:11:33.576 INFO:tasks.workunit.client.1.smithi141.stdout:6/357: stat d1/d12/d22/l67 0 2023-12-16T20:11:33.579 INFO:tasks.workunit.client.0.smithi038.stdout:6/566: dread d1/d5b/d7d/d9d/f46 [4194304,4194304] 0 2023-12-16T20:11:33.583 INFO:tasks.workunit.client.1.smithi141.stdout:4/294: mknod d1a/d3c/c73 0 2023-12-16T20:11:33.583 INFO:tasks.workunit.client.1.smithi141.stdout:8/358: link d14/f64 d14/d35/f70 0 2023-12-16T20:11:33.583 INFO:tasks.workunit.client.1.smithi141.stdout:4/295: fsync d1a/f29 0 2023-12-16T20:11:33.584 INFO:tasks.workunit.client.0.smithi038.stdout:1/685: mknod d15/d22/d7b/cee 0 2023-12-16T20:11:33.587 INFO:tasks.workunit.client.0.smithi038.stdout:8/540: mknod d17/d1d/d82/d9b/cb0 0 2023-12-16T20:11:33.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/214: rmdir d0/df 39 2023-12-16T20:11:33.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/215: creat d0/d9/d16/d2a/d35/f40 x:0 0 0 2023-12-16T20:11:33.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/216: creat d0/d9/f41 x:0 0 0 2023-12-16T20:11:33.589 INFO:tasks.workunit.client.1.smithi141.stdout:1/349: mknod da/d67/c70 0 2023-12-16T20:11:33.591 INFO:tasks.workunit.client.1.smithi141.stdout:8/359: mkdir d14/d71 0 2023-12-16T20:11:33.591 INFO:tasks.workunit.client.1.smithi141.stdout:8/360: chown d14 234306654 1 2023-12-16T20:11:33.591 INFO:tasks.workunit.client.0.smithi038.stdout:3/625: truncate d4/d8/d15/d1e/f3f 3530360 0 2023-12-16T20:11:33.593 INFO:tasks.workunit.client.0.smithi038.stdout:6/567: write d1/f56 [4351696,71570] 0 2023-12-16T20:11:33.593 INFO:tasks.workunit.client.0.smithi038.stdout:0/698: dwrite db/d16/d19/f98 [0,4194304] 0 2023-12-16T20:11:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:1/686: unlink d15/ldd 0 2023-12-16T20:11:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:7/628: symlink da/d3e/d8e/lda 0 2023-12-16T20:11:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:7/629: creat da/dcf/fdb x:0 0 0 2023-12-16T20:11:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:7/630: getdents da/d21/d2c/d76/dce 0 2023-12-16T20:11:33.594 INFO:tasks.workunit.client.0.smithi038.stdout:7/631: fdatasync da/d24/d4d/dc5/fa8 0 2023-12-16T20:11:33.595 INFO:tasks.workunit.client.1.smithi141.stdout:5/217: symlink d0/d25/l42 0 2023-12-16T20:11:33.595 INFO:tasks.workunit.client.1.smithi141.stdout:4/296: read d1a/f1b [910275,130315] 0 2023-12-16T20:11:33.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/541: mkdir d17/d1d/d82/da9/d50/db1 0 2023-12-16T20:11:33.597 INFO:tasks.workunit.client.1.smithi141.stdout:8/361: symlink d14/d19/d1b/d24/d4a/d69/l72 0 2023-12-16T20:11:33.597 INFO:tasks.workunit.client.1.smithi141.stdout:8/362: truncate d14/d19/d1b/d24/d4a/d5b/f5d 584352 0 2023-12-16T20:11:33.598 INFO:tasks.workunit.client.0.smithi038.stdout:5/675: mknod d2/ccf 0 2023-12-16T20:11:33.598 INFO:tasks.workunit.client.0.smithi038.stdout:5/676: write d2/df/d1a/d1f/d4a/d53/d6e/f8d [3652927,58699] 0 2023-12-16T20:11:33.598 INFO:tasks.workunit.client.1.smithi141.stdout:4/297: symlink d1a/d3c/d70/l74 0 2023-12-16T20:11:33.600 INFO:tasks.workunit.client.1.smithi141.stdout:4/298: symlink d1a/d4e/l75 0 2023-12-16T20:11:33.601 INFO:tasks.workunit.client.1.smithi141.stdout:1/350: dread da/d36/d4b/d4d/f54 [0,4194304] 0 2023-12-16T20:11:33.601 INFO:tasks.workunit.client.1.smithi141.stdout:1/351: readlink da/l5b 0 2023-12-16T20:11:33.602 INFO:tasks.workunit.client.1.smithi141.stdout:8/363: write d14/d19/d1b/d24/f31 [3237799,71771] 0 2023-12-16T20:11:33.602 INFO:tasks.workunit.client.1.smithi141.stdout:8/364: fdatasync d14/d19/d1b/f21 0 2023-12-16T20:11:33.604 INFO:tasks.workunit.client.0.smithi038.stdout:0/699: mknod db/d16/db5/de6/ceb 0 2023-12-16T20:11:33.604 INFO:tasks.workunit.client.0.smithi038.stdout:2/676: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fe0 [0,4194304] 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:1/352: creat da/d1a/d1d/d22/d29/d61/f71 x:0 0 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:1/353: read da/fc [1657962,24720] 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:1/354: chown da/d36/d4b/d4d/f56 354872 1 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:5/218: dread d0/df/f1d [0,4194304] 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:5/219: fdatasync d0/d9/f41 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:5/220: write d0/d9/f15 [5241665,76732] 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:5/221: write d0/d14/f1b [3636149,82772] 0 2023-12-16T20:11:33.605 INFO:tasks.workunit.client.1.smithi141.stdout:8/365: getdents d14/d19/d1b/d3d 0 2023-12-16T20:11:33.606 INFO:tasks.workunit.client.1.smithi141.stdout:8/366: truncate d14/d35/f70 893013 0 2023-12-16T20:11:33.606 INFO:tasks.workunit.client.0.smithi038.stdout:8/542: creat d17/d1b/d66/d73/d55/fb2 x:0 0 0 2023-12-16T20:11:33.607 INFO:tasks.workunit.client.1.smithi141.stdout:1/355: symlink da/d1a/d1d/d22/d29/d6c/l72 0 2023-12-16T20:11:33.607 INFO:tasks.workunit.client.0.smithi038.stdout:6/568: write d1/d2e/f47 [3901361,128851] 0 2023-12-16T20:11:33.607 INFO:tasks.workunit.client.0.smithi038.stdout:6/569: write d1/d4/d1d/d28/f41 [2099459,42433] 0 2023-12-16T20:11:33.607 INFO:tasks.workunit.client.0.smithi038.stdout:5/677: creat d2/df/d87/fd0 x:0 0 0 2023-12-16T20:11:33.608 INFO:tasks.workunit.client.0.smithi038.stdout:1/687: mknod d15/cef 0 2023-12-16T20:11:33.610 INFO:tasks.workunit.client.0.smithi038.stdout:0/700: link db/d16/d19/d80/f92 db/fec 0 2023-12-16T20:11:33.610 INFO:tasks.workunit.client.0.smithi038.stdout:0/701: write db/d16/d5a/dce/fa8 [876778,60975] 0 2023-12-16T20:11:33.613 INFO:tasks.workunit.client.1.smithi141.stdout:5/222: mkdir d0/d43 0 2023-12-16T20:11:33.615 INFO:tasks.workunit.client.0.smithi038.stdout:2/677: truncate d1/d5/d95/d61/d66/f83 514447 0 2023-12-16T20:11:33.615 INFO:tasks.workunit.client.0.smithi038.stdout:7/632: rmdir da/d21/d86/d92 39 2023-12-16T20:11:33.615 INFO:tasks.workunit.client.0.smithi038.stdout:7/633: write da/d21/d2c/d76/f89 [4693132,34157] 0 2023-12-16T20:11:33.616 INFO:tasks.workunit.client.0.smithi038.stdout:6/570: write d1/d16/d23/fa1 [1802736,89084] 0 2023-12-16T20:11:33.616 INFO:tasks.workunit.client.0.smithi038.stdout:6/571: write d1/d4/d1d/d67/fa6 [321134,16300] 0 2023-12-16T20:11:33.617 INFO:tasks.workunit.client.1.smithi141.stdout:4/299: write f1 [1477278,65604] 0 2023-12-16T20:11:33.618 INFO:tasks.workunit.client.0.smithi038.stdout:3/626: dwrite d4/f17 [4194304,4194304] 0 2023-12-16T20:11:33.618 INFO:tasks.workunit.client.1.smithi141.stdout:1/356: rename da/df/f4c to da/d1a/f73 0 2023-12-16T20:11:33.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/678: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1 0 2023-12-16T20:11:33.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/679: write d2/d14/d25/d2d/d4b/fac [2568552,16143] 0 2023-12-16T20:11:33.620 INFO:tasks.workunit.client.0.smithi038.stdout:8/543: dwrite d17/d1b/d66/d73/d4e/fa2 [0,4194304] 0 2023-12-16T20:11:33.623 INFO:tasks.workunit.client.0.smithi038.stdout:0/702: mkdir db/d16/d1c/d5d/d64/dd0/ded 0 2023-12-16T20:11:33.626 INFO:tasks.workunit.client.1.smithi141.stdout:5/223: creat d0/d43/f44 x:0 0 0 2023-12-16T20:11:33.628 INFO:tasks.workunit.client.0.smithi038.stdout:7/634: rename da/d3e to da/d24/d4d/dc5/ddc 0 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:5/224: link d0/d9/cd d0/d9/d16/d2a/c45 0 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:5/225: dread - d0/f3e zero size 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:5/226: write d0/d25/f2e [2442755,82875] 0 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:5/227: write d0/d25/d30/f36 [168302,33573] 0 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:1/357: getdents da 0 2023-12-16T20:11:33.632 INFO:tasks.workunit.client.1.smithi141.stdout:1/358: fsync da/d67/f2f 0 2023-12-16T20:11:33.633 INFO:tasks.workunit.client.0.smithi038.stdout:6/572: creat d1/d4/d1d/fae x:0 0 0 2023-12-16T20:11:33.633 INFO:tasks.workunit.client.0.smithi038.stdout:5/680: dread d2/d4/d62/f77 [0,4194304] 0 2023-12-16T20:11:33.633 INFO:tasks.workunit.client.0.smithi038.stdout:1/688: getdents d15/d1e/d3b 0 2023-12-16T20:11:33.633 INFO:tasks.workunit.client.0.smithi038.stdout:1/689: write f7 [1481904,79772] 0 2023-12-16T20:11:33.638 INFO:tasks.workunit.client.1.smithi141.stdout:5/228: truncate d0/d14/f23 148222 0 2023-12-16T20:11:33.638 INFO:tasks.workunit.client.0.smithi038.stdout:8/544: readlink lb 0 2023-12-16T20:11:33.638 INFO:tasks.workunit.client.0.smithi038.stdout:0/703: write db/d16/d5a/d65/de8/d77/d95/da4/fb0 [877528,39744] 0 2023-12-16T20:11:33.639 INFO:tasks.workunit.client.0.smithi038.stdout:0/704: read db/d16/d19/d27/d78/faf [645106,24431] 0 2023-12-16T20:11:33.639 INFO:tasks.workunit.client.0.smithi038.stdout:7/635: mknod da/dcf/cdd 0 2023-12-16T20:11:33.639 INFO:tasks.workunit.client.1.smithi141.stdout:1/359: mknod da/d1a/d31/c74 0 2023-12-16T20:11:33.639 INFO:tasks.workunit.client.1.smithi141.stdout:1/360: write da/fb [5238438,47038] 0 2023-12-16T20:11:33.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/678: dwrite d1/d5/d6c/d9f/fc1 [0,4194304] 0 2023-12-16T20:11:33.641 INFO:tasks.workunit.client.1.smithi141.stdout:5/229: rename d0/d9/ca to d0/d25/d30/c46 0 2023-12-16T20:11:33.641 INFO:tasks.workunit.client.1.smithi141.stdout:1/361: write da/d67/f26 [3678288,52404] 0 2023-12-16T20:11:33.641 INFO:tasks.workunit.client.0.smithi038.stdout:3/627: rename d4/dc4 to d4/dcd/d9a/dda 0 2023-12-16T20:11:33.642 INFO:tasks.workunit.client.1.smithi141.stdout:4/300: dwrite d1a/f1f [0,4194304] 0 2023-12-16T20:11:33.642 INFO:tasks.workunit.client.1.smithi141.stdout:4/301: creat d1a/d2a/f76 x:0 0 0 2023-12-16T20:11:33.642 INFO:tasks.workunit.client.1.smithi141.stdout:4/302: stat d1a/d4e/f51 0 2023-12-16T20:11:33.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/367: truncate d14/d19/d1b/d24/f31 1043220 0 2023-12-16T20:11:33.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/368: stat d14/d19/d1b/d24/d4a/d5b/f5d 0 2023-12-16T20:11:33.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/369: readlink d14/d19/d1b/d24/l29 0 2023-12-16T20:11:33.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/370: creat d14/d35/f73 x:0 0 0 2023-12-16T20:11:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:33 smithi038 ceph-mon[80659]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:33 smithi038 ceph-mon[80659]: mgrmap e24: smithi141.cycgjd(active, since 4s) 2023-12-16T20:11:33.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/681: creat d2/d14/d25/d2d/d17/fd2 x:0 0 0 2023-12-16T20:11:33.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/545: creat d17/d1d/d82/d9b/fb3 x:0 0 0 2023-12-16T20:11:33.654 INFO:tasks.workunit.client.1.smithi141.stdout:4/303: creat d1a/d4e/d63/f77 x:0 0 0 2023-12-16T20:11:33.655 INFO:tasks.workunit.client.0.smithi038.stdout:6/573: dwrite d1/d4/f7c [0,4194304] 0 2023-12-16T20:11:33.655 INFO:tasks.workunit.client.0.smithi038.stdout:6/574: creat d1/d4/d1d/d67/d73/faf x:0 0 0 2023-12-16T20:11:33.655 INFO:tasks.workunit.client.0.smithi038.stdout:8/546: dread d17/d1b/d25/f32 [0,4194304] 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:8/547: write d17/d1b/d66/d73/d54/d69/f8f [670459,91753] 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:0/705: unlink db/d16/d5a/dce/fa8 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:2/679: dread d1/d5/d16/f3b [0,4194304] 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:7/636: creat da/d21/d2c/dd0/fde x:0 0 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:7/637: creat da/d21/d2c/fdf x:0 0 0 2023-12-16T20:11:33.656 INFO:tasks.workunit.client.0.smithi038.stdout:7/638: truncate da/d21/d61/fbc 476344 0 2023-12-16T20:11:33.657 INFO:tasks.workunit.client.0.smithi038.stdout:7/639: write da/d21/d86/d92/fab [1259455,92006] 0 2023-12-16T20:11:33.657 INFO:tasks.workunit.client.0.smithi038.stdout:7/640: chown da/d24/d4d/dc5/d38/d65/d81/dbd 3535 1 2023-12-16T20:11:33.657 INFO:tasks.workunit.client.1.smithi141.stdout:8/371: symlink d14/d19/d1b/d24/d4a/d5b/l74 0 2023-12-16T20:11:33.657 INFO:tasks.workunit.client.1.smithi141.stdout:8/372: readlink d14/d19/d1b/d24/d4b/l65 0 2023-12-16T20:11:33.657 INFO:tasks.workunit.client.1.smithi141.stdout:8/373: stat d14/d35 0 2023-12-16T20:11:33.661 INFO:tasks.workunit.client.1.smithi141.stdout:4/304: rename d1a/d4e/f51 to d1a/d2a/f78 0 2023-12-16T20:11:33.661 INFO:tasks.workunit.client.1.smithi141.stdout:4/305: write d1a/d4e/d63/f77 [74236,89295] 0 2023-12-16T20:11:33.663 INFO:tasks.workunit.client.1.smithi141.stdout:8/374: getdents d14/d19/d1b/d24/d4a/d69 0 2023-12-16T20:11:33.663 INFO:tasks.workunit.client.1.smithi141.stdout:8/375: chown d14/d19/d1b/l2a 2445 1 2023-12-16T20:11:33.663 INFO:tasks.workunit.client.1.smithi141.stdout:8/376: dread - d14/d19/d1b/f3f zero size 2023-12-16T20:11:33.664 INFO:tasks.workunit.client.0.smithi038.stdout:5/682: symlink d2/d14/d25/d2d/d17/da9/db0/ld3 0 2023-12-16T20:11:33.665 INFO:tasks.workunit.client.1.smithi141.stdout:4/306: mknod d1a/d3c/c79 0 2023-12-16T20:11:33.666 INFO:tasks.workunit.client.0.smithi038.stdout:1/690: getdents d15/d1e/d23/d34/d86/d9a 0 2023-12-16T20:11:33.666 INFO:tasks.workunit.client.0.smithi038.stdout:1/691: fdatasync d15/d22/d62/fe7 0 2023-12-16T20:11:33.668 INFO:tasks.workunit.client.1.smithi141.stdout:8/377: truncate d14/d19/d1b/d24/d4a/d5b/f5d 544265 0 2023-12-16T20:11:33.670 INFO:tasks.workunit.client.1.smithi141.stdout:4/307: getdents d1a/d2a/d3b 0 2023-12-16T20:11:33.670 INFO:tasks.workunit.client.1.smithi141.stdout:8/378: creat d14/d19/d1b/d30/f75 x:0 0 0 2023-12-16T20:11:33.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/379: dread d14/d19/d1b/d24/f55 [0,4194304] 0 2023-12-16T20:11:33.673 INFO:tasks.workunit.client.1.smithi141.stdout:4/308: mknod d1a/d3c/c7a 0 2023-12-16T20:11:33.673 INFO:tasks.workunit.client.1.smithi141.stdout:8/380: write d14/d19/d1b/d3d/f33 [153603,67948] 0 2023-12-16T20:11:33.673 INFO:tasks.workunit.client.1.smithi141.stdout:8/381: fsync d14/d19/d1b/d3d/f37 0 2023-12-16T20:11:33.674 INFO:tasks.workunit.client.0.smithi038.stdout:3/628: dwrite d4/f28 [0,4194304] 0 2023-12-16T20:11:33.674 INFO:tasks.workunit.client.0.smithi038.stdout:6/575: truncate d1/d4/d1d/f1e 1084169 0 2023-12-16T20:11:33.674 INFO:tasks.workunit.client.0.smithi038.stdout:6/576: write d1/f83 [817734,1003] 0 2023-12-16T20:11:33.675 INFO:tasks.workunit.client.0.smithi038.stdout:8/548: creat d17/d1b/d66/d73/d55/da5/fb4 x:0 0 0 2023-12-16T20:11:33.678 INFO:tasks.workunit.client.0.smithi038.stdout:2/680: rename d1/d5/d95/ce6 to d1/d5/d6c/d91/dce/ce7 0 2023-12-16T20:11:33.679 INFO:tasks.workunit.client.1.smithi141.stdout:1/362: dwrite da/d1a/d1d/d22/f30 [0,4194304] 0 2023-12-16T20:11:33.679 INFO:tasks.workunit.client.1.smithi141.stdout:1/363: creat da/d1a/d1d/d22/d29/f75 x:0 0 0 2023-12-16T20:11:33.679 INFO:tasks.workunit.client.1.smithi141.stdout:1/364: chown da/d1a/d1d/d22/f69 11 1 2023-12-16T20:11:33.683 INFO:tasks.workunit.client.0.smithi038.stdout:7/641: unlink da/d24/d4d/dc5/d38/d90/f27 0 2023-12-16T20:11:33.683 INFO:tasks.workunit.client.0.smithi038.stdout:7/642: getdents da/d21/d2c/d76/dce 0 2023-12-16T20:11:33.684 INFO:tasks.workunit.client.1.smithi141.stdout:4/309: symlink d1a/d4e/l7b 0 2023-12-16T20:11:33.684 INFO:tasks.workunit.client.1.smithi141.stdout:5/230: dwrite d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:33.684 INFO:tasks.workunit.client.1.smithi141.stdout:5/231: creat d0/d43/f47 x:0 0 0 2023-12-16T20:11:33.684 INFO:tasks.workunit.client.0.smithi038.stdout:0/706: dwrite db/d16/d5a/d65/f6a [4194304,4194304] 0 2023-12-16T20:11:33.689 INFO:tasks.workunit.client.1.smithi141.stdout:8/382: rename d14/d19/d1b/d3d/f51 to d14/d19/d1b/d3d/f76 0 2023-12-16T20:11:33.696 INFO:tasks.workunit.client.0.smithi038.stdout:3/629: creat d4/d8/dc8/fdb x:0 0 0 2023-12-16T20:11:33.697 INFO:tasks.workunit.client.0.smithi038.stdout:6/577: creat d1/d2e/d94/fb0 x:0 0 0 2023-12-16T20:11:33.699 INFO:tasks.workunit.client.0.smithi038.stdout:1/692: rename d15/d1e/d23/d46/c5f to d15/d1e/d23/d7d/de9/cf0 0 2023-12-16T20:11:33.702 INFO:tasks.workunit.client.1.smithi141.stdout:5/232: unlink d0/d25/d30/f36 0 2023-12-16T20:11:33.702 INFO:tasks.workunit.client.1.smithi141.stdout:5/233: write d0/d9/f20 [64497,94455] 0 2023-12-16T20:11:33.703 INFO:tasks.workunit.client.1.smithi141.stdout:1/365: getdents da/d1a/d1d/d22 0 2023-12-16T20:11:33.708 INFO:tasks.workunit.client.0.smithi038.stdout:0/707: creat db/d16/da6/fee x:0 0 0 2023-12-16T20:11:33.708 INFO:tasks.workunit.client.0.smithi038.stdout:5/683: symlink d2/df/d1a/d1f/d4a/d53/d6e/d9e/ld4 0 2023-12-16T20:11:33.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/578: mkdir d1/d4/d1d/d28/db1 0 2023-12-16T20:11:33.710 INFO:tasks.workunit.client.0.smithi038.stdout:6/579: stat d1/d4/d1d/d67/d73/c88 0 2023-12-16T20:11:33.711 INFO:tasks.workunit.client.1.smithi141.stdout:1/366: mkdir da/d76 0 2023-12-16T20:11:33.711 INFO:tasks.workunit.client.1.smithi141.stdout:1/367: truncate da/d1a/d1d/f5d 106886 0 2023-12-16T20:11:33.711 INFO:tasks.workunit.client.0.smithi038.stdout:0/708: unlink db/d16/d19/d4e/le2 0 2023-12-16T20:11:33.712 INFO:tasks.workunit.client.0.smithi038.stdout:1/693: symlink d15/d1e/d3b/d48/d37/lf1 0 2023-12-16T20:11:33.713 INFO:tasks.workunit.client.0.smithi038.stdout:0/709: truncate db/d16/d1c/f32 153538 0 2023-12-16T20:11:33.713 INFO:tasks.workunit.client.0.smithi038.stdout:0/710: fsync f8 0 2023-12-16T20:11:33.715 INFO:tasks.workunit.client.1.smithi141.stdout:1/368: symlink da/d1a/d1d/d22/d29/d6c/l77 0 2023-12-16T20:11:33.716 INFO:tasks.workunit.client.0.smithi038.stdout:0/711: unlink db/d16/d5a/d65/de8/l21 0 2023-12-16T20:11:33.718 INFO:tasks.workunit.client.0.smithi038.stdout:0/712: write db/d16/d5a/d65/de8/f59 [1372558,4815] 0 2023-12-16T20:11:33.724 INFO:tasks.workunit.client.1.smithi141.stdout:4/310: dwrite d1a/f1f [0,4194304] 0 2023-12-16T20:11:33.724 INFO:tasks.workunit.client.0.smithi038.stdout:7/643: dwrite da/d24/d4d/dc5/f43 [0,4194304] 0 2023-12-16T20:11:33.725 INFO:tasks.workunit.client.1.smithi141.stdout:8/383: fdatasync d14/d19/d1b/d3d/f33 0 2023-12-16T20:11:33.726 INFO:tasks.workunit.client.0.smithi038.stdout:8/549: dwrite d17/d1b/d66/d73/d54/f8c [0,4194304] 0 2023-12-16T20:11:33.728 INFO:tasks.workunit.client.1.smithi141.stdout:4/311: mknod d1a/d2a/d3b/d69/c7c 0 2023-12-16T20:11:33.728 INFO:tasks.workunit.client.0.smithi038.stdout:3/630: dwrite d4/d8/f43 [0,4194304] 0 2023-12-16T20:11:33.728 INFO:tasks.workunit.client.0.smithi038.stdout:3/631: readlink d4/d8/d15/ld1 0 2023-12-16T20:11:33.729 INFO:tasks.workunit.client.1.smithi141.stdout:8/384: creat d14/d19/d1b/d3d/f77 x:0 0 0 2023-12-16T20:11:33.729 INFO:tasks.workunit.client.0.smithi038.stdout:7/644: mknod da/d24/d4d/dc5/d38/d65/d81/ce0 0 2023-12-16T20:11:33.730 INFO:tasks.workunit.client.0.smithi038.stdout:6/580: dread d1/f71 [0,4194304] 0 2023-12-16T20:11:33.730 INFO:tasks.workunit.client.0.smithi038.stdout:2/681: dwrite d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:33.731 INFO:tasks.workunit.client.1.smithi141.stdout:4/312: creat d1a/d3c/d70/f7d x:0 0 0 2023-12-16T20:11:33.733 INFO:tasks.workunit.client.0.smithi038.stdout:8/550: mkdir d17/d1b/d66/d73/d55/da5/da6/db5 0 2023-12-16T20:11:33.736 INFO:tasks.workunit.client.0.smithi038.stdout:3/632: mkdir d4/d8/d15/d2c/d4c/d70/d71/db9/dd8/ddc 0 2023-12-16T20:11:33.736 INFO:tasks.workunit.client.1.smithi141.stdout:5/234: write d0/d14/f31 [4484081,22359] 0 2023-12-16T20:11:33.737 INFO:tasks.workunit.client.0.smithi038.stdout:2/682: mkdir d1/d5/d95/d61/d66/ddd/de8 0 2023-12-16T20:11:33.738 INFO:tasks.workunit.client.0.smithi038.stdout:6/581: mknod d1/cb2 0 2023-12-16T20:11:33.738 INFO:tasks.workunit.client.0.smithi038.stdout:6/582: write d1/d2e/d94/fb0 [113340,28799] 0 2023-12-16T20:11:33.738 INFO:tasks.workunit.client.0.smithi038.stdout:6/583: read d1/d16/d23/fa1 [2235706,78101] 0 2023-12-16T20:11:33.741 INFO:tasks.workunit.client.0.smithi038.stdout:8/551: mknod d17/d5a/cb6 0 2023-12-16T20:11:33.741 INFO:tasks.workunit.client.0.smithi038.stdout:0/713: dwrite db/db6/fdb [0,4194304] 0 2023-12-16T20:11:33.742 INFO:tasks.workunit.client.0.smithi038.stdout:5/684: dwrite d2/fba [4194304,4194304] 0 2023-12-16T20:11:33.743 INFO:tasks.workunit.client.1.smithi141.stdout:8/385: write d14/d19/d1b/f21 [2040358,4807] 0 2023-12-16T20:11:33.745 INFO:tasks.workunit.client.1.smithi141.stdout:8/386: dread d14/f64 [0,4194304] 0 2023-12-16T20:11:33.749 INFO:tasks.workunit.client.1.smithi141.stdout:8/387: write f11 [5417585,34761] 0 2023-12-16T20:11:33.749 INFO:tasks.workunit.client.1.smithi141.stdout:8/388: creat d14/d19/f78 x:0 0 0 2023-12-16T20:11:33.749 INFO:tasks.workunit.client.1.smithi141.stdout:8/389: write d14/d19/d1b/d3d/f37 [534421,68155] 0 2023-12-16T20:11:33.749 INFO:tasks.workunit.client.1.smithi141.stdout:8/390: read - d14/d19/d1b/f3f zero size 2023-12-16T20:11:33.750 INFO:tasks.workunit.client.1.smithi141.stdout:8/391: truncate d14/d19/d1b/f3f 315023 0 2023-12-16T20:11:33.750 INFO:tasks.workunit.client.1.smithi141.stdout:8/392: write d14/d19/f78 [384812,95459] 0 2023-12-16T20:11:33.750 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:33 smithi141 ceph-mon[88165]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail 2023-12-16T20:11:33.750 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:33 smithi141 ceph-mon[88165]: mgrmap e24: smithi141.cycgjd(active, since 4s) 2023-12-16T20:11:33.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/393: write d14/d35/f70 [1276362,115517] 0 2023-12-16T20:11:33.751 INFO:tasks.workunit.client.1.smithi141.stdout:4/313: dread f15 [0,4194304] 0 2023-12-16T20:11:33.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/394: write d14/d19/d1b/d24/d4b/f62 [111373,79685] 0 2023-12-16T20:11:33.752 INFO:tasks.workunit.client.0.smithi038.stdout:3/633: rmdir d4/d67 39 2023-12-16T20:11:33.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/645: getdents da/d24/d4d/dc5/d38/d90 0 2023-12-16T20:11:33.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/646: getdents da/d24/d4d 0 2023-12-16T20:11:33.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/647: dread - da/dcf/fdb zero size 2023-12-16T20:11:33.752 INFO:tasks.workunit.client.0.smithi038.stdout:8/552: write d17/d34/f92 [3554205,86761] 0 2023-12-16T20:11:33.753 INFO:tasks.workunit.client.1.smithi141.stdout:1/369: dwrite da/d1a/f73 [0,4194304] 0 2023-12-16T20:11:33.753 INFO:tasks.workunit.client.1.smithi141.stdout:1/370: creat da/df/f78 x:0 0 0 2023-12-16T20:11:33.753 INFO:tasks.workunit.client.1.smithi141.stdout:1/371: fsync da/d36/f66 0 2023-12-16T20:11:33.754 INFO:tasks.workunit.client.0.smithi038.stdout:2/683: unlink d1/fde 0 2023-12-16T20:11:33.754 INFO:tasks.workunit.client.0.smithi038.stdout:6/584: mkdir d1/d2e/db3 0 2023-12-16T20:11:33.754 INFO:tasks.workunit.client.0.smithi038.stdout:6/585: chown d1/d4/d1d/d28/f37 30819 1 2023-12-16T20:11:33.757 INFO:tasks.workunit.client.1.smithi141.stdout:1/372: creat da/f79 x:0 0 0 2023-12-16T20:11:33.757 INFO:tasks.workunit.client.1.smithi141.stdout:1/373: read - da/d1a/d1d/d22/f6d zero size 2023-12-16T20:11:33.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/374: readlink da/d1a/l58 0 2023-12-16T20:11:33.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/375: dread - da/d1a/d1d/d33/f62 zero size 2023-12-16T20:11:33.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/376: write da/d1a/d1d/f4f [376908,110963] 0 2023-12-16T20:11:33.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/377: dread - da/f52 zero size 2023-12-16T20:11:33.758 INFO:tasks.workunit.client.1.smithi141.stdout:1/378: chown da/f2c 14 1 2023-12-16T20:11:33.759 INFO:tasks.workunit.client.1.smithi141.stdout:1/379: mkdir da/d7a 0 2023-12-16T20:11:33.760 INFO:tasks.workunit.client.0.smithi038.stdout:8/553: write d17/d1b/d66/d73/d54/f8c [2464434,51519] 0 2023-12-16T20:11:33.760 INFO:tasks.workunit.client.0.smithi038.stdout:8/554: readlink d17/d1b/d66/d73/d54/l83 0 2023-12-16T20:11:33.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/380: creat da/d1a/f7b x:0 0 0 2023-12-16T20:11:33.772 INFO:tasks.workunit.client.1.smithi141.stdout:1/381: write da/d1a/d1d/d22/f30 [936743,16173] 0 2023-12-16T20:11:33.772 INFO:tasks.workunit.client.1.smithi141.stdout:1/382: read - da/d36/d4b/d4d/f56 zero size 2023-12-16T20:11:33.772 INFO:tasks.workunit.client.1.smithi141.stdout:1/383: mkdir da/d36/d4b/d7c 0 2023-12-16T20:11:33.775 INFO:tasks.workunit.client.1.smithi141.stdout:1/384: dread da/d1a/d1d/d33/f43 [0,4194304] 0 2023-12-16T20:11:33.775 INFO:tasks.workunit.client.1.smithi141.stdout:1/385: write da/d1a/d1d/f5d [1081326,2133] 0 2023-12-16T20:11:33.775 INFO:tasks.workunit.client.1.smithi141.stdout:1/386: creat da/f7d x:0 0 0 2023-12-16T20:11:33.775 INFO:tasks.workunit.client.1.smithi141.stdout:1/387: readlink da/d1a/l28 0 2023-12-16T20:11:33.775 INFO:tasks.workunit.client.1.smithi141.stdout:1/388: creat da/d1a/d31/f7e x:0 0 0 2023-12-16T20:11:33.777 INFO:tasks.workunit.client.1.smithi141.stdout:1/389: mkdir da/d1a/d1d/d33/d7f 0 2023-12-16T20:11:33.789 INFO:tasks.workunit.client.0.smithi038.stdout:0/714: rmdir db/d16/db5 39 2023-12-16T20:11:33.789 INFO:tasks.workunit.client.0.smithi038.stdout:0/715: chown db/d16/d5a/d65/de8/d77/d95/da4/ld6 12385428 1 2023-12-16T20:11:33.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/634: mkdir d4/d8/d15/d2c/ddd 0 2023-12-16T20:11:33.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/635: creat d4/d8/dc8/fde x:0 0 0 2023-12-16T20:11:33.796 INFO:tasks.workunit.client.0.smithi038.stdout:7/648: unlink da/d24/d4d/dc5/d38/d90/l73 0 2023-12-16T20:11:33.796 INFO:tasks.workunit.client.0.smithi038.stdout:7/649: write da/d21/d61/fc3 [425527,117872] 0 2023-12-16T20:11:33.797 INFO:tasks.workunit.client.0.smithi038.stdout:2/684: mkdir d1/d5/d95/d61/dd4/d6a/d43/de9 0 2023-12-16T20:11:33.797 INFO:tasks.workunit.client.0.smithi038.stdout:2/685: write d1/d5/d95/d61/dd4/d10/f5e [1826467,25780] 0 2023-12-16T20:11:33.799 INFO:tasks.workunit.client.0.smithi038.stdout:6/586: rename d1/d4/d1d/d28/f81 to d1/d16/d23/d5f/fb4 0 2023-12-16T20:11:33.801 INFO:tasks.workunit.client.0.smithi038.stdout:0/716: mkdir db/d16/d19/d27/d56/def 0 2023-12-16T20:11:33.801 INFO:tasks.workunit.client.0.smithi038.stdout:0/717: fdatasync db/d16/f8c 0 2023-12-16T20:11:33.802 INFO:tasks.workunit.client.0.smithi038.stdout:3/636: mknod d4/d8/dc8/cdf 0 2023-12-16T20:11:33.804 INFO:tasks.workunit.client.1.smithi141.stdout:8/395: dwrite d14/d35/f61 [0,4194304] 0 2023-12-16T20:11:33.804 INFO:tasks.workunit.client.1.smithi141.stdout:8/396: dread - d14/d19/d1b/f48 zero size 2023-12-16T20:11:33.804 INFO:tasks.workunit.client.1.smithi141.stdout:8/397: fdatasync d14/d19/d1b/d24/d4a/f6d 0 2023-12-16T20:11:33.804 INFO:tasks.workunit.client.0.smithi038.stdout:7/650: symlink da/d21/d2c/d76/dc9/le1 0 2023-12-16T20:11:33.805 INFO:tasks.workunit.client.1.smithi141.stdout:5/235: dwrite d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:33.807 INFO:tasks.workunit.client.0.smithi038.stdout:6/587: creat d1/d2e/db3/fb5 x:0 0 0 2023-12-16T20:11:33.807 INFO:tasks.workunit.client.0.smithi038.stdout:6/588: fsync d1/f8f 0 2023-12-16T20:11:33.807 INFO:tasks.workunit.client.1.smithi141.stdout:8/398: unlink d14/d19/d1b/l2a 0 2023-12-16T20:11:33.811 INFO:tasks.workunit.client.0.smithi038.stdout:5/685: dwrite d2/d14/d25/d2d/d17/d55/fbe [0,4194304] 0 2023-12-16T20:11:33.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/718: truncate f3 3694167 0 2023-12-16T20:11:33.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/719: truncate db/d16/d1c/f32 757681 0 2023-12-16T20:11:33.811 INFO:tasks.workunit.client.1.smithi141.stdout:5/236: creat d0/d25/f48 x:0 0 0 2023-12-16T20:11:33.811 INFO:tasks.workunit.client.1.smithi141.stdout:5/237: stat d0/df/c27 0 2023-12-16T20:11:33.813 INFO:tasks.workunit.client.1.smithi141.stdout:1/390: dwrite da/d1a/d1d/d22/d29/d61/f71 [0,4194304] 0 2023-12-16T20:11:33.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/238: mkdir d0/df/d49 0 2023-12-16T20:11:33.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/239: readlink d0/l7 0 2023-12-16T20:11:33.815 INFO:tasks.workunit.client.0.smithi038.stdout:7/651: mkdir da/d21/d86/de2 0 2023-12-16T20:11:33.815 INFO:tasks.workunit.client.1.smithi141.stdout:8/399: link d14/f23 d14/f79 0 2023-12-16T20:11:33.818 INFO:tasks.workunit.client.0.smithi038.stdout:3/637: write d4/dcd/d9a/fb7 [1726536,2792] 0 2023-12-16T20:11:33.818 INFO:tasks.workunit.client.0.smithi038.stdout:3/638: dread - d4/d27/d2b/da0/fba zero size 2023-12-16T20:11:33.818 INFO:tasks.workunit.client.1.smithi141.stdout:1/391: dread f6 [0,4194304] 0 2023-12-16T20:11:33.819 INFO:tasks.workunit.client.0.smithi038.stdout:5/686: write d2/d4/fb [7147423,49242] 0 2023-12-16T20:11:33.819 INFO:tasks.workunit.client.0.smithi038.stdout:5/687: truncate d2/d14/f40 136095 0 2023-12-16T20:11:33.819 INFO:tasks.workunit.client.1.smithi141.stdout:5/240: mkdir d0/d14/d2c/d4a 0 2023-12-16T20:11:33.819 INFO:tasks.workunit.client.1.smithi141.stdout:5/241: write d0/d9/d16/d2a/d35/f3f [248709,91725] 0 2023-12-16T20:11:33.820 INFO:tasks.workunit.client.0.smithi038.stdout:8/555: rename d17/d1d to d17/d1b/d25/db7 0 2023-12-16T20:11:33.822 INFO:tasks.workunit.client.1.smithi141.stdout:8/400: symlink d14/d35/l7a 0 2023-12-16T20:11:33.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/392: mkdir da/d36/d4b/d4d/d80 0 2023-12-16T20:11:33.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/393: write da/d36/f3f [4431184,85952] 0 2023-12-16T20:11:33.829 INFO:tasks.workunit.client.1.smithi141.stdout:8/401: creat d14/d19/d1b/d24/d4a/d5b/f7b x:0 0 0 2023-12-16T20:11:33.829 INFO:tasks.workunit.client.0.smithi038.stdout:6/589: dwrite d1/d4/f5e [0,4194304] 0 2023-12-16T20:11:33.829 INFO:tasks.workunit.client.1.smithi141.stdout:1/394: mkdir da/d1a/d31/d81 0 2023-12-16T20:11:33.833 INFO:tasks.workunit.client.0.smithi038.stdout:0/720: symlink db/d16/d5a/d65/de8/lf0 0 2023-12-16T20:11:33.837 INFO:tasks.workunit.client.0.smithi038.stdout:3/639: truncate d4/f6 7638906 0 2023-12-16T20:11:33.838 INFO:tasks.workunit.client.0.smithi038.stdout:5/688: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/dd5 0 2023-12-16T20:11:33.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/590: truncate d1/d4/f49 3652859 0 2023-12-16T20:11:33.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/591: readlink d1/d4/l13 0 2023-12-16T20:11:33.843 INFO:tasks.workunit.client.1.smithi141.stdout:5/242: dwrite d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:33.843 INFO:tasks.workunit.client.0.smithi038.stdout:3/640: mknod d4/d8/d15/d2c/d4c/d70/d71/db9/dd8/ce0 0 2023-12-16T20:11:33.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/689: truncate d2/d14/d25/d2d/d17/d93/fab 25611 0 2023-12-16T20:11:33.846 INFO:tasks.workunit.client.0.smithi038.stdout:8/556: dwrite d17/d1b/d25/db7/d82/da9/f4c [0,4194304] 0 2023-12-16T20:11:33.846 INFO:tasks.workunit.client.1.smithi141.stdout:5/243: rename d0/d14/c3c to d0/d43/c4b 0 2023-12-16T20:11:33.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/612: sync 2023-12-16T20:11:33.848 INFO:tasks.workunit.client.0.smithi038.stdout:1/694: sync 2023-12-16T20:11:33.848 INFO:tasks.workunit.client.0.smithi038.stdout:9/688: sync 2023-12-16T20:11:33.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/613: creat d13/d69/d7a/fcd x:0 0 0 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:9/289: sync 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:2/190: sync 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:9/290: chown d1/d10/d14/c42 0 1 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/402: sync 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:9/291: readlink d1/d10/d27/d36/l3e 0 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/403: read - d0/d1c/d2c/d72/f8e zero size 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/404: chown d0/d1c/d40/d3f/d52/d5a/l6d 3542 1 2023-12-16T20:11:33.849 INFO:tasks.workunit.client.1.smithi141.stdout:3/405: write d0/d1c/d40/d3f/d52/d5d/f79 [679004,646] 0 2023-12-16T20:11:33.850 INFO:tasks.workunit.client.0.smithi038.stdout:5/690: link d2/d14/d25/d2d/d17/d55/fbb d2/df/d1a/d2a/d59/fd6 0 2023-12-16T20:11:33.850 INFO:tasks.workunit.client.0.smithi038.stdout:5/691: dread - d2/d14/d25/fb7 zero size 2023-12-16T20:11:33.850 INFO:tasks.workunit.client.0.smithi038.stdout:5/692: chown d2/df/d1a/d1f/d4a/f52 1665277623 1 2023-12-16T20:11:33.851 INFO:tasks.workunit.client.1.smithi141.stdout:0/339: sync 2023-12-16T20:11:33.851 INFO:tasks.workunit.client.1.smithi141.stdout:9/292: truncate d1/d10/d14/d20/da/f38 3466908 0 2023-12-16T20:11:33.851 INFO:tasks.workunit.client.1.smithi141.stdout:9/293: creat d1/d10/f6c x:0 0 0 2023-12-16T20:11:33.852 INFO:tasks.workunit.client.0.smithi038.stdout:8/557: mknod d17/d1b/d25/cb8 0 2023-12-16T20:11:33.853 INFO:tasks.workunit.client.0.smithi038.stdout:2/686: rename d1/d5/d6c/da7 to d1/d5/d95/d61/d66/ddd/de8/dea 0 2023-12-16T20:11:33.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/406: unlink d0/d1c/d2c/c61 0 2023-12-16T20:11:33.854 INFO:tasks.workunit.client.1.smithi141.stdout:3/407: creat d0/d1c/d40/d3f/f90 x:0 0 0 2023-12-16T20:11:33.856 INFO:tasks.workunit.client.1.smithi141.stdout:0/340: rename d4/d7/d44 to d4/d49/d73/d3b/d78 0 2023-12-16T20:11:33.857 INFO:tasks.workunit.client.0.smithi038.stdout:9/689: symlink d9/d1f/d21/d3e/d4e/d61/d9e/dc2/ld1 0 2023-12-16T20:11:33.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/695: dread d15/d1e/d3b/d48/d3d/f58 [0,4194304] 0 2023-12-16T20:11:33.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/696: read d15/d1e/d23/d34/d79/f83 [259009,109418] 0 2023-12-16T20:11:33.858 INFO:tasks.workunit.client.1.smithi141.stdout:9/294: getdents d1/d26/d4a 0 2023-12-16T20:11:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/614: creat d13/d17/d4b/d7d/dc0/fce x:0 0 0 2023-12-16T20:11:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/615: write d13/d17/d4b/f43 [1768754,29600] 0 2023-12-16T20:11:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/616: fsync d13/d1f/db7/fb8 0 2023-12-16T20:11:33.861 INFO:tasks.workunit.client.1.smithi141.stdout:1/395: dwrite da/d1a/d31/f49 [0,4194304] 0 2023-12-16T20:11:33.861 INFO:tasks.workunit.client.1.smithi141.stdout:3/408: symlink d0/d1c/d40/d85/l91 0 2023-12-16T20:11:33.861 INFO:tasks.workunit.client.1.smithi141.stdout:1/396: chown da/d1a/d1d/d22/d29/d6c 5 1 2023-12-16T20:11:33.861 INFO:tasks.workunit.client.1.smithi141.stdout:1/397: creat da/d1a/d1d/d22/d29/f82 x:0 0 0 2023-12-16T20:11:33.861 INFO:tasks.workunit.client.1.smithi141.stdout:1/398: chown da/d67/c70 1203475 1 2023-12-16T20:11:33.862 INFO:tasks.workunit.client.1.smithi141.stdout:0/341: unlink d4/d49/d73/d3b/c3f 0 2023-12-16T20:11:33.863 INFO:tasks.workunit.client.1.smithi141.stdout:0/342: write d4/fe [217461,12603] 0 2023-12-16T20:11:33.863 INFO:tasks.workunit.client.0.smithi038.stdout:7/652: rename da/d21/d61/dcd/d6b/l9e to da/d24/d4d/dc5/d38/d90/le3 0 2023-12-16T20:11:33.865 INFO:tasks.workunit.client.0.smithi038.stdout:8/558: creat d17/d1b/d66/d8e/d97/fb9 x:0 0 0 2023-12-16T20:11:33.867 INFO:tasks.workunit.client.0.smithi038.stdout:9/690: symlink d9/d1f/d21/d3e/d4e/d61/daa/ld2 0 2023-12-16T20:11:33.867 INFO:tasks.workunit.client.0.smithi038.stdout:9/691: chown d9/d1f/l6d 107 1 2023-12-16T20:11:33.868 INFO:tasks.workunit.client.1.smithi141.stdout:1/399: creat da/d1a/d31/d81/f83 x:0 0 0 2023-12-16T20:11:33.868 INFO:tasks.workunit.client.1.smithi141.stdout:0/343: creat d4/d49/d73/d3b/f79 x:0 0 0 2023-12-16T20:11:33.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/721: rename db/d16/d19/d4e/d89/c8b to db/d16/d5a/d65/cf1 0 2023-12-16T20:11:33.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/722: chown db/d16/d1c/fd9 75398349 1 2023-12-16T20:11:33.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/723: getdents db/d16/d5a/d65/de8/d77/d95/dd8 0 2023-12-16T20:11:33.870 INFO:tasks.workunit.client.1.smithi141.stdout:9/295: getdents d1/d10/d14/d20/d3b 0 2023-12-16T20:11:33.871 INFO:tasks.workunit.client.1.smithi141.stdout:9/296: dread - d1/d10/d14/d20/d3b/f5c zero size 2023-12-16T20:11:33.873 INFO:tasks.workunit.client.0.smithi038.stdout:7/653: creat da/d21/d86/de2/fe4 x:0 0 0 2023-12-16T20:11:33.875 INFO:tasks.workunit.client.1.smithi141.stdout:9/297: link d1/d10/d14/d20/da/l17 d1/d10/d33/d6a/l6d 0 2023-12-16T20:11:33.875 INFO:tasks.workunit.client.1.smithi141.stdout:9/298: chown d1/d10/d33/d47/f5b 862956 1 2023-12-16T20:11:33.875 INFO:tasks.workunit.client.1.smithi141.stdout:9/299: fdatasync d1/d10/d14/d20/d3b/f6b 0 2023-12-16T20:11:33.875 INFO:tasks.workunit.client.1.smithi141.stdout:9/300: stat d1/d10/d27/l2c 0 2023-12-16T20:11:33.878 INFO:tasks.workunit.client.1.smithi141.stdout:9/301: mknod d1/d10/d14/d20/da/d3f/d66/c6e 0 2023-12-16T20:11:33.879 INFO:tasks.workunit.client.0.smithi038.stdout:7/654: dread da/d24/d4d/d51/f60 [0,4194304] 0 2023-12-16T20:11:33.879 INFO:tasks.workunit.client.0.smithi038.stdout:7/655: dread - da/dcf/fd4 zero size 2023-12-16T20:11:33.880 INFO:tasks.workunit.client.0.smithi038.stdout:6/592: dwrite d1/d4/d1d/d61/f9a [0,4194304] 0 2023-12-16T20:11:33.880 INFO:tasks.workunit.client.1.smithi141.stdout:9/302: mknod d1/d10/d14/d20/c6f 0 2023-12-16T20:11:33.880 INFO:tasks.workunit.client.1.smithi141.stdout:9/303: truncate d1/d10/d14/d20/d3b/f52 184872 0 2023-12-16T20:11:33.881 INFO:tasks.workunit.client.1.smithi141.stdout:9/304: chown d1/d10/d14/d20/da/d3f/d66 0 1 2023-12-16T20:11:33.881 INFO:tasks.workunit.client.1.smithi141.stdout:8/402: dwrite d14/f79 [0,4194304] 0 2023-12-16T20:11:33.881 INFO:tasks.workunit.client.1.smithi141.stdout:3/409: dread d0/f65 [0,4194304] 0 2023-12-16T20:11:33.882 INFO:tasks.workunit.client.1.smithi141.stdout:9/305: mknod d1/d10/d14/c70 0 2023-12-16T20:11:33.883 INFO:tasks.workunit.client.1.smithi141.stdout:9/306: dread - d1/d10/d27/d36/f50 zero size 2023-12-16T20:11:33.883 INFO:tasks.workunit.client.1.smithi141.stdout:9/307: getdents d1/d10/d14/d20/d3b 0 2023-12-16T20:11:33.883 INFO:tasks.workunit.client.1.smithi141.stdout:0/344: dread d4/d7/f50 [0,4194304] 0 2023-12-16T20:11:33.883 INFO:tasks.workunit.client.1.smithi141.stdout:0/345: fsync d4/d49/f71 0 2023-12-16T20:11:33.883 INFO:tasks.workunit.client.1.smithi141.stdout:0/346: stat d4/d5c/l65 0 2023-12-16T20:11:33.884 INFO:tasks.workunit.client.1.smithi141.stdout:0/347: creat d4/d49/d73/d3b/f7a x:0 0 0 2023-12-16T20:11:33.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/641: rename d4/d8/d15/d2c to d4/d67/de1 0 2023-12-16T20:11:33.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/642: stat d4/d27/d40/f5f 0 2023-12-16T20:11:33.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/643: fdatasync d4/d8/f24 0 2023-12-16T20:11:33.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/644: stat d4/d27/d40/c93 0 2023-12-16T20:11:33.887 INFO:tasks.workunit.client.1.smithi141.stdout:3/410: truncate d0/d1c/d40/f39 2268408 0 2023-12-16T20:11:33.887 INFO:tasks.workunit.client.1.smithi141.stdout:3/411: stat d0/f29 0 2023-12-16T20:11:33.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/656: creat da/d21/d2c/d76/d9a/fe5 x:0 0 0 2023-12-16T20:11:33.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/657: write da/d24/d4d/dc5/f4a [4411832,108808] 0 2023-12-16T20:11:33.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/658: read - da/d24/d4d/fd2 zero size 2023-12-16T20:11:33.889 INFO:tasks.workunit.client.1.smithi141.stdout:5/244: dwrite d0/d43/f44 [0,4194304] 0 2023-12-16T20:11:33.891 INFO:tasks.workunit.client.0.smithi038.stdout:2/687: rename d1/d73/f81 to d1/d5/d95/d61/dd4/d6d/d72/feb 0 2023-12-16T20:11:33.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/245: getdents d0/d25/d30 0 2023-12-16T20:11:33.893 INFO:tasks.workunit.client.1.smithi141.stdout:5/246: truncate d0/d9/d16/f2d 1947786 0 2023-12-16T20:11:33.896 INFO:tasks.workunit.client.0.smithi038.stdout:3/645: write d4/d27/d23/d6e/f87 [2912214,72140] 0 2023-12-16T20:11:33.897 INFO:tasks.workunit.client.0.smithi038.stdout:7/659: unlink da/d24/d4d/dc5/c88 0 2023-12-16T20:11:33.899 INFO:tasks.workunit.client.0.smithi038.stdout:5/693: dwrite d2/d14/d25/d2d/f63 [0,4194304] 0 2023-12-16T20:11:33.899 INFO:tasks.workunit.client.0.smithi038.stdout:2/688: symlink d1/d5/d3d/lec 0 2023-12-16T20:11:33.899 INFO:tasks.workunit.client.1.smithi141.stdout:5/247: mkdir d0/d9/d16/d2a/d35/d4c 0 2023-12-16T20:11:33.901 INFO:tasks.workunit.client.0.smithi038.stdout:0/724: rename db/d16/d19/l53 to db/d16/d19/d80/lf2 0 2023-12-16T20:11:33.901 INFO:tasks.workunit.client.0.smithi038.stdout:0/725: fsync db/d16/d1c/fc0 0 2023-12-16T20:11:33.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/689: read d1/d5/d95/d61/dd4/d6a/d43/faa [1095341,32070] 0 2023-12-16T20:11:33.905 INFO:tasks.workunit.client.0.smithi038.stdout:3/646: creat d4/d8/d15/d6d/d7a/d98/fe2 x:0 0 0 2023-12-16T20:11:33.910 INFO:tasks.workunit.client.1.smithi141.stdout:9/308: rename d1/d10/d14/d20/da/f38 to d1/d10/d14/f71 0 2023-12-16T20:11:33.910 INFO:tasks.workunit.client.1.smithi141.stdout:9/309: chown d1/d10/d14/f71 269 1 2023-12-16T20:11:33.910 INFO:tasks.workunit.client.0.smithi038.stdout:5/694: creat d2/d14/d25/d2d/d4b/fd7 x:0 0 0 2023-12-16T20:11:33.910 INFO:tasks.workunit.client.0.smithi038.stdout:5/695: chown d2/df/d1a/c38 63593 1 2023-12-16T20:11:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:0/726: creat db/d16/d19/d27/ff3 x:0 0 0 2023-12-16T20:11:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:0/727: write db/d16/d1c/f72 [237018,87968] 0 2023-12-16T20:11:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:0/728: truncate db/d16/d19/f4b 5038152 0 2023-12-16T20:11:33.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/647: rename d4/d18/l3a to d4/dcd/d9a/dda/le3 0 2023-12-16T20:11:33.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/648: stat d4/d8/d15/l59 0 2023-12-16T20:11:33.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/649: write d4/d8/dc8/fde [691607,35779] 0 2023-12-16T20:11:33.913 INFO:tasks.workunit.client.0.smithi038.stdout:2/690: read d1/d5/d95/d61/dd4/d6a/d43/d57/f5a [3521832,7736] 0 2023-12-16T20:11:33.914 INFO:tasks.workunit.client.1.smithi141.stdout:0/348: rename d4/d7/c22 to d4/d74/c7b 0 2023-12-16T20:11:33.914 INFO:tasks.workunit.client.0.smithi038.stdout:5/696: creat d2/d14/d44/fd8 x:0 0 0 2023-12-16T20:11:33.915 INFO:tasks.workunit.client.0.smithi038.stdout:4/617: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:33.917 INFO:tasks.workunit.client.0.smithi038.stdout:0/729: symlink db/d16/d70/d7c/lf4 0 2023-12-16T20:11:33.917 INFO:tasks.workunit.client.1.smithi141.stdout:5/248: rename d0/d9/f20 to d0/d14/d2c/d4a/f4d 0 2023-12-16T20:11:33.917 INFO:tasks.workunit.client.1.smithi141.stdout:5/249: write d0/d14/f23 [531698,22975] 0 2023-12-16T20:11:33.917 INFO:tasks.workunit.client.1.smithi141.stdout:9/310: dread d1/fc [0,4194304] 0 2023-12-16T20:11:33.918 INFO:tasks.workunit.client.0.smithi038.stdout:3/650: getdents d4/d67/de1/d4c 0 2023-12-16T20:11:33.918 INFO:tasks.workunit.client.0.smithi038.stdout:3/651: write d4/d6c/d80/fb3 [785305,11317] 0 2023-12-16T20:11:33.919 INFO:tasks.workunit.client.1.smithi141.stdout:0/349: rename d4/l15 to d4/d74/l7c 0 2023-12-16T20:11:33.920 INFO:tasks.workunit.client.0.smithi038.stdout:2/691: unlink d1/d5/d95/d61/dd4/d10/d2f/cab 0 2023-12-16T20:11:33.921 INFO:tasks.workunit.client.1.smithi141.stdout:5/250: link d0/d25/l42 d0/d9/d16/l4e 0 2023-12-16T20:11:33.922 INFO:tasks.workunit.client.0.smithi038.stdout:8/559: dwrite d17/d5a/f63 [4194304,4194304] 0 2023-12-16T20:11:33.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/400: dwrite da/d1a/d1d/d22/f69 [0,4194304] 0 2023-12-16T20:11:33.923 INFO:tasks.workunit.client.1.smithi141.stdout:9/311: rename d1/d10/d14/d20/d3b/d63 to d1/d10/d33/d6a/d72 0 2023-12-16T20:11:33.925 INFO:tasks.workunit.client.0.smithi038.stdout:6/593: dwrite d1/d4/d1d/f60 [0,4194304] 0 2023-12-16T20:11:33.925 INFO:tasks.workunit.client.1.smithi141.stdout:3/412: dwrite d0/d1c/f6e [0,4194304] 0 2023-12-16T20:11:33.926 INFO:tasks.workunit.client.1.smithi141.stdout:8/403: dwrite d14/d19/d1b/d3d/f77 [0,4194304] 0 2023-12-16T20:11:33.926 INFO:tasks.workunit.client.1.smithi141.stdout:8/404: chown cd 4758 1 2023-12-16T20:11:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/692: mkdir d1/d5/d2a/d31/d60/ded 0 2023-12-16T20:11:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/660: dwrite da/d24/d4d/dc5/d38/d90/fb1 [0,4194304] 0 2023-12-16T20:11:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/661: chown da/d24/d4d/dc5/d38/d90/l7e 4 1 2023-12-16T20:11:33.927 INFO:tasks.workunit.client.1.smithi141.stdout:5/251: mkdir d0/d9/d16/d2a/d4f 0 2023-12-16T20:11:33.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/693: read d1/d5/d95/d61/dd4/d10/fb5 [67714,111554] 0 2023-12-16T20:11:33.928 INFO:tasks.workunit.client.0.smithi038.stdout:2/694: stat d1/d5/d2a/f79 0 2023-12-16T20:11:33.928 INFO:tasks.workunit.client.0.smithi038.stdout:0/730: mkdir db/d16/d19/d27/df5 0 2023-12-16T20:11:33.932 INFO:tasks.workunit.client.1.smithi141.stdout:3/413: dread d0/f65 [0,4194304] 0 2023-12-16T20:11:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/731: dread db/d16/d5a/d65/de8/d77/d95/da4/fd7 [0,4194304] 0 2023-12-16T20:11:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/732: fsync db/d16/d1c/fd9 0 2023-12-16T20:11:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/733: stat db/d16/d1c/f72 0 2023-12-16T20:11:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/734: write db/d16/d1c/fd9 [747726,9954] 0 2023-12-16T20:11:33.934 INFO:tasks.workunit.client.0.smithi038.stdout:6/594: link d1/d5b/f63 d1/d2e/fb6 0 2023-12-16T20:11:33.934 INFO:tasks.workunit.client.0.smithi038.stdout:6/595: creat d1/d16/d23/fb7 x:0 0 0 2023-12-16T20:11:33.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/652: dwrite d4/d27/d2b/f35 [0,4194304] 0 2023-12-16T20:11:33.938 INFO:tasks.workunit.client.1.smithi141.stdout:9/312: write d1/d10/d27/f4b [2568710,37346] 0 2023-12-16T20:11:33.940 INFO:tasks.workunit.client.1.smithi141.stdout:1/401: symlink da/d1a/d1d/d33/l84 0 2023-12-16T20:11:33.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/662: mkdir da/d21/d2c/d76/dc9/de6 0 2023-12-16T20:11:33.947 INFO:tasks.workunit.client.0.smithi038.stdout:8/560: dwrite d17/d1b/d25/db7/d82/da9/f4b [0,4194304] 0 2023-12-16T20:11:33.948 INFO:tasks.workunit.client.1.smithi141.stdout:0/350: link d4/d49/d73/d3b/c43 d4/d7/c7d 0 2023-12-16T20:11:33.950 INFO:tasks.workunit.client.1.smithi141.stdout:1/402: dread da/d1a/f51 [0,4194304] 0 2023-12-16T20:11:33.950 INFO:tasks.workunit.client.1.smithi141.stdout:1/403: write da/d1a/d1d/d22/f6d [765950,120108] 0 2023-12-16T20:11:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:2/695: rename d1/d5/d95/d61/dd4/d21/d82/dcc to d1/d5/d2a/d31/d60/ded/dee 0 2023-12-16T20:11:33.952 INFO:tasks.workunit.client.0.smithi038.stdout:0/735: truncate db/f3d 3223216 0 2023-12-16T20:11:33.952 INFO:tasks.workunit.client.0.smithi038.stdout:0/736: stat db/d16/d19/d4e/l9a 0 2023-12-16T20:11:33.954 INFO:tasks.workunit.client.1.smithi141.stdout:8/405: rename cc to d14/d19/d1b/d24/d4b/c7c 0 2023-12-16T20:11:33.955 INFO:tasks.workunit.client.0.smithi038.stdout:3/653: dwrite d4/d8/d15/d6d/d7a/d98/fe2 [0,4194304] 0 2023-12-16T20:11:33.956 INFO:tasks.workunit.client.0.smithi038.stdout:3/654: readlink d4/d27/d23/l51 0 2023-12-16T20:11:33.957 INFO:tasks.workunit.client.1.smithi141.stdout:3/414: creat d0/d1c/d40/f92 x:0 0 0 2023-12-16T20:11:33.957 INFO:tasks.workunit.client.1.smithi141.stdout:3/415: stat d0/d1c/d2c/l3b 0 2023-12-16T20:11:33.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/663: symlink da/d21/d61/le7 0 2023-12-16T20:11:33.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/664: write da/d21/d2c/d76/fad [915848,53221] 0 2023-12-16T20:11:33.962 INFO:tasks.workunit.client.0.smithi038.stdout:8/561: mkdir d17/d1b/d25/db7/d82/da9/d50/d96/dba 0 2023-12-16T20:11:33.962 INFO:tasks.workunit.client.0.smithi038.stdout:8/562: getdents d17/d1b/d57/d90 0 2023-12-16T20:11:33.963 INFO:tasks.workunit.client.1.smithi141.stdout:1/404: chown da/d36/d4b/f63 331 1 2023-12-16T20:11:33.963 INFO:tasks.workunit.client.1.smithi141.stdout:1/405: fsync da/d36/d4b/f5a 0 2023-12-16T20:11:33.963 INFO:tasks.workunit.client.1.smithi141.stdout:1/406: fsync da/d1a/d31/f47 0 2023-12-16T20:11:33.963 INFO:tasks.workunit.client.1.smithi141.stdout:1/407: fsync da/d1a/d31/f49 0 2023-12-16T20:11:33.964 INFO:tasks.workunit.client.0.smithi038.stdout:6/596: rename d1/d4/f62 to d1/d16/d23/fb8 0 2023-12-16T20:11:33.964 INFO:tasks.workunit.client.1.smithi141.stdout:8/406: mknod d14/d19/d1b/c7d 0 2023-12-16T20:11:33.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/696: mknod d1/d5/d95/d61/cef 0 2023-12-16T20:11:33.969 INFO:tasks.workunit.client.1.smithi141.stdout:0/351: symlink d4/d7/l7e 0 2023-12-16T20:11:33.969 INFO:tasks.workunit.client.0.smithi038.stdout:0/737: dwrite db/d16/d5a/d65/de8/f7a [0,4194304] 0 2023-12-16T20:11:33.970 INFO:tasks.workunit.client.0.smithi038.stdout:3/655: mkdir d4/d8/dc8/de4 0 2023-12-16T20:11:33.970 INFO:tasks.workunit.client.0.smithi038.stdout:3/656: write d4/d6c/d80/da8/fd9 [633682,69629] 0 2023-12-16T20:11:33.970 INFO:tasks.workunit.client.0.smithi038.stdout:3/657: truncate d4/d67/de1/f65 1119814 0 2023-12-16T20:11:33.971 INFO:tasks.workunit.client.1.smithi141.stdout:1/408: mknod da/d7a/c85 0 2023-12-16T20:11:33.972 INFO:tasks.workunit.client.0.smithi038.stdout:8/563: mknod d17/d1b/d66/d8e/d97/cbb 0 2023-12-16T20:11:33.972 INFO:tasks.workunit.client.0.smithi038.stdout:8/564: stat d17/d1b/d25/db7/d82/da9/d50/d96/dba 0 2023-12-16T20:11:33.972 INFO:tasks.workunit.client.0.smithi038.stdout:8/565: stat d17/d1b/d66/d8e/d97/fb9 0 2023-12-16T20:11:33.973 INFO:tasks.workunit.client.0.smithi038.stdout:6/597: creat d1/d4/d1d/d28/db1/fb9 x:0 0 0 2023-12-16T20:11:33.974 INFO:tasks.workunit.client.1.smithi141.stdout:5/252: rename d0/d43/f47 to d0/f50 0 2023-12-16T20:11:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:7/665: write da/d21/d86/fb0 [7965133,1186] 0 2023-12-16T20:11:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:7/666: dread - da/d24/d4d/dc5/d38/fc1 zero size 2023-12-16T20:11:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:2/697: mknod d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/cf0 0 2023-12-16T20:11:33.977 INFO:tasks.workunit.client.1.smithi141.stdout:3/416: mkdir d0/d1c/d40/d93 0 2023-12-16T20:11:33.979 INFO:tasks.workunit.client.1.smithi141.stdout:8/407: dread d14/d19/d1b/d3d/f77 [0,4194304] 0 2023-12-16T20:11:33.979 INFO:tasks.workunit.client.1.smithi141.stdout:0/352: mkdir d4/d49/d73/d3b/d78/d7f 0 2023-12-16T20:11:33.979 INFO:tasks.workunit.client.0.smithi038.stdout:3/658: mknod d4/d6c/d80/ce5 0 2023-12-16T20:11:33.982 INFO:tasks.workunit.client.0.smithi038.stdout:8/566: write d17/d1b/d66/d73/d4e/fa2 [783481,98305] 0 2023-12-16T20:11:33.982 INFO:tasks.workunit.client.0.smithi038.stdout:8/567: chown d17/d1b/d53 9 1 2023-12-16T20:11:33.982 INFO:tasks.workunit.client.0.smithi038.stdout:8/568: creat d17/d1b/d66/d8e/d97/fbc x:0 0 0 2023-12-16T20:11:33.982 INFO:tasks.workunit.client.1.smithi141.stdout:1/409: symlink da/l86 0 2023-12-16T20:11:33.982 INFO:tasks.workunit.client.1.smithi141.stdout:1/410: chown da/l5b 6133 1 2023-12-16T20:11:33.983 INFO:tasks.workunit.client.1.smithi141.stdout:1/411: write da/f52 [437266,93982] 0 2023-12-16T20:11:33.983 INFO:tasks.workunit.client.1.smithi141.stdout:1/412: fsync da/df/f27 0 2023-12-16T20:11:33.983 INFO:tasks.workunit.client.0.smithi038.stdout:6/598: link d1/d4/d1d/d67/fa6 d1/d4/d1d/d8e/fba 0 2023-12-16T20:11:33.987 INFO:tasks.workunit.client.1.smithi141.stdout:3/417: creat d0/d1c/d2c/d72/d74/f94 x:0 0 0 2023-12-16T20:11:33.988 INFO:tasks.workunit.client.1.smithi141.stdout:3/418: chown d0/d1c/d40/d85 42 1 2023-12-16T20:11:33.988 INFO:tasks.workunit.client.1.smithi141.stdout:3/419: chown d0/f6 110 1 2023-12-16T20:11:33.988 INFO:tasks.workunit.client.1.smithi141.stdout:3/420: write d0/d1c/d40/f1e [5077446,24859] 0 2023-12-16T20:11:33.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/698: dread d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f56 [0,4194304] 0 2023-12-16T20:11:33.989 INFO:tasks.workunit.client.1.smithi141.stdout:0/353: mkdir d4/d49/d73/d3b/d78/d7f/d80 0 2023-12-16T20:11:33.989 INFO:tasks.workunit.client.1.smithi141.stdout:0/354: write d4/d49/f71 [1410995,48690] 0 2023-12-16T20:11:33.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/667: fdatasync da/d24/d4d/dc5/ddc/fc4 0 2023-12-16T20:11:33.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/668: dread - da/d24/d4d/fd2 zero size 2023-12-16T20:11:33.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/669: creat da/d21/d2c/dd0/fe8 x:0 0 0 2023-12-16T20:11:33.992 INFO:tasks.workunit.client.0.smithi038.stdout:8/569: creat d17/d1b/d25/db7/d82/da9/d50/d7d/fbd x:0 0 0 2023-12-16T20:11:33.992 INFO:tasks.workunit.client.0.smithi038.stdout:8/570: readlink lb 0 2023-12-16T20:11:33.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/599: mknod d1/d4/d1d/d28/d2f/cbb 0 2023-12-16T20:11:33.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/600: dread - d1/d4/d1d/d28/f37 zero size 2023-12-16T20:11:33.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/601: creat d1/d2e/db3/fbc x:0 0 0 2023-12-16T20:11:33.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/602: truncate d1/f6c 152793 0 2023-12-16T20:11:33.993 INFO:tasks.workunit.client.1.smithi141.stdout:3/421: mkdir d0/d1c/d40/d3f/d52/d5d/d95 0 2023-12-16T20:11:33.994 INFO:tasks.workunit.client.0.smithi038.stdout:0/738: dwrite db/fc3 [0,4194304] 0 2023-12-16T20:11:33.995 INFO:tasks.workunit.client.0.smithi038.stdout:2/699: mknod d1/d5/d2a/d31/d60/ded/cf1 0 2023-12-16T20:11:33.995 INFO:tasks.workunit.client.0.smithi038.stdout:2/700: chown d1/d5/d95/d61/dd4/d21/lc4 0 1 2023-12-16T20:11:33.995 INFO:tasks.workunit.client.0.smithi038.stdout:2/701: write d1/d5/d95/d61/d66/ddd/de8/dea/fa9 [4773906,24876] 0 2023-12-16T20:11:33.996 INFO:tasks.workunit.client.1.smithi141.stdout:0/355: creat d4/d49/d73/d3b/d78/f81 x:0 0 0 2023-12-16T20:11:33.998 INFO:tasks.workunit.client.1.smithi141.stdout:9/313: rename d1/d10/d14/d20/da/de to d1/d26/d4a/d73 0 2023-12-16T20:11:33.998 INFO:tasks.workunit.client.0.smithi038.stdout:7/670: symlink da/d21/d86/le9 0 2023-12-16T20:11:33.998 INFO:tasks.workunit.client.0.smithi038.stdout:7/671: dread - da/d21/d2c/dd0/fde zero size 2023-12-16T20:11:33.998 INFO:tasks.workunit.client.0.smithi038.stdout:7/672: chown da/d21/d2c/d76/l97 2002 1 2023-12-16T20:11:33.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/673: fdatasync da/f5e 0 2023-12-16T20:11:33.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/674: chown da/d21/d2c/d76/fca 15357 1 2023-12-16T20:11:33.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/675: write da/d24/f6f [3423468,28159] 0 2023-12-16T20:11:34.000 INFO:tasks.workunit.client.1.smithi141.stdout:3/422: mkdir d0/d1c/d40/d85/d96 0 2023-12-16T20:11:34.000 INFO:tasks.workunit.client.0.smithi038.stdout:8/571: unlink lb 0 2023-12-16T20:11:34.001 INFO:tasks.workunit.client.1.smithi141.stdout:3/423: read d0/d1c/d40/d3f/d52/d5d/f79 [552365,68918] 0 2023-12-16T20:11:34.001 INFO:tasks.workunit.client.1.smithi141.stdout:0/356: link d4/d5c/l65 d4/d49/d73/d3b/l82 0 2023-12-16T20:11:34.001 INFO:tasks.workunit.client.1.smithi141.stdout:3/424: chown d0/d1c/d2c/l3e 622 1 2023-12-16T20:11:34.001 INFO:tasks.workunit.client.1.smithi141.stdout:3/425: readlink d0/d1c/d40/d3f/d52/d5a/l86 0 2023-12-16T20:11:34.002 INFO:tasks.workunit.client.1.smithi141.stdout:3/426: write d0/d1c/d40/d85/d4c/f8a [998530,105133] 0 2023-12-16T20:11:34.004 INFO:tasks.workunit.client.1.smithi141.stdout:5/253: rename d0/d9/f41 to d0/d14/d2c/d4a/f51 0 2023-12-16T20:11:34.005 INFO:tasks.workunit.client.1.smithi141.stdout:6/358: sync 2023-12-16T20:11:34.005 INFO:tasks.workunit.client.1.smithi141.stdout:7/283: sync 2023-12-16T20:11:34.006 INFO:tasks.workunit.client.1.smithi141.stdout:7/284: truncate d5/d16/d30/d36/f4b 561335 0 2023-12-16T20:11:34.007 INFO:tasks.workunit.client.1.smithi141.stdout:8/408: dwrite d14/d19/d1b/d3d/f76 [0,4194304] 0 2023-12-16T20:11:34.008 INFO:tasks.workunit.client.0.smithi038.stdout:6/603: creat d1/d4/d1d/d28/d2f/fbd x:0 0 0 2023-12-16T20:11:34.008 INFO:tasks.workunit.client.0.smithi038.stdout:6/604: chown d1/cb2 85 1 2023-12-16T20:11:34.009 INFO:tasks.workunit.client.1.smithi141.stdout:8/409: dread d14/d19/d1b/d24/d4a/d5b/f5d [0,4194304] 0 2023-12-16T20:11:34.010 INFO:tasks.workunit.client.0.smithi038.stdout:3/659: dwrite d4/d27/d23/f4f [0,4194304] 0 2023-12-16T20:11:34.010 INFO:tasks.workunit.client.0.smithi038.stdout:0/739: write f5 [7756674,43626] 0 2023-12-16T20:11:34.011 INFO:tasks.workunit.client.0.smithi038.stdout:3/660: write d4/d8/f16 [4855403,126509] 0 2023-12-16T20:11:34.011 INFO:tasks.workunit.client.0.smithi038.stdout:0/740: creat db/d16/d19/d80/ff6 x:0 0 0 2023-12-16T20:11:34.011 INFO:tasks.workunit.client.1.smithi141.stdout:1/413: rename da/d1a/d31/c6b to da/df/c87 0 2023-12-16T20:11:34.012 INFO:tasks.workunit.client.1.smithi141.stdout:6/359: mkdir d1/d77 0 2023-12-16T20:11:34.013 INFO:tasks.workunit.client.1.smithi141.stdout:9/314: dread d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:34.014 INFO:tasks.workunit.client.0.smithi038.stdout:2/702: unlink d1/d5/d95/d61/dd4/d21/d9a/fa3 0 2023-12-16T20:11:34.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/572: read d17/d1b/d66/f8a [3195946,13130] 0 2023-12-16T20:11:34.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/573: dread - d17/d1b/d57/f79 zero size 2023-12-16T20:11:34.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/574: fdatasync d17/d5a/f85 0 2023-12-16T20:11:34.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/575: write d17/d1b/d66/f8a [5165156,100054] 0 2023-12-16T20:11:34.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/576: fdatasync d17/d1b/d66/d8e/f91 0 2023-12-16T20:11:34.016 INFO:tasks.workunit.client.1.smithi141.stdout:1/414: dread da/d1a/d1d/d22/f60 [0,4194304] 0 2023-12-16T20:11:34.016 INFO:tasks.workunit.client.0.smithi038.stdout:7/676: write da/d21/f87 [2292952,104813] 0 2023-12-16T20:11:34.016 INFO:tasks.workunit.client.0.smithi038.stdout:7/677: chown f5 4 1 2023-12-16T20:11:34.016 INFO:tasks.workunit.client.0.smithi038.stdout:7/678: dread - da/d21/d61/dcd/f7b zero size 2023-12-16T20:11:34.017 INFO:tasks.workunit.client.1.smithi141.stdout:7/285: unlink d5/f12 0 2023-12-16T20:11:34.020 INFO:tasks.workunit.client.0.smithi038.stdout:3/661: mkdir d4/d8/d15/d6d/d7a/de6 0 2023-12-16T20:11:34.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/703: mknod d1/d5/d95/d61/dd4/d10/cf2 0 2023-12-16T20:11:34.025 INFO:tasks.workunit.client.0.smithi038.stdout:7/679: symlink da/d24/d4d/dc5/d38/lea 0 2023-12-16T20:11:34.025 INFO:tasks.workunit.client.0.smithi038.stdout:7/680: chown da/d21/d2c/d76/l97 31990337 1 2023-12-16T20:11:34.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/704: fsync d1/d5/d95/d61/dd4/d10/f71 0 2023-12-16T20:11:34.027 INFO:tasks.workunit.client.0.smithi038.stdout:7/681: dread da/d21/d61/dcd/d6b/f99 [0,4194304] 0 2023-12-16T20:11:34.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/705: write d1/d5/d2a/fd3 [606734,14472] 0 2023-12-16T20:11:34.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/706: stat d1/d5/d3d/lec 0 2023-12-16T20:11:34.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/707: stat d1/d5/d6c/d91/dce 0 2023-12-16T20:11:34.030 INFO:tasks.workunit.client.1.smithi141.stdout:6/360: dread d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:34.031 INFO:tasks.workunit.client.1.smithi141.stdout:3/427: dwrite d0/d1c/d40/d3f/f80 [0,4194304] 0 2023-12-16T20:11:34.031 INFO:tasks.workunit.client.1.smithi141.stdout:9/315: rename d1/d10/d14/d20/c13 to d1/d10/d14/d20/c74 0 2023-12-16T20:11:34.031 INFO:tasks.workunit.client.1.smithi141.stdout:9/316: chown d1/d26 116 1 2023-12-16T20:11:34.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/708: symlink d1/d5/d95/d61/dd4/d21/lf3 0 2023-12-16T20:11:34.036 INFO:tasks.workunit.client.0.smithi038.stdout:3/662: dread d4/d27/d23/d26/f68 [0,4194304] 0 2023-12-16T20:11:34.036 INFO:tasks.workunit.client.0.smithi038.stdout:7/682: creat da/d24/d4d/dc5/ddc/dba/dd9/feb x:0 0 0 2023-12-16T20:11:34.038 INFO:tasks.workunit.client.0.smithi038.stdout:3/663: mknod d4/d27/d40/ce7 0 2023-12-16T20:11:34.038 INFO:tasks.workunit.client.0.smithi038.stdout:3/664: truncate d4/d8/d15/d6d/d7a/f86 5080901 0 2023-12-16T20:11:34.039 INFO:tasks.workunit.client.1.smithi141.stdout:6/361: creat d1/d12/d22/f78 x:0 0 0 2023-12-16T20:11:34.040 INFO:tasks.workunit.client.0.smithi038.stdout:7/683: link da/d24/l3d da/d21/d86/lec 0 2023-12-16T20:11:34.040 INFO:tasks.workunit.client.0.smithi038.stdout:7/684: write f5 [1051964,37939] 0 2023-12-16T20:11:34.041 INFO:tasks.workunit.client.0.smithi038.stdout:3/665: truncate d4/f6 2429694 0 2023-12-16T20:11:34.041 INFO:tasks.workunit.client.0.smithi038.stdout:3/666: chown d4/d27/d2b/f32 30 1 2023-12-16T20:11:34.042 INFO:tasks.workunit.client.1.smithi141.stdout:3/428: creat d0/d1c/d2c/d72/d74/f97 x:0 0 0 2023-12-16T20:11:34.043 INFO:tasks.workunit.client.1.smithi141.stdout:9/317: rmdir d1/d10/d33/d6a 39 2023-12-16T20:11:34.044 INFO:tasks.workunit.client.1.smithi141.stdout:6/362: truncate d1/dd/f1e 3379942 0 2023-12-16T20:11:34.044 INFO:tasks.workunit.client.1.smithi141.stdout:6/363: chown d1/d12/d20/d3a/f6d 572 1 2023-12-16T20:11:34.047 INFO:tasks.workunit.client.0.smithi038.stdout:7/685: mkdir da/d21/d61/dcd/d6b/ded 0 2023-12-16T20:11:34.047 INFO:tasks.workunit.client.0.smithi038.stdout:7/686: truncate da/d21/d2c/dd0/fde 539170 0 2023-12-16T20:11:34.049 INFO:tasks.workunit.client.1.smithi141.stdout:4/314: sync 2023-12-16T20:11:34.050 INFO:tasks.workunit.client.1.smithi141.stdout:9/318: mkdir d1/d10/d33/d6a/d75 0 2023-12-16T20:11:34.050 INFO:tasks.workunit.client.1.smithi141.stdout:9/319: chown d1/d10/f12 12 1 2023-12-16T20:11:34.050 INFO:tasks.workunit.client.1.smithi141.stdout:9/320: chown d1/d10/d33 244262 1 2023-12-16T20:11:34.050 INFO:tasks.workunit.client.0.smithi038.stdout:2/709: dwrite d1/d5/d95/d61/dd4/d10/f71 [0,4194304] 0 2023-12-16T20:11:34.050 INFO:tasks.workunit.client.0.smithi038.stdout:2/710: fdatasync d1/d5/d95/d61/dd4/d21/f93 0 2023-12-16T20:11:34.051 INFO:tasks.workunit.client.0.smithi038.stdout:2/711: fdatasync d1/d5/f4e 0 2023-12-16T20:11:34.052 INFO:tasks.workunit.client.1.smithi141.stdout:6/364: unlink d1/d3/c5a 0 2023-12-16T20:11:34.053 INFO:tasks.workunit.client.1.smithi141.stdout:9/321: mkdir d1/d26/d4a/d73/d76 0 2023-12-16T20:11:34.053 INFO:tasks.workunit.client.0.smithi038.stdout:6/605: rename d1/d2e to d1/d4/d1d/d28/db1/dbe 0 2023-12-16T20:11:34.053 INFO:tasks.workunit.client.0.smithi038.stdout:3/667: dread d4/d27/d23/f4f [0,4194304] 0 2023-12-16T20:11:34.053 INFO:tasks.workunit.client.0.smithi038.stdout:3/668: chown d4/d8/d15/d1e/l48 0 1 2023-12-16T20:11:34.053 INFO:tasks.workunit.client.0.smithi038.stdout:3/669: write d4/d67/f76 [434827,10571] 0 2023-12-16T20:11:34.054 INFO:tasks.workunit.client.1.smithi141.stdout:6/365: creat d1/d12/d20/d44/d4a/f79 x:0 0 0 2023-12-16T20:11:34.054 INFO:tasks.workunit.client.1.smithi141.stdout:6/366: read - d1/d3/d4b/f66 zero size 2023-12-16T20:11:34.054 INFO:tasks.workunit.client.1.smithi141.stdout:6/367: write d1/d12/d22/d25/f55 [1332229,47752] 0 2023-12-16T20:11:34.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/712: dread d1/d5/d95/d61/dd4/d10/f4f [0,4194304] 0 2023-12-16T20:11:34.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/713: dread - d1/d5/d95/d61/dd4/d10/f77 zero size 2023-12-16T20:11:34.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/714: readlink d1/d5/d95/d61/dd4/d21/d82/l65 0 2023-12-16T20:11:34.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/715: chown d1/d5/d95/d61/dd4/d21/f3c 22 1 2023-12-16T20:11:34.056 INFO:tasks.workunit.client.1.smithi141.stdout:2/191: sync 2023-12-16T20:11:34.058 INFO:tasks.workunit.client.1.smithi141.stdout:9/322: creat d1/d10/d14/d20/d3b/f77 x:0 0 0 2023-12-16T20:11:34.058 INFO:tasks.workunit.client.1.smithi141.stdout:9/323: truncate d1/d10/d14/d20/d3b/f5c 949627 0 2023-12-16T20:11:34.058 INFO:tasks.workunit.client.1.smithi141.stdout:3/429: dread d0/d1c/d40/d3f/f73 [0,4194304] 0 2023-12-16T20:11:34.058 INFO:tasks.workunit.client.1.smithi141.stdout:3/430: creat d0/d1c/f98 x:0 0 0 2023-12-16T20:11:34.059 INFO:tasks.workunit.client.1.smithi141.stdout:2/192: symlink d6/da/d33/l43 0 2023-12-16T20:11:34.059 INFO:tasks.workunit.client.0.smithi038.stdout:8/577: dwrite d17/d1b/d25/f5c [0,4194304] 0 2023-12-16T20:11:34.061 INFO:tasks.workunit.client.1.smithi141.stdout:9/324: unlink d1/fc 0 2023-12-16T20:11:34.061 INFO:tasks.workunit.client.1.smithi141.stdout:9/325: write d1/d10/d27/d36/f50 [483066,120495] 0 2023-12-16T20:11:34.064 INFO:tasks.workunit.client.1.smithi141.stdout:9/326: chown d1/l5 34 1 2023-12-16T20:11:34.066 INFO:tasks.workunit.client.1.smithi141.stdout:7/286: dwrite d5/d16/d30/f32 [0,4194304] 0 2023-12-16T20:11:34.072 INFO:tasks.workunit.client.1.smithi141.stdout:7/287: creat d5/d16/d30/d4e/f5e x:0 0 0 2023-12-16T20:11:34.072 INFO:tasks.workunit.client.1.smithi141.stdout:7/288: chown d5/l6 1051572 1 2023-12-16T20:11:34.073 INFO:tasks.workunit.client.1.smithi141.stdout:7/289: readlink d5/l19 0 2023-12-16T20:11:34.073 INFO:tasks.workunit.client.0.smithi038.stdout:6/606: mkdir d1/d4/d1d/d8e/dbf 0 2023-12-16T20:11:34.076 INFO:tasks.workunit.client.1.smithi141.stdout:7/290: rename d5/d16/d30/d4e/f5e to d5/f5f 0 2023-12-16T20:11:34.076 INFO:tasks.workunit.client.1.smithi141.stdout:7/291: truncate d5/d2a/f3e 645997 0 2023-12-16T20:11:34.076 INFO:tasks.workunit.client.0.smithi038.stdout:3/670: mkdir d4/de8 0 2023-12-16T20:11:34.077 INFO:tasks.workunit.client.0.smithi038.stdout:3/671: chown d4/d8/d15/d6d/l73 0 1 2023-12-16T20:11:34.078 INFO:tasks.workunit.client.1.smithi141.stdout:7/292: rmdir d5/d16/d1a/d40 39 2023-12-16T20:11:34.078 INFO:tasks.workunit.client.1.smithi141.stdout:2/193: dread d6/f17 [8388608,4194304] 0 2023-12-16T20:11:34.079 INFO:tasks.workunit.client.1.smithi141.stdout:6/368: dread d1/d12/d22/f50 [0,4194304] 0 2023-12-16T20:11:34.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/716: mknod d1/d5/d95/d61/d66/cf4 0 2023-12-16T20:11:34.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/717: truncate d1/d5/d95/d61/dd4/d6a/d43/d57/f5a 5235142 0 2023-12-16T20:11:34.082 INFO:tasks.workunit.client.1.smithi141.stdout:7/293: rename d5/f8 to d5/d2a/f60 0 2023-12-16T20:11:34.085 INFO:tasks.workunit.client.0.smithi038.stdout:8/578: creat d17/d1b/d66/d73/d4e/fbe x:0 0 0 2023-12-16T20:11:34.086 INFO:tasks.workunit.client.1.smithi141.stdout:1/415: getdents da/d1a/d31 0 2023-12-16T20:11:34.095 INFO:tasks.workunit.client.0.smithi038.stdout:8/579: write f16 [5969077,85760] 0 2023-12-16T20:11:34.096 INFO:tasks.workunit.client.1.smithi141.stdout:7/294: dread d5/d16/d30/f32 [0,4194304] 0 2023-12-16T20:11:34.096 INFO:tasks.workunit.client.1.smithi141.stdout:7/295: truncate d5/d16/d1a/d40/f58 141533 0 2023-12-16T20:11:34.096 INFO:tasks.workunit.client.1.smithi141.stdout:7/296: fdatasync d5/d2a/f34 0 2023-12-16T20:11:34.098 INFO:tasks.workunit.client.0.smithi038.stdout:6/607: getdents d1/d5b/d7d 0 2023-12-16T20:11:34.098 INFO:tasks.workunit.client.0.smithi038.stdout:6/608: creat d1/d4/d1d/d28/d2f/d85/fc0 x:0 0 0 2023-12-16T20:11:34.099 INFO:tasks.workunit.client.0.smithi038.stdout:7/687: dwrite da/d21/f8f [0,4194304] 0 2023-12-16T20:11:34.099 INFO:tasks.workunit.client.1.smithi141.stdout:7/297: mkdir d5/d16/d46/d61 0 2023-12-16T20:11:34.099 INFO:tasks.workunit.client.1.smithi141.stdout:7/298: fsync d5/d16/d1a/f25 0 2023-12-16T20:11:34.099 INFO:tasks.workunit.client.1.smithi141.stdout:7/299: dread - d5/d1d/d1e/f52 zero size 2023-12-16T20:11:34.099 INFO:tasks.workunit.client.1.smithi141.stdout:4/315: dwrite d1a/d2a/d3b/f45 [0,4194304] 0 2023-12-16T20:11:34.100 INFO:tasks.workunit.client.0.smithi038.stdout:2/718: truncate d1/d73/f7c 6530275 0 2023-12-16T20:11:34.102 INFO:tasks.workunit.client.1.smithi141.stdout:1/416: dread da/d1a/f73 [0,4194304] 0 2023-12-16T20:11:34.102 INFO:tasks.workunit.client.1.smithi141.stdout:7/300: rename d5/d1d/f59 to d5/d16/d30/d4e/f62 0 2023-12-16T20:11:34.102 INFO:tasks.workunit.client.1.smithi141.stdout:7/301: read - d5/d1d/d1e/f52 zero size 2023-12-16T20:11:34.105 INFO:tasks.workunit.client.0.smithi038.stdout:6/609: rename d1/d16/f21 to d1/d4/d1d/d28/d2f/fc1 0 2023-12-16T20:11:34.107 INFO:tasks.workunit.client.1.smithi141.stdout:7/302: dread d5/d2a/f41 [0,4194304] 0 2023-12-16T20:11:34.107 INFO:tasks.workunit.client.1.smithi141.stdout:1/417: write da/d36/d4b/f63 [237029,93661] 0 2023-12-16T20:11:34.108 INFO:tasks.workunit.client.1.smithi141.stdout:1/418: fdatasync da/df/f78 0 2023-12-16T20:11:34.108 INFO:tasks.workunit.client.1.smithi141.stdout:1/419: readlink da/l44 0 2023-12-16T20:11:34.109 INFO:tasks.workunit.client.1.smithi141.stdout:9/327: dwrite d1/d10/d14/d20/d3b/f52 [0,4194304] 0 2023-12-16T20:11:34.109 INFO:tasks.workunit.client.1.smithi141.stdout:9/328: fdatasync d1/d26/d4a/d73/f4e 0 2023-12-16T20:11:34.109 INFO:tasks.workunit.client.1.smithi141.stdout:9/329: chown d1/d26/d4a/d73/c43 34876 1 2023-12-16T20:11:34.109 INFO:tasks.workunit.client.1.smithi141.stdout:7/303: symlink d5/d16/d1a/d40/l63 0 2023-12-16T20:11:34.110 INFO:tasks.workunit.client.1.smithi141.stdout:3/431: dwrite d0/d1c/d40/d3f/d52/f59 [0,4194304] 0 2023-12-16T20:11:34.110 INFO:tasks.workunit.client.1.smithi141.stdout:3/432: write d0/d1c/d40/f92 [571550,14602] 0 2023-12-16T20:11:34.110 INFO:tasks.workunit.client.0.smithi038.stdout:2/719: dread d1/d5/d95/d61/dd4/d6a/d43/fb0 [0,4194304] 0 2023-12-16T20:11:34.110 INFO:tasks.workunit.client.0.smithi038.stdout:2/720: stat d1/d5/d95/d61/d66/ddd 0 2023-12-16T20:11:34.111 INFO:tasks.workunit.client.1.smithi141.stdout:6/369: dwrite d1/d12/d20/d3a/f6d [0,4194304] 0 2023-12-16T20:11:34.111 INFO:tasks.workunit.client.1.smithi141.stdout:6/370: write d1/d12/d22/f78 [302806,77249] 0 2023-12-16T20:11:34.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/610: truncate d1/d4/f49 1278842 0 2023-12-16T20:11:34.114 INFO:tasks.workunit.client.1.smithi141.stdout:1/420: mknod da/d76/c88 0 2023-12-16T20:11:34.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/330: truncate d1/d10/d14/d20/d3b/f46 519284 0 2023-12-16T20:11:34.118 INFO:tasks.workunit.client.0.smithi038.stdout:6/611: creat d1/d4/d1d/d61/da4/fc2 x:0 0 0 2023-12-16T20:11:34.118 INFO:tasks.workunit.client.0.smithi038.stdout:6/612: readlink d1/d4/d1d/l5c 0 2023-12-16T20:11:34.118 INFO:tasks.workunit.client.0.smithi038.stdout:6/613: write d1/d4/d1d/d61/da4/fc2 [401671,89495] 0 2023-12-16T20:11:34.118 INFO:tasks.workunit.client.1.smithi141.stdout:3/433: truncate d0/d1c/d40/d85/d4c/f55 229620 0 2023-12-16T20:11:34.119 INFO:tasks.workunit.client.1.smithi141.stdout:7/304: creat d5/d2a/d45/d5a/f64 x:0 0 0 2023-12-16T20:11:34.120 INFO:tasks.workunit.client.1.smithi141.stdout:5/254: dwrite d0/fe [0,4194304] 0 2023-12-16T20:11:34.120 INFO:tasks.workunit.client.0.smithi038.stdout:3/672: dwrite d4/d8/dc8/fdb [0,4194304] 0 2023-12-16T20:11:34.122 INFO:tasks.workunit.client.1.smithi141.stdout:6/371: mknod d1/d3/d4f/c7a 0 2023-12-16T20:11:34.125 INFO:tasks.workunit.client.1.smithi141.stdout:9/331: creat d1/d10/d14/d20/da/f78 x:0 0 0 2023-12-16T20:11:34.126 INFO:tasks.workunit.client.1.smithi141.stdout:3/434: rmdir d0/d1c/d40/d93 0 2023-12-16T20:11:34.128 INFO:tasks.workunit.client.1.smithi141.stdout:7/305: mknod d5/d16/d30/c65 0 2023-12-16T20:11:34.129 INFO:tasks.workunit.client.1.smithi141.stdout:7/306: truncate d5/f5f 716119 0 2023-12-16T20:11:34.129 INFO:tasks.workunit.client.1.smithi141.stdout:5/255: mknod d0/df/c52 0 2023-12-16T20:11:34.129 INFO:tasks.workunit.client.1.smithi141.stdout:5/256: chown d0/d9/d16/d2a/d35/f40 0 1 2023-12-16T20:11:34.129 INFO:tasks.workunit.client.1.smithi141.stdout:5/257: truncate d0/d9/d16/d2a/d35/f40 742639 0 2023-12-16T20:11:34.129 INFO:tasks.workunit.client.1.smithi141.stdout:5/258: stat d0/df/f3a 0 2023-12-16T20:11:34.130 INFO:tasks.workunit.client.0.smithi038.stdout:2/721: write d1/d5/d6c/d91/fca [3416099,53882] 0 2023-12-16T20:11:34.130 INFO:tasks.workunit.client.1.smithi141.stdout:6/372: mknod d1/dd/d43/c7b 0 2023-12-16T20:11:34.130 INFO:tasks.workunit.client.0.smithi038.stdout:8/580: dwrite d17/d5a/f7f [0,4194304] 0 2023-12-16T20:11:34.133 INFO:tasks.workunit.client.0.smithi038.stdout:2/722: creat d1/d5/d95/d61/dd4/d10/ff5 x:0 0 0 2023-12-16T20:11:34.133 INFO:tasks.workunit.client.1.smithi141.stdout:9/332: truncate d1/d10/d33/d39/f40 5975059 0 2023-12-16T20:11:34.133 INFO:tasks.workunit.client.1.smithi141.stdout:9/333: fdatasync d1/d10/d33/d47/f5b 0 2023-12-16T20:11:34.133 INFO:tasks.workunit.client.1.smithi141.stdout:9/334: write d1/d10/d14/f25 [8888115,36226] 0 2023-12-16T20:11:34.135 INFO:tasks.workunit.client.1.smithi141.stdout:7/307: link d5/d16/d46/l4d d5/d1d/d1e/l66 0 2023-12-16T20:11:34.139 INFO:tasks.workunit.client.1.smithi141.stdout:1/421: rename da/d1a/d1d/d22/d29 to da/d36/d4b/d4d/d89 0 2023-12-16T20:11:34.139 INFO:tasks.workunit.client.1.smithi141.stdout:1/422: chown da/d36/d4b/d4d/f54 248754396 1 2023-12-16T20:11:34.139 INFO:tasks.workunit.client.1.smithi141.stdout:3/435: dread d0/f8 [0,4194304] 0 2023-12-16T20:11:34.142 INFO:tasks.workunit.client.1.smithi141.stdout:7/308: read d5/d16/d30/f32 [2297243,47101] 0 2023-12-16T20:11:34.143 INFO:tasks.workunit.client.0.smithi038.stdout:8/581: write d17/d1b/d66/f72 [3942454,106656] 0 2023-12-16T20:11:34.144 INFO:tasks.workunit.client.1.smithi141.stdout:6/373: getdents d1/d12/d22 0 2023-12-16T20:11:34.144 INFO:tasks.workunit.client.1.smithi141.stdout:6/374: fdatasync d1/dd/d2f/f30 0 2023-12-16T20:11:34.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/582: creat d17/d1b/d66/d73/fbf x:0 0 0 2023-12-16T20:11:34.149 INFO:tasks.workunit.client.1.smithi141.stdout:1/423: symlink da/d1a/d1d/l8a 0 2023-12-16T20:11:34.151 INFO:tasks.workunit.client.0.smithi038.stdout:7/688: dwrite da/d24/d4d/dc5/ddc/f3a [4194304,4194304] 0 2023-12-16T20:11:34.151 INFO:tasks.workunit.client.0.smithi038.stdout:3/673: dwrite d4/d27/d40/f5f [0,4194304] 0 2023-12-16T20:11:34.152 INFO:tasks.workunit.client.1.smithi141.stdout:4/316: dwrite d1a/f2e [0,4194304] 0 2023-12-16T20:11:34.152 INFO:tasks.workunit.client.1.smithi141.stdout:3/436: creat d0/d1c/d40/f99 x:0 0 0 2023-12-16T20:11:34.154 INFO:tasks.workunit.client.0.smithi038.stdout:1/697: sync 2023-12-16T20:11:34.155 INFO:tasks.workunit.client.1.smithi141.stdout:5/259: rename d0/d9/d16/d2a/l3b to d0/l53 0 2023-12-16T20:11:34.155 INFO:tasks.workunit.client.1.smithi141.stdout:5/260: creat d0/d9/f54 x:0 0 0 2023-12-16T20:11:34.156 INFO:tasks.workunit.client.1.smithi141.stdout:4/317: dread d1a/d4e/d63/f77 [0,4194304] 0 2023-12-16T20:11:34.156 INFO:tasks.workunit.client.1.smithi141.stdout:4/318: fdatasync d1a/f1c 0 2023-12-16T20:11:34.156 INFO:tasks.workunit.client.1.smithi141.stdout:4/319: fdatasync fd 0 2023-12-16T20:11:34.161 INFO:tasks.workunit.client.0.smithi038.stdout:3/674: mknod d4/d8/d15/d6d/d7a/daf/ce9 0 2023-12-16T20:11:34.162 INFO:tasks.workunit.client.0.smithi038.stdout:1/698: write d15/d22/f61 [1253085,68011] 0 2023-12-16T20:11:34.165 INFO:tasks.workunit.client.0.smithi038.stdout:7/689: write da/d24/d4d/dc5/ddc/f40 [1255310,129527] 0 2023-12-16T20:11:34.165 INFO:tasks.workunit.client.0.smithi038.stdout:7/690: chown da/d24/d4d/dc5/d38/fc6 7 1 2023-12-16T20:11:34.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/675: unlink d4/d67/l9d 0 2023-12-16T20:11:34.168 INFO:tasks.workunit.client.1.smithi141.stdout:5/261: creat d0/d14/d2c/d4a/f55 x:0 0 0 2023-12-16T20:11:34.168 INFO:tasks.workunit.client.0.smithi038.stdout:1/699: symlink d15/d1e/d3b/d5a/lf2 0 2023-12-16T20:11:34.170 INFO:tasks.workunit.client.1.smithi141.stdout:9/335: rename d1/d10/d14/d20/d3b/f67 to d1/d10/d27/f79 0 2023-12-16T20:11:34.170 INFO:tasks.workunit.client.1.smithi141.stdout:9/336: write d1/d26/d4a/d73/f5e [957392,35778] 0 2023-12-16T20:11:34.170 INFO:tasks.workunit.client.1.smithi141.stdout:9/337: creat d1/d10/d27/d36/f7a x:0 0 0 2023-12-16T20:11:34.171 INFO:tasks.workunit.client.0.smithi038.stdout:7/691: getdents da/d21/d86 0 2023-12-16T20:11:34.172 INFO:tasks.workunit.client.1.smithi141.stdout:4/320: mknod d1a/d4e/c7e 0 2023-12-16T20:11:34.173 INFO:tasks.workunit.client.0.smithi038.stdout:3/676: symlink d4/d27/d23/d26/lea 0 2023-12-16T20:11:34.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/677: write d4/d8/d15/f54 [789661,94062] 0 2023-12-16T20:11:34.175 INFO:tasks.workunit.client.0.smithi038.stdout:1/700: symlink d15/d1e/d23/d34/d86/d9a/lf3 0 2023-12-16T20:11:34.175 INFO:tasks.workunit.client.0.smithi038.stdout:7/692: mkdir da/d21/d86/dee 0 2023-12-16T20:11:34.177 INFO:tasks.workunit.client.0.smithi038.stdout:7/693: read da/d24/d4d/dc5/d38/d90/f2d [248206,19682] 0 2023-12-16T20:11:34.177 INFO:tasks.workunit.client.0.smithi038.stdout:7/694: truncate da/d21/d2c/d76/fca 955176 0 2023-12-16T20:11:34.178 INFO:tasks.workunit.client.0.smithi038.stdout:3/678: creat d4/d8/d15/d6d/d7a/feb x:0 0 0 2023-12-16T20:11:34.178 INFO:tasks.workunit.client.0.smithi038.stdout:3/679: readlink d4/lb1 0 2023-12-16T20:11:34.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/701: creat d15/d1e/d3b/d48/ff4 x:0 0 0 2023-12-16T20:11:34.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/702: stat d15/d1e/d3b/d48/d37/dde/d75/dc6/fe5 0 2023-12-16T20:11:34.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/703: truncate d15/d1e/d3b/d48/d37/dde/fe0 896444 0 2023-12-16T20:11:34.180 INFO:tasks.workunit.client.1.smithi141.stdout:1/424: mknod da/d36/d4b/c8b 0 2023-12-16T20:11:34.180 INFO:tasks.workunit.client.1.smithi141.stdout:1/425: chown da/d1a/f59 9705 1 2023-12-16T20:11:34.180 INFO:tasks.workunit.client.0.smithi038.stdout:7/695: mknod da/d24/d4d/cef 0 2023-12-16T20:11:34.182 INFO:tasks.workunit.client.0.smithi038.stdout:3/680: mknod d4/d27/d23/d6e/cec 0 2023-12-16T20:11:34.182 INFO:tasks.workunit.client.1.smithi141.stdout:1/426: read da/d1a/d1d/d33/f43 [39297,90664] 0 2023-12-16T20:11:34.182 INFO:tasks.workunit.client.1.smithi141.stdout:1/427: dread - da/d36/d4b/f5a zero size 2023-12-16T20:11:34.182 INFO:tasks.workunit.client.1.smithi141.stdout:9/338: symlink d1/d10/d33/d6a/l7b 0 2023-12-16T20:11:34.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/375: rename d1/dd/d43/l59 to d1/d77/l7c 0 2023-12-16T20:11:34.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/376: readlink d1/d12/d20/d3a/l62 0 2023-12-16T20:11:34.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/377: rename d1/d77 to d1/d77/d7d 22 2023-12-16T20:11:34.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/378: read d1/d12/d22/f53 [882979,69312] 0 2023-12-16T20:11:34.185 INFO:tasks.workunit.client.0.smithi038.stdout:1/704: rmdir d15/d1e/d23/d7d/daa/dc9 0 2023-12-16T20:11:34.185 INFO:tasks.workunit.client.1.smithi141.stdout:1/428: mknod da/d36/d4b/d4d/d89/c8c 0 2023-12-16T20:11:34.185 INFO:tasks.workunit.client.1.smithi141.stdout:1/429: write da/d36/d4b/d4d/d89/f75 [921361,120503] 0 2023-12-16T20:11:34.186 INFO:tasks.workunit.client.0.smithi038.stdout:1/705: mkdir d15/d1e/d23/d34/d86/d99/df5 0 2023-12-16T20:11:34.186 INFO:tasks.workunit.client.0.smithi038.stdout:1/706: truncate d15/d4a/fc0 513904 0 2023-12-16T20:11:34.186 INFO:tasks.workunit.client.0.smithi038.stdout:1/707: stat d15/d22/d62/fe7 0 2023-12-16T20:11:34.186 INFO:tasks.workunit.client.0.smithi038.stdout:1/708: write d15/d1e/d23/d34/fbe [467508,70305] 0 2023-12-16T20:11:34.188 INFO:tasks.workunit.client.0.smithi038.stdout:1/709: creat d15/d1e/d30/ff6 x:0 0 0 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:6/379: rename d1/d3/f10 to d1/d12/d22/d25/f7e 0 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:5/262: dread d0/d9/f34 [0,4194304] 0 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:6/380: dread d1/d12/d20/f6a [0,4194304] 0 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:6/381: chown d1/d12/d20/c42 108587 1 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:6/382: chown d1/l1f 55734 1 2023-12-16T20:11:34.189 INFO:tasks.workunit.client.1.smithi141.stdout:5/263: write d0/d25/f2e [2386427,14864] 0 2023-12-16T20:11:34.196 INFO:tasks.workunit.client.0.smithi038.stdout:3/681: dread d4/d8/dc8/fdb [0,4194304] 0 2023-12-16T20:11:34.196 INFO:tasks.workunit.client.1.smithi141.stdout:6/383: link d1/dd/de/f6f d1/d5e/f7f 0 2023-12-16T20:11:34.197 INFO:tasks.workunit.client.1.smithi141.stdout:5/264: symlink d0/d9/d16/l56 0 2023-12-16T20:11:34.197 INFO:tasks.workunit.client.1.smithi141.stdout:5/265: write d0/df/f3a [629907,3136] 0 2023-12-16T20:11:34.197 INFO:tasks.workunit.client.1.smithi141.stdout:6/384: creat d1/d12/d20/d3a/f80 x:0 0 0 2023-12-16T20:11:34.197 INFO:tasks.workunit.client.1.smithi141.stdout:5/266: mknod d0/d14/d2c/d4a/c57 0 2023-12-16T20:11:34.197 INFO:tasks.workunit.client.1.smithi141.stdout:5/267: write d0/d9/d16/d2a/d35/f40 [862803,128020] 0 2023-12-16T20:11:34.206 INFO:tasks.workunit.client.0.smithi038.stdout:7/696: write da/d24/d4d/dc5/f39 [1906475,129029] 0 2023-12-16T20:11:34.206 INFO:tasks.workunit.client.0.smithi038.stdout:7/697: creat da/d21/ff0 x:0 0 0 2023-12-16T20:11:34.209 INFO:tasks.workunit.client.1.smithi141.stdout:6/385: dread d1/dd/de/f27 [0,4194304] 0 2023-12-16T20:11:34.211 INFO:tasks.workunit.client.1.smithi141.stdout:1/430: write da/d1a/f59 [808109,63065] 0 2023-12-16T20:11:34.211 INFO:tasks.workunit.client.1.smithi141.stdout:1/431: creat da/d36/f8d x:0 0 0 2023-12-16T20:11:34.211 INFO:tasks.workunit.client.1.smithi141.stdout:9/339: dread d1/d10/d14/d20/d3b/f52 [0,4194304] 0 2023-12-16T20:11:34.211 INFO:tasks.workunit.client.1.smithi141.stdout:5/268: dread d0/d9/f15 [4194304,4194304] 0 2023-12-16T20:11:34.212 INFO:tasks.workunit.client.0.smithi038.stdout:7/698: dread da/d21/d61/fc3 [0,4194304] 0 2023-12-16T20:11:34.215 INFO:tasks.workunit.client.1.smithi141.stdout:9/340: link d1/d10/l37 d1/d26/d4a/d73/l7c 0 2023-12-16T20:11:34.216 INFO:tasks.workunit.client.1.smithi141.stdout:1/432: link da/d1a/d31/f7e da/d67/f8e 0 2023-12-16T20:11:34.216 INFO:tasks.workunit.client.1.smithi141.stdout:1/433: write da/d1a/f7b [22508,107096] 0 2023-12-16T20:11:34.217 INFO:tasks.workunit.client.1.smithi141.stdout:6/386: dread d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:34.218 INFO:tasks.workunit.client.1.smithi141.stdout:1/434: mkdir da/d1a/d1d/d8f 0 2023-12-16T20:11:34.218 INFO:tasks.workunit.client.1.smithi141.stdout:1/435: dread - da/d67/f68 zero size 2023-12-16T20:11:34.220 INFO:tasks.workunit.client.1.smithi141.stdout:9/341: link d1/d10/d14/d20/l59 d1/l7d 0 2023-12-16T20:11:34.221 INFO:tasks.workunit.client.1.smithi141.stdout:6/387: truncate d1/d12/d22/f53 1471931 0 2023-12-16T20:11:34.224 INFO:tasks.workunit.client.1.smithi141.stdout:9/342: truncate d1/d10/d14/f31 1277504 0 2023-12-16T20:11:34.224 INFO:tasks.workunit.client.1.smithi141.stdout:5/269: write d0/d9/d16/f2d [1502941,49764] 0 2023-12-16T20:11:34.224 INFO:tasks.workunit.client.1.smithi141.stdout:5/270: write d0/f3e [74691,81786] 0 2023-12-16T20:11:34.225 INFO:tasks.workunit.client.1.smithi141.stdout:9/343: mknod d1/d10/d33/d6a/c7e 0 2023-12-16T20:11:34.225 INFO:tasks.workunit.client.1.smithi141.stdout:9/344: readlink d1/d10/d33/d47/l4f 0 2023-12-16T20:11:34.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/345: getdents d1/d10/d33/d39 0 2023-12-16T20:11:34.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/346: write d1/d10/f15 [1734118,68799] 0 2023-12-16T20:11:34.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/347: dread - d1/d10/d14/d20/da/d3f/f68 zero size 2023-12-16T20:11:34.228 INFO:tasks.workunit.client.0.smithi038.stdout:2/723: dwrite d1/d5/d6c/d91/fca [0,4194304] 0 2023-12-16T20:11:34.231 INFO:tasks.workunit.client.0.smithi038.stdout:3/682: dwrite d4/d27/d23/f57 [0,4194304] 0 2023-12-16T20:11:34.231 INFO:tasks.workunit.client.0.smithi038.stdout:3/683: fsync d4/d18/f38 0 2023-12-16T20:11:34.231 INFO:tasks.workunit.client.0.smithi038.stdout:3/684: write d4/d8/d15/d1e/f22 [2212391,75508] 0 2023-12-16T20:11:34.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/583: dwrite d17/d1b/d25/db7/d82/d9b/fb3 [0,4194304] 0 2023-12-16T20:11:34.232 INFO:tasks.workunit.client.1.smithi141.stdout:7/309: dwrite d5/d2a/f34 [0,4194304] 0 2023-12-16T20:11:34.232 INFO:tasks.workunit.client.1.smithi141.stdout:4/321: dwrite f14 [0,4194304] 0 2023-12-16T20:11:34.233 INFO:tasks.workunit.client.0.smithi038.stdout:2/724: rename d1/d5/d95/d61/dd4/d10/fb5 to d1/d5/d95/d61/ff6 0 2023-12-16T20:11:34.235 INFO:tasks.workunit.client.0.smithi038.stdout:8/584: write d17/d1b/f3f [5135188,39353] 0 2023-12-16T20:11:34.236 INFO:tasks.workunit.client.1.smithi141.stdout:3/437: dwrite d0/f41 [0,4194304] 0 2023-12-16T20:11:34.239 INFO:tasks.workunit.client.1.smithi141.stdout:4/322: creat d1a/d2a/d3b/f7f x:0 0 0 2023-12-16T20:11:34.239 INFO:tasks.workunit.client.1.smithi141.stdout:4/323: chown d1a/d3c/f5d 162320 1 2023-12-16T20:11:34.242 INFO:tasks.workunit.client.0.smithi038.stdout:1/710: dwrite d15/d1e/d3b/d48/d37/dde/d75/fe2 [0,4194304] 0 2023-12-16T20:11:34.243 INFO:tasks.workunit.client.1.smithi141.stdout:7/310: getdents d5 0 2023-12-16T20:11:34.246 INFO:tasks.workunit.client.1.smithi141.stdout:9/348: write d1/d10/d33/d39/f62 [2028908,122508] 0 2023-12-16T20:11:34.246 INFO:tasks.workunit.client.0.smithi038.stdout:1/711: chown d15/d22/f6d 28 1 2023-12-16T20:11:34.255 INFO:tasks.workunit.client.1.smithi141.stdout:7/311: link d5/l19 d5/l67 0 2023-12-16T20:11:34.258 INFO:tasks.workunit.client.1.smithi141.stdout:3/438: mkdir d0/d1c/d40/d9a 0 2023-12-16T20:11:34.258 INFO:tasks.workunit.client.1.smithi141.stdout:9/349: dread d1/d26/f4d [0,4194304] 0 2023-12-16T20:11:34.258 INFO:tasks.workunit.client.1.smithi141.stdout:9/350: creat d1/d10/d33/d47/f7f x:0 0 0 2023-12-16T20:11:34.258 INFO:tasks.workunit.client.1.smithi141.stdout:9/351: dread - d1/d26/d4a/d73/f4e zero size 2023-12-16T20:11:34.259 INFO:tasks.workunit.client.1.smithi141.stdout:4/324: getdents d1a/d54 0 2023-12-16T20:11:34.259 INFO:tasks.workunit.client.1.smithi141.stdout:4/325: creat d1a/d2a/d3b/d69/f80 x:0 0 0 2023-12-16T20:11:34.259 INFO:tasks.workunit.client.1.smithi141.stdout:4/326: chown d1a/l58 2973 1 2023-12-16T20:11:34.259 INFO:tasks.workunit.client.1.smithi141.stdout:4/327: fdatasync d1a/d4e/f56 0 2023-12-16T20:11:34.259 INFO:tasks.workunit.client.1.smithi141.stdout:4/328: read - d1a/d2a/f76 zero size 2023-12-16T20:11:34.260 INFO:tasks.workunit.client.1.smithi141.stdout:3/439: write d0/f46 [349745,86239] 0 2023-12-16T20:11:34.263 INFO:tasks.workunit.client.1.smithi141.stdout:9/352: link d1/d10/d14/d20/da/d3f/l45 d1/d10/d33/d47/l80 0 2023-12-16T20:11:34.264 INFO:tasks.workunit.client.1.smithi141.stdout:3/440: dread d0/d1c/d40/d3f/d52/d5d/f79 [0,4194304] 0 2023-12-16T20:11:34.265 INFO:tasks.workunit.client.1.smithi141.stdout:4/329: symlink d1a/d54/l81 0 2023-12-16T20:11:34.265 INFO:tasks.workunit.client.1.smithi141.stdout:4/330: creat d1a/d2a/d3b/f82 x:0 0 0 2023-12-16T20:11:34.266 INFO:tasks.workunit.client.1.smithi141.stdout:7/312: getdents d5/d16 0 2023-12-16T20:11:34.270 INFO:tasks.workunit.client.1.smithi141.stdout:4/331: rename d1a/d2a/f2f to d1a/d2a/d3b/d69/f83 0 2023-12-16T20:11:34.270 INFO:tasks.workunit.client.1.smithi141.stdout:4/332: chown d1a/d3c/c4d 7395158 1 2023-12-16T20:11:34.271 INFO:tasks.workunit.client.1.smithi141.stdout:7/313: mknod d5/c68 0 2023-12-16T20:11:34.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/699: dwrite da/d24/d4d/dc5/ddc/f2a [4194304,4194304] 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:7/314: rename d5/d16/d30/d36/l51 to d5/d2a/d45/d5a/l69 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:7/315: dread - d5/f47 zero size 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:7/316: dread d5/f5f [0,4194304] 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:6/388: dwrite d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/353: dread d1/d10/d14/d20/da/f41 [0,4194304] 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/354: fdatasync d1/d10/d27/f79 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/355: fsync d1/d10/f6c 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/356: write d1/d10/d14/f25 [9665972,130560] 0 2023-12-16T20:11:34.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/357: write d1/d10/d14/d20/da/f32 [33141,388] 0 2023-12-16T20:11:34.284 INFO:tasks.workunit.client.1.smithi141.stdout:6/389: rename d1/d12/d22/f50 to d1/d12/d20/d3a/d45/f81 0 2023-12-16T20:11:34.284 INFO:tasks.workunit.client.1.smithi141.stdout:6/390: stat d1/dd 0 2023-12-16T20:11:34.286 INFO:tasks.workunit.client.0.smithi038.stdout:8/585: dwrite d17/d1b/d25/db7/d82/da9/d50/d7d/fbd [0,4194304] 0 2023-12-16T20:11:34.288 INFO:tasks.workunit.client.1.smithi141.stdout:3/441: dwrite d0/d1c/d40/f43 [4194304,4194304] 0 2023-12-16T20:11:34.292 INFO:tasks.workunit.client.1.smithi141.stdout:7/317: dread d5/fc [0,4194304] 0 2023-12-16T20:11:34.293 INFO:tasks.workunit.client.1.smithi141.stdout:6/391: getdents d1/d77 0 2023-12-16T20:11:34.293 INFO:tasks.workunit.client.1.smithi141.stdout:6/392: readlink d1/d3/lc 0 2023-12-16T20:11:34.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/393: dread d1/d12/d20/f6a [0,4194304] 0 2023-12-16T20:11:34.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/394: chown d1/d12/d22/f64 28856174 1 2023-12-16T20:11:34.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/395: chown d1/d12/d20/d3a/d45/f81 940 1 2023-12-16T20:11:34.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/396: chown d1/dd/de/f27 10 1 2023-12-16T20:11:34.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/397: fsync d1/d12/d22/d25/f7e 0 2023-12-16T20:11:34.297 INFO:tasks.workunit.client.0.smithi038.stdout:2/725: dwrite d1/d5/d95/d61/dd4/d10/f71 [4194304,4194304] 0 2023-12-16T20:11:34.298 INFO:tasks.workunit.client.1.smithi141.stdout:5/271: dwrite d0/d14/d2c/d4a/f4d [0,4194304] 0 2023-12-16T20:11:34.298 INFO:tasks.workunit.client.1.smithi141.stdout:5/272: truncate d0/d9/f15 5461102 0 2023-12-16T20:11:34.301 INFO:tasks.workunit.client.1.smithi141.stdout:7/318: creat d5/d16/f6a x:0 0 0 2023-12-16T20:11:34.302 INFO:tasks.workunit.client.1.smithi141.stdout:6/398: rename d1/d12/d22/d31/c51 to d1/dd/d43/c82 0 2023-12-16T20:11:34.304 INFO:tasks.workunit.client.1.smithi141.stdout:5/273: rename d0/df/f3a to d0/df/f58 0 2023-12-16T20:11:34.306 INFO:tasks.workunit.client.1.smithi141.stdout:5/274: mkdir d0/d9/d16/d2a/d35/d59 0 2023-12-16T20:11:34.306 INFO:tasks.workunit.client.1.smithi141.stdout:5/275: fdatasync d0/d9/d16/f21 0 2023-12-16T20:11:34.313 INFO:tasks.workunit.client.1.smithi141.stdout:0/357: sync 2023-12-16T20:11:34.313 INFO:tasks.workunit.client.1.smithi141.stdout:8/410: sync 2023-12-16T20:11:34.314 INFO:tasks.workunit.client.1.smithi141.stdout:2/194: sync 2023-12-16T20:11:34.314 INFO:tasks.workunit.client.1.smithi141.stdout:0/358: stat d4/d49/d73/f5b 0 2023-12-16T20:11:34.316 INFO:tasks.workunit.client.1.smithi141.stdout:8/411: rename f11 to d14/d19/d1b/d24/d4a/d5b/f7e 0 2023-12-16T20:11:34.318 INFO:tasks.workunit.client.1.smithi141.stdout:2/195: creat d6/d12/d15/f44 x:0 0 0 2023-12-16T20:11:34.318 INFO:tasks.workunit.client.1.smithi141.stdout:2/196: dread - d6/d32/f34 zero size 2023-12-16T20:11:34.318 INFO:tasks.workunit.client.1.smithi141.stdout:2/197: creat d6/d12/d15/f45 x:0 0 0 2023-12-16T20:11:34.319 INFO:tasks.workunit.client.1.smithi141.stdout:0/359: mkdir d4/d49/d73/d3b/d78/d7f/d80/d83 0 2023-12-16T20:11:34.319 INFO:tasks.workunit.client.1.smithi141.stdout:0/360: creat d4/d49/d73/d3b/f84 x:0 0 0 2023-12-16T20:11:34.322 INFO:tasks.workunit.client.1.smithi141.stdout:8/412: unlink d14/d19/d1b/d24/c6b 0 2023-12-16T20:11:34.325 INFO:tasks.workunit.client.1.smithi141.stdout:8/413: unlink d14/d35/f73 0 2023-12-16T20:11:34.326 INFO:tasks.workunit.client.1.smithi141.stdout:8/414: symlink d14/d19/d1b/d24/l7f 0 2023-12-16T20:11:34.331 INFO:tasks.workunit.client.0.smithi038.stdout:2/726: dread d1/d5/d2a/f79 [0,4194304] 0 2023-12-16T20:11:34.332 INFO:tasks.workunit.client.1.smithi141.stdout:5/276: dread d0/d14/d2c/d4a/f4d [0,4194304] 0 2023-12-16T20:11:34.332 INFO:tasks.workunit.client.0.smithi038.stdout:2/727: creat d1/d5/d6c/ff7 x:0 0 0 2023-12-16T20:11:34.335 INFO:tasks.workunit.client.1.smithi141.stdout:5/277: mknod d0/d25/d30/c5a 0 2023-12-16T20:11:34.337 INFO:tasks.workunit.client.1.smithi141.stdout:5/278: rename d0/d14/d2c/d4a/c57 to d0/df/d49/c5b 0 2023-12-16T20:11:34.350 INFO:tasks.workunit.client.0.smithi038.stdout:8/586: dwrite d17/d1b/d66/d73/d4e/fa2 [4194304,4194304] 0 2023-12-16T20:11:34.350 INFO:tasks.workunit.client.1.smithi141.stdout:7/319: dwrite d5/d2a/f2d [0,4194304] 0 2023-12-16T20:11:34.351 INFO:tasks.workunit.client.1.smithi141.stdout:9/358: dwrite d1/d10/d27/d36/f7a [0,4194304] 0 2023-12-16T20:11:34.351 INFO:tasks.workunit.client.1.smithi141.stdout:9/359: chown d1/d10/d33/c35 532845108 1 2023-12-16T20:11:34.351 INFO:tasks.workunit.client.1.smithi141.stdout:9/360: creat d1/d10/d27/f81 x:0 0 0 2023-12-16T20:11:34.351 INFO:tasks.workunit.client.1.smithi141.stdout:4/333: dwrite d1a/d3c/f65 [0,4194304] 0 2023-12-16T20:11:34.351 INFO:tasks.workunit.client.1.smithi141.stdout:4/334: creat d1a/d2a/d3b/d69/f84 x:0 0 0 2023-12-16T20:11:34.352 INFO:tasks.workunit.client.1.smithi141.stdout:4/335: truncate d1a/f20 5037623 0 2023-12-16T20:11:34.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/587: rmdir d17/d1b/d25/db7 39 2023-12-16T20:11:34.354 INFO:tasks.workunit.client.0.smithi038.stdout:7/700: dwrite da/d21/ff0 [0,4194304] 0 2023-12-16T20:11:34.358 INFO:tasks.workunit.client.0.smithi038.stdout:7/701: fdatasync da/d24/d4d/dc5/ddc/d8e/f78 0 2023-12-16T20:11:34.358 INFO:tasks.workunit.client.0.smithi038.stdout:7/702: fdatasync da/d21/fb5 0 2023-12-16T20:11:34.360 INFO:tasks.workunit.client.0.smithi038.stdout:7/703: getdents da/d24/d4d/dc5/ddc/dba/dd9 0 2023-12-16T20:11:34.360 INFO:tasks.workunit.client.0.smithi038.stdout:7/704: truncate da/d21/d2c/d76/fd8 489019 0 2023-12-16T20:11:34.361 INFO:tasks.workunit.client.0.smithi038.stdout:7/705: mknod da/d21/dc0/cf1 0 2023-12-16T20:11:34.362 INFO:tasks.workunit.client.0.smithi038.stdout:7/706: truncate da/d21/d2c/d76/f89 4146336 0 2023-12-16T20:11:34.362 INFO:tasks.workunit.client.0.smithi038.stdout:7/707: write da/d24/d4d/dc5/ddc/dba/dd9/feb [546273,111663] 0 2023-12-16T20:11:34.362 INFO:tasks.workunit.client.1.smithi141.stdout:9/361: unlink d1/d10/d33/f44 0 2023-12-16T20:11:34.363 INFO:tasks.workunit.client.0.smithi038.stdout:7/708: truncate da/d21/f28 1547375 0 2023-12-16T20:11:34.369 INFO:tasks.workunit.client.1.smithi141.stdout:2/198: dwrite d6/f26 [0,4194304] 0 2023-12-16T20:11:34.370 INFO:tasks.workunit.client.1.smithi141.stdout:3/442: dwrite d0/d1c/d40/d3f/d52/d5d/f79 [0,4194304] 0 2023-12-16T20:11:34.370 INFO:tasks.workunit.client.1.smithi141.stdout:3/443: chown d0/d1c/d40/f39 8678 1 2023-12-16T20:11:34.370 INFO:tasks.workunit.client.1.smithi141.stdout:6/399: dwrite d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:34.371 INFO:tasks.workunit.client.1.smithi141.stdout:7/320: getdents d5/d1d/d1e 0 2023-12-16T20:11:34.371 INFO:tasks.workunit.client.1.smithi141.stdout:9/362: mknod d1/d10/d33/c82 0 2023-12-16T20:11:34.378 INFO:tasks.workunit.client.0.smithi038.stdout:8/588: dread d17/d1b/d25/db7/d82/fad [0,4194304] 0 2023-12-16T20:11:34.378 INFO:tasks.workunit.client.1.smithi141.stdout:2/199: mkdir d6/d12/d1f/d46 0 2023-12-16T20:11:34.379 INFO:tasks.workunit.client.1.smithi141.stdout:3/444: symlink d0/d1c/d2c/d72/d74/l9b 0 2023-12-16T20:11:34.379 INFO:tasks.workunit.client.0.smithi038.stdout:8/589: dread d17/d34/f61 [0,4194304] 0 2023-12-16T20:11:34.379 INFO:tasks.workunit.client.0.smithi038.stdout:8/590: stat d17/d1b/d66/d73/d55/da5/da6/laf 0 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:9/692: sync 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/618: sync 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/619: write d13/d17/d4b/f43 [218653,107941] 0 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:5/697: sync 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/620: read - d13/d17/d4b/da4/d9d/db5/fbe zero size 2023-12-16T20:11:34.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/621: chown d13/f19 78423058 1 2023-12-16T20:11:34.383 INFO:tasks.workunit.client.1.smithi141.stdout:8/415: dwrite d14/d19/f78 [0,4194304] 0 2023-12-16T20:11:34.384 INFO:tasks.workunit.client.0.smithi038.stdout:9/693: unlink d9/d1e/d40/fc6 0 2023-12-16T20:11:34.385 INFO:tasks.workunit.client.1.smithi141.stdout:5/279: dwrite d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:34.387 INFO:tasks.workunit.client.0.smithi038.stdout:2/728: dwrite d1/d5/d95/d61/dd4/d21/f93 [0,4194304] 0 2023-12-16T20:11:34.389 INFO:tasks.workunit.client.0.smithi038.stdout:5/698: rename d2/l15 to d2/df/d1a/d1f/d4a/d53/ld9 0 2023-12-16T20:11:34.389 INFO:tasks.workunit.client.0.smithi038.stdout:9/694: mkdir d9/d1f/d21/d3e/d4e/d61/d9b/dd3 0 2023-12-16T20:11:34.390 INFO:tasks.workunit.client.1.smithi141.stdout:4/336: dwrite d1a/d3c/f5d [0,4194304] 0 2023-12-16T20:11:34.390 INFO:tasks.workunit.client.1.smithi141.stdout:3/445: write d0/d1c/d40/f1e [2790620,107084] 0 2023-12-16T20:11:34.392 INFO:tasks.workunit.client.1.smithi141.stdout:6/400: truncate d1/d12/d20/d3a/f6d 2657643 0 2023-12-16T20:11:34.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/622: read d13/d17/d4b/fcc [2635956,93182] 0 2023-12-16T20:11:34.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/709: dwrite da/d21/d86/d92/fab [4194304,4194304] 0 2023-12-16T20:11:34.394 INFO:tasks.workunit.client.0.smithi038.stdout:5/699: mkdir d2/d14/d25/d2d/d17/d51/daf/dda 0 2023-12-16T20:11:34.396 INFO:tasks.workunit.client.0.smithi038.stdout:9/695: symlink d9/d1f/d21/d55/ld4 0 2023-12-16T20:11:34.396 INFO:tasks.workunit.client.1.smithi141.stdout:9/363: truncate d1/d10/d33/f34 99339 0 2023-12-16T20:11:34.400 INFO:tasks.workunit.client.0.smithi038.stdout:4/623: mknod d13/d17/d2e/d32/d7c/ccf 0 2023-12-16T20:11:34.400 INFO:tasks.workunit.client.0.smithi038.stdout:4/624: write d13/d1f/fab [972507,27240] 0 2023-12-16T20:11:34.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/710: readlink da/d24/d4d/dc5/ddc/l37 0 2023-12-16T20:11:34.401 INFO:tasks.workunit.client.1.smithi141.stdout:8/416: creat d14/d19/d1b/d24/d4b/f80 x:0 0 0 2023-12-16T20:11:34.401 INFO:tasks.workunit.client.1.smithi141.stdout:8/417: readlink d14/l53 0 2023-12-16T20:11:34.403 INFO:tasks.workunit.client.1.smithi141.stdout:7/321: dwrite d5/d2a/f3e [0,4194304] 0 2023-12-16T20:11:34.404 INFO:tasks.workunit.client.1.smithi141.stdout:2/200: dwrite d6/d12/d15/f38 [0,4194304] 0 2023-12-16T20:11:34.404 INFO:tasks.workunit.client.1.smithi141.stdout:5/280: rmdir d0/d9/d16/d2a/d35/d59 0 2023-12-16T20:11:34.407 INFO:tasks.workunit.client.0.smithi038.stdout:4/625: truncate d13/d17/d2e/d32/d70/fa3 2270335 0 2023-12-16T20:11:34.407 INFO:tasks.workunit.client.0.smithi038.stdout:4/626: creat d13/d1f/d98/fd0 x:0 0 0 2023-12-16T20:11:34.407 INFO:tasks.workunit.client.0.smithi038.stdout:5/700: dread d2/d14/d25/f79 [0,4194304] 0 2023-12-16T20:11:34.409 INFO:tasks.workunit.client.1.smithi141.stdout:4/337: symlink d1a/d2a/d3b/d69/l85 0 2023-12-16T20:11:34.410 INFO:tasks.workunit.client.1.smithi141.stdout:5/281: dread d0/d14/d2c/d4a/f4d [0,4194304] 0 2023-12-16T20:11:34.411 INFO:tasks.workunit.client.1.smithi141.stdout:6/401: rename d1/d12/l2c to d1/d12/d22/d31/l83 0 2023-12-16T20:11:34.412 INFO:tasks.workunit.client.0.smithi038.stdout:7/711: creat da/ff2 x:0 0 0 2023-12-16T20:11:34.414 INFO:tasks.workunit.client.1.smithi141.stdout:5/282: dread d0/d9/d16/d2a/d35/f3f [0,4194304] 0 2023-12-16T20:11:34.414 INFO:tasks.workunit.client.1.smithi141.stdout:5/283: truncate d0/d9/d16/f21 2788396 0 2023-12-16T20:11:34.414 INFO:tasks.workunit.client.1.smithi141.stdout:5/284: read d0/f3e [145135,55078] 0 2023-12-16T20:11:34.414 INFO:tasks.workunit.client.1.smithi141.stdout:5/285: fsync d0/d14/f23 0 2023-12-16T20:11:34.415 INFO:tasks.workunit.client.1.smithi141.stdout:7/322: rmdir d5/d16/d30/d36 39 2023-12-16T20:11:34.415 INFO:tasks.workunit.client.1.smithi141.stdout:7/323: chown d5/ld 23 1 2023-12-16T20:11:34.415 INFO:tasks.workunit.client.0.smithi038.stdout:4/627: stat d13/d69/d7a/cc2 0 2023-12-16T20:11:34.417 INFO:tasks.workunit.client.0.smithi038.stdout:4/628: mknod d13/d69/cd1 0 2023-12-16T20:11:34.417 INFO:tasks.workunit.client.1.smithi141.stdout:2/201: mkdir d6/d3a/d47 0 2023-12-16T20:11:34.417 INFO:tasks.workunit.client.1.smithi141.stdout:2/202: chown d6/d12/d1f/c3d 1307367 1 2023-12-16T20:11:34.418 INFO:tasks.workunit.client.0.smithi038.stdout:5/701: getdents d2/d14/d25/d2d/d2f 0 2023-12-16T20:11:34.419 INFO:tasks.workunit.client.1.smithi141.stdout:6/402: creat d1/dd/d2f/d48/f84 x:0 0 0 2023-12-16T20:11:34.419 INFO:tasks.workunit.client.1.smithi141.stdout:6/403: write d1/d12/d22/d25/f2e [1092151,88395] 0 2023-12-16T20:11:34.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/629: unlink d13/d1f/d98/fc5 0 2023-12-16T20:11:34.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/630: fsync d13/d17/d2e/d32/d4d/f65 0 2023-12-16T20:11:34.420 INFO:tasks.workunit.client.1.smithi141.stdout:9/364: write d1/d10/d14/f25 [487983,15909] 0 2023-12-16T20:11:34.421 INFO:tasks.workunit.client.0.smithi038.stdout:5/702: mknod d2/d14/d25/d2d/d17/da9/cdb 0 2023-12-16T20:11:34.422 INFO:tasks.workunit.client.0.smithi038.stdout:4/631: truncate d13/f18 1333324 0 2023-12-16T20:11:34.422 INFO:tasks.workunit.client.0.smithi038.stdout:4/632: truncate d13/d17/d2e/d32/d4e/fa9 1255693 0 2023-12-16T20:11:34.422 INFO:tasks.workunit.client.1.smithi141.stdout:5/286: link d0/d25/d30/c5a d0/d9/d16/d2a/d35/c5c 0 2023-12-16T20:11:34.424 INFO:tasks.workunit.client.0.smithi038.stdout:5/703: link d2/d14/d25/d2d/d17/d93/fab d2/d14/d25/d2d/d4b/d8b/fdc 0 2023-12-16T20:11:34.427 INFO:tasks.workunit.client.1.smithi141.stdout:7/324: creat d5/d16/d46/d61/f6b x:0 0 0 2023-12-16T20:11:34.428 INFO:tasks.workunit.client.1.smithi141.stdout:4/338: mkdir d1a/d54/d86 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/712: dread da/d21/d2c/d76/f89 [0,4194304] 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/633: rename d13/d17/d4b/da4/l2d to d13/d17/d2e/d32/d4d/d78/da6/ld2 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:5/704: mkdir d2/d14/ddd 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:5/705: creat d2/d14/d25/fde x:0 0 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:5/706: chown d2/d14/d25/d2d 13176 1 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:8/591: dwrite d17/d1b/d25/f41 [0,4194304] 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:8/592: fdatasync d17/d1b/d25/db7/d82/da9/d50/f67 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/713: unlink da/d21/dc0/ld6 0 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/714: dread - da/d21/d86/de2/fe4 zero size 2023-12-16T20:11:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/715: fsync da/d21/d61/dcd/d6b/f99 0 2023-12-16T20:11:34.433 INFO:tasks.workunit.client.1.smithi141.stdout:6/404: mkdir d1/d12/d20/d85 0 2023-12-16T20:11:34.433 INFO:tasks.workunit.client.1.smithi141.stdout:2/203: dread d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:34.433 INFO:tasks.workunit.client.1.smithi141.stdout:2/204: dread - d6/d3a/f2f zero size 2023-12-16T20:11:34.433 INFO:tasks.workunit.client.1.smithi141.stdout:6/405: dread d1/d12/d22/d25/f55 [0,4194304] 0 2023-12-16T20:11:34.434 INFO:tasks.workunit.client.1.smithi141.stdout:5/287: symlink d0/d14/d2c/d4a/l5d 0 2023-12-16T20:11:34.435 INFO:tasks.workunit.client.0.smithi038.stdout:5/707: symlink d2/df/ldf 0 2023-12-16T20:11:34.435 INFO:tasks.workunit.client.0.smithi038.stdout:5/708: fdatasync d2/d14/d25/d2d/d17/d51/d7b/fa1 0 2023-12-16T20:11:34.437 INFO:tasks.workunit.client.1.smithi141.stdout:8/418: rename d14/d19/d1b/d30 to d14/d71/d81 0 2023-12-16T20:11:34.439 INFO:tasks.workunit.client.0.smithi038.stdout:5/709: truncate d2/df/d1a/d2a/f91 438559 0 2023-12-16T20:11:34.439 INFO:tasks.workunit.client.1.smithi141.stdout:4/339: mkdir d1a/d54/d87 0 2023-12-16T20:11:34.441 INFO:tasks.workunit.client.0.smithi038.stdout:8/593: dread d17/d1b/d25/db7/f31 [0,4194304] 0 2023-12-16T20:11:34.441 INFO:tasks.workunit.client.0.smithi038.stdout:8/594: read d17/d1b/d66/d73/d54/d69/f1a [1440349,28617] 0 2023-12-16T20:11:34.441 INFO:tasks.workunit.client.0.smithi038.stdout:5/710: mknod d2/df/d1a/d1f/d4a/db2/ce0 0 2023-12-16T20:11:34.441 INFO:tasks.workunit.client.0.smithi038.stdout:5/711: read - d2/d14/d25/d2d/d17/da9/fc5 zero size 2023-12-16T20:11:34.442 INFO:tasks.workunit.client.1.smithi141.stdout:2/205: rename d6/d12/d15/f45 to d6/d12/d1f/d46/f48 0 2023-12-16T20:11:34.442 INFO:tasks.workunit.client.0.smithi038.stdout:7/716: write da/d24/d4d/dc5/d38/d90/f2d [3169840,56604] 0 2023-12-16T20:11:34.442 INFO:tasks.workunit.client.0.smithi038.stdout:5/712: write d2/df/d1a/d2a/f74 [491590,33531] 0 2023-12-16T20:11:34.442 INFO:tasks.workunit.client.0.smithi038.stdout:4/634: getdents d13/d17/d2e/d32/d7c 0 2023-12-16T20:11:34.442 INFO:tasks.workunit.client.0.smithi038.stdout:2/729: dwrite d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:34.443 INFO:tasks.workunit.client.1.smithi141.stdout:3/446: dwrite d0/d1c/d40/d3f/d52/f75 [0,4194304] 0 2023-12-16T20:11:34.444 INFO:tasks.workunit.client.0.smithi038.stdout:9/696: dwrite d9/d1f/d21/d3e/d72/f86 [4194304,4194304] 0 2023-12-16T20:11:34.451 INFO:tasks.workunit.client.1.smithi141.stdout:8/419: creat d14/d19/d1b/d3d/d5e/f82 x:0 0 0 2023-12-16T20:11:34.452 INFO:tasks.workunit.client.1.smithi141.stdout:5/288: getdents d0/d14/d2c 0 2023-12-16T20:11:34.453 INFO:tasks.workunit.client.1.smithi141.stdout:3/447: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:34.455 INFO:tasks.workunit.client.0.smithi038.stdout:7/717: creat da/d21/d86/ff3 x:0 0 0 2023-12-16T20:11:34.455 INFO:tasks.workunit.client.1.smithi141.stdout:2/206: truncate d6/d3a/f2c 1172856 0 2023-12-16T20:11:34.456 INFO:tasks.workunit.client.1.smithi141.stdout:9/365: dwrite d1/d10/d14/d20/f54 [0,4194304] 0 2023-12-16T20:11:34.456 INFO:tasks.workunit.client.1.smithi141.stdout:9/366: truncate d1/d10/d14/d20/da/f78 565701 0 2023-12-16T20:11:34.457 INFO:tasks.workunit.client.0.smithi038.stdout:5/713: mknod d2/d14/d25/d2d/d4b/d8b/ce1 0 2023-12-16T20:11:34.458 INFO:tasks.workunit.client.0.smithi038.stdout:5/714: rename d2/d14/d25/d2d to d2/d14/d25/d2d/de2 22 2023-12-16T20:11:34.458 INFO:tasks.workunit.client.1.smithi141.stdout:6/406: rename d1/dd/de/f29 to d1/d12/d20/d85/f86 0 2023-12-16T20:11:34.458 INFO:tasks.workunit.client.1.smithi141.stdout:6/407: fdatasync d1/d12/d20/d85/f86 0 2023-12-16T20:11:34.459 INFO:tasks.workunit.client.1.smithi141.stdout:6/408: chown d1/dd/d43/c4e 22 1 2023-12-16T20:11:34.460 INFO:tasks.workunit.client.0.smithi038.stdout:2/730: creat d1/d5/d95/d61/dd4/d6a/d43/d57/dd6/ff8 x:0 0 0 2023-12-16T20:11:34.463 INFO:tasks.workunit.client.1.smithi141.stdout:7/325: dwrite d5/d16/f56 [0,4194304] 0 2023-12-16T20:11:34.464 INFO:tasks.workunit.client.1.smithi141.stdout:7/326: dread - d5/f47 zero size 2023-12-16T20:11:34.464 INFO:tasks.workunit.client.1.smithi141.stdout:7/327: chown d5/d16/d30/c65 174512533 1 2023-12-16T20:11:34.464 INFO:tasks.workunit.client.1.smithi141.stdout:7/328: dread - d5/d16/d1a/f25 zero size 2023-12-16T20:11:34.464 INFO:tasks.workunit.client.1.smithi141.stdout:7/329: write d5/d2a/f41 [1670808,99446] 0 2023-12-16T20:11:34.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/635: dwrite d13/d17/d4b/da4/f41 [0,4194304] 0 2023-12-16T20:11:34.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/636: readlink d13/d17/d2e/d32/d4d/l60 0 2023-12-16T20:11:34.469 INFO:tasks.workunit.client.0.smithi038.stdout:8/595: dwrite d17/f38 [0,4194304] 0 2023-12-16T20:11:34.471 INFO:tasks.workunit.client.1.smithi141.stdout:5/289: truncate d0/d43/f44 2310785 0 2023-12-16T20:11:34.479 INFO:tasks.workunit.client.1.smithi141.stdout:9/367: mkdir d1/d10/d33/d47/d83 0 2023-12-16T20:11:34.481 INFO:tasks.workunit.client.1.smithi141.stdout:4/340: rename d1a/c5f to d1a/d4e/d63/c88 0 2023-12-16T20:11:34.482 INFO:tasks.workunit.client.0.smithi038.stdout:9/697: mkdir d9/d1f/d96/dd5 0 2023-12-16T20:11:34.484 INFO:tasks.workunit.client.0.smithi038.stdout:7/718: creat da/d24/d4d/dc5/ddc/ff4 x:0 0 0 2023-12-16T20:11:34.485 INFO:tasks.workunit.client.0.smithi038.stdout:7/719: stat da/d21/c6e 0 2023-12-16T20:11:34.487 INFO:tasks.workunit.client.0.smithi038.stdout:5/715: creat d2/d14/fe3 x:0 0 0 2023-12-16T20:11:34.488 INFO:tasks.workunit.client.0.smithi038.stdout:2/731: creat d1/d5/d95/d61/dd4/d6a/d43/d57/ff9 x:0 0 0 2023-12-16T20:11:34.489 INFO:tasks.workunit.client.1.smithi141.stdout:8/420: getdents d14/d19/d1b/d3d 0 2023-12-16T20:11:34.489 INFO:tasks.workunit.client.0.smithi038.stdout:4/637: truncate d13/f2f 639080 0 2023-12-16T20:11:34.491 INFO:tasks.workunit.client.1.smithi141.stdout:5/290: mkdir d0/d9/d16/d2a/d35/d5e 0 2023-12-16T20:11:34.491 INFO:tasks.workunit.client.1.smithi141.stdout:9/368: write d1/d10/f22 [4097639,8358] 0 2023-12-16T20:11:34.492 INFO:tasks.workunit.client.0.smithi038.stdout:9/698: symlink d9/d1e/d40/d5e/d71/d83/da1/ld6 0 2023-12-16T20:11:34.493 INFO:tasks.workunit.client.1.smithi141.stdout:3/448: unlink d0/d1c/d40/l33 0 2023-12-16T20:11:34.494 INFO:tasks.workunit.client.0.smithi038.stdout:5/716: mkdir d2/d14/d25/d2d/d17/d51/d7b/d89/de4 0 2023-12-16T20:11:34.495 INFO:tasks.workunit.client.1.smithi141.stdout:6/409: mkdir d1/dd/d87 0 2023-12-16T20:11:34.497 INFO:tasks.workunit.client.0.smithi038.stdout:2/732: rename d1/d5/d95/d61/dd4/d21/d9a/db9/fb2 to d1/d88/ffa 0 2023-12-16T20:11:34.499 INFO:tasks.workunit.client.1.smithi141.stdout:7/330: rename d5/ld to d5/d16/d30/d36/l6c 0 2023-12-16T20:11:34.499 INFO:tasks.workunit.client.1.smithi141.stdout:4/341: mkdir d1a/d59/d89 0 2023-12-16T20:11:34.500 INFO:tasks.workunit.client.0.smithi038.stdout:4/638: creat d13/d17/d4b/da4/fd3 x:0 0 0 2023-12-16T20:11:34.500 INFO:tasks.workunit.client.0.smithi038.stdout:4/639: creat d13/d17/d4b/da4/d9d/db5/fd4 x:0 0 0 2023-12-16T20:11:34.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/640: write d13/d17/d2e/d32/d70/db2/fc9 [371325,43060] 0 2023-12-16T20:11:34.501 INFO:tasks.workunit.client.1.smithi141.stdout:2/207: dwrite d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:34.503 INFO:tasks.workunit.client.1.smithi141.stdout:8/421: chown d14/c39 16014 1 2023-12-16T20:11:34.503 INFO:tasks.workunit.client.1.smithi141.stdout:3/449: creat d0/f9c x:0 0 0 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:3/450: read - d0/d1c/d40/f81 zero size 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/331: link d5/d1d/d1e/f52 d5/d1d/f6d 0 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/332: chown d5/d16/d30/f32 58 1 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/333: fdatasync d5/d16/d46/f53 0 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/334: fdatasync d5/d1d/d1e/d27/f5b 0 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/335: chown d5/d1d/d1e/l66 926897 1 2023-12-16T20:11:34.505 INFO:tasks.workunit.client.0.smithi038.stdout:9/699: mknod d9/d1f/d21/d3e/d4e/d61/daa/cd7 0 2023-12-16T20:11:34.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/700: write d9/d1e/d45/fbd [931468,109374] 0 2023-12-16T20:11:34.506 INFO:tasks.workunit.client.1.smithi141.stdout:9/369: dread d1/d10/d14/f71 [0,4194304] 0 2023-12-16T20:11:34.507 INFO:tasks.workunit.client.1.smithi141.stdout:2/208: link d6/da/d1b/f27 d6/da/f49 0 2023-12-16T20:11:34.507 INFO:tasks.workunit.client.1.smithi141.stdout:1/436: sync 2023-12-16T20:11:34.507 INFO:tasks.workunit.client.1.smithi141.stdout:1/437: fdatasync da/df/f27 0 2023-12-16T20:11:34.507 INFO:tasks.workunit.client.1.smithi141.stdout:1/438: chown da/d36/d4b/d4d/d89/c8c 273982329 1 2023-12-16T20:11:34.508 INFO:tasks.workunit.client.0.smithi038.stdout:5/717: symlink d2/d14/d44/le5 0 2023-12-16T20:11:34.509 INFO:tasks.workunit.client.1.smithi141.stdout:3/451: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:34.509 INFO:tasks.workunit.client.1.smithi141.stdout:3/452: creat d0/d1c/d6a/f9d x:0 0 0 2023-12-16T20:11:34.509 INFO:tasks.workunit.client.0.smithi038.stdout:8/596: dwrite d17/d1b/d66/d73/d4e/f9f [0,4194304] 0 2023-12-16T20:11:34.511 INFO:tasks.workunit.client.1.smithi141.stdout:8/422: mknod d14/d19/d1b/d24/d4a/d69/c83 0 2023-12-16T20:11:34.511 INFO:tasks.workunit.client.1.smithi141.stdout:0/361: sync 2023-12-16T20:11:34.513 INFO:tasks.workunit.client.0.smithi038.stdout:2/733: mkdir d1/d5/d95/d61/dd4/d6a/dfb 0 2023-12-16T20:11:34.513 INFO:tasks.workunit.client.0.smithi038.stdout:5/718: write d2/df/d1a/d2a/f68 [680391,11939] 0 2023-12-16T20:11:34.514 INFO:tasks.workunit.client.1.smithi141.stdout:7/336: unlink d5/d2a/f37 0 2023-12-16T20:11:34.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/641: unlink d13/d17/d4b/da4/f41 0 2023-12-16T20:11:34.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/642: dread - d13/d17/d2e/d32/d7c/fa8 zero size 2023-12-16T20:11:34.515 INFO:tasks.workunit.client.1.smithi141.stdout:9/370: mkdir d1/d10/d14/d20/d84 0 2023-12-16T20:11:34.516 INFO:tasks.workunit.client.0.smithi038.stdout:9/701: creat d9/fd8 x:0 0 0 2023-12-16T20:11:34.516 INFO:tasks.workunit.client.0.smithi038.stdout:9/702: chown d9/d1f/d21/d3e/d4e/d64/lae 54 1 2023-12-16T20:11:34.517 INFO:tasks.workunit.client.1.smithi141.stdout:2/209: mkdir d6/da/d4a 0 2023-12-16T20:11:34.517 INFO:tasks.workunit.client.1.smithi141.stdout:2/210: write d6/da/d1b/f42 [52393,130502] 0 2023-12-16T20:11:34.518 INFO:tasks.workunit.client.1.smithi141.stdout:2/211: creat d6/da/d33/f4b x:0 0 0 2023-12-16T20:11:34.518 INFO:tasks.workunit.client.1.smithi141.stdout:2/212: creat d6/d12/d15/f4c x:0 0 0 2023-12-16T20:11:34.518 INFO:tasks.workunit.client.1.smithi141.stdout:1/439: mknod da/d36/d4b/d4d/d89/d61/c90 0 2023-12-16T20:11:34.519 INFO:tasks.workunit.client.0.smithi038.stdout:0/741: sync 2023-12-16T20:11:34.520 INFO:tasks.workunit.client.0.smithi038.stdout:5/719: mknod d2/d14/d25/d2d/d4b/ce6 0 2023-12-16T20:11:34.520 INFO:tasks.workunit.client.1.smithi141.stdout:5/291: dwrite d0/d14/d2c/d4a/f51 [0,4194304] 0 2023-12-16T20:11:34.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/643: mknod d13/d17/d2e/d32/d70/d84/d88/cd5 0 2023-12-16T20:11:34.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/644: truncate d13/f48 5126832 0 2023-12-16T20:11:34.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/645: readlink d13/d17/d4b/da4/lae 0 2023-12-16T20:11:34.522 INFO:tasks.workunit.client.1.smithi141.stdout:8/423: symlink d14/d35/l84 0 2023-12-16T20:11:34.524 INFO:tasks.workunit.client.0.smithi038.stdout:9/703: rmdir d9/d1f/d21/d3e/d4e/d61/d9e/dc2 39 2023-12-16T20:11:34.524 INFO:tasks.workunit.client.0.smithi038.stdout:9/704: write d9/d1e/d3d/d42/d59/d76/f9a [51902,14475] 0 2023-12-16T20:11:34.524 INFO:tasks.workunit.client.0.smithi038.stdout:9/705: write d9/d1e/d40/d5e/f67 [1509071,45167] 0 2023-12-16T20:11:34.525 INFO:tasks.workunit.client.1.smithi141.stdout:0/362: dread d4/d49/f71 [0,4194304] 0 2023-12-16T20:11:34.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/597: getdents d17/d1b/d66/d73 0 2023-12-16T20:11:34.526 INFO:tasks.workunit.client.1.smithi141.stdout:2/213: mknod d6/d32/c4d 0 2023-12-16T20:11:34.528 INFO:tasks.workunit.client.0.smithi038.stdout:0/742: creat db/d16/d5a/d65/de8/d77/ff7 x:0 0 0 2023-12-16T20:11:34.529 INFO:tasks.workunit.client.1.smithi141.stdout:9/371: read d1/d10/d14/f31 [72846,10502] 0 2023-12-16T20:11:34.529 INFO:tasks.workunit.client.1.smithi141.stdout:1/440: unlink da/d1a/d1d/f4f 0 2023-12-16T20:11:34.529 INFO:tasks.workunit.client.1.smithi141.stdout:1/441: chown da/d1a/f45 13300 1 2023-12-16T20:11:34.531 INFO:tasks.workunit.client.1.smithi141.stdout:5/292: symlink d0/d14/d2c/l5f 0 2023-12-16T20:11:34.532 INFO:tasks.workunit.client.0.smithi038.stdout:4/646: creat d13/d17/d2e/d32/d4d/d78/dc8/fd6 x:0 0 0 2023-12-16T20:11:34.533 INFO:tasks.workunit.client.0.smithi038.stdout:9/706: link d9/d1f/d21/f7e d9/d1f/d21/d55/fd9 0 2023-12-16T20:11:34.533 INFO:tasks.workunit.client.0.smithi038.stdout:9/707: dread - d9/d1f/d21/d3e/d4e/d64/f93 zero size 2023-12-16T20:11:34.533 INFO:tasks.workunit.client.0.smithi038.stdout:9/708: readlink d9/d1e/d40/d5e/d71/d83/lbe 0 2023-12-16T20:11:34.534 INFO:tasks.workunit.client.1.smithi141.stdout:7/337: getdents d5/d2a/d45/d5a 0 2023-12-16T20:11:34.534 INFO:tasks.workunit.client.1.smithi141.stdout:6/410: dwrite d1/dd/d43/f6c [4194304,4194304] 0 2023-12-16T20:11:34.535 INFO:tasks.workunit.client.0.smithi038.stdout:8/598: unlink d17/d1b/d53/c56 0 2023-12-16T20:11:34.536 INFO:tasks.workunit.client.1.smithi141.stdout:0/363: mkdir d4/d74/d85 0 2023-12-16T20:11:34.536 INFO:tasks.workunit.client.1.smithi141.stdout:0/364: write d4/d49/d73/d3b/f84 [74438,115139] 0 2023-12-16T20:11:34.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/720: write d2/d4/f4c [2434354,99013] 0 2023-12-16T20:11:34.538 INFO:tasks.workunit.client.1.smithi141.stdout:2/214: rename d6/d3a/f2f to d6/d32/f4e 0 2023-12-16T20:11:34.539 INFO:tasks.workunit.client.1.smithi141.stdout:1/442: rename da/d36/d4b/d4d/d89/d6c to da/d36/d4b/d4d/d89/d6c/d91 22 2023-12-16T20:11:34.539 INFO:tasks.workunit.client.1.smithi141.stdout:1/443: truncate da/d36/d4b/f5a 607325 0 2023-12-16T20:11:34.539 INFO:tasks.workunit.client.1.smithi141.stdout:1/444: fsync da/d36/f66 0 2023-12-16T20:11:34.539 INFO:tasks.workunit.client.0.smithi038.stdout:0/743: rename db/d16/d1c/d5d/cd3 to db/d16/da6/cf8 0 2023-12-16T20:11:34.540 INFO:tasks.workunit.client.1.smithi141.stdout:9/372: symlink d1/d10/d14/d20/d84/l85 0 2023-12-16T20:11:34.540 INFO:tasks.workunit.client.1.smithi141.stdout:9/373: creat d1/d10/d14/d20/f86 x:0 0 0 2023-12-16T20:11:34.542 INFO:tasks.workunit.client.0.smithi038.stdout:5/721: write d2/d14/d25/f79 [1126892,23085] 0 2023-12-16T20:11:34.542 INFO:tasks.workunit.client.0.smithi038.stdout:5/722: chown d2/d14/d25/d2d/d17/c7f 37143911 1 2023-12-16T20:11:34.543 INFO:tasks.workunit.client.1.smithi141.stdout:0/365: truncate d4/d7/f50 1881250 0 2023-12-16T20:11:34.543 INFO:tasks.workunit.client.1.smithi141.stdout:0/366: dread - d4/d49/d73/d3b/f7a zero size 2023-12-16T20:11:34.543 INFO:tasks.workunit.client.1.smithi141.stdout:0/367: stat d4/f16 0 2023-12-16T20:11:34.544 INFO:tasks.workunit.client.0.smithi038.stdout:9/709: creat d9/d1f/d21/d3e/fda x:0 0 0 2023-12-16T20:11:34.546 INFO:tasks.workunit.client.1.smithi141.stdout:9/374: dread d1/d26/f4d [0,4194304] 0 2023-12-16T20:11:34.546 INFO:tasks.workunit.client.1.smithi141.stdout:9/375: chown d1/d10/d14/f71 125 1 2023-12-16T20:11:34.547 INFO:tasks.workunit.client.0.smithi038.stdout:8/599: creat d17/d1b/d25/db7/d82/d9b/fc0 x:0 0 0 2023-12-16T20:11:34.549 INFO:tasks.workunit.client.1.smithi141.stdout:4/342: dwrite d1a/f2e [0,4194304] 0 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:4/343: truncate d1a/f35 1909087 0 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:4/344: fsync d1a/d2a/f6b 0 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:4/345: dread - d1a/d2a/d3b/d69/f80 zero size 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:6/411: dread d1/d12/d20/d3a/f6d [0,4194304] 0 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:6/412: truncate d1/d12/d22/d31/f75 154543 0 2023-12-16T20:11:34.550 INFO:tasks.workunit.client.1.smithi141.stdout:0/368: rename d4/lf to d4/d49/d4b/l86 0 2023-12-16T20:11:34.552 INFO:tasks.workunit.client.0.smithi038.stdout:7/720: dwrite da/d24/d4d/dc5/d38/d90/fb1 [0,4194304] 0 2023-12-16T20:11:34.554 INFO:tasks.workunit.client.1.smithi141.stdout:6/413: unlink d1/d12/d20/d85/f86 0 2023-12-16T20:11:34.555 INFO:tasks.workunit.client.0.smithi038.stdout:8/600: mknod d17/d1b/d25/db7/d82/da9/d50/d96/cc1 0 2023-12-16T20:11:34.556 INFO:tasks.workunit.client.0.smithi038.stdout:2/734: dwrite d1/d5/d3d/fda [0,4194304] 0 2023-12-16T20:11:34.557 INFO:tasks.workunit.client.1.smithi141.stdout:3/453: dwrite d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:34.557 INFO:tasks.workunit.client.1.smithi141.stdout:3/454: chown d0/d1c/d40/d3f/d52/f59 54673565 1 2023-12-16T20:11:34.557 INFO:tasks.workunit.client.1.smithi141.stdout:9/376: rename d1/d10/d14/d20/c30 to d1/d10/d27/c87 0 2023-12-16T20:11:34.559 INFO:tasks.workunit.client.0.smithi038.stdout:5/723: rmdir d2/d14/d44 39 2023-12-16T20:11:34.559 INFO:tasks.workunit.client.0.smithi038.stdout:5/724: chown d2/df/d1a/d1f/d4a/d53/f5e 22874956 1 2023-12-16T20:11:34.562 INFO:tasks.workunit.client.1.smithi141.stdout:3/455: write d0/d1c/d40/d3f/f73 [972822,114167] 0 2023-12-16T20:11:34.562 INFO:tasks.workunit.client.1.smithi141.stdout:4/346: unlink d1a/l23 0 2023-12-16T20:11:34.562 INFO:tasks.workunit.client.0.smithi038.stdout:9/710: write d9/d1f/d6a/f77 [727508,27972] 0 2023-12-16T20:11:34.565 INFO:tasks.workunit.client.0.smithi038.stdout:7/721: dread da/d21/f28 [0,4194304] 0 2023-12-16T20:11:34.565 INFO:tasks.workunit.client.0.smithi038.stdout:0/744: write db/d16/d5a/d65/f6a [7233851,88878] 0 2023-12-16T20:11:34.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/745: chown db/d16/d19/d4e/dac 56 1 2023-12-16T20:11:34.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/746: truncate db/d16/d5a/d65/de8/d77/d95/da4/fbe 1058188 0 2023-12-16T20:11:34.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/747: dread - db/d16/d1c/fa5 zero size 2023-12-16T20:11:34.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/748: read db/d16/f8c [3601718,33647] 0 2023-12-16T20:11:34.566 INFO:tasks.workunit.client.1.smithi141.stdout:6/414: rename d1/d12/d22/d25/f55 to d1/d12/d22/f88 0 2023-12-16T20:11:34.570 INFO:tasks.workunit.client.1.smithi141.stdout:9/377: unlink d1/d26/d4a/d73/c24 0 2023-12-16T20:11:34.572 INFO:tasks.workunit.client.1.smithi141.stdout:3/456: rename d0/d1c/d2c/f48 to d0/d1c/d40/d3f/d52/f9e 0 2023-12-16T20:11:34.573 INFO:tasks.workunit.client.1.smithi141.stdout:8/424: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:34.574 INFO:tasks.workunit.client.0.smithi038.stdout:9/711: creat d9/d1f/d21/d3e/d4e/d61/d9b/fdb x:0 0 0 2023-12-16T20:11:34.574 INFO:tasks.workunit.client.0.smithi038.stdout:9/712: write d9/d1e/d3d/d42/d59/d76/f9a [829554,125160] 0 2023-12-16T20:11:34.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/722: dread da/d21/f25 [0,4194304] 0 2023-12-16T20:11:34.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/723: fsync da/d21/f25 0 2023-12-16T20:11:34.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/724: readlink da/d21/l35 0 2023-12-16T20:11:34.577 INFO:tasks.workunit.client.0.smithi038.stdout:7/725: write da/d21/d86/de2/fe4 [4627,71641] 0 2023-12-16T20:11:34.578 INFO:tasks.workunit.client.1.smithi141.stdout:9/378: dread d1/d10/d14/d20/d3b/f46 [0,4194304] 0 2023-12-16T20:11:34.578 INFO:tasks.workunit.client.1.smithi141.stdout:9/379: write d1/d10/d14/f71 [4400822,118508] 0 2023-12-16T20:11:34.580 INFO:tasks.workunit.client.0.smithi038.stdout:2/735: getdents d1/d5/d95/d61/dd4/d21/d9a/db9/d3a 0 2023-12-16T20:11:34.581 INFO:tasks.workunit.client.0.smithi038.stdout:4/647: dwrite d13/d69/d7a/fb3 [0,4194304] 0 2023-12-16T20:11:34.582 INFO:tasks.workunit.client.0.smithi038.stdout:5/725: dread d2/d14/f5a [0,4194304] 0 2023-12-16T20:11:34.582 INFO:tasks.workunit.client.1.smithi141.stdout:1/445: rmdir da/d36 39 2023-12-16T20:11:34.582 INFO:tasks.workunit.client.1.smithi141.stdout:6/415: rename d1/dd/d87 to d1/d12/d20/d89 0 2023-12-16T20:11:34.583 INFO:tasks.workunit.client.1.smithi141.stdout:6/416: readlink d1/d12/d22/l40 0 2023-12-16T20:11:34.583 INFO:tasks.workunit.client.1.smithi141.stdout:6/417: truncate d1/dd/d2f/d48/f84 819827 0 2023-12-16T20:11:34.583 INFO:tasks.workunit.client.1.smithi141.stdout:7/338: dwrite d5/d2a/f2d [0,4194304] 0 2023-12-16T20:11:34.587 INFO:tasks.workunit.client.0.smithi038.stdout:2/736: rename d1/d5/d95/d61/dd4/d21/c6b to d1/d5/d95/d61/dd4/d21/d82/cfc 0 2023-12-16T20:11:34.588 INFO:tasks.workunit.client.1.smithi141.stdout:9/380: dread d1/d10/d14/d20/da/f41 [0,4194304] 0 2023-12-16T20:11:34.589 INFO:tasks.workunit.client.1.smithi141.stdout:1/446: symlink da/l92 0 2023-12-16T20:11:34.590 INFO:tasks.workunit.client.0.smithi038.stdout:9/713: dread d9/f18 [0,4194304] 0 2023-12-16T20:11:34.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/215: dwrite d6/d12/d15/f44 [0,4194304] 0 2023-12-16T20:11:34.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/216: stat d6/d32/f4e 0 2023-12-16T20:11:34.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/217: read d6/da/d1b/f42 [50679,108091] 0 2023-12-16T20:11:34.591 INFO:tasks.workunit.client.0.smithi038.stdout:7/726: mknod da/cf5 0 2023-12-16T20:11:34.592 INFO:tasks.workunit.client.1.smithi141.stdout:5/293: rmdir d0/d14 39 2023-12-16T20:11:34.593 INFO:tasks.workunit.client.1.smithi141.stdout:5/294: write d0/d14/d2c/f33 [409636,34436] 0 2023-12-16T20:11:34.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/737: mknod d1/d5/d95/d61/dd4/d21/d9a/db9/cfd 0 2023-12-16T20:11:34.595 INFO:tasks.workunit.client.1.smithi141.stdout:1/447: dread da/d36/d4b/f63 [0,4194304] 0 2023-12-16T20:11:34.595 INFO:tasks.workunit.client.1.smithi141.stdout:1/448: chown da/d1a/d1d/l8a 3898 1 2023-12-16T20:11:34.595 INFO:tasks.workunit.client.1.smithi141.stdout:1/449: dread - da/df/f34 zero size 2023-12-16T20:11:34.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/601: dwrite d17/d1b/d66/d8e/f91 [0,4194304] 0 2023-12-16T20:11:34.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/602: creat d17/d1b/d66/d73/d55/da5/fc2 x:0 0 0 2023-12-16T20:11:34.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/603: write d17/d1b/d66/d73/fbf [491513,30235] 0 2023-12-16T20:11:34.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/604: chown d17/d34/l87 46355 1 2023-12-16T20:11:34.597 INFO:tasks.workunit.client.0.smithi038.stdout:5/726: rename d2/d14/d25/d2d/f63 to d2/d14/d25/d2d/d17/d51/fe7 0 2023-12-16T20:11:34.597 INFO:tasks.workunit.client.0.smithi038.stdout:5/727: dread - d2/d4/f58 zero size 2023-12-16T20:11:34.599 INFO:tasks.workunit.client.1.smithi141.stdout:8/425: rmdir d14/d19/d1b 39 2023-12-16T20:11:34.599 INFO:tasks.workunit.client.1.smithi141.stdout:8/426: write d14/d19/d1b/d3d/f33 [733612,129052] 0 2023-12-16T20:11:34.599 INFO:tasks.workunit.client.0.smithi038.stdout:5/728: read d2/df/d1a/d2a/f91 [194550,47186] 0 2023-12-16T20:11:34.600 INFO:tasks.workunit.client.1.smithi141.stdout:0/369: dwrite d4/f1c [0,4194304] 0 2023-12-16T20:11:34.600 INFO:tasks.workunit.client.1.smithi141.stdout:2/218: dread d6/f1d [0,4194304] 0 2023-12-16T20:11:34.600 INFO:tasks.workunit.client.0.smithi038.stdout:4/648: creat d13/d17/d2e/d32/d4d/d78/da6/fd7 x:0 0 0 2023-12-16T20:11:34.601 INFO:tasks.workunit.client.0.smithi038.stdout:7/727: symlink da/d24/d4d/dc5/ddc/dba/dd9/lf6 0 2023-12-16T20:11:34.603 INFO:tasks.workunit.client.1.smithi141.stdout:4/347: dwrite d1a/f2e [4194304,4194304] 0 2023-12-16T20:11:34.604 INFO:tasks.workunit.client.1.smithi141.stdout:9/381: creat d1/d26/d4a/f88 x:0 0 0 2023-12-16T20:11:34.604 INFO:tasks.workunit.client.0.smithi038.stdout:2/738: read d1/d5/d3d/fda [744350,65828] 0 2023-12-16T20:11:34.604 INFO:tasks.workunit.client.0.smithi038.stdout:2/739: stat d1/d5/d95/d61/dd4/d21/f45 0 2023-12-16T20:11:34.606 INFO:tasks.workunit.client.1.smithi141.stdout:6/418: mkdir d1/dd/de/d8a 0 2023-12-16T20:11:34.607 INFO:tasks.workunit.client.0.smithi038.stdout:7/728: dread da/d24/d4d/dc5/d38/d90/f2d [0,4194304] 0 2023-12-16T20:11:34.608 INFO:tasks.workunit.client.1.smithi141.stdout:5/295: symlink d0/d14/l60 0 2023-12-16T20:11:34.608 INFO:tasks.workunit.client.1.smithi141.stdout:5/296: write d0/d14/d2c/f33 [977237,110415] 0 2023-12-16T20:11:34.609 INFO:tasks.workunit.client.1.smithi141.stdout:2/219: mkdir d6/da/d33/d4f 0 2023-12-16T20:11:34.609 INFO:tasks.workunit.client.1.smithi141.stdout:2/220: chown d6/f7 7516753 1 2023-12-16T20:11:34.609 INFO:tasks.workunit.client.1.smithi141.stdout:2/221: chown d6/f7 0 1 2023-12-16T20:11:34.609 INFO:tasks.workunit.client.1.smithi141.stdout:2/222: dread - d6/d12/d1f/d46/f48 zero size 2023-12-16T20:11:34.610 INFO:tasks.workunit.client.1.smithi141.stdout:4/348: dread f19 [0,4194304] 0 2023-12-16T20:11:34.610 INFO:tasks.workunit.client.1.smithi141.stdout:4/349: readlink d1a/l39 0 2023-12-16T20:11:34.610 INFO:tasks.workunit.client.1.smithi141.stdout:4/350: stat d1a/d2a/c44 0 2023-12-16T20:11:34.610 INFO:tasks.workunit.client.1.smithi141.stdout:6/419: truncate d1/f19 2611755 0 2023-12-16T20:11:34.611 INFO:tasks.workunit.client.1.smithi141.stdout:2/223: creat d6/d3a/f50 x:0 0 0 2023-12-16T20:11:34.611 INFO:tasks.workunit.client.1.smithi141.stdout:2/224: chown d6/d3a/l2a 22751724 1 2023-12-16T20:11:34.612 INFO:tasks.workunit.client.1.smithi141.stdout:2/225: dread - d6/d32/f34 zero size 2023-12-16T20:11:34.612 INFO:tasks.workunit.client.1.smithi141.stdout:2/226: read d6/da/d1b/f42 [95321,115382] 0 2023-12-16T20:11:34.613 INFO:tasks.workunit.client.1.smithi141.stdout:4/351: rename d1a/d54/d86 to d1a/d59/d89/d8a 0 2023-12-16T20:11:34.613 INFO:tasks.workunit.client.1.smithi141.stdout:5/297: write d0/d9/d16/f21 [2360712,69299] 0 2023-12-16T20:11:34.615 INFO:tasks.workunit.client.0.smithi038.stdout:5/729: symlink d2/d14/d25/d2d/d17/d51/d7b/d89/le8 0 2023-12-16T20:11:34.615 INFO:tasks.workunit.client.0.smithi038.stdout:9/714: write d9/d1f/d21/d3e/d72/f86 [4773059,29114] 0 2023-12-16T20:11:34.616 INFO:tasks.workunit.client.1.smithi141.stdout:6/420: link d1/fa d1/d12/d20/d3a/d45/d47/f8b 0 2023-12-16T20:11:34.616 INFO:tasks.workunit.client.1.smithi141.stdout:0/370: dread d4/d49/f5a [0,4194304] 0 2023-12-16T20:11:34.617 INFO:tasks.workunit.client.1.smithi141.stdout:0/371: chown d4/d5c/l6c 26 1 2023-12-16T20:11:34.617 INFO:tasks.workunit.client.0.smithi038.stdout:4/649: rename c3 to d13/d17/d2e/d32/d4d/d6e/cd8 0 2023-12-16T20:11:34.618 INFO:tasks.workunit.client.0.smithi038.stdout:2/740: mknod d1/d5/d95/d61/dd4/d21/d9a/cfe 0 2023-12-16T20:11:34.619 INFO:tasks.workunit.client.1.smithi141.stdout:2/227: creat d6/da/d33/d4f/f51 x:0 0 0 2023-12-16T20:11:34.620 INFO:tasks.workunit.client.1.smithi141.stdout:4/352: symlink d1a/d3c/l8b 0 2023-12-16T20:11:34.620 INFO:tasks.workunit.client.1.smithi141.stdout:6/421: dread d1/d12/d20/d3a/f6d [0,4194304] 0 2023-12-16T20:11:34.620 INFO:tasks.workunit.client.1.smithi141.stdout:7/339: dwrite d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:34.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/729: truncate f6 8085973 0 2023-12-16T20:11:34.622 INFO:tasks.workunit.client.0.smithi038.stdout:1/712: sync 2023-12-16T20:11:34.622 INFO:tasks.workunit.client.0.smithi038.stdout:3/685: sync 2023-12-16T20:11:34.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/730: truncate da/d24/d4d/dc5/d38/d65/f77 925906 0 2023-12-16T20:11:34.622 INFO:tasks.workunit.client.0.smithi038.stdout:6/614: sync 2023-12-16T20:11:34.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/615: write d1/d4/d1d/d28/f41 [69167,115408] 0 2023-12-16T20:11:34.625 INFO:tasks.workunit.client.1.smithi141.stdout:2/228: mkdir d6/d32/d52 0 2023-12-16T20:11:34.625 INFO:tasks.workunit.client.1.smithi141.stdout:4/353: mknod d1a/d59/d89/c8c 0 2023-12-16T20:11:34.625 INFO:tasks.workunit.client.1.smithi141.stdout:9/382: dread d1/d10/d14/d20/f54 [0,4194304] 0 2023-12-16T20:11:34.625 INFO:tasks.workunit.client.1.smithi141.stdout:7/340: mkdir d5/d16/d30/d4e/d6e 0 2023-12-16T20:11:34.628 INFO:tasks.workunit.client.1.smithi141.stdout:2/229: unlink d6/f26 0 2023-12-16T20:11:34.629 INFO:tasks.workunit.client.1.smithi141.stdout:2/230: write d6/da/d33/f4b [703674,83943] 0 2023-12-16T20:11:34.630 INFO:tasks.workunit.client.1.smithi141.stdout:9/383: mkdir d1/d10/d14/d20/da/d89 0 2023-12-16T20:11:34.631 INFO:tasks.workunit.client.0.smithi038.stdout:2/741: symlink d1/d5/d3d/lff 0 2023-12-16T20:11:34.631 INFO:tasks.workunit.client.1.smithi141.stdout:8/427: dread d14/d19/d1b/d3d/f33 [0,4194304] 0 2023-12-16T20:11:34.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/341: symlink d5/d16/d30/l6f 0 2023-12-16T20:11:34.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/342: truncate d5/d16/d46/d61/f6b 286809 0 2023-12-16T20:11:34.632 INFO:tasks.workunit.client.1.smithi141.stdout:7/343: stat d5/d16/d1a/f25 0 2023-12-16T20:11:34.634 INFO:tasks.workunit.client.1.smithi141.stdout:3/457: dwrite d0/d1c/d40/d3f/f80 [0,4194304] 0 2023-12-16T20:11:34.634 INFO:tasks.workunit.client.1.smithi141.stdout:4/354: rename d1a/d4e/d63/c88 to d1a/c8d 0 2023-12-16T20:11:34.634 INFO:tasks.workunit.client.1.smithi141.stdout:3/458: rename d0/d1c/d2c to d0/d1c/d2c/d72/d74/d9f 22 2023-12-16T20:11:34.634 INFO:tasks.workunit.client.1.smithi141.stdout:1/450: dwrite da/f52 [0,4194304] 0 2023-12-16T20:11:34.634 INFO:tasks.workunit.client.0.smithi038.stdout:5/730: rename d2/df/d1a/d1f/d4a/d53/d6e/d9e/dbc to d2/d14/d25/d2d/d17/d51/de9 0 2023-12-16T20:11:34.635 INFO:tasks.workunit.client.0.smithi038.stdout:2/742: read d1/fad [789344,29654] 0 2023-12-16T20:11:34.635 INFO:tasks.workunit.client.1.smithi141.stdout:2/231: mkdir d6/d32/d52/d53 0 2023-12-16T20:11:34.637 INFO:tasks.workunit.client.0.smithi038.stdout:3/686: creat d4/fed x:0 0 0 2023-12-16T20:11:34.638 INFO:tasks.workunit.client.1.smithi141.stdout:9/384: mkdir d1/d10/d14/d20/da/d3f/d8a 0 2023-12-16T20:11:34.638 INFO:tasks.workunit.client.1.smithi141.stdout:9/385: fdatasync d1/d10/d33/d47/f5b 0 2023-12-16T20:11:34.638 INFO:tasks.workunit.client.1.smithi141.stdout:9/386: chown d1/d10/d33/d47/c69 6797653 1 2023-12-16T20:11:34.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/616: symlink d1/d4/d1d/d67/d73/lc3 0 2023-12-16T20:11:34.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/617: write d1/d4/f9c [884286,104238] 0 2023-12-16T20:11:34.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/618: chown d1/d4/d1d/d67/d73/faf 501729 1 2023-12-16T20:11:34.641 INFO:tasks.workunit.client.1.smithi141.stdout:4/355: symlink d1a/d59/l8e 0 2023-12-16T20:11:34.641 INFO:tasks.workunit.client.1.smithi141.stdout:4/356: dread - d1a/d2a/d3b/d69/f72 zero size 2023-12-16T20:11:34.643 INFO:tasks.workunit.client.0.smithi038.stdout:4/650: getdents d13/d17/d2e/d32/d70 0 2023-12-16T20:11:34.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/687: getdents d4/d27/d2b/d64 0 2023-12-16T20:11:34.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/688: dread - d4/d27/d40/fb5 zero size 2023-12-16T20:11:34.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/689: write d4/d27/d2b/d64/f72 [3582253,64347] 0 2023-12-16T20:11:34.643 INFO:tasks.workunit.client.0.smithi038.stdout:3/690: chown d4/d27/d23/d6e/f87 7350354 1 2023-12-16T20:11:34.647 INFO:tasks.workunit.client.0.smithi038.stdout:6/619: unlink d1/l72 0 2023-12-16T20:11:34.648 INFO:tasks.workunit.client.1.smithi141.stdout:3/459: symlink d0/d1c/d2c/d72/la0 0 2023-12-16T20:11:34.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/691: creat d4/d8/dc8/de4/fee x:0 0 0 2023-12-16T20:11:34.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/692: chown d4/dcd/d9a/dda/le3 36845640 1 2023-12-16T20:11:34.650 INFO:tasks.workunit.client.1.smithi141.stdout:1/451: rename da/d36/d4b/d4d/f54 to da/d36/d4b/d4d/d80/f93 0 2023-12-16T20:11:34.654 INFO:tasks.workunit.client.1.smithi141.stdout:2/232: truncate d6/f1d 1055240 0 2023-12-16T20:11:34.657 INFO:tasks.workunit.client.1.smithi141.stdout:4/357: mknod d1a/d59/d89/d8a/c8f 0 2023-12-16T20:11:34.658 INFO:tasks.workunit.client.0.smithi038.stdout:7/731: getdents da/d24/d4d/dc5/ddc/dba/dd9 0 2023-12-16T20:11:34.658 INFO:tasks.workunit.client.0.smithi038.stdout:3/693: dread d4/d67/de1/d7d/f91 [0,4194304] 0 2023-12-16T20:11:34.659 INFO:tasks.workunit.client.1.smithi141.stdout:8/428: write d14/f15 [2303795,13230] 0 2023-12-16T20:11:34.661 INFO:tasks.workunit.client.1.smithi141.stdout:3/460: read d0/f3a [673596,85076] 0 2023-12-16T20:11:34.661 INFO:tasks.workunit.client.1.smithi141.stdout:1/452: mkdir da/d36/d4b/d4d/d80/d94 0 2023-12-16T20:11:34.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/732: rename da/d24/d4d/dc5/l79 to da/dcf/lf7 0 2023-12-16T20:11:34.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/733: read da/d21/f28 [603731,99000] 0 2023-12-16T20:11:34.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/734: write da/d21/d2c/d76/fad [1181975,80806] 0 2023-12-16T20:11:34.663 INFO:tasks.workunit.client.1.smithi141.stdout:7/344: dread d5/d16/d1a/d40/f58 [0,4194304] 0 2023-12-16T20:11:34.663 INFO:tasks.workunit.client.1.smithi141.stdout:7/345: creat d5/d1d/d1e/d27/f70 x:0 0 0 2023-12-16T20:11:34.663 INFO:tasks.workunit.client.1.smithi141.stdout:7/346: truncate d5/d16/d30/d36/f4b 701199 0 2023-12-16T20:11:34.663 INFO:tasks.workunit.client.0.smithi038.stdout:3/694: creat d4/d67/de1/d4c/fef x:0 0 0 2023-12-16T20:11:34.664 INFO:tasks.workunit.client.1.smithi141.stdout:3/461: dread d0/f68 [0,4194304] 0 2023-12-16T20:11:34.664 INFO:tasks.workunit.client.1.smithi141.stdout:2/233: mkdir d6/da/d33/d54 0 2023-12-16T20:11:34.665 INFO:tasks.workunit.client.0.smithi038.stdout:7/735: mknod da/d21/d86/d92/cf8 0 2023-12-16T20:11:34.666 INFO:tasks.workunit.client.1.smithi141.stdout:4/358: symlink d1a/d2a/d3b/l90 0 2023-12-16T20:11:34.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/695: rmdir d4/d8/d15/d6d/d7a/de6 0 2023-12-16T20:11:34.669 INFO:tasks.workunit.client.0.smithi038.stdout:7/736: creat da/d21/dc0/ff9 x:0 0 0 2023-12-16T20:11:34.669 INFO:tasks.workunit.client.1.smithi141.stdout:8/429: mknod d14/d19/d1b/d24/c85 0 2023-12-16T20:11:34.670 INFO:tasks.workunit.client.1.smithi141.stdout:8/430: chown d14/d19/f1f 307720858 1 2023-12-16T20:11:34.670 INFO:tasks.workunit.client.1.smithi141.stdout:8/431: write d14/d71/d81/f75 [34070,55938] 0 2023-12-16T20:11:34.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/737: symlink da/d24/d4d/lfa 0 2023-12-16T20:11:34.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/738: read - da/dcf/fd4 zero size 2023-12-16T20:11:34.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/739: creat da/d21/d2c/dd0/ffb x:0 0 0 2023-12-16T20:11:34.672 INFO:tasks.workunit.client.0.smithi038.stdout:6/620: dread d1/d5b/f63 [0,4194304] 0 2023-12-16T20:11:34.674 INFO:tasks.workunit.client.1.smithi141.stdout:4/359: mknod d1a/d2a/c91 0 2023-12-16T20:11:34.674 INFO:tasks.workunit.client.1.smithi141.stdout:2/234: creat d6/d12/f55 x:0 0 0 2023-12-16T20:11:34.674 INFO:tasks.workunit.client.1.smithi141.stdout:2/235: truncate d6/da/d1b/f30 955033 0 2023-12-16T20:11:34.675 INFO:tasks.workunit.client.1.smithi141.stdout:4/360: dread - d1a/d2a/f53 zero size 2023-12-16T20:11:34.679 INFO:tasks.workunit.client.0.smithi038.stdout:6/621: write d1/d4/d1d/d28/db1/dbe/fb6 [691276,64580] 0 2023-12-16T20:11:34.679 INFO:tasks.workunit.client.0.smithi038.stdout:6/622: truncate d1/d16/fa7 658249 0 2023-12-16T20:11:34.680 INFO:tasks.workunit.client.1.smithi141.stdout:8/432: symlink d14/d19/d1b/d24/l86 0 2023-12-16T20:11:34.680 INFO:tasks.workunit.client.1.smithi141.stdout:7/347: rmdir d5/d16/d1a 39 2023-12-16T20:11:34.681 INFO:tasks.workunit.client.1.smithi141.stdout:4/361: truncate f2 2828083 0 2023-12-16T20:11:34.683 INFO:tasks.workunit.client.0.smithi038.stdout:8/605: dwrite d17/d1b/d25/db7/d82/da9/d50/f6e [4194304,4194304] 0 2023-12-16T20:11:34.683 INFO:tasks.workunit.client.0.smithi038.stdout:8/606: creat d17/d1b/d25/fc3 x:0 0 0 2023-12-16T20:11:34.683 INFO:tasks.workunit.client.0.smithi038.stdout:8/607: chown d17/d1b/d66/d73/d54/f8c 6 1 2023-12-16T20:11:34.684 INFO:tasks.workunit.client.1.smithi141.stdout:8/433: link d14/d71/d81/f75 d14/d71/d81/f87 0 2023-12-16T20:11:34.684 INFO:tasks.workunit.client.1.smithi141.stdout:7/348: mkdir d5/d1d/d1e/d71 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/349: truncate d5/d16/d1a/d40/f58 5230523 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/350: fdatasync d5/d16/d30/f57 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/351: read d5/d16/d30/f32 [4105032,119099] 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/352: readlink d5/d1d/d1e/l20 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/353: dread - d5/d2a/d45/d5a/f64 zero size 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:7/354: dread d5/f5f [0,4194304] 0 2023-12-16T20:11:34.685 INFO:tasks.workunit.client.1.smithi141.stdout:4/362: mknod d1a/d59/c92 0 2023-12-16T20:11:34.688 INFO:tasks.workunit.client.1.smithi141.stdout:8/434: creat d14/d19/d1b/d24/d4a/d69/f88 x:0 0 0 2023-12-16T20:11:34.688 INFO:tasks.workunit.client.1.smithi141.stdout:0/372: dwrite d4/d7/fd [0,4194304] 0 2023-12-16T20:11:34.689 INFO:tasks.workunit.client.1.smithi141.stdout:8/435: dread d14/d19/d1b/d3d/f3e [0,4194304] 0 2023-12-16T20:11:34.690 INFO:tasks.workunit.client.1.smithi141.stdout:3/462: dread d0/d1c/f6e [0,4194304] 0 2023-12-16T20:11:34.691 INFO:tasks.workunit.client.1.smithi141.stdout:4/363: rename d1a/d3c/l8b to d1a/d4e/d63/l93 0 2023-12-16T20:11:34.691 INFO:tasks.workunit.client.1.smithi141.stdout:4/364: creat d1a/d3c/d70/f94 x:0 0 0 2023-12-16T20:11:34.695 INFO:tasks.workunit.client.0.smithi038.stdout:6/623: read d1/d4/f20 [1074815,58688] 0 2023-12-16T20:11:34.696 INFO:tasks.workunit.client.1.smithi141.stdout:4/365: rename d1a/d3c/f5a to d1a/d2a/d3b/d69/f95 0 2023-12-16T20:11:34.696 INFO:tasks.workunit.client.1.smithi141.stdout:4/366: chown d1a/d2a/d3b/l6e 5893189 1 2023-12-16T20:11:34.700 INFO:tasks.workunit.client.1.smithi141.stdout:7/355: dread d5/d2a/f3e [0,4194304] 0 2023-12-16T20:11:34.703 INFO:tasks.workunit.client.1.smithi141.stdout:7/356: creat d5/d16/d30/d4e/f72 x:0 0 0 2023-12-16T20:11:34.704 INFO:tasks.workunit.client.0.smithi038.stdout:6/624: link d1/f25 d1/d4/d1d/d67/d73/fc4 0 2023-12-16T20:11:34.704 INFO:tasks.workunit.client.0.smithi038.stdout:6/625: truncate d1/d4/f8 8709918 0 2023-12-16T20:11:34.704 INFO:tasks.workunit.client.0.smithi038.stdout:6/626: readlink d1/d4/d1d/l5c 0 2023-12-16T20:11:34.704 INFO:tasks.workunit.client.0.smithi038.stdout:6/627: fsync d1/d4/f7c 0 2023-12-16T20:11:34.706 INFO:tasks.workunit.client.0.smithi038.stdout:6/628: mkdir d1/d4/d1d/d28/db1/dbe/d94/dc5 0 2023-12-16T20:11:34.706 INFO:tasks.workunit.client.0.smithi038.stdout:6/629: write d1/f71 [5215683,533] 0 2023-12-16T20:11:34.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/630: dread d1/d4/d1d/d28/f69 [0,4194304] 0 2023-12-16T20:11:34.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/631: chown d1/d4/d1d/d28/d2f/c70 106996 1 2023-12-16T20:11:34.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/632: chown d1/d4/c5d 13618 1 2023-12-16T20:11:34.709 INFO:tasks.workunit.client.1.smithi141.stdout:7/357: dread d5/d2a/f41 [0,4194304] 0 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:7/358: chown d5/d16/d30/l43 74 1 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:7/359: stat d5/d1d/c26 0 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:5/298: dwrite d0/d14/d2c/f33 [0,4194304] 0 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:1/453: dwrite da/d1a/d1d/d22/f30 [0,4194304] 0 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:3/463: read d0/d1c/d40/d3f/d52/d5d/f79 [310675,109092] 0 2023-12-16T20:11:34.710 INFO:tasks.workunit.client.1.smithi141.stdout:3/464: chown d0/d1c/d40/d3f/f80 22222 1 2023-12-16T20:11:34.711 INFO:tasks.workunit.client.0.smithi038.stdout:5/731: dwrite d2/df/d1a/d2a/f3a [0,4194304] 0 2023-12-16T20:11:34.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/651: dwrite d13/f37 [0,4194304] 0 2023-12-16T20:11:34.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/652: stat d13/d17/d2e/d32/d70/d84/d88 0 2023-12-16T20:11:34.711 INFO:tasks.workunit.client.0.smithi038.stdout:5/732: write d2/d14/d25/d2d/f8c [743600,69247] 0 2023-12-16T20:11:34.711 INFO:tasks.workunit.client.0.smithi038.stdout:1/713: dwrite d15/d1e/d23/d34/d86/fa0 [0,4194304] 0 2023-12-16T20:11:34.712 INFO:tasks.workunit.client.1.smithi141.stdout:6/422: dwrite d1/d12/d22/f53 [0,4194304] 0 2023-12-16T20:11:34.713 INFO:tasks.workunit.client.1.smithi141.stdout:5/299: rename d0/d9/d16/f2d to d0/d14/d2c/d4a/f61 0 2023-12-16T20:11:34.713 INFO:tasks.workunit.client.0.smithi038.stdout:9/715: dwrite d9/d1e/d3d/f4b [0,4194304] 0 2023-12-16T20:11:34.713 INFO:tasks.workunit.client.0.smithi038.stdout:9/716: truncate d9/d1f/d96/fb7 707789 0 2023-12-16T20:11:34.713 INFO:tasks.workunit.client.0.smithi038.stdout:6/633: rename d1/d4/d1d/d28/db1/dbe/d94/dc5 to d1/d5b/d7d/dc6 0 2023-12-16T20:11:34.713 INFO:tasks.workunit.client.1.smithi141.stdout:1/454: creat da/d1a/f95 x:0 0 0 2023-12-16T20:11:34.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/455: write da/df/f78 [624019,22335] 0 2023-12-16T20:11:34.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/456: chown da/d36/d4b/d4d/d89/f32 8045311 1 2023-12-16T20:11:34.714 INFO:tasks.workunit.client.0.smithi038.stdout:7/740: dwrite da/d24/d4d/d51/f60 [0,4194304] 0 2023-12-16T20:11:34.714 INFO:tasks.workunit.client.1.smithi141.stdout:7/360: write d5/d16/f56 [2082230,34709] 0 2023-12-16T20:11:34.719 INFO:tasks.workunit.client.0.smithi038.stdout:5/733: creat d2/df/fea x:0 0 0 2023-12-16T20:11:34.719 INFO:tasks.workunit.client.1.smithi141.stdout:3/465: rmdir d0/d1c/d40/d9a 0 2023-12-16T20:11:34.719 INFO:tasks.workunit.client.1.smithi141.stdout:3/466: creat d0/d1c/fa1 x:0 0 0 2023-12-16T20:11:34.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/714: mkdir d15/d22/d52/d7f/df7 0 2023-12-16T20:11:34.723 INFO:tasks.workunit.client.1.smithi141.stdout:2/236: dwrite d6/da/d33/f3e [0,4194304] 0 2023-12-16T20:11:34.724 INFO:tasks.workunit.client.1.smithi141.stdout:4/367: dwrite f9 [0,4194304] 0 2023-12-16T20:11:34.725 INFO:tasks.workunit.client.1.smithi141.stdout:6/423: mknod d1/d12/d20/d3a/d45/d47/c8c 0 2023-12-16T20:11:34.726 INFO:tasks.workunit.client.0.smithi038.stdout:9/717: symlink d9/d1f/d21/d3e/d4e/d61/d9b/dd3/ldc 0 2023-12-16T20:11:34.728 INFO:tasks.workunit.client.1.smithi141.stdout:5/300: link d0/d25/d30/c46 d0/d14/d2c/c62 0 2023-12-16T20:11:34.728 INFO:tasks.workunit.client.0.smithi038.stdout:5/734: mkdir d2/d14/ddd/deb 0 2023-12-16T20:11:34.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/373: dwrite d4/d49/d73/d3b/f67 [0,4194304] 0 2023-12-16T20:11:34.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/374: creat d4/d5c/f87 x:0 0 0 2023-12-16T20:11:34.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/375: creat d4/f88 x:0 0 0 2023-12-16T20:11:34.731 INFO:tasks.workunit.client.0.smithi038.stdout:6/634: dread d1/d4/d1d/d61/f7b [0,4194304] 0 2023-12-16T20:11:34.731 INFO:tasks.workunit.client.0.smithi038.stdout:2/743: dwrite d1/d5/fc7 [0,4194304] 0 2023-12-16T20:11:34.731 INFO:tasks.workunit.client.1.smithi141.stdout:1/457: unlink da/d1a/d31/f47 0 2023-12-16T20:11:34.737 INFO:tasks.workunit.client.0.smithi038.stdout:9/718: getdents d9/d1f/d21/d3e/d4e/d61/d9e 0 2023-12-16T20:11:34.739 INFO:tasks.workunit.client.1.smithi141.stdout:3/467: mkdir d0/d1c/d6a/d76/da2 0 2023-12-16T20:11:34.739 INFO:tasks.workunit.client.1.smithi141.stdout:3/468: chown d0/d1c/f6e 1 1 2023-12-16T20:11:34.741 INFO:tasks.workunit.client.0.smithi038.stdout:5/735: creat d2/d14/d25/d2d/d17/d51/daf/dda/fec x:0 0 0 2023-12-16T20:11:34.741 INFO:tasks.workunit.client.0.smithi038.stdout:1/715: getdents d15/d4a 0 2023-12-16T20:11:34.742 INFO:tasks.workunit.client.0.smithi038.stdout:1/716: readlink d15/d22/d7b/lb5 0 2023-12-16T20:11:34.745 INFO:tasks.workunit.client.1.smithi141.stdout:2/237: symlink d6/d12/l56 0 2023-12-16T20:11:34.745 INFO:tasks.workunit.client.1.smithi141.stdout:2/238: dread - d6/da/f49 zero size 2023-12-16T20:11:34.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/239: truncate d6/da/d1b/f30 1388876 0 2023-12-16T20:11:34.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/240: readlink d6/da/l22 0 2023-12-16T20:11:34.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/241: creat d6/d32/f57 x:0 0 0 2023-12-16T20:11:34.748 INFO:tasks.workunit.client.1.smithi141.stdout:4/368: creat d1a/d59/f96 x:0 0 0 2023-12-16T20:11:34.748 INFO:tasks.workunit.client.1.smithi141.stdout:4/369: write d1a/d2a/f76 [843789,52233] 0 2023-12-16T20:11:34.749 INFO:tasks.workunit.client.1.smithi141.stdout:7/361: dwrite d5/d2a/d45/d5a/f64 [0,4194304] 0 2023-12-16T20:11:34.750 INFO:tasks.workunit.client.0.smithi038.stdout:6/635: truncate d1/d4/d1d/f59 594324 0 2023-12-16T20:11:34.751 INFO:tasks.workunit.client.1.smithi141.stdout:5/301: creat d0/d14/d2c/d4a/f63 x:0 0 0 2023-12-16T20:11:34.752 INFO:tasks.workunit.client.0.smithi038.stdout:4/653: dwrite d13/d17/d4b/da4/fd3 [0,4194304] 0 2023-12-16T20:11:34.752 INFO:tasks.workunit.client.0.smithi038.stdout:4/654: stat d13/d17/d2e/d32/d4e/fbd 0 2023-12-16T20:11:34.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/741: dwrite da/d21/f8f [0,4194304] 0 2023-12-16T20:11:34.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/742: stat da/d21/l53 0 2023-12-16T20:11:34.753 INFO:tasks.workunit.client.0.smithi038.stdout:7/743: chown da/d21/d2c/dd0/ffb 25419283 1 2023-12-16T20:11:34.754 INFO:tasks.workunit.client.0.smithi038.stdout:9/719: truncate d9/d1f/f5b 340479 0 2023-12-16T20:11:34.755 INFO:tasks.workunit.client.1.smithi141.stdout:6/424: dwrite d1/d3/f76 [0,4194304] 0 2023-12-16T20:11:34.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/744: chown da/d24/d4d/dc5/d38/d65/f77 179621 1 2023-12-16T20:11:34.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/745: stat da/d21/d86/dee 0 2023-12-16T20:11:34.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/746: getdents da/d21/d2c/d76/dce 0 2023-12-16T20:11:34.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/747: readlink da/d24/d4d/dc5/d38/d90/l7e 0 2023-12-16T20:11:34.756 INFO:tasks.workunit.client.1.smithi141.stdout:0/376: creat d4/d49/d73/d3b/d78/d7f/d80/d83/f89 x:0 0 0 2023-12-16T20:11:34.757 INFO:tasks.workunit.client.0.smithi038.stdout:4/655: write d13/d17/d2e/d32/d4d/d78/dc8/fd6 [151307,97620] 0 2023-12-16T20:11:34.757 INFO:tasks.workunit.client.0.smithi038.stdout:4/656: dread - d13/d69/d7a/fa0 zero size 2023-12-16T20:11:34.757 INFO:tasks.workunit.client.0.smithi038.stdout:4/657: write d13/d1f/f8e [741986,33081] 0 2023-12-16T20:11:34.758 INFO:tasks.workunit.client.0.smithi038.stdout:4/658: write d13/d1f/fc4 [577754,69823] 0 2023-12-16T20:11:34.758 INFO:tasks.workunit.client.0.smithi038.stdout:1/717: symlink d15/d1e/d23/d7d/de9/lf8 0 2023-12-16T20:11:34.759 INFO:tasks.workunit.client.1.smithi141.stdout:1/458: creat da/d36/f96 x:0 0 0 2023-12-16T20:11:34.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/459: chown da/d36/d4b/d4d/d89/d6c/l77 445633960 1 2023-12-16T20:11:34.760 INFO:tasks.workunit.client.0.smithi038.stdout:9/720: link d9/d1f/d21/d3e/d4e/d61/daa/cb2 d9/d1f/d96/dd5/cdd 0 2023-12-16T20:11:34.760 INFO:tasks.workunit.client.0.smithi038.stdout:9/721: fdatasync d9/d1e/d3d/d42/d59/d76/f78 0 2023-12-16T20:11:34.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/722: getdents d9/d1f/d21/d84/daf 0 2023-12-16T20:11:34.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/723: creat d9/d1e/d40/d5e/fde x:0 0 0 2023-12-16T20:11:34.766 INFO:tasks.workunit.client.1.smithi141.stdout:3/469: mkdir d0/d1c/d2c/d72/d74/d8b/da3 0 2023-12-16T20:11:34.766 INFO:tasks.workunit.client.1.smithi141.stdout:3/470: write d0/d1c/d6a/f8d [371188,48122] 0 2023-12-16T20:11:34.766 INFO:tasks.workunit.client.1.smithi141.stdout:3/471: dread - d0/d1c/d6a/f9d zero size 2023-12-16T20:11:34.766 INFO:tasks.workunit.client.1.smithi141.stdout:3/472: truncate d0/d1c/d40/f1d 2974275 0 2023-12-16T20:11:34.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/718: write d15/d1e/d3b/d48/d37/dde/d75/fe2 [1564626,39705] 0 2023-12-16T20:11:34.777 INFO:tasks.workunit.client.0.smithi038.stdout:4/659: dread d13/d1f/f8e [0,4194304] 0 2023-12-16T20:11:34.778 INFO:tasks.workunit.client.0.smithi038.stdout:4/660: read d13/d17/d2e/d32/d70/fa3 [1805323,108997] 0 2023-12-16T20:11:34.779 INFO:tasks.workunit.client.1.smithi141.stdout:2/242: mkdir d6/d3a/d47/d58 0 2023-12-16T20:11:34.782 INFO:tasks.workunit.client.0.smithi038.stdout:5/736: dwrite d2/d14/d25/fbd [0,4194304] 0 2023-12-16T20:11:34.782 INFO:tasks.workunit.client.0.smithi038.stdout:4/661: rename d13/d17/c24 to d13/d17/d2e/cd9 0 2023-12-16T20:11:34.785 INFO:tasks.workunit.client.1.smithi141.stdout:5/302: creat d0/d9/d16/d2a/d4f/f64 x:0 0 0 2023-12-16T20:11:34.789 INFO:tasks.workunit.client.0.smithi038.stdout:5/737: unlink d2/c6 0 2023-12-16T20:11:34.789 INFO:tasks.workunit.client.0.smithi038.stdout:5/738: dread - d2/d14/d25/d2d/d2f/d98/fcd zero size 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:6/636: dwrite d1/d5b/d7d/d9d/f48 [0,4194304] 0 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:6/637: write d1/d4/d1d/d28/d2f/d85/fc0 [604375,49708] 0 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:6/638: chown d1/d4/d1d/l5c 0 1 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:6/639: chown d1/f25 414061201 1 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:7/748: dwrite da/d24/d4d/dc5/d38/d90/f16 [0,4194304] 0 2023-12-16T20:11:34.791 INFO:tasks.workunit.client.0.smithi038.stdout:7/749: readlink da/d24/d4d/dc5/d38/l75 0 2023-12-16T20:11:34.794 INFO:tasks.workunit.client.0.smithi038.stdout:5/739: rmdir d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1 39 2023-12-16T20:11:34.797 INFO:tasks.workunit.client.1.smithi141.stdout:4/370: dwrite d1a/d2a/f4b [0,4194304] 0 2023-12-16T20:11:34.798 INFO:tasks.workunit.client.0.smithi038.stdout:6/640: creat d1/d4/d1d/d61/fc7 x:0 0 0 2023-12-16T20:11:34.800 INFO:tasks.workunit.client.0.smithi038.stdout:6/641: mkdir d1/d5b/d7d/d9d/dc8 0 2023-12-16T20:11:34.802 INFO:tasks.workunit.client.0.smithi038.stdout:6/642: mkdir d1/d4/d1d/d28/d2f/d85/da2/dc9 0 2023-12-16T20:11:34.802 INFO:tasks.workunit.client.0.smithi038.stdout:6/643: write d1/f71 [6231477,61552] 0 2023-12-16T20:11:34.803 INFO:tasks.workunit.client.0.smithi038.stdout:7/750: dread da/f98 [4194304,4194304] 0 2023-12-16T20:11:34.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/644: link d1/d5b/d7d/d9d/f4c d1/d4/d1d/d28/db1/dbe/fca 0 2023-12-16T20:11:34.806 INFO:tasks.workunit.client.0.smithi038.stdout:6/645: write d1/d4/d1d/d28/f41 [2062630,74060] 0 2023-12-16T20:11:34.806 INFO:tasks.workunit.client.0.smithi038.stdout:7/751: getdents da/d21/d86 0 2023-12-16T20:11:34.806 INFO:tasks.workunit.client.1.smithi141.stdout:7/362: dwrite d5/f28 [0,4194304] 0 2023-12-16T20:11:34.807 INFO:tasks.workunit.client.0.smithi038.stdout:6/646: truncate d1/d4/f8 7687492 0 2023-12-16T20:11:34.807 INFO:tasks.workunit.client.0.smithi038.stdout:6/647: write d1/d4/d1d/d28/d2f/d85/fc0 [1363419,42444] 0 2023-12-16T20:11:34.807 INFO:tasks.workunit.client.0.smithi038.stdout:6/648: fsync d1/d4/d1d/d67/d73/faf 0 2023-12-16T20:11:34.808 INFO:tasks.workunit.client.0.smithi038.stdout:7/752: mkdir da/d24/d4d/dc5/ddc/d8e/dfc 0 2023-12-16T20:11:34.815 INFO:tasks.workunit.client.0.smithi038.stdout:6/649: write d1/d5b/f76 [207407,86264] 0 2023-12-16T20:11:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:6/650: rmdir d1/d4/d1d/d28/d2f/d85/da2 39 2023-12-16T20:11:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:6/651: chown d1/d4/d1d/d67/d73/f98 182085 1 2023-12-16T20:11:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:5/740: dread d2/df/d1a/d2a/f95 [0,4194304] 0 2023-12-16T20:11:34.817 INFO:tasks.workunit.client.0.smithi038.stdout:5/741: fdatasync d2/df/d1a/d2a/f74 0 2023-12-16T20:11:34.819 INFO:tasks.workunit.client.0.smithi038.stdout:5/742: creat d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4/fed x:0 0 0 2023-12-16T20:11:34.819 INFO:tasks.workunit.client.0.smithi038.stdout:5/743: chown d2/d14/d25/d2d/d17/f88 111 1 2023-12-16T20:11:34.819 INFO:tasks.workunit.client.0.smithi038.stdout:5/744: write d2/d14/d25/d2d/d17/d51/daf/dda/fec [517236,91919] 0 2023-12-16T20:11:34.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/745: rmdir d2/d14/d25/d2d/d17/d55 39 2023-12-16T20:11:34.822 INFO:tasks.workunit.client.0.smithi038.stdout:7/753: write da/d21/fac [3460926,82535] 0 2023-12-16T20:11:34.822 INFO:tasks.workunit.client.0.smithi038.stdout:7/754: write da/d21/d2c/d76/f89 [4202327,6505] 0 2023-12-16T20:11:34.823 INFO:tasks.workunit.client.0.smithi038.stdout:7/755: chown da/d21/l54 1124535234 1 2023-12-16T20:11:34.823 INFO:tasks.workunit.client.1.smithi141.stdout:6/425: chown d1/dd/de/c28 83611 1 2023-12-16T20:11:34.823 INFO:tasks.workunit.client.0.smithi038.stdout:2/744: dwrite d1/d5/d95/d61/d66/f83 [0,4194304] 0 2023-12-16T20:11:34.823 INFO:tasks.workunit.client.0.smithi038.stdout:2/745: read - d1/d5/d95/d61/dd4/d6a/d43/d57/ff9 zero size 2023-12-16T20:11:34.825 INFO:tasks.workunit.client.0.smithi038.stdout:4/662: dwrite d13/d17/d62/fba [0,4194304] 0 2023-12-16T20:11:34.825 INFO:tasks.workunit.client.0.smithi038.stdout:4/663: stat d13/d17/d2e/d32/c50 0 2023-12-16T20:11:34.825 INFO:tasks.workunit.client.0.smithi038.stdout:9/724: dwrite d9/d1f/d21/d3e/d4e/d61/d9b/fa3 [0,4194304] 0 2023-12-16T20:11:34.825 INFO:tasks.workunit.client.0.smithi038.stdout:9/725: fsync d9/d1e/d3d/f4b 0 2023-12-16T20:11:34.826 INFO:tasks.workunit.client.0.smithi038.stdout:5/746: creat d2/d14/ddd/fee x:0 0 0 2023-12-16T20:11:34.826 INFO:tasks.workunit.client.0.smithi038.stdout:5/747: truncate d2/d14/d25/d2d/d2f/d98/fcd 174465 0 2023-12-16T20:11:34.826 INFO:tasks.workunit.client.1.smithi141.stdout:0/377: mkdir d4/d49/d73/d8a 0 2023-12-16T20:11:34.829 INFO:tasks.workunit.client.1.smithi141.stdout:2/243: dwrite d6/da/d1b/f30 [0,4194304] 0 2023-12-16T20:11:34.829 INFO:tasks.workunit.client.1.smithi141.stdout:1/460: unlink da/l35 0 2023-12-16T20:11:34.832 INFO:tasks.workunit.client.0.smithi038.stdout:7/756: write da/d24/f6f [2195917,34824] 0 2023-12-16T20:11:34.832 INFO:tasks.workunit.client.0.smithi038.stdout:4/664: write d13/d17/d2e/d75/f6d [390202,46515] 0 2023-12-16T20:11:34.833 INFO:tasks.workunit.client.0.smithi038.stdout:4/665: read - d13/d17/d4b/f87 zero size 2023-12-16T20:11:34.834 INFO:tasks.workunit.client.1.smithi141.stdout:3/473: rename d0/d1c/c20 to d0/d1c/d40/d85/ca4 0 2023-12-16T20:11:34.835 INFO:tasks.workunit.client.1.smithi141.stdout:3/474: write d0/d1c/d40/d85/d4c/f4f [4413936,110584] 0 2023-12-16T20:11:34.844 INFO:tasks.workunit.client.0.smithi038.stdout:2/746: creat d1/d5/d95/d61/dd4/d12/f100 x:0 0 0 2023-12-16T20:11:34.845 INFO:tasks.workunit.client.0.smithi038.stdout:2/747: stat d1/d5/d3d/d9e 0 2023-12-16T20:11:34.845 INFO:tasks.workunit.client.0.smithi038.stdout:2/748: dread - d1/d5/d95/d61/dd4/d6a/d43/d57/dd6/ff8 zero size 2023-12-16T20:11:34.845 INFO:tasks.workunit.client.0.smithi038.stdout:2/749: chown d1/d5/d95/d61/dd4/d21/d82 9 1 2023-12-16T20:11:34.845 INFO:tasks.workunit.client.0.smithi038.stdout:2/750: creat d1/d5/d2a/f101 x:0 0 0 2023-12-16T20:11:34.847 INFO:tasks.workunit.client.1.smithi141.stdout:1/461: write da/f2c [956521,124884] 0 2023-12-16T20:11:34.847 INFO:tasks.workunit.client.1.smithi141.stdout:1/462: fdatasync da/df/f78 0 2023-12-16T20:11:34.847 INFO:tasks.workunit.client.1.smithi141.stdout:1/463: chown da/d1a/f73 14378444 1 2023-12-16T20:11:34.850 INFO:tasks.workunit.client.1.smithi141.stdout:7/363: symlink d5/d16/d30/l73 0 2023-12-16T20:11:34.850 INFO:tasks.workunit.client.1.smithi141.stdout:7/364: read - d5/d16/d30/f50 zero size 2023-12-16T20:11:34.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/726: symlink d9/d1e/d45/ldf 0 2023-12-16T20:11:34.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/727: read d9/d1f/f98 [1001422,105936] 0 2023-12-16T20:11:34.855 INFO:tasks.workunit.client.0.smithi038.stdout:4/666: mkdir d13/d17/d2e/d32/d4d/d78/dc8/dda 0 2023-12-16T20:11:34.857 INFO:tasks.workunit.client.1.smithi141.stdout:2/244: mknod d6/da/c59 0 2023-12-16T20:11:34.857 INFO:tasks.workunit.client.1.smithi141.stdout:2/245: chown d6/d32 1 1 2023-12-16T20:11:34.858 INFO:tasks.workunit.client.1.smithi141.stdout:2/246: chown d6/c10 1 1 2023-12-16T20:11:34.858 INFO:tasks.workunit.client.1.smithi141.stdout:2/247: dread - d6/da/f35 zero size 2023-12-16T20:11:34.858 INFO:tasks.workunit.client.1.smithi141.stdout:2/248: fsync d6/f17 0 2023-12-16T20:11:34.861 INFO:tasks.workunit.client.1.smithi141.stdout:5/303: rmdir d0/d9/d16/d2a/d35 39 2023-12-16T20:11:34.861 INFO:tasks.workunit.client.1.smithi141.stdout:5/304: fsync d0/d14/d2c/d4a/f55 0 2023-12-16T20:11:34.866 INFO:tasks.workunit.client.0.smithi038.stdout:6/652: dwrite d1/d4/d1d/d28/db1/dbe/db3/fb5 [0,4194304] 0 2023-12-16T20:11:34.866 INFO:tasks.workunit.client.1.smithi141.stdout:1/464: rename da/d36/d4b/d4d/d89/f53 to da/d36/d4b/d4d/d89/f97 0 2023-12-16T20:11:34.866 INFO:tasks.workunit.client.1.smithi141.stdout:1/465: fdatasync da/d67/f5e 0 2023-12-16T20:11:34.868 INFO:tasks.workunit.client.0.smithi038.stdout:2/751: write d1/d5/d95/d61/dd4/d10/f71 [7345220,25736] 0 2023-12-16T20:11:34.869 INFO:tasks.workunit.client.1.smithi141.stdout:2/249: fdatasync d6/d12/d15/f44 0 2023-12-16T20:11:34.869 INFO:tasks.workunit.client.1.smithi141.stdout:2/250: chown d6/l2b 8987569 1 2023-12-16T20:11:34.870 INFO:tasks.workunit.client.0.smithi038.stdout:2/752: link d1/d5/d95/d61/dd4/d21/d82/ccd d1/d5/d95/d61/dd4/d6a/dfb/c102 0 2023-12-16T20:11:34.870 INFO:tasks.workunit.client.0.smithi038.stdout:2/753: getdents d1/d5/d95/d61/dd4/d6a/d43 0 2023-12-16T20:11:34.872 INFO:tasks.workunit.client.1.smithi141.stdout:5/305: creat d0/df/f65 x:0 0 0 2023-12-16T20:11:34.872 INFO:tasks.workunit.client.1.smithi141.stdout:6/426: dwrite d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:34.872 INFO:tasks.workunit.client.1.smithi141.stdout:6/427: truncate d1/dd/d2f/f30 4682207 0 2023-12-16T20:11:34.872 INFO:tasks.workunit.client.1.smithi141.stdout:6/428: fdatasync d1/d12/f16 0 2023-12-16T20:11:34.872 INFO:tasks.workunit.client.0.smithi038.stdout:7/757: dwrite da/d24/d4d/dc5/d38/d90/f15 [0,4194304] 0 2023-12-16T20:11:34.874 INFO:tasks.workunit.client.0.smithi038.stdout:7/758: symlink da/d24/d4d/dc5/d38/d65/d81/lfd 0 2023-12-16T20:11:34.875 INFO:tasks.workunit.client.1.smithi141.stdout:1/466: unlink da/d1a/d1d/d22/f60 0 2023-12-16T20:11:34.875 INFO:tasks.workunit.client.0.smithi038.stdout:7/759: dread da/d21/d2c/d76/fca [0,4194304] 0 2023-12-16T20:11:34.876 INFO:tasks.workunit.client.0.smithi038.stdout:5/748: dwrite d2/d14/f92 [0,4194304] 0 2023-12-16T20:11:34.876 INFO:tasks.workunit.client.1.smithi141.stdout:3/475: dwrite d0/d1c/d40/f81 [0,4194304] 0 2023-12-16T20:11:34.876 INFO:tasks.workunit.client.1.smithi141.stdout:3/476: truncate d0/f9c 348841 0 2023-12-16T20:11:34.877 INFO:tasks.workunit.client.1.smithi141.stdout:7/365: rmdir d5/d16/d46/d61 39 2023-12-16T20:11:34.878 INFO:tasks.workunit.client.0.smithi038.stdout:4/667: dwrite d13/d1f/f66 [4194304,4194304] 0 2023-12-16T20:11:34.878 INFO:tasks.workunit.client.0.smithi038.stdout:4/668: write d13/d17/d2e/d32/fa7 [226758,28382] 0 2023-12-16T20:11:34.880 INFO:tasks.workunit.client.1.smithi141.stdout:2/251: mkdir d6/d12/d1f/d46/d5a 0 2023-12-16T20:11:34.885 INFO:tasks.workunit.client.1.smithi141.stdout:5/306: creat d0/d9/d16/d2a/d35/f66 x:0 0 0 2023-12-16T20:11:34.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/760: write da/f19 [4103383,787] 0 2023-12-16T20:11:34.887 INFO:tasks.workunit.client.0.smithi038.stdout:5/749: dread d2/d14/d25/d2d/d17/d51/f9c [0,4194304] 0 2023-12-16T20:11:34.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/761: dread - da/d21/d2c/d76/d9a/fa5 zero size 2023-12-16T20:11:34.888 INFO:tasks.workunit.client.1.smithi141.stdout:6/429: mknod d1/d3/d4b/c8d 0 2023-12-16T20:11:34.889 INFO:tasks.workunit.client.1.smithi141.stdout:6/430: dread - d1/d12/d20/d44/d4a/f79 zero size 2023-12-16T20:11:34.892 INFO:tasks.workunit.client.0.smithi038.stdout:4/669: write d13/d17/d2e/d32/f39 [2420124,74051] 0 2023-12-16T20:11:34.893 INFO:tasks.workunit.client.0.smithi038.stdout:5/750: rmdir d2/d14/d44 39 2023-12-16T20:11:34.894 INFO:tasks.workunit.client.0.smithi038.stdout:7/762: truncate da/d24/d4d/d51/f60 2907560 0 2023-12-16T20:11:34.894 INFO:tasks.workunit.client.0.smithi038.stdout:7/763: chown da/d24/d4d/dc5/ddc/d8e/dfc 6522 1 2023-12-16T20:11:34.896 INFO:tasks.workunit.client.0.smithi038.stdout:7/764: mknod da/d24/d4d/dc5/ddc/dba/cfe 0 2023-12-16T20:11:34.896 INFO:tasks.workunit.client.0.smithi038.stdout:7/765: fdatasync da/d24/d4d/dc5/ddc/d8e/f78 0 2023-12-16T20:11:34.898 INFO:tasks.workunit.client.1.smithi141.stdout:4/371: truncate f19 3549860 0 2023-12-16T20:11:34.898 INFO:tasks.workunit.client.0.smithi038.stdout:5/751: unlink d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4/fed 0 2023-12-16T20:11:34.898 INFO:tasks.workunit.client.0.smithi038.stdout:7/766: creat da/fff x:0 0 0 2023-12-16T20:11:34.910 INFO:tasks.workunit.client.1.smithi141.stdout:3/477: symlink d0/d1c/d2c/d72/la5 0 2023-12-16T20:11:34.910 INFO:tasks.workunit.client.1.smithi141.stdout:3/478: fdatasync d0/d1c/d40/d3f/d52/f9e 0 2023-12-16T20:11:34.910 INFO:tasks.workunit.client.1.smithi141.stdout:3/479: fdatasync d0/d1c/d40/f1b 0 2023-12-16T20:11:34.911 INFO:tasks.workunit.client.1.smithi141.stdout:7/366: dwrite d5/d16/d30/f32 [4194304,4194304] 0 2023-12-16T20:11:34.912 INFO:tasks.workunit.client.1.smithi141.stdout:1/467: dwrite da/d36/f66 [0,4194304] 0 2023-12-16T20:11:34.912 INFO:tasks.workunit.client.1.smithi141.stdout:2/252: dwrite d6/d32/f57 [0,4194304] 0 2023-12-16T20:11:34.913 INFO:tasks.workunit.client.0.smithi038.stdout:2/754: dwrite d1/d5/fc7 [0,4194304] 0 2023-12-16T20:11:34.913 INFO:tasks.workunit.client.0.smithi038.stdout:5/752: dread d2/d14/d25/d2d/d17/f19 [0,4194304] 0 2023-12-16T20:11:34.913 INFO:tasks.workunit.client.0.smithi038.stdout:2/755: chown d1/d5/d95/d61/dd4/laf 7 1 2023-12-16T20:11:34.915 INFO:tasks.workunit.client.1.smithi141.stdout:6/431: rmdir d1/d12/d22/d25/d6e 0 2023-12-16T20:11:34.915 INFO:tasks.workunit.client.1.smithi141.stdout:6/432: chown d1/d12/d20/d3a/d45 28508918 1 2023-12-16T20:11:34.916 INFO:tasks.workunit.client.0.smithi038.stdout:2/756: rmdir d1/d5/d95/d61/dd4/d21/d82/d92/db3 39 2023-12-16T20:11:34.918 INFO:tasks.workunit.client.0.smithi038.stdout:5/753: creat d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/dd5/fef x:0 0 0 2023-12-16T20:11:34.920 INFO:tasks.workunit.client.0.smithi038.stdout:2/757: creat d1/d88/f103 x:0 0 0 2023-12-16T20:11:34.922 INFO:tasks.workunit.client.1.smithi141.stdout:4/372: rename d1a/d59/f96 to d1a/d3c/d70/f97 0 2023-12-16T20:11:34.923 INFO:tasks.workunit.client.1.smithi141.stdout:4/373: chown d1a/d3c 244187 1 2023-12-16T20:11:34.923 INFO:tasks.workunit.client.1.smithi141.stdout:4/374: dread - d1a/d3c/d70/f94 zero size 2023-12-16T20:11:34.923 INFO:tasks.workunit.client.1.smithi141.stdout:4/375: truncate d1a/d2a/d3b/f7f 447521 0 2023-12-16T20:11:34.923 INFO:tasks.workunit.client.1.smithi141.stdout:4/376: write fd [2309638,22900] 0 2023-12-16T20:11:34.924 INFO:tasks.workunit.client.0.smithi038.stdout:7/767: rename da/d24 to da/dcf/d100 0 2023-12-16T20:11:34.924 INFO:tasks.workunit.client.0.smithi038.stdout:7/768: chown da/dcf/d100/f6f 20962 1 2023-12-16T20:11:34.926 INFO:tasks.workunit.client.0.smithi038.stdout:7/769: truncate da/f19 1411140 0 2023-12-16T20:11:34.928 INFO:tasks.workunit.client.1.smithi141.stdout:7/367: creat d5/d1d/d1e/f74 x:0 0 0 2023-12-16T20:11:34.930 INFO:tasks.workunit.client.1.smithi141.stdout:3/480: dwrite d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:34.935 INFO:tasks.workunit.client.1.smithi141.stdout:5/307: getdents d0/d25 0 2023-12-16T20:11:34.939 INFO:tasks.workunit.client.1.smithi141.stdout:2/253: mkdir d6/da/d1b/d5b 0 2023-12-16T20:11:34.941 INFO:tasks.workunit.client.1.smithi141.stdout:6/433: symlink d1/d12/l8e 0 2023-12-16T20:11:34.941 INFO:tasks.workunit.client.1.smithi141.stdout:6/434: readlink d1/d12/d22/d31/l39 0 2023-12-16T20:11:34.942 INFO:tasks.workunit.client.1.smithi141.stdout:4/377: getdents d1a/d59/d89/d8a 0 2023-12-16T20:11:34.942 INFO:tasks.workunit.client.1.smithi141.stdout:4/378: write f14 [5079827,1950] 0 2023-12-16T20:11:34.946 INFO:tasks.workunit.client.1.smithi141.stdout:7/368: link d5/d2a/f2c d5/d16/f75 0 2023-12-16T20:11:34.950 INFO:tasks.workunit.client.1.smithi141.stdout:2/254: dread d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:34.953 INFO:tasks.workunit.client.1.smithi141.stdout:1/468: symlink da/d36/d4b/d4d/d80/d94/l98 0 2023-12-16T20:11:34.955 INFO:tasks.workunit.client.1.smithi141.stdout:6/435: mknod d1/d3/d4b/d60/c8f 0 2023-12-16T20:11:34.958 INFO:tasks.workunit.client.1.smithi141.stdout:1/469: dread - da/d1a/d1d/d33/f62 zero size 2023-12-16T20:11:34.958 INFO:tasks.workunit.client.1.smithi141.stdout:1/470: truncate da/d36/d4b/d4d/d89/d61/f71 4280444 0 2023-12-16T20:11:34.961 INFO:tasks.workunit.client.1.smithi141.stdout:6/436: link d1/d12/l8e d1/l90 0 2023-12-16T20:11:34.963 INFO:tasks.workunit.client.1.smithi141.stdout:5/308: rename d0/df to d0/d25/d30/d67 0 2023-12-16T20:11:34.964 INFO:tasks.workunit.client.1.smithi141.stdout:7/369: write d5/fc [1625109,76946] 0 2023-12-16T20:11:34.964 INFO:tasks.workunit.client.1.smithi141.stdout:1/471: symlink da/d36/d4b/l99 0 2023-12-16T20:11:34.964 INFO:tasks.workunit.client.1.smithi141.stdout:1/472: creat da/d1a/d1d/d33/f9a x:0 0 0 2023-12-16T20:11:34.965 INFO:tasks.workunit.client.0.smithi038.stdout:5/754: dwrite d2/df/d1a/d2a/f75 [0,4194304] 0 2023-12-16T20:11:34.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/758: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fe0 [0,4194304] 0 2023-12-16T20:11:34.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/759: dread - d1/d5/d2a/f101 zero size 2023-12-16T20:11:34.966 INFO:tasks.workunit.client.0.smithi038.stdout:7/770: dwrite da/d21/f28 [0,4194304] 0 2023-12-16T20:11:34.966 INFO:tasks.workunit.client.0.smithi038.stdout:7/771: creat da/d21/d2c/d76/d9a/f101 x:0 0 0 2023-12-16T20:11:34.967 INFO:tasks.workunit.client.1.smithi141.stdout:3/481: dwrite d0/d1c/d40/f1b [0,4194304] 0 2023-12-16T20:11:34.967 INFO:tasks.workunit.client.1.smithi141.stdout:3/482: write d0/d1c/d40/d85/d4c/f55 [567818,45934] 0 2023-12-16T20:11:34.967 INFO:tasks.workunit.client.1.smithi141.stdout:3/483: chown d0/d1c/d6a/d76/l78 0 1 2023-12-16T20:11:34.967 INFO:tasks.workunit.client.1.smithi141.stdout:7/370: creat d5/d16/d1a/f76 x:0 0 0 2023-12-16T20:11:34.973 INFO:tasks.workunit.client.0.smithi038.stdout:5/755: creat d2/df/d1a/d1f/d4a/dc8/ff0 x:0 0 0 2023-12-16T20:11:34.973 INFO:tasks.workunit.client.0.smithi038.stdout:5/756: chown d2/df/d87/ca2 26384357 1 2023-12-16T20:11:34.974 INFO:tasks.workunit.client.1.smithi141.stdout:3/484: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:34.975 INFO:tasks.workunit.client.1.smithi141.stdout:3/485: creat d0/d1c/d2c/fa6 x:0 0 0 2023-12-16T20:11:34.975 INFO:tasks.workunit.client.1.smithi141.stdout:3/486: fdatasync d0/d1c/d40/d85/f62 0 2023-12-16T20:11:34.975 INFO:tasks.workunit.client.0.smithi038.stdout:2/760: rename d1/d5/d6c/ff7 to d1/f104 0 2023-12-16T20:11:34.979 INFO:tasks.workunit.client.1.smithi141.stdout:1/473: rename da/df/f24 to da/d1a/d1d/d22/f9b 0 2023-12-16T20:11:34.979 INFO:tasks.workunit.client.1.smithi141.stdout:2/255: dwrite d6/da/d1b/f27 [0,4194304] 0 2023-12-16T20:11:34.981 INFO:tasks.workunit.client.0.smithi038.stdout:5/757: truncate d2/df/d1a/d2a/f68 168912 0 2023-12-16T20:11:34.981 INFO:tasks.workunit.client.0.smithi038.stdout:7/772: getdents da/d21 0 2023-12-16T20:11:34.982 INFO:tasks.workunit.client.1.smithi141.stdout:3/487: chown d0/c47 233406912 1 2023-12-16T20:11:34.983 INFO:tasks.workunit.client.1.smithi141.stdout:3/488: truncate d0/d1c/d40/d3f/d52/f9e 1250500 0 2023-12-16T20:11:34.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/256: mknod d6/da/d4a/c5c 0 2023-12-16T20:11:34.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/257: chown d6/f21 2 1 2023-12-16T20:11:34.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/258: chown d6/d32/f34 460905 1 2023-12-16T20:11:34.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/259: fdatasync d6/d32/f4e 0 2023-12-16T20:11:34.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/260: fsync d6/d12/d1f/f36 0 2023-12-16T20:11:34.988 INFO:tasks.workunit.client.1.smithi141.stdout:2/261: unlink d6/d3a/f50 0 2023-12-16T20:11:34.989 INFO:tasks.workunit.client.0.smithi038.stdout:5/758: symlink d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/dd5/lf1 0 2023-12-16T20:11:34.989 INFO:tasks.workunit.client.1.smithi141.stdout:8/436: sync 2023-12-16T20:11:34.989 INFO:tasks.workunit.client.1.smithi141.stdout:9/387: sync 2023-12-16T20:11:34.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/773: rename da/d21/d2c/d76/fca to da/d21/d86/d92/f102 0 2023-12-16T20:11:34.994 INFO:tasks.workunit.client.0.smithi038.stdout:5/759: unlink d2/df/d1a/d1f/d4a/d53/d6e/d85/f9d 0 2023-12-16T20:11:34.994 INFO:tasks.workunit.client.0.smithi038.stdout:7/774: mknod da/d21/d86/c103 0 2023-12-16T20:11:34.996 INFO:tasks.workunit.client.0.smithi038.stdout:7/775: creat da/dcf/d100/d4d/f104 x:0 0 0 2023-12-16T20:11:34.996 INFO:tasks.workunit.client.0.smithi038.stdout:7/776: fdatasync da/dcf/d100/d4d/dc5/fa8 0 2023-12-16T20:11:34.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/777: truncate da/d21/d61/dcd/d6b/f7f 7258 0 2023-12-16T20:11:35.005 INFO:tasks.workunit.client.1.smithi141.stdout:2/262: dread d6/d32/f57 [0,4194304] 0 2023-12-16T20:11:35.005 INFO:tasks.workunit.client.1.smithi141.stdout:2/263: fdatasync d6/d32/f4e 0 2023-12-16T20:11:35.006 INFO:tasks.workunit.client.1.smithi141.stdout:2/264: rename d6/d12/f55 to d6/da/d1b/f5d 0 2023-12-16T20:11:35.007 INFO:tasks.workunit.client.1.smithi141.stdout:2/265: write d6/d32/f39 [938372,39681] 0 2023-12-16T20:11:35.008 INFO:tasks.workunit.client.1.smithi141.stdout:2/266: rename d6/d12/d3c to d6/da/d4a/d5e 0 2023-12-16T20:11:35.008 INFO:tasks.workunit.client.1.smithi141.stdout:9/388: dread d1/d10/d27/f4b [0,4194304] 0 2023-12-16T20:11:35.009 INFO:tasks.workunit.client.1.smithi141.stdout:9/389: creat d1/d10/d33/f8b x:0 0 0 2023-12-16T20:11:35.025 INFO:tasks.workunit.client.1.smithi141.stdout:9/390: dread d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:35.027 INFO:tasks.workunit.client.1.smithi141.stdout:9/391: link d1/d10/d33/d6a/l7b d1/d10/d33/d6a/d75/l8c 0 2023-12-16T20:11:35.027 INFO:tasks.workunit.client.1.smithi141.stdout:9/392: write d1/d10/d14/f31 [644672,71621] 0 2023-12-16T20:11:35.027 INFO:tasks.workunit.client.1.smithi141.stdout:9/393: dread - d1/d10/d33/d39/f56 zero size 2023-12-16T20:11:35.028 INFO:tasks.workunit.client.1.smithi141.stdout:9/394: stat d1/d10/d27/f79 0 2023-12-16T20:11:35.028 INFO:tasks.workunit.client.1.smithi141.stdout:9/395: read d1/d10/d14/d20/da/f32 [1059333,4477] 0 2023-12-16T20:11:35.028 INFO:tasks.workunit.client.1.smithi141.stdout:5/309: dwrite d0/d14/f37 [0,4194304] 0 2023-12-16T20:11:35.029 INFO:tasks.workunit.client.0.smithi038.stdout:5/760: dread d2/d14/d25/d2d/d17/d55/fbe [0,4194304] 0 2023-12-16T20:11:35.030 INFO:tasks.workunit.client.1.smithi141.stdout:4/379: dwrite d1a/f1b [0,4194304] 0 2023-12-16T20:11:35.030 INFO:tasks.workunit.client.0.smithi038.stdout:5/761: creat d2/d14/d25/d2d/d17/d51/ff2 x:0 0 0 2023-12-16T20:11:35.031 INFO:tasks.workunit.client.1.smithi141.stdout:7/371: dwrite d5/d2a/f2c [0,4194304] 0 2023-12-16T20:11:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/761: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f56 [4194304,4194304] 0 2023-12-16T20:11:35.033 INFO:tasks.workunit.client.1.smithi141.stdout:1/474: dwrite da/d1a/d1d/d33/f4e [0,4194304] 0 2023-12-16T20:11:35.033 INFO:tasks.workunit.client.1.smithi141.stdout:3/489: dwrite d0/d1c/f67 [0,4194304] 0 2023-12-16T20:11:35.034 INFO:tasks.workunit.client.1.smithi141.stdout:8/437: dwrite d14/f43 [0,4194304] 0 2023-12-16T20:11:35.034 INFO:tasks.workunit.client.1.smithi141.stdout:8/438: fdatasync d14/d19/f20 0 2023-12-16T20:11:35.034 INFO:tasks.workunit.client.1.smithi141.stdout:3/490: write d0/d1c/d2c/d72/d74/f94 [394675,115715] 0 2023-12-16T20:11:35.034 INFO:tasks.workunit.client.1.smithi141.stdout:1/475: write da/d36/d4b/d4d/f56 [75445,123883] 0 2023-12-16T20:11:35.034 INFO:tasks.workunit.client.1.smithi141.stdout:3/491: getdents d0/d1c/d40/d3f/d52/d63 0 2023-12-16T20:11:35.035 INFO:tasks.workunit.client.0.smithi038.stdout:7/778: write da/dcf/d100/d4d/dc5/ddc/d8e/f78 [1756580,128812] 0 2023-12-16T20:11:35.037 INFO:tasks.workunit.client.0.smithi038.stdout:2/762: mknod d1/d5/d2a/d31/d60/ded/dee/c105 0 2023-12-16T20:11:35.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/779: link da/dcf/d100/d4d/dc5/cc7 da/dcf/d100/d4d/dc5/ddc/d8e/c105 0 2023-12-16T20:11:35.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/780: write da/dcf/d100/d4d/dae/fd7 [579486,119517] 0 2023-12-16T20:11:35.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/781: dread - da/dcf/d100/d4d/dc5/d38/fc6 zero size 2023-12-16T20:11:35.044 INFO:tasks.workunit.client.1.smithi141.stdout:7/372: getdents d5/d16/d30/d36 0 2023-12-16T20:11:35.044 INFO:tasks.workunit.client.1.smithi141.stdout:0/378: sync 2023-12-16T20:11:35.044 INFO:tasks.workunit.client.1.smithi141.stdout:0/379: fdatasync d4/f16 0 2023-12-16T20:11:35.046 INFO:tasks.workunit.client.1.smithi141.stdout:4/380: dread d1a/f20 [0,4194304] 0 2023-12-16T20:11:35.048 INFO:tasks.workunit.client.1.smithi141.stdout:8/439: write d14/d35/f66 [3707064,129078] 0 2023-12-16T20:11:35.050 INFO:tasks.workunit.client.0.smithi038.stdout:7/782: getdents da/dcf/d100/d4d 0 2023-12-16T20:11:35.053 INFO:tasks.workunit.client.1.smithi141.stdout:1/476: mknod da/d1a/d1d/d33/c9c 0 2023-12-16T20:11:35.053 INFO:tasks.workunit.client.1.smithi141.stdout:1/477: fdatasync da/d1a/f7b 0 2023-12-16T20:11:35.053 INFO:tasks.workunit.client.0.smithi038.stdout:2/763: write d1/d5/d95/d61/dd4/d21/f45 [2486929,29379] 0 2023-12-16T20:11:35.054 INFO:tasks.workunit.client.0.smithi038.stdout:7/783: mkdir da/d21/d2c/d106 0 2023-12-16T20:11:35.055 INFO:tasks.workunit.client.1.smithi141.stdout:3/492: mknod d0/d1c/d2c/ca7 0 2023-12-16T20:11:35.055 INFO:tasks.workunit.client.1.smithi141.stdout:3/493: truncate d0/d1c/d2c/d72/d74/f97 674451 0 2023-12-16T20:11:35.056 INFO:tasks.workunit.client.0.smithi038.stdout:2/764: symlink d1/d5/d95/d61/dd4/d6a/dfb/l106 0 2023-12-16T20:11:35.056 INFO:tasks.workunit.client.0.smithi038.stdout:2/765: dread - d1/d5/d95/fb7 zero size 2023-12-16T20:11:35.057 INFO:tasks.workunit.client.1.smithi141.stdout:9/396: getdents d1/d10/d33 0 2023-12-16T20:11:35.057 INFO:tasks.workunit.client.1.smithi141.stdout:9/397: write d1/d10/f6c [588916,117211] 0 2023-12-16T20:11:35.058 INFO:tasks.workunit.client.1.smithi141.stdout:0/380: dread d4/d5c/f72 [0,4194304] 0 2023-12-16T20:11:35.058 INFO:tasks.workunit.client.1.smithi141.stdout:0/381: readlink d4/l61 0 2023-12-16T20:11:35.058 INFO:tasks.workunit.client.0.smithi038.stdout:7/784: symlink da/d21/d2c/l107 0 2023-12-16T20:11:35.061 INFO:tasks.workunit.client.0.smithi038.stdout:5/762: dwrite d2/df/d1a/d2a/f75 [0,4194304] 0 2023-12-16T20:11:35.062 INFO:tasks.workunit.client.0.smithi038.stdout:2/766: creat d1/d5/d95/d61/d66/ddd/de8/dea/f107 x:0 0 0 2023-12-16T20:11:35.062 INFO:tasks.workunit.client.1.smithi141.stdout:4/381: write d1a/d3c/f5d [2558924,21338] 0 2023-12-16T20:11:35.065 INFO:tasks.workunit.client.0.smithi038.stdout:7/785: symlink da/dcf/d100/d4d/dae/l108 0 2023-12-16T20:11:35.068 INFO:tasks.workunit.client.0.smithi038.stdout:5/763: creat d2/df/d1a/d2a/d59/ff3 x:0 0 0 2023-12-16T20:11:35.069 INFO:tasks.workunit.client.1.smithi141.stdout:8/440: rename d14/d71/d81/f34 to d14/d19/d1b/d24/d4a/d5b/f89 0 2023-12-16T20:11:35.069 INFO:tasks.workunit.client.0.smithi038.stdout:2/767: unlink d1/d5/d95/d61/dd4/d21/d82/l65 0 2023-12-16T20:11:35.070 INFO:tasks.workunit.client.1.smithi141.stdout:5/310: dwrite d0/d14/f23 [0,4194304] 0 2023-12-16T20:11:35.072 INFO:tasks.workunit.client.0.smithi038.stdout:5/764: rmdir d2/d14/d25/d2d 39 2023-12-16T20:11:35.072 INFO:tasks.workunit.client.0.smithi038.stdout:5/765: chown d2/df/d1a/d1f/d4a 898805369 1 2023-12-16T20:11:35.074 INFO:tasks.workunit.client.0.smithi038.stdout:7/786: dread f6 [0,4194304] 0 2023-12-16T20:11:35.074 INFO:tasks.workunit.client.0.smithi038.stdout:2/768: rename d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fe0 to d1/d5/d95/d61/dd4/d10/f108 0 2023-12-16T20:11:35.074 INFO:tasks.workunit.client.1.smithi141.stdout:2/267: dwrite d6/da/f49 [4194304,4194304] 0 2023-12-16T20:11:35.074 INFO:tasks.workunit.client.1.smithi141.stdout:3/494: mknod d0/d1c/d6a/d76/da2/ca8 0 2023-12-16T20:11:35.074 INFO:tasks.workunit.client.1.smithi141.stdout:9/398: truncate d1/d10/f22 1203623 0 2023-12-16T20:11:35.075 INFO:tasks.workunit.client.0.smithi038.stdout:7/787: link da/dcf/lf7 da/d21/d2c/d106/l109 0 2023-12-16T20:11:35.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/769: rmdir d1/d5/d95/d61/dd4/d6d 39 2023-12-16T20:11:35.076 INFO:tasks.workunit.client.1.smithi141.stdout:8/441: creat d14/d19/d1b/f8a x:0 0 0 2023-12-16T20:11:35.077 INFO:tasks.workunit.client.1.smithi141.stdout:1/478: getdents da/d1a/d31/d81 0 2023-12-16T20:11:35.078 INFO:tasks.workunit.client.0.smithi038.stdout:7/788: creat da/d21/d86/f10a x:0 0 0 2023-12-16T20:11:35.081 INFO:tasks.workunit.client.1.smithi141.stdout:7/373: dwrite d5/d16/f75 [4194304,4194304] 0 2023-12-16T20:11:35.082 INFO:tasks.workunit.client.1.smithi141.stdout:5/311: link d0/d9/f15 d0/d14/d2c/f68 0 2023-12-16T20:11:35.083 INFO:tasks.workunit.client.0.smithi038.stdout:5/766: dread f0 [4194304,4194304] 0 2023-12-16T20:11:35.084 INFO:tasks.workunit.client.0.smithi038.stdout:5/767: dread - d2/d4/f58 zero size 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.1.smithi141.stdout:2/268: mkdir d6/da/d33/d4f/d5f 0 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.1.smithi141.stdout:2/269: chown d6/c10 7 1 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.1.smithi141.stdout:2/270: readlink d6/d3a/l2a 0 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.0.smithi038.stdout:0/749: sync 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/608: sync 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.0.smithi038.stdout:3/696: sync 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.0.smithi038.stdout:5/768: rename d2/df/d1a/d1f/d4a/d53/d6e/c71 to d2/df/d1a/d1f/d4a/cf4 0 2023-12-16T20:11:35.087 INFO:tasks.workunit.client.0.smithi038.stdout:5/769: fsync d2/df/d1a/d2a/d59/f6f 0 2023-12-16T20:11:35.090 INFO:tasks.workunit.client.1.smithi141.stdout:3/495: mkdir d0/d1c/da9 0 2023-12-16T20:11:35.090 INFO:tasks.workunit.client.1.smithi141.stdout:3/496: readlink d0/d1c/d6a/d76/l88 0 2023-12-16T20:11:35.090 INFO:tasks.workunit.client.0.smithi038.stdout:3/697: creat d4/d67/de1/d4c/dae/ff0 x:0 0 0 2023-12-16T20:11:35.091 INFO:tasks.workunit.client.0.smithi038.stdout:2/770: dread d1/d5/d95/d61/dd4/d21/d82/fba [0,4194304] 0 2023-12-16T20:11:35.091 INFO:tasks.workunit.client.1.smithi141.stdout:9/399: mkdir d1/d10/d33/d47/d8d 0 2023-12-16T20:11:35.091 INFO:tasks.workunit.client.1.smithi141.stdout:9/400: chown d1/d10/d14/c42 25019822 1 2023-12-16T20:11:35.091 INFO:tasks.workunit.client.1.smithi141.stdout:9/401: readlink d1/l7 0 2023-12-16T20:11:35.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/609: rename d17/d1b/d66/d73/d55/da5/da6/db5 to d17/d1b/d25/db7/d82/da9/d50/dc4 0 2023-12-16T20:11:35.094 INFO:tasks.workunit.client.0.smithi038.stdout:5/770: link d2/df/d1a/d1f/d4a/cae d2/d14/d25/d2d/d4b/cf5 0 2023-12-16T20:11:35.095 INFO:tasks.workunit.client.1.smithi141.stdout:0/382: symlink d4/d7/l8b 0 2023-12-16T20:11:35.095 INFO:tasks.workunit.client.1.smithi141.stdout:0/383: readlink d4/d74/l7c 0 2023-12-16T20:11:35.096 INFO:tasks.workunit.client.0.smithi038.stdout:0/750: rmdir db/d16/d70 39 2023-12-16T20:11:35.103 INFO:tasks.workunit.client.0.smithi038.stdout:3/698: mkdir d4/dcd/d9a/dda/df1 0 2023-12-16T20:11:35.103 INFO:tasks.workunit.client.1.smithi141.stdout:4/382: link d1a/f1c d1a/d54/f98 0 2023-12-16T20:11:35.103 INFO:tasks.workunit.client.1.smithi141.stdout:9/402: dread d1/d10/d14/d20/da/f41 [0,4194304] 0 2023-12-16T20:11:35.103 INFO:tasks.workunit.client.1.smithi141.stdout:8/442: mkdir d14/d19/d1b/d24/d4a/d58/d8b 0 2023-12-16T20:11:35.106 INFO:tasks.workunit.client.0.smithi038.stdout:5/771: mkdir d2/d14/d25/d2d/d4b/d8b/df6 0 2023-12-16T20:11:35.106 INFO:tasks.workunit.client.0.smithi038.stdout:5/772: dread - d2/df/d1a/d1f/d4a/d53/fa5 zero size 2023-12-16T20:11:35.109 INFO:tasks.workunit.client.0.smithi038.stdout:7/789: dwrite da/dcf/fdb [0,4194304] 0 2023-12-16T20:11:35.109 INFO:tasks.workunit.client.1.smithi141.stdout:1/479: mkdir da/d36/d4b/d4d/d80/d94/d9d 0 2023-12-16T20:11:35.111 INFO:tasks.workunit.client.0.smithi038.stdout:2/771: rename d1/d5/d6c/d91 to d1/d5/d95/d61/dd4/d10/d109 0 2023-12-16T20:11:35.112 INFO:tasks.workunit.client.0.smithi038.stdout:2/772: dread d1/d5/d95/d61/dd4/d21/d9a/db9/f64 [0,4194304] 0 2023-12-16T20:11:35.112 INFO:tasks.workunit.client.0.smithi038.stdout:2/773: chown d1/d5/d95/d61/d66/ddd 19810 1 2023-12-16T20:11:35.114 INFO:tasks.workunit.client.1.smithi141.stdout:2/271: creat d6/d3a/d47/f60 x:0 0 0 2023-12-16T20:11:35.115 INFO:tasks.workunit.client.0.smithi038.stdout:7/790: rename da/d21/d2c/d76/fad to da/d21/f10b 0 2023-12-16T20:11:35.117 INFO:tasks.workunit.client.1.smithi141.stdout:5/312: dwrite d0/d14/f37 [0,4194304] 0 2023-12-16T20:11:35.118 INFO:tasks.workunit.client.1.smithi141.stdout:0/384: unlink d4/l4c 0 2023-12-16T20:11:35.119 INFO:tasks.workunit.client.1.smithi141.stdout:9/403: mknod d1/d10/d27/d36/c8e 0 2023-12-16T20:11:35.119 INFO:tasks.workunit.client.1.smithi141.stdout:9/404: fdatasync d1/d10/d14/f71 0 2023-12-16T20:11:35.119 INFO:tasks.workunit.client.1.smithi141.stdout:1/480: chown da/d67/f2f 948 1 2023-12-16T20:11:35.120 INFO:tasks.workunit.client.1.smithi141.stdout:7/374: getdents d5/d1d/d1e/d27 0 2023-12-16T20:11:35.121 INFO:tasks.workunit.client.1.smithi141.stdout:2/272: symlink d6/d3a/d47/d58/l61 0 2023-12-16T20:11:35.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/773: write d2/df/d1a/d2a/f3a [1817056,75530] 0 2023-12-16T20:11:35.122 INFO:tasks.workunit.client.1.smithi141.stdout:3/497: link d0/d1c/d40/c2b d0/d1c/d40/d3f/d52/d5d/caa 0 2023-12-16T20:11:35.122 INFO:tasks.workunit.client.1.smithi141.stdout:9/405: dread d1/d10/f12 [0,4194304] 0 2023-12-16T20:11:35.123 INFO:tasks.workunit.client.1.smithi141.stdout:0/385: unlink d4/l61 0 2023-12-16T20:11:35.123 INFO:tasks.workunit.client.1.smithi141.stdout:0/386: chown d4/d7/f24 99440 1 2023-12-16T20:11:35.123 INFO:tasks.workunit.client.1.smithi141.stdout:1/481: truncate da/d1a/d1d/d22/f9b 1171200 0 2023-12-16T20:11:35.125 INFO:tasks.workunit.client.1.smithi141.stdout:7/375: creat d5/d16/d30/d4e/d6e/f77 x:0 0 0 2023-12-16T20:11:35.125 INFO:tasks.workunit.client.1.smithi141.stdout:7/376: fdatasync d5/d2a/f60 0 2023-12-16T20:11:35.129 INFO:tasks.workunit.client.1.smithi141.stdout:9/406: stat d1/d10/d33/d6a/l7b 0 2023-12-16T20:11:35.129 INFO:tasks.workunit.client.1.smithi141.stdout:2/273: unlink d6/da/d1b/f42 0 2023-12-16T20:11:35.129 INFO:tasks.workunit.client.1.smithi141.stdout:0/387: creat d4/d49/d73/d3b/d78/d7f/f8c x:0 0 0 2023-12-16T20:11:35.130 INFO:tasks.workunit.client.0.smithi038.stdout:5/774: creat d2/d14/d25/d2d/d17/d51/de9/ff7 x:0 0 0 2023-12-16T20:11:35.130 INFO:tasks.workunit.client.0.smithi038.stdout:5/775: truncate d2/d14/d25/d2d/d17/fd2 655955 0 2023-12-16T20:11:35.130 INFO:tasks.workunit.client.1.smithi141.stdout:2/274: mknod d6/da/d33/d4f/d5f/c62 0 2023-12-16T20:11:35.131 INFO:tasks.workunit.client.1.smithi141.stdout:2/275: chown d6/d32/d52/d53 4583958 1 2023-12-16T20:11:35.131 INFO:tasks.workunit.client.1.smithi141.stdout:9/407: creat d1/d10/d33/d47/d83/f8f x:0 0 0 2023-12-16T20:11:35.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/610: dwrite f16 [0,4194304] 0 2023-12-16T20:11:35.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/611: stat d17/d1b/d25/db7/d82 0 2023-12-16T20:11:35.133 INFO:tasks.workunit.client.1.smithi141.stdout:9/408: mkdir d1/d10/d14/d20/d90 0 2023-12-16T20:11:35.133 INFO:tasks.workunit.client.1.smithi141.stdout:9/409: stat d1/d10/d33/d39/f40 0 2023-12-16T20:11:35.133 INFO:tasks.workunit.client.0.smithi038.stdout:0/751: dwrite db/d16/d5a/d65/de8/f59 [0,4194304] 0 2023-12-16T20:11:35.133 INFO:tasks.workunit.client.0.smithi038.stdout:0/752: dread - db/d16/d19/d27/ff3 zero size 2023-12-16T20:11:35.135 INFO:tasks.workunit.client.0.smithi038.stdout:5/776: creat d2/d14/d25/d2d/d17/d93/ff8 x:0 0 0 2023-12-16T20:11:35.135 INFO:tasks.workunit.client.0.smithi038.stdout:5/777: chown d2/d14/d25/d2d/d17/d51/d7b/d89/de4 2931 1 2023-12-16T20:11:35.136 INFO:tasks.workunit.client.0.smithi038.stdout:2/774: dread d1/d5/d95/d61/dd4/d21/f45 [0,4194304] 0 2023-12-16T20:11:35.137 INFO:tasks.workunit.client.0.smithi038.stdout:0/753: read db/d16/d5a/d65/de8/f3a [593182,4765] 0 2023-12-16T20:11:35.138 INFO:tasks.workunit.client.1.smithi141.stdout:5/313: dread d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:35.139 INFO:tasks.workunit.client.0.smithi038.stdout:8/612: rename d17/d1b/d25/db7/d82/da9/d50/d7d/fbd to d17/d1b/d25/db7/d82/da9/d50/dc4/fc5 0 2023-12-16T20:11:35.140 INFO:tasks.workunit.client.0.smithi038.stdout:3/699: dwrite d4/d6c/d80/f83 [0,4194304] 0 2023-12-16T20:11:35.141 INFO:tasks.workunit.client.1.smithi141.stdout:5/314: symlink d0/d25/d30/l69 0 2023-12-16T20:11:35.142 INFO:tasks.workunit.client.0.smithi038.stdout:2/775: creat d1/d5/d95/d61/dd4/d6d/d72/f10a x:0 0 0 2023-12-16T20:11:35.144 INFO:tasks.workunit.client.0.smithi038.stdout:0/754: rmdir db/d16/d5a 39 2023-12-16T20:11:35.144 INFO:tasks.workunit.client.0.smithi038.stdout:0/755: read - db/d16/d1c/fc0 zero size 2023-12-16T20:11:35.145 INFO:tasks.workunit.client.0.smithi038.stdout:0/756: fsync db/d16/d19/d27/d56/f8a 0 2023-12-16T20:11:35.145 INFO:tasks.workunit.client.0.smithi038.stdout:0/757: stat db/d16/d5a/d65/de8/f7b 0 2023-12-16T20:11:35.146 INFO:tasks.workunit.client.1.smithi141.stdout:0/388: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:35.146 INFO:tasks.workunit.client.1.smithi141.stdout:0/389: readlink d4/l28 0 2023-12-16T20:11:35.146 INFO:tasks.workunit.client.1.smithi141.stdout:2/276: dread d6/da/d33/f3e [0,4194304] 0 2023-12-16T20:11:35.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/613: rename d17/d1b/d25/db7/f31 to d17/d1b/d57/d90/fc6 0 2023-12-16T20:11:35.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/614: truncate d17/d1b/d25/fc3 825389 0 2023-12-16T20:11:35.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/615: truncate d17/d1b/d66/f94 802282 0 2023-12-16T20:11:35.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/616: fdatasync d17/d1b/d25/f6b 0 2023-12-16T20:11:35.148 INFO:tasks.workunit.client.1.smithi141.stdout:0/390: link d4/l32 d4/d74/l8d 0 2023-12-16T20:11:35.149 INFO:tasks.workunit.client.0.smithi038.stdout:3/700: mknod d4/dcd/cf2 0 2023-12-16T20:11:35.149 INFO:tasks.workunit.client.0.smithi038.stdout:3/701: creat d4/d8/d15/d6d/d7a/d98/ff3 x:0 0 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/277: creat d6/d12/d1f/d46/f63 x:0 0 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/278: truncate d6/d32/f34 242058 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/279: chown d6/l8 8187 1 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/280: stat d6/d32/f39 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/281: write d6/da/d1b/f5d [609812,38363] 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.0.smithi038.stdout:0/758: mkdir db/d16/d5a/d65/de8/d77/d95/d9e/df9 0 2023-12-16T20:11:35.151 INFO:tasks.workunit.client.0.smithi038.stdout:0/759: readlink db/d16/d1c/laa 0 2023-12-16T20:11:35.154 INFO:tasks.workunit.client.0.smithi038.stdout:3/702: rmdir d4/d6c/d80/da8 39 2023-12-16T20:11:35.155 INFO:tasks.workunit.client.0.smithi038.stdout:3/703: write d4/fed [652946,46529] 0 2023-12-16T20:11:35.158 INFO:tasks.workunit.client.0.smithi038.stdout:3/704: rename d4/d6c/d80/ce5 to d4/d8/d15/d6d/d7a/cf4 0 2023-12-16T20:11:35.159 INFO:tasks.workunit.client.1.smithi141.stdout:0/391: read d4/d5c/f72 [3884328,68999] 0 2023-12-16T20:11:35.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/705: mknod d4/dcd/d9a/dda/cf5 0 2023-12-16T20:11:35.160 INFO:tasks.workunit.client.1.smithi141.stdout:0/392: mknod d4/d49/d73/d3b/c8e 0 2023-12-16T20:11:35.160 INFO:tasks.workunit.client.1.smithi141.stdout:0/393: readlink d4/d49/d4b/l86 0 2023-12-16T20:11:35.160 INFO:tasks.workunit.client.1.smithi141.stdout:5/315: dread d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:35.161 INFO:tasks.workunit.client.0.smithi038.stdout:3/706: creat d4/d67/de1/ddd/ff6 x:0 0 0 2023-12-16T20:11:35.163 INFO:tasks.workunit.client.1.smithi141.stdout:0/394: mkdir d4/d49/d8f 0 2023-12-16T20:11:35.164 INFO:tasks.workunit.client.0.smithi038.stdout:3/707: rmdir d4/d8/dc8 39 2023-12-16T20:11:35.164 INFO:tasks.workunit.client.1.smithi141.stdout:0/395: truncate d4/d49/d73/d3b/f59 487068 0 2023-12-16T20:11:35.165 INFO:tasks.workunit.client.1.smithi141.stdout:0/396: creat d4/d49/d73/d3b/d78/d7f/f90 x:0 0 0 2023-12-16T20:11:35.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/708: creat d4/d27/d23/db6/ff7 x:0 0 0 2023-12-16T20:11:35.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/709: readlink d4/d27/l82 0 2023-12-16T20:11:35.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/710: fsync d4/d27/d23/d6e/f87 0 2023-12-16T20:11:35.165 INFO:tasks.workunit.client.0.smithi038.stdout:3/711: fdatasync d4/d67/de1/fd4 0 2023-12-16T20:11:35.166 INFO:tasks.workunit.client.0.smithi038.stdout:3/712: rmdir d4/d6c/d80/da8 39 2023-12-16T20:11:35.166 INFO:tasks.workunit.client.0.smithi038.stdout:7/791: dwrite da/d21/d61/fc3 [0,4194304] 0 2023-12-16T20:11:35.167 INFO:tasks.workunit.client.1.smithi141.stdout:0/397: creat d4/d49/d73/d8a/f91 x:0 0 0 2023-12-16T20:11:35.167 INFO:tasks.workunit.client.1.smithi141.stdout:0/398: dread - d4/d49/d4b/f66 zero size 2023-12-16T20:11:35.168 INFO:tasks.workunit.client.0.smithi038.stdout:2/776: dread d1/d5/d16/f3b [0,4194304] 0 2023-12-16T20:11:35.169 INFO:tasks.workunit.client.0.smithi038.stdout:2/777: truncate d1/d5/d95/d61/dd4/d21/d82/d92/fe2 890154 0 2023-12-16T20:11:35.169 INFO:tasks.workunit.client.0.smithi038.stdout:2/778: chown d1/d5/d95/d61/dd4/d21/d9a/db9/c3e 920111 1 2023-12-16T20:11:35.169 INFO:tasks.workunit.client.0.smithi038.stdout:2/779: dread - d1/d5/fd7 zero size 2023-12-16T20:11:35.170 INFO:tasks.workunit.client.0.smithi038.stdout:8/617: dwrite d17/d1b/d25/f3c [0,4194304] 0 2023-12-16T20:11:35.171 INFO:tasks.workunit.client.1.smithi141.stdout:9/410: dwrite d1/d10/f22 [0,4194304] 0 2023-12-16T20:11:35.171 INFO:tasks.workunit.client.1.smithi141.stdout:9/411: chown d1/d10/d27/f4b 2 1 2023-12-16T20:11:35.173 INFO:tasks.workunit.client.1.smithi141.stdout:0/399: dread d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:35.173 INFO:tasks.workunit.client.1.smithi141.stdout:7/377: dwrite d5/d16/f3c [0,4194304] 0 2023-12-16T20:11:35.174 INFO:tasks.workunit.client.1.smithi141.stdout:3/498: dwrite d0/d1c/d40/d85/f53 [0,4194304] 0 2023-12-16T20:11:35.177 INFO:tasks.workunit.client.1.smithi141.stdout:0/400: symlink d4/d49/d73/d3b/l92 0 2023-12-16T20:11:35.177 INFO:tasks.workunit.client.1.smithi141.stdout:0/401: write d4/d49/d73/d3b/d78/f4f [1751819,117984] 0 2023-12-16T20:11:35.180 INFO:tasks.workunit.client.1.smithi141.stdout:7/378: mknod d5/d1d/d1e/d71/c78 0 2023-12-16T20:11:35.180 INFO:tasks.workunit.client.1.smithi141.stdout:7/379: chown d5/d16/f56 328514188 1 2023-12-16T20:11:35.182 INFO:tasks.workunit.client.0.smithi038.stdout:3/713: link d4/d8/dc8/fdb d4/d67/ff8 0 2023-12-16T20:11:35.182 INFO:tasks.workunit.client.0.smithi038.stdout:3/714: dread - d4/d67/de1/d4c/dae/ff0 zero size 2023-12-16T20:11:35.182 INFO:tasks.workunit.client.0.smithi038.stdout:3/715: fsync d4/d8/f43 0 2023-12-16T20:11:35.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/792: chown da/l44 2 1 2023-12-16T20:11:35.184 INFO:tasks.workunit.client.0.smithi038.stdout:1/719: sync 2023-12-16T20:11:35.185 INFO:tasks.workunit.client.0.smithi038.stdout:1/720: write d15/d1e/d3b/d48/d37/dde/fc5 [992529,25310] 0 2023-12-16T20:11:35.185 INFO:tasks.workunit.client.0.smithi038.stdout:1/721: write d15/d22/d52/f89 [1181327,20517] 0 2023-12-16T20:11:35.185 INFO:tasks.workunit.client.0.smithi038.stdout:1/722: fsync d15/d1e/d23/d34/d86/fa0 0 2023-12-16T20:11:35.185 INFO:tasks.workunit.client.1.smithi141.stdout:3/499: rename d0/l2d to d0/d1c/d2c/d72/lab 0 2023-12-16T20:11:35.186 INFO:tasks.workunit.client.0.smithi038.stdout:8/618: mknod d17/d1b/d25/db7/d82/da9/d59/cc7 0 2023-12-16T20:11:35.186 INFO:tasks.workunit.client.0.smithi038.stdout:8/619: chown d17/d1b/d25/f6b 107 1 2023-12-16T20:11:35.187 INFO:tasks.workunit.client.1.smithi141.stdout:0/402: mknod d4/d49/d73/d3b/d78/d7f/d80/d83/c93 0 2023-12-16T20:11:35.188 INFO:tasks.workunit.client.0.smithi038.stdout:3/716: mknod d4/d67/de1/d4c/d70/d71/db9/cf9 0 2023-12-16T20:11:35.188 INFO:tasks.workunit.client.0.smithi038.stdout:3/717: readlink d4/d67/de1/l2f 0 2023-12-16T20:11:35.189 INFO:tasks.workunit.client.0.smithi038.stdout:8/620: mkdir d17/d1b/d66/d73/dc8 0 2023-12-16T20:11:35.190 INFO:tasks.workunit.client.0.smithi038.stdout:1/723: dread d15/d1e/d23/f78 [0,4194304] 0 2023-12-16T20:11:35.190 INFO:tasks.workunit.client.0.smithi038.stdout:1/724: getdents d15/d1e/d3b/dbb 0 2023-12-16T20:11:35.191 INFO:tasks.workunit.client.0.smithi038.stdout:8/621: symlink d17/d1b/d53/lc9 0 2023-12-16T20:11:35.192 INFO:tasks.workunit.client.0.smithi038.stdout:8/622: readlink d17/d1b/d66/d73/l7a 0 2023-12-16T20:11:35.192 INFO:tasks.workunit.client.1.smithi141.stdout:5/316: dwrite d0/d14/d2c/f33 [0,4194304] 0 2023-12-16T20:11:35.192 INFO:tasks.workunit.client.1.smithi141.stdout:3/500: getdents d0/d1c/d40/d85 0 2023-12-16T20:11:35.196 INFO:tasks.workunit.client.0.smithi038.stdout:8/623: symlink d17/d1b/d25/db7/d82/da9/d50/lca 0 2023-12-16T20:11:35.198 INFO:tasks.workunit.client.1.smithi141.stdout:0/403: getdents d4 0 2023-12-16T20:11:35.200 INFO:tasks.workunit.client.1.smithi141.stdout:0/404: creat d4/d49/d8f/f94 x:0 0 0 2023-12-16T20:11:35.202 INFO:tasks.workunit.client.0.smithi038.stdout:3/718: dread d4/d67/ff8 [0,4194304] 0 2023-12-16T20:11:35.203 INFO:tasks.workunit.client.0.smithi038.stdout:9/728: sync 2023-12-16T20:11:35.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/670: sync 2023-12-16T20:11:35.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/671: stat d13/d17/d4b/da4/d34/l99 0 2023-12-16T20:11:35.203 INFO:tasks.workunit.client.0.smithi038.stdout:6/653: sync 2023-12-16T20:11:35.204 INFO:tasks.workunit.client.0.smithi038.stdout:6/654: readlink d1/d4/d1d/d28/l82 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.0.smithi038.stdout:1/725: dread d15/d1e/d23/d34/f7a [0,4194304] 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.0.smithi038.stdout:2/780: dwrite d1/d5/d95/fb7 [0,4194304] 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.0.smithi038.stdout:3/719: creat d4/d27/d2b/ffa x:0 0 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.0.smithi038.stdout:2/781: stat d1/d5/d16/c20 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.1.smithi141.stdout:0/405: rename d4/d49/d73/d3b/f58 to d4/d49/d73/d3b/d78/d7f/d80/d83/f95 0 2023-12-16T20:11:35.206 INFO:tasks.workunit.client.1.smithi141.stdout:0/406: stat d4/d49/d4b/l57 0 2023-12-16T20:11:35.207 INFO:tasks.workunit.client.0.smithi038.stdout:2/782: dread d1/d5/d95/d61/dd4/d21/d82/d92/fe2 [0,4194304] 0 2023-12-16T20:11:35.207 INFO:tasks.workunit.client.0.smithi038.stdout:2/783: fdatasync d1/d5/d95/d61/dd4/d6d/d72/f10a 0 2023-12-16T20:11:35.208 INFO:tasks.workunit.client.1.smithi141.stdout:0/407: stat d4/d5c/l65 0 2023-12-16T20:11:35.208 INFO:tasks.workunit.client.0.smithi038.stdout:9/729: link d9/d1f/d21/d3e/d4e/d61/f99 d9/d1e/d40/d5e/d71/d83/da1/fe0 0 2023-12-16T20:11:35.209 INFO:tasks.workunit.client.1.smithi141.stdout:9/412: dwrite d1/d10/d33/d39/f40 [0,4194304] 0 2023-12-16T20:11:35.210 INFO:tasks.workunit.client.1.smithi141.stdout:9/413: creat d1/d26/f91 x:0 0 0 2023-12-16T20:11:35.211 INFO:tasks.workunit.client.0.smithi038.stdout:4/672: unlink d13/d17/d2e/d32/fa7 0 2023-12-16T20:11:35.212 INFO:tasks.workunit.client.0.smithi038.stdout:6/655: creat d1/d5b/d7d/dc6/fcb x:0 0 0 2023-12-16T20:11:35.212 INFO:tasks.workunit.client.0.smithi038.stdout:6/656: write d1/d4/f8 [7601069,8358] 0 2023-12-16T20:11:35.215 INFO:tasks.workunit.client.0.smithi038.stdout:1/726: link d15/d1e/d23/da2/fa7 d15/d1e/d23/d46/ff9 0 2023-12-16T20:11:35.216 INFO:tasks.workunit.client.0.smithi038.stdout:1/727: chown d15/d1e/d3b/d48/d3d/ca3 8306 1 2023-12-16T20:11:35.216 INFO:tasks.workunit.client.0.smithi038.stdout:3/720: unlink d4/f6 0 2023-12-16T20:11:35.217 INFO:tasks.workunit.client.0.smithi038.stdout:3/721: stat d4/d27/d2b/c31 0 2023-12-16T20:11:35.218 INFO:tasks.workunit.client.0.smithi038.stdout:2/784: stat d1/d5/d95/d61/dd4/d6a/dfb 0 2023-12-16T20:11:35.218 INFO:tasks.workunit.client.0.smithi038.stdout:2/785: stat d1/d5/cb 0 2023-12-16T20:11:35.223 INFO:tasks.workunit.client.0.smithi038.stdout:1/728: truncate f11 3860421 0 2023-12-16T20:11:35.225 INFO:tasks.workunit.client.0.smithi038.stdout:3/722: link d4/d27/d40/fac d4/d8/d15/d6d/ffb 0 2023-12-16T20:11:35.225 INFO:tasks.workunit.client.0.smithi038.stdout:2/786: symlink d1/l10b 0 2023-12-16T20:11:35.225 INFO:tasks.workunit.client.0.smithi038.stdout:2/787: read - d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f8d zero size 2023-12-16T20:11:35.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/729: getdents d15/d1e/d3b/d48/d37/deb 0 2023-12-16T20:11:35.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/730: fsync f7 0 2023-12-16T20:11:35.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/731: creat d15/d1e/d23/d34/d86/d99/ffa x:0 0 0 2023-12-16T20:11:35.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/732: stat d15/d1e/d23/d34/f38 0 2023-12-16T20:11:35.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/733: rename d15/d1e/d3b/fcc to d15/d22/d7b/ffb 0 2023-12-16T20:11:35.228 INFO:tasks.workunit.client.0.smithi038.stdout:1/734: creat d15/d1e/d30/ffc x:0 0 0 2023-12-16T20:11:35.229 INFO:tasks.workunit.client.0.smithi038.stdout:1/735: write d15/d1e/d3b/d5a/f9e [698009,8116] 0 2023-12-16T20:11:35.229 INFO:tasks.workunit.client.0.smithi038.stdout:2/788: dread d1/d5/d3d/fda [0,4194304] 0 2023-12-16T20:11:35.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/736: mkdir d15/d1e/d3b/dfd 0 2023-12-16T20:11:35.234 INFO:tasks.workunit.client.0.smithi038.stdout:7/793: dwrite da/d21/d86/fb0 [0,4194304] 0 2023-12-16T20:11:35.234 INFO:tasks.workunit.client.0.smithi038.stdout:7/794: chown da/d21/f55 223787443 1 2023-12-16T20:11:35.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/789: unlink d1/d5/d95/d61/dd4/d6a/l8f 0 2023-12-16T20:11:35.236 INFO:tasks.workunit.client.0.smithi038.stdout:7/795: rmdir da/dcf/d100/d4d/dc5/d38/d65 39 2023-12-16T20:11:35.240 INFO:tasks.workunit.client.0.smithi038.stdout:3/723: write f1 [5353658,26084] 0 2023-12-16T20:11:35.242 INFO:tasks.workunit.client.0.smithi038.stdout:3/724: symlink d4/dcd/dcc/lfc 0 2023-12-16T20:11:35.243 INFO:tasks.workunit.client.0.smithi038.stdout:3/725: mkdir d4/d6c/da7/dfd 0 2023-12-16T20:11:35.244 INFO:tasks.workunit.client.0.smithi038.stdout:1/737: dread d15/d1e/d3b/d48/f97 [4194304,4194304] 0 2023-12-16T20:11:35.244 INFO:tasks.workunit.client.0.smithi038.stdout:7/796: dread da/dcf/d100/d4d/dc5/d38/f8d [0,4194304] 0 2023-12-16T20:11:35.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/726: link d4/d27/ca5 d4/d8/d15/d6d/cfe 0 2023-12-16T20:11:35.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/727: chown d4/d6c/da7/dfd 78372 1 2023-12-16T20:11:35.246 INFO:tasks.workunit.client.0.smithi038.stdout:1/738: mknod d15/d1e/d23/d7d/cfe 0 2023-12-16T20:11:35.248 INFO:tasks.workunit.client.1.smithi141.stdout:5/317: dwrite d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:35.248 INFO:tasks.workunit.client.0.smithi038.stdout:7/797: rmdir da/d21/d2c/d76/dc9/de6 0 2023-12-16T20:11:35.249 INFO:tasks.workunit.client.0.smithi038.stdout:8/624: dwrite d17/d1b/d25/f3c [0,4194304] 0 2023-12-16T20:11:35.249 INFO:tasks.workunit.client.1.smithi141.stdout:7/380: dwrite d5/d2a/f3e [0,4194304] 0 2023-12-16T20:11:35.249 INFO:tasks.workunit.client.1.smithi141.stdout:7/381: fdatasync d5/f11 0 2023-12-16T20:11:35.251 INFO:tasks.workunit.client.1.smithi141.stdout:0/408: dwrite d4/f31 [4194304,4194304] 0 2023-12-16T20:11:35.251 INFO:tasks.workunit.client.1.smithi141.stdout:0/409: write d4/d49/d73/d8a/f91 [824636,98372] 0 2023-12-16T20:11:35.253 INFO:tasks.workunit.client.1.smithi141.stdout:3/501: dwrite d0/d1c/d40/d85/f53 [4194304,4194304] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:3/728: symlink d4/d67/de1/d4c/d70/d71/lff 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:3/729: write d4/d8/d15/f56 [4704782,51546] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:4/673: dwrite d13/d17/d2e/d32/d70/d84/fad [0,4194304] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/739: symlink d15/d1e/lff 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/740: write d15/d1e/d3b/d48/d3d/fd3 [957526,58581] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:1/741: write d15/d1e/d3b/d5a/f9e [715608,69822] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/730: dwrite d9/d1f/fac [0,4194304] 0 2023-12-16T20:11:35.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/731: stat d9/d1f/d21/d3e/fda 0 2023-12-16T20:11:35.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/730: dread d4/d27/d23/f2e [0,4194304] 0 2023-12-16T20:11:35.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/731: write d4/d18/f94 [295582,3401] 0 2023-12-16T20:11:35.257 INFO:tasks.workunit.client.1.smithi141.stdout:3/502: link d0/f29 d0/d1c/d6a/d76/da2/fac 0 2023-12-16T20:11:35.257 INFO:tasks.workunit.client.1.smithi141.stdout:3/503: chown d0/d1c/f98 226981887 1 2023-12-16T20:11:35.259 INFO:tasks.workunit.client.1.smithi141.stdout:3/504: mknod d0/d1c/d2c/d72/cad 0 2023-12-16T20:11:35.259 INFO:tasks.workunit.client.1.smithi141.stdout:3/505: write d0/f37 [1602181,29575] 0 2023-12-16T20:11:35.259 INFO:tasks.workunit.client.1.smithi141.stdout:3/506: chown d0/d1c/d40/d3f/d52/d5a 0 1 2023-12-16T20:11:35.259 INFO:tasks.workunit.client.1.smithi141.stdout:3/507: write d0/d1c/d40/d3f/f90 [798068,60133] 0 2023-12-16T20:11:35.259 INFO:tasks.workunit.client.1.smithi141.stdout:3/508: chown d0/f9c 182 1 2023-12-16T20:11:35.263 INFO:tasks.workunit.client.0.smithi038.stdout:4/674: mkdir d13/d17/d4b/da4/d9d/ddb 0 2023-12-16T20:11:35.263 INFO:tasks.workunit.client.1.smithi141.stdout:7/382: dread d5/f28 [0,4194304] 0 2023-12-16T20:11:35.263 INFO:tasks.workunit.client.1.smithi141.stdout:3/509: rename d0/d1c/d40/d3c/c5e to d0/d1c/d40/cae 0 2023-12-16T20:11:35.264 INFO:tasks.workunit.client.0.smithi038.stdout:3/732: dread d4/d27/d2b/f32 [0,4194304] 0 2023-12-16T20:11:35.264 INFO:tasks.workunit.client.0.smithi038.stdout:3/733: write d4/d67/de1/d4c/fef [931044,97781] 0 2023-12-16T20:11:35.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/742: mknod d15/d1e/c100 0 2023-12-16T20:11:35.265 INFO:tasks.workunit.client.1.smithi141.stdout:7/383: unlink d5/l29 0 2023-12-16T20:11:35.265 INFO:tasks.workunit.client.1.smithi141.stdout:7/384: truncate d5/d1d/d1e/f74 41646 0 2023-12-16T20:11:35.265 INFO:tasks.workunit.client.1.smithi141.stdout:7/385: chown d5/d16/d46/f5d 417 1 2023-12-16T20:11:35.267 INFO:tasks.workunit.client.1.smithi141.stdout:3/510: rmdir d0/d1c/d40/d3f/d52/d5a 39 2023-12-16T20:11:35.268 INFO:tasks.workunit.client.0.smithi038.stdout:9/732: symlink d9/d1e/d40/d5e/db5/le1 0 2023-12-16T20:11:35.270 INFO:tasks.workunit.client.1.smithi141.stdout:0/410: read d4/d5c/f68 [1489736,70393] 0 2023-12-16T20:11:35.270 INFO:tasks.workunit.client.1.smithi141.stdout:0/411: dread - d4/f88 zero size 2023-12-16T20:11:35.270 INFO:tasks.workunit.client.1.smithi141.stdout:0/412: stat d4/d49/l69 0 2023-12-16T20:11:35.271 INFO:tasks.workunit.client.1.smithi141.stdout:7/386: mknod d5/d16/d1a/c79 0 2023-12-16T20:11:35.271 INFO:tasks.workunit.client.0.smithi038.stdout:8/625: dread d17/d1b/d25/db7/d82/d9b/fb3 [0,4194304] 0 2023-12-16T20:11:35.271 INFO:tasks.workunit.client.0.smithi038.stdout:8/626: getdents d17/d1b/d25/db7/d82/da9/d50/db1 0 2023-12-16T20:11:35.271 INFO:tasks.workunit.client.0.smithi038.stdout:8/627: chown f13 1281397 1 2023-12-16T20:11:35.271 INFO:tasks.workunit.client.0.smithi038.stdout:7/798: dwrite da/d21/d2c/f9c [0,4194304] 0 2023-12-16T20:11:35.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/511: creat d0/d1c/d2c/d72/d74/d8b/da3/faf x:0 0 0 2023-12-16T20:11:35.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/512: rename d0/d1c to d0/d1c/d2c/d72/d74/db0 22 2023-12-16T20:11:35.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/513: chown d0/d1c/d2c/d72/d74/l9b 4980 1 2023-12-16T20:11:35.273 INFO:tasks.workunit.client.1.smithi141.stdout:0/413: creat d4/d49/d73/f96 x:0 0 0 2023-12-16T20:11:35.274 INFO:tasks.workunit.client.0.smithi038.stdout:1/743: unlink d15/d22/d62/cda 0 2023-12-16T20:11:35.275 INFO:tasks.workunit.client.1.smithi141.stdout:5/318: truncate d0/d14/f1b 3244978 0 2023-12-16T20:11:35.275 INFO:tasks.workunit.client.1.smithi141.stdout:5/319: fsync d0/d14/d2c/d4a/f51 0 2023-12-16T20:11:35.276 INFO:tasks.workunit.client.1.smithi141.stdout:7/387: mknod d5/d16/d30/d4e/d6e/c7a 0 2023-12-16T20:11:35.276 INFO:tasks.workunit.client.0.smithi038.stdout:9/733: mknod d9/d1f/d6c/ce2 0 2023-12-16T20:11:35.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/414: rename d4/d49/d73/d3b/d78/d7f/d80/d83/c93 to d4/d49/d73/d8a/c97 0 2023-12-16T20:11:35.278 INFO:tasks.workunit.client.1.smithi141.stdout:0/415: chown d4/d49/d4b/f53 760257415 1 2023-12-16T20:11:35.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/416: chown d4/d49/f71 828 1 2023-12-16T20:11:35.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/417: write d4/d49/d73/f5b [1571576,26726] 0 2023-12-16T20:11:35.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/418: creat d4/d5c/f98 x:0 0 0 2023-12-16T20:11:35.279 INFO:tasks.workunit.client.1.smithi141.stdout:0/419: stat d4/d74 0 2023-12-16T20:11:35.281 INFO:tasks.workunit.client.1.smithi141.stdout:5/320: rename d0/d9/d16/d2a/d35/f40 to d0/d9/d16/d2a/d35/f6a 0 2023-12-16T20:11:35.281 INFO:tasks.workunit.client.1.smithi141.stdout:5/321: chown d0/d14/d2c/f33 72417689 1 2023-12-16T20:11:35.282 INFO:tasks.workunit.client.1.smithi141.stdout:0/420: dread d4/d49/d73/d3b/d78/f4f [0,4194304] 0 2023-12-16T20:11:35.284 INFO:tasks.workunit.client.1.smithi141.stdout:7/388: creat d5/d16/d1a/d40/f7b x:0 0 0 2023-12-16T20:11:35.284 INFO:tasks.workunit.client.1.smithi141.stdout:7/389: write d5/f5f [1115611,31160] 0 2023-12-16T20:11:35.284 INFO:tasks.workunit.client.1.smithi141.stdout:7/390: creat d5/d1d/f7c x:0 0 0 2023-12-16T20:11:35.284 INFO:tasks.workunit.client.1.smithi141.stdout:7/391: readlink d5/l6 0 2023-12-16T20:11:35.285 INFO:tasks.workunit.client.0.smithi038.stdout:7/799: dread da/dcf/d100/d4d/dc5/ddc/f2a [0,4194304] 0 2023-12-16T20:11:35.285 INFO:tasks.workunit.client.0.smithi038.stdout:7/800: readlink da/dcf/d100/la9 0 2023-12-16T20:11:35.288 INFO:tasks.workunit.client.0.smithi038.stdout:3/734: dwrite d4/d27/d2b/f5b [0,4194304] 0 2023-12-16T20:11:35.288 INFO:tasks.workunit.client.0.smithi038.stdout:3/735: fsync d4/d8/f84 0 2023-12-16T20:11:35.291 INFO:tasks.workunit.client.1.smithi141.stdout:3/514: dwrite d0/d1c/d6a/f7f [4194304,4194304] 0 2023-12-16T20:11:35.291 INFO:tasks.workunit.client.1.smithi141.stdout:5/322: creat d0/d9/d16/d2a/d35/d5e/f6b x:0 0 0 2023-12-16T20:11:35.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/392: symlink d5/d1d/d1e/l7d 0 2023-12-16T20:11:35.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/393: stat d5/d2a 0 2023-12-16T20:11:35.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/394: chown d5/d1d/d1e/l2e 327 1 2023-12-16T20:11:35.295 INFO:tasks.workunit.client.1.smithi141.stdout:7/395: dread - d5/d16/d1a/f76 zero size 2023-12-16T20:11:35.298 INFO:tasks.workunit.client.0.smithi038.stdout:8/628: dwrite d17/f40 [0,4194304] 0 2023-12-16T20:11:35.303 INFO:tasks.workunit.client.1.smithi141.stdout:3/515: creat d0/d1c/d40/d3f/d52/d5a/fb1 x:0 0 0 2023-12-16T20:11:35.303 INFO:tasks.workunit.client.1.smithi141.stdout:3/516: fsync d0/f41 0 2023-12-16T20:11:35.304 INFO:tasks.workunit.client.1.smithi141.stdout:0/421: dwrite d4/d49/d4b/f66 [0,4194304] 0 2023-12-16T20:11:35.304 INFO:tasks.workunit.client.0.smithi038.stdout:4/675: rmdir d13 39 2023-12-16T20:11:35.304 INFO:tasks.workunit.client.0.smithi038.stdout:4/676: write d13/d1f/d98/fb6 [365959,75049] 0 2023-12-16T20:11:35.304 INFO:tasks.workunit.client.0.smithi038.stdout:4/677: write d13/d17/d2e/d32/d4e/f64 [1227707,2226] 0 2023-12-16T20:11:35.305 INFO:tasks.workunit.client.1.smithi141.stdout:5/323: creat d0/d25/d30/f6c x:0 0 0 2023-12-16T20:11:35.305 INFO:tasks.workunit.client.1.smithi141.stdout:5/324: chown d0/d14/f1b 188035 1 2023-12-16T20:11:35.305 INFO:tasks.workunit.client.1.smithi141.stdout:0/422: dread d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:35.306 INFO:tasks.workunit.client.1.smithi141.stdout:7/396: creat d5/d2a/f7e x:0 0 0 2023-12-16T20:11:35.308 INFO:tasks.workunit.client.1.smithi141.stdout:3/517: mknod d0/d1c/d40/d85/cb2 0 2023-12-16T20:11:35.312 INFO:tasks.workunit.client.0.smithi038.stdout:9/734: creat d9/d1f/d21/d3e/d4e/d61/d9e/dc2/fe3 x:0 0 0 2023-12-16T20:11:35.317 INFO:tasks.workunit.client.1.smithi141.stdout:5/325: link d0/d25/d30/d67/c27 d0/d9/d16/d2a/c6d 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.1.smithi141.stdout:7/397: dread d5/d2a/f34 [0,4194304] 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.1.smithi141.stdout:7/398: dread - d5/d16/d1a/f25 zero size 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.1.smithi141.stdout:7/399: fsync d5/d2a/d45/d5a/f64 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/735: dread d9/d1f/d96/fba [0,4194304] 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/736: dread - d9/d1e/d3d/d42/d59/d76/d8d/fca zero size 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/737: creat d9/d1e/d40/fe4 x:0 0 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/801: creat da/d21/d2c/d76/dc9/f10c x:0 0 0 2023-12-16T20:11:35.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/802: write da/d21/d2c/d76/d9a/fa5 [373705,18197] 0 2023-12-16T20:11:35.322 INFO:tasks.workunit.client.1.smithi141.stdout:7/400: dread d5/f24 [0,4194304] 0 2023-12-16T20:11:35.323 INFO:tasks.workunit.client.1.smithi141.stdout:7/401: stat d5/d16/d46/l4d 0 2023-12-16T20:11:35.323 INFO:tasks.workunit.client.1.smithi141.stdout:6/437: sync 2023-12-16T20:11:35.324 INFO:tasks.workunit.client.0.smithi038.stdout:4/678: creat d13/d17/d2e/d32/d4d/d6e/fdc x:0 0 0 2023-12-16T20:11:35.325 INFO:tasks.workunit.client.1.smithi141.stdout:7/402: rename d5/f47 to d5/d16/d1a/f7f 0 2023-12-16T20:11:35.325 INFO:tasks.workunit.client.0.smithi038.stdout:1/744: rmdir d15/d1e/d3b/d48/d37/dde/d75/dc6 39 2023-12-16T20:11:35.326 INFO:tasks.workunit.client.1.smithi141.stdout:6/438: mknod d1/d3/d4b/c91 0 2023-12-16T20:11:35.327 INFO:tasks.workunit.client.1.smithi141.stdout:6/439: write d1/d12/d22/d25/f2e [204549,84173] 0 2023-12-16T20:11:35.328 INFO:tasks.workunit.client.0.smithi038.stdout:9/738: creat d9/d1f/d6a/dc0/fe5 x:0 0 0 2023-12-16T20:11:35.329 INFO:tasks.workunit.client.1.smithi141.stdout:0/423: dwrite d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:35.329 INFO:tasks.workunit.client.1.smithi141.stdout:0/424: chown d4/d74/d85 11 1 2023-12-16T20:11:35.330 INFO:tasks.workunit.client.1.smithi141.stdout:7/403: link d5/d2a/d45/d5a/f64 d5/d1d/d1e/f80 0 2023-12-16T20:11:35.331 INFO:tasks.workunit.client.0.smithi038.stdout:7/803: creat da/d21/f10d x:0 0 0 2023-12-16T20:11:35.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/736: truncate d4/d8/d15/d1e/f22 257002 0 2023-12-16T20:11:35.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/737: chown d4/d27/d23/d26/c7c 156195773 1 2023-12-16T20:11:35.335 INFO:tasks.workunit.client.1.smithi141.stdout:7/404: mknod d5/d1d/c81 0 2023-12-16T20:11:35.335 INFO:tasks.workunit.client.1.smithi141.stdout:7/405: dread - d5/d16/d1a/f25 zero size 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.0.smithi038.stdout:8/629: link c6 d17/d5a/ccb 0 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.0.smithi038.stdout:8/630: chown d17/d1b/d66/d8e/d97/ca0 63 1 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.1.smithi141.stdout:5/326: dwrite d0/d25/f2e [4194304,4194304] 0 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/679: getdents d13/d17/d4b/da4/d9d 0 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/680: fdatasync d13/d17/d2e/d32/d70/f8c 0 2023-12-16T20:11:35.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/681: truncate d13/d17/d2e/d32/d7c/fa8 385832 0 2023-12-16T20:11:35.337 INFO:tasks.workunit.client.0.smithi038.stdout:1/745: mknod d15/d1e/d3b/d48/d37/dde/d75/dbc/c101 0 2023-12-16T20:11:35.337 INFO:tasks.workunit.client.0.smithi038.stdout:1/746: dread - d15/d1e/d3b/d48/d37/dde/d75/dbc/fc3 zero size 2023-12-16T20:11:35.339 INFO:tasks.workunit.client.1.smithi141.stdout:7/406: rename d5/d1d/f54 to d5/d16/d30/d4e/f82 0 2023-12-16T20:11:35.340 INFO:tasks.workunit.client.0.smithi038.stdout:7/804: rmdir da/dcf/d100/d4d/dc5/ddc/d8e/dfc 0 2023-12-16T20:11:35.343 INFO:tasks.workunit.client.0.smithi038.stdout:8/631: unlink d17/d1b/d25/db7/d82/da9/d59/l7b 0 2023-12-16T20:11:35.344 INFO:tasks.workunit.client.1.smithi141.stdout:5/327: link d0/d9/d16/f21 d0/d43/f6e 0 2023-12-16T20:11:35.345 INFO:tasks.workunit.client.1.smithi141.stdout:5/328: read - d0/d9/d16/d2a/d35/f66 zero size 2023-12-16T20:11:35.349 INFO:tasks.workunit.client.0.smithi038.stdout:9/739: truncate d9/d1e/f37 326002 0 2023-12-16T20:11:35.350 INFO:tasks.workunit.client.0.smithi038.stdout:1/747: write d15/d1e/d23/d34/f7a [1509777,48436] 0 2023-12-16T20:11:35.350 INFO:tasks.workunit.client.0.smithi038.stdout:3/738: dread d4/d18/f38 [0,4194304] 0 2023-12-16T20:11:35.350 INFO:tasks.workunit.client.0.smithi038.stdout:3/739: chown d4/d27/l6f 14 1 2023-12-16T20:11:35.350 INFO:tasks.workunit.client.0.smithi038.stdout:4/682: dread fb [4194304,4194304] 0 2023-12-16T20:11:35.351 INFO:tasks.workunit.client.1.smithi141.stdout:5/329: rename d0/d25/d30/d67/c52 to d0/d14/d2c/c6f 0 2023-12-16T20:11:35.351 INFO:tasks.workunit.client.1.smithi141.stdout:5/330: chown d0/d9/d16/d2a/d35/f3f 7092928 1 2023-12-16T20:11:35.351 INFO:tasks.workunit.client.1.smithi141.stdout:7/407: getdents d5/d1d/d1e 0 2023-12-16T20:11:35.351 INFO:tasks.workunit.client.1.smithi141.stdout:7/408: getdents d5/d1d/d1e 0 2023-12-16T20:11:35.351 INFO:tasks.workunit.client.1.smithi141.stdout:7/409: creat d5/d16/f83 x:0 0 0 2023-12-16T20:11:35.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/632: mkdir d17/d1b/d66/d73/d55/da5/da6/dcc 0 2023-12-16T20:11:35.352 INFO:tasks.workunit.client.0.smithi038.stdout:1/748: symlink d15/d1e/d3b/dfd/l102 0 2023-12-16T20:11:35.352 INFO:tasks.workunit.client.0.smithi038.stdout:1/749: dread - d15/d22/d62/fe7 zero size 2023-12-16T20:11:35.353 INFO:tasks.workunit.client.1.smithi141.stdout:5/331: rename d0/d25/f48 to d0/d14/f70 0 2023-12-16T20:11:35.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/760: sync 2023-12-16T20:11:35.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/761: dread - db/d16/d19/d80/ff6 zero size 2023-12-16T20:11:35.353 INFO:tasks.workunit.client.1.smithi141.stdout:6/440: dwrite d1/d3/f76 [0,4194304] 0 2023-12-16T20:11:35.355 INFO:tasks.workunit.client.0.smithi038.stdout:4/683: symlink d13/d17/d2e/d32/d4d/d78/da6/ldd 0 2023-12-16T20:11:35.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/740: write d4/d18/f38 [1718860,68505] 0 2023-12-16T20:11:35.357 INFO:tasks.workunit.client.1.smithi141.stdout:7/410: rename d5/d1d/d1e/d27/f5b to d5/d16/d30/d4e/d6e/f84 0 2023-12-16T20:11:35.358 INFO:tasks.workunit.client.0.smithi038.stdout:8/633: creat d17/d1b/d25/db7/d82/da9/d50/dc4/fcd x:0 0 0 2023-12-16T20:11:35.359 INFO:tasks.workunit.client.1.smithi141.stdout:6/441: symlink d1/dd/d43/l92 0 2023-12-16T20:11:35.360 INFO:tasks.workunit.client.0.smithi038.stdout:4/684: dread d13/d17/f95 [0,4194304] 0 2023-12-16T20:11:35.360 INFO:tasks.workunit.client.0.smithi038.stdout:4/685: chown d13/d1f/d35 8984855 1 2023-12-16T20:11:35.360 INFO:tasks.workunit.client.0.smithi038.stdout:4/686: stat d13/d69/d7a/f89 0 2023-12-16T20:11:35.362 INFO:tasks.workunit.client.0.smithi038.stdout:0/762: creat db/d16/d70/dd2/ffa x:0 0 0 2023-12-16T20:11:35.362 INFO:tasks.workunit.client.0.smithi038.stdout:0/763: fsync db/d16/d19/d27/f4c 0 2023-12-16T20:11:35.362 INFO:tasks.workunit.client.0.smithi038.stdout:6/657: sync 2023-12-16T20:11:35.362 INFO:tasks.workunit.client.0.smithi038.stdout:2/790: sync 2023-12-16T20:11:35.363 INFO:tasks.workunit.client.0.smithi038.stdout:5/778: sync 2023-12-16T20:11:35.365 INFO:tasks.workunit.client.0.smithi038.stdout:8/634: rename d17/d1b/d66/d73/d4e/l4f to d17/d1b/d66/d73/dc8/lce 0 2023-12-16T20:11:35.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/764: write db/d16/d5a/d65/de8/f59 [3502543,40195] 0 2023-12-16T20:11:35.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/765: read - db/d16/d5a/d65/de8/d77/ff7 zero size 2023-12-16T20:11:35.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/766: chown db/d16/d5a/d65/de8/d77/d95/da4/ld6 7833 1 2023-12-16T20:11:35.370 INFO:tasks.workunit.client.0.smithi038.stdout:0/767: write db/d16/d19/f43 [1990894,36410] 0 2023-12-16T20:11:35.370 INFO:tasks.workunit.client.0.smithi038.stdout:3/741: dread d4/d8/f1a [0,4194304] 0 2023-12-16T20:11:35.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/658: rename d1/d4/d1d/d28/d2f/fc1 to d1/d4/d1d/d61/fcc 0 2023-12-16T20:11:35.373 INFO:tasks.workunit.client.0.smithi038.stdout:6/659: write d1/d5b/f76 [708740,130327] 0 2023-12-16T20:11:35.375 INFO:tasks.workunit.client.0.smithi038.stdout:7/805: dwrite da/d21/d2c/f9c [0,4194304] 0 2023-12-16T20:11:35.376 INFO:tasks.workunit.client.0.smithi038.stdout:8/635: creat d17/d1b/fcf x:0 0 0 2023-12-16T20:11:35.378 INFO:tasks.workunit.client.0.smithi038.stdout:2/791: mknod d1/d5/d95/d61/dd4/d6a/dd5/c10c 0 2023-12-16T20:11:35.378 INFO:tasks.workunit.client.0.smithi038.stdout:2/792: fsync d1/d5/d2a/f101 0 2023-12-16T20:11:35.381 INFO:tasks.workunit.client.0.smithi038.stdout:5/779: dread d2/d4/f4c [0,4194304] 0 2023-12-16T20:11:35.383 INFO:tasks.workunit.client.0.smithi038.stdout:0/768: rename db/d16/d5a/cb7 to db/d16/d19/d4e/d89/cfb 0 2023-12-16T20:11:35.384 INFO:tasks.workunit.client.0.smithi038.stdout:5/780: unlink d2/d14/d25/d2d/d17/d51/d7b/d89/le8 0 2023-12-16T20:11:35.385 INFO:tasks.workunit.client.0.smithi038.stdout:0/769: truncate db/d16/d19/d80/f92 3940678 0 2023-12-16T20:11:35.386 INFO:tasks.workunit.client.0.smithi038.stdout:2/793: write d1/d5/d95/d61/dd4/d10/f108 [1233847,45771] 0 2023-12-16T20:11:35.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/806: getdents da/d21/d2c 0 2023-12-16T20:11:35.387 INFO:tasks.workunit.client.0.smithi038.stdout:8/636: mknod d17/d1b/d25/db7/cd0 0 2023-12-16T20:11:35.388 INFO:tasks.workunit.client.0.smithi038.stdout:5/781: unlink d2/df/d1a/d1f/d4a/d53/f82 0 2023-12-16T20:11:35.389 INFO:tasks.workunit.client.0.smithi038.stdout:0/770: creat db/d16/d5a/d65/d90/ffc x:0 0 0 2023-12-16T20:11:35.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/794: readlink d1/d5/d95/d61/dd4/d6a/lbb 0 2023-12-16T20:11:35.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/807: rename da/dcf/d100/d4d/dc5/d38/d90/l7e to da/d21/d61/dcd/l10e 0 2023-12-16T20:11:35.395 INFO:tasks.workunit.client.0.smithi038.stdout:5/782: symlink d2/d14/d25/d2d/d17/d51/de9/lf9 0 2023-12-16T20:11:35.398 INFO:tasks.workunit.client.0.smithi038.stdout:5/783: rmdir d2/df/d1a/d1f 39 2023-12-16T20:11:35.399 INFO:tasks.workunit.client.0.smithi038.stdout:2/795: getdents d1 0 2023-12-16T20:11:35.400 INFO:tasks.workunit.client.0.smithi038.stdout:0/771: dread db/d16/d1c/f2a [0,4194304] 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:5/784: symlink d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4/lfa 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:9/740: dwrite d9/d1e/d3d/d42/f48 [4194304,4194304] 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:6/660: dread d1/d4/f5e [0,4194304] 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:6/661: readlink d1/d4/l13 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:6/662: fdatasync d1/d4/d1d/d28/f41 0 2023-12-16T20:11:35.401 INFO:tasks.workunit.client.0.smithi038.stdout:4/687: dwrite d13/d17/d4b/da4/d9d/db5/fbe [0,4194304] 0 2023-12-16T20:11:35.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/750: dwrite d15/d22/fcb [0,4194304] 0 2023-12-16T20:11:35.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/751: stat d15/d22/d52/d7f 0 2023-12-16T20:11:35.402 INFO:tasks.workunit.client.0.smithi038.stdout:2/796: read d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f4a [320726,11384] 0 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/443: sync 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:4/383: sync 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:4/384: creat d1a/d3c/d70/f99 x:0 0 0 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:4/385: write d1a/d54/f98 [565730,28516] 0 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/444: getdents d14/d71 0 2023-12-16T20:11:35.403 INFO:tasks.workunit.client.1.smithi141.stdout:8/445: write d14/d35/f70 [1557792,19564] 0 2023-12-16T20:11:35.404 INFO:tasks.workunit.client.1.smithi141.stdout:8/446: mkdir d14/d19/d1b/d24/d4b/d8c 0 2023-12-16T20:11:35.404 INFO:tasks.workunit.client.1.smithi141.stdout:8/447: truncate d14/d19/d1b/d24/d4b/f80 109212 0 2023-12-16T20:11:35.405 INFO:tasks.workunit.client.0.smithi038.stdout:0/772: truncate f5 3012482 0 2023-12-16T20:11:35.405 INFO:tasks.workunit.client.1.smithi141.stdout:8/448: symlink d14/d71/l8d 0 2023-12-16T20:11:35.407 INFO:tasks.workunit.client.1.smithi141.stdout:8/449: link d14/d71/d81/l41 d14/d19/d1b/d24/d4a/d69/l8e 0 2023-12-16T20:11:35.407 INFO:tasks.workunit.client.0.smithi038.stdout:5/785: mknod d2/df/d1a/d1f/d4a/db2/cfb 0 2023-12-16T20:11:35.408 INFO:tasks.workunit.client.0.smithi038.stdout:5/786: read d2/d4/f4c [795778,100374] 0 2023-12-16T20:11:35.409 INFO:tasks.workunit.client.0.smithi038.stdout:9/741: link d9/d1f/d21/d3e/d4e/d64/lae d9/d1f/d21/d3e/d4e/le6 0 2023-12-16T20:11:35.411 INFO:tasks.workunit.client.0.smithi038.stdout:6/663: link d1/d16/d23/fb8 d1/d4/d1d/d28/db1/dbe/d94/fcd 0 2023-12-16T20:11:35.414 INFO:tasks.workunit.client.1.smithi141.stdout:4/386: dread d1a/d2a/d3b/f45 [0,4194304] 0 2023-12-16T20:11:35.414 INFO:tasks.workunit.client.1.smithi141.stdout:4/387: chown d1a/d54/f98 555 1 2023-12-16T20:11:35.416 INFO:tasks.workunit.client.0.smithi038.stdout:4/688: rename d13/d17/d4b/fcc to d13/d17/d2e/d32/d7c/fde 0 2023-12-16T20:11:35.416 INFO:tasks.workunit.client.1.smithi141.stdout:4/388: creat d1a/f9a x:0 0 0 2023-12-16T20:11:35.416 INFO:tasks.workunit.client.1.smithi141.stdout:4/389: read - d1a/d3c/d70/f99 zero size 2023-12-16T20:11:35.416 INFO:tasks.workunit.client.1.smithi141.stdout:4/390: write d1a/d2a/d3b/d69/f83 [217088,54862] 0 2023-12-16T20:11:35.416 INFO:tasks.workunit.client.1.smithi141.stdout:4/391: fdatasync d1a/d2a/f31 0 2023-12-16T20:11:35.417 INFO:tasks.workunit.client.0.smithi038.stdout:8/637: dwrite d17/d1b/d25/db7/d82/da9/d50/f6e [4194304,4194304] 0 2023-12-16T20:11:35.419 INFO:tasks.workunit.client.1.smithi141.stdout:8/450: write d14/f23 [3551222,86827] 0 2023-12-16T20:11:35.420 INFO:tasks.workunit.client.0.smithi038.stdout:1/752: unlink d15/d1e/d3b/dfd/l102 0 2023-12-16T20:11:35.421 INFO:tasks.workunit.client.1.smithi141.stdout:4/392: dread d1a/d4e/d63/f77 [0,4194304] 0 2023-12-16T20:11:35.423 INFO:tasks.workunit.client.0.smithi038.stdout:2/797: mkdir d1/d5/d2a/d31/d60/ded/dee/d10d 0 2023-12-16T20:11:35.423 INFO:tasks.workunit.client.0.smithi038.stdout:2/798: creat d1/d5/d95/d61/d66/ddd/de8/dea/f10e x:0 0 0 2023-12-16T20:11:35.423 INFO:tasks.workunit.client.1.smithi141.stdout:4/393: getdents d1a/d2a 0 2023-12-16T20:11:35.424 INFO:tasks.workunit.client.1.smithi141.stdout:4/394: chown d1a/d4e/d63/l66 8 1 2023-12-16T20:11:35.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/773: unlink db/d16/d5a/dc5/lcc 0 2023-12-16T20:11:35.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/774: chown db/f10 1437798 1 2023-12-16T20:11:35.426 INFO:tasks.workunit.client.1.smithi141.stdout:4/395: mkdir d1a/d3c/d9b 0 2023-12-16T20:11:35.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/689: mkdir d13/d1f/d35/ddf 0 2023-12-16T20:11:35.435 INFO:tasks.workunit.client.0.smithi038.stdout:8/638: creat d17/d1b/d66/d73/d54/fd1 x:0 0 0 2023-12-16T20:11:35.439 INFO:tasks.workunit.client.0.smithi038.stdout:5/787: getdents d2/d14/ddd 0 2023-12-16T20:11:35.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/775: dread db/d16/d5a/d65/f6a [4194304,4194304] 0 2023-12-16T20:11:35.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/776: getdents db/d16/d19/d27/d78/dd5 0 2023-12-16T20:11:35.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/777: chown db/f88 139 1 2023-12-16T20:11:35.442 INFO:tasks.workunit.client.0.smithi038.stdout:2/799: dread d1/d5/f4e [0,4194304] 0 2023-12-16T20:11:35.445 INFO:tasks.workunit.client.0.smithi038.stdout:1/753: dwrite d15/d22/f51 [0,4194304] 0 2023-12-16T20:11:35.446 INFO:tasks.workunit.client.0.smithi038.stdout:8/639: rename d17/d1b/d66/d73/d54/d69/f2a to d17/d1b/fd2 0 2023-12-16T20:11:35.448 INFO:tasks.workunit.client.0.smithi038.stdout:2/800: read - d1/d5/d95/d61/dd4/d6a/fa6 zero size 2023-12-16T20:11:35.448 INFO:tasks.workunit.client.1.smithi141.stdout:4/396: dwrite d1a/d2a/f78 [0,4194304] 0 2023-12-16T20:11:35.448 INFO:tasks.workunit.client.1.smithi141.stdout:4/397: write d1a/d2a/d3b/d69/f80 [587599,58043] 0 2023-12-16T20:11:35.452 INFO:tasks.workunit.client.1.smithi141.stdout:4/398: rename d1a/d4e/f55 to d1a/f9c 0 2023-12-16T20:11:35.455 INFO:tasks.workunit.client.0.smithi038.stdout:2/801: dread - d1/d5/d95/d61/dd4/d6a/d43/d57/dd6/ff8 zero size 2023-12-16T20:11:35.457 INFO:tasks.workunit.client.0.smithi038.stdout:1/754: getdents d15/d1e/d30 0 2023-12-16T20:11:35.457 INFO:tasks.workunit.client.0.smithi038.stdout:1/755: write d15/d1e/d30/ffc [153819,27669] 0 2023-12-16T20:11:35.458 INFO:tasks.workunit.client.0.smithi038.stdout:2/802: rmdir d1/d5/d2a/d31/d60/ded/dee/d10d 0 2023-12-16T20:11:35.458 INFO:tasks.workunit.client.0.smithi038.stdout:0/778: write db/d16/d5a/d65/de8/d77/d95/d9f/fb9 [844825,99568] 0 2023-12-16T20:11:35.458 INFO:tasks.workunit.client.0.smithi038.stdout:2/803: write d1/d5/d95/d61/d66/ddd/de8/dea/f107 [537333,86158] 0 2023-12-16T20:11:35.459 INFO:tasks.workunit.client.0.smithi038.stdout:1/756: mknod d15/d1e/d3b/d48/d3d/dc8/c103 0 2023-12-16T20:11:35.461 INFO:tasks.workunit.client.0.smithi038.stdout:0/779: symlink db/d16/d19/d80/lfd 0 2023-12-16T20:11:35.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/399: write d1a/d2a/f4b [201112,64124] 0 2023-12-16T20:11:35.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/400: stat d1a/l62 0 2023-12-16T20:11:35.463 INFO:tasks.workunit.client.0.smithi038.stdout:2/804: getdents d1/d5/d2a/d31/d60/ded 0 2023-12-16T20:11:35.463 INFO:tasks.workunit.client.0.smithi038.stdout:2/805: write d1/d5/d95/d61/dd4/d21/f3c [1485712,13109] 0 2023-12-16T20:11:35.464 INFO:tasks.workunit.client.0.smithi038.stdout:1/757: mknod d15/d1e/d23/d34/d79/c104 0 2023-12-16T20:11:35.465 INFO:tasks.workunit.client.0.smithi038.stdout:0/780: mknod db/d16/db5/de6/cfe 0 2023-12-16T20:11:35.465 INFO:tasks.workunit.client.0.smithi038.stdout:1/758: read d15/d1e/d3b/d48/d37/f6a [795026,40023] 0 2023-12-16T20:11:35.467 INFO:tasks.workunit.client.0.smithi038.stdout:5/788: dwrite d2/d14/d25/d2d/d17/d51/fe7 [0,4194304] 0 2023-12-16T20:11:35.467 INFO:tasks.workunit.client.0.smithi038.stdout:5/789: write d2/df/d1a/d2a/d59/ff3 [158287,15480] 0 2023-12-16T20:11:35.469 INFO:tasks.workunit.client.0.smithi038.stdout:1/759: rename d15/d1e/d3b/d48/d3d/dc8/c103 to d15/d1e/d3b/d48/d37/dde/d75/dc6/c105 0 2023-12-16T20:11:35.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/690: dwrite d13/d69/d7a/f89 [0,4194304] 0 2023-12-16T20:11:35.472 INFO:tasks.workunit.client.0.smithi038.stdout:5/790: link d2/d14/c3b d2/d14/d25/d2d/d17/d93/cfc 0 2023-12-16T20:11:35.473 INFO:tasks.workunit.client.0.smithi038.stdout:1/760: truncate d15/d22/d62/fa8 2767988 0 2023-12-16T20:11:35.474 INFO:tasks.workunit.client.0.smithi038.stdout:4/691: symlink d13/d17/d2e/d32/d70/le0 0 2023-12-16T20:11:35.476 INFO:tasks.workunit.client.0.smithi038.stdout:5/791: mknod d2/d14/d25/d2d/d2f/cfd 0 2023-12-16T20:11:35.476 INFO:tasks.workunit.client.0.smithi038.stdout:4/692: symlink d13/d17/d2e/d32/d4d/d4f/le1 0 2023-12-16T20:11:35.477 INFO:tasks.workunit.client.0.smithi038.stdout:5/792: write d2/df/f1d [4357870,107425] 0 2023-12-16T20:11:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/693: creat d13/d17/d2e/d32/d70/d84/d88/dc3/fe2 x:0 0 0 2023-12-16T20:11:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/694: fsync d13/f37 0 2023-12-16T20:11:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/695: stat d13/d1f/fc4 0 2023-12-16T20:11:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/696: fdatasync d13/d17/d2e/d32/d70/f8c 0 2023-12-16T20:11:35.482 INFO:tasks.workunit.client.0.smithi038.stdout:4/697: mkdir d13/d17/d2e/d32/d70/d84/de3 0 2023-12-16T20:11:35.483 INFO:tasks.workunit.client.1.smithi141.stdout:4/401: dwrite d1a/f35 [0,4194304] 0 2023-12-16T20:11:35.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/781: fdatasync db/d16/d5a/d65/de8/d77/d95/d9f/fb9 0 2023-12-16T20:11:35.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/782: chown db/d16/d5a/d65/le9 86014 1 2023-12-16T20:11:35.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/783: readlink db/d16/d70/d7c/lf4 0 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:1/761: dread f7 [0,4194304] 0 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/698: rename d13/d17/d2e/d32/d70/le0 to d13/le4 0 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/699: chown d13/d17/d4b/laa 497773 1 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/700: truncate d13/f91 916382 0 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/701: chown d13/d17/d2e/f3d 6 1 2023-12-16T20:11:35.487 INFO:tasks.workunit.client.0.smithi038.stdout:4/702: readlink d13/d17/d2e/d32/d4d/l60 0 2023-12-16T20:11:35.489 INFO:tasks.workunit.client.0.smithi038.stdout:9/742: dwrite d9/d1f/f98 [0,4194304] 0 2023-12-16T20:11:35.490 INFO:tasks.workunit.client.0.smithi038.stdout:8/640: dread d17/d34/f84 [0,4194304] 0 2023-12-16T20:11:35.490 INFO:tasks.workunit.client.0.smithi038.stdout:9/743: write d9/d1f/d21/d3e/d4e/d61/d9b/fdb [159885,127602] 0 2023-12-16T20:11:35.490 INFO:tasks.workunit.client.0.smithi038.stdout:7/808: dwrite da/dcf/d100/d4d/d51/f6d [0,4194304] 0 2023-12-16T20:11:35.494 INFO:tasks.workunit.client.0.smithi038.stdout:2/806: dwrite d1/d5/d2a/f79 [0,4194304] 0 2023-12-16T20:11:35.496 INFO:tasks.workunit.client.0.smithi038.stdout:4/703: link d13/f91 d13/d17/d4b/d7d/fe5 0 2023-12-16T20:11:35.496 INFO:tasks.workunit.client.0.smithi038.stdout:4/704: fsync d13/d17/d62/fba 0 2023-12-16T20:11:35.498 INFO:tasks.workunit.client.0.smithi038.stdout:2/807: truncate d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f4a 1726056 0 2023-12-16T20:11:35.506 INFO:tasks.workunit.client.0.smithi038.stdout:2/808: symlink d1/d5/d95/d61/l10f 0 2023-12-16T20:11:35.506 INFO:tasks.workunit.client.0.smithi038.stdout:2/809: creat d1/d5/d6c/d9f/f110 x:0 0 0 2023-12-16T20:11:35.506 INFO:tasks.workunit.client.0.smithi038.stdout:2/810: creat d1/d88/f111 x:0 0 0 2023-12-16T20:11:35.506 INFO:tasks.workunit.client.0.smithi038.stdout:2/811: chown d1/d5/d95/d61/dd4/d10/f77 250 1 2023-12-16T20:11:35.507 INFO:tasks.workunit.client.1.smithi141.stdout:8/451: dwrite d14/d19/d1b/f21 [4194304,4194304] 0 2023-12-16T20:11:35.510 INFO:tasks.workunit.client.0.smithi038.stdout:1/762: write d15/d1e/d3b/d48/f36 [214594,110158] 0 2023-12-16T20:11:35.510 INFO:tasks.workunit.client.1.smithi141.stdout:8/452: mkdir d14/d19/d1b/d24/d4b/d8f 0 2023-12-16T20:11:35.511 INFO:tasks.workunit.client.1.smithi141.stdout:8/453: creat d14/d19/d1b/f90 x:0 0 0 2023-12-16T20:11:35.511 INFO:tasks.workunit.client.1.smithi141.stdout:8/454: dread - d14/d19/d1b/f48 zero size 2023-12-16T20:11:35.514 INFO:tasks.workunit.client.1.smithi141.stdout:8/455: mknod d14/d19/d1b/d24/d4a/d58/c91 0 2023-12-16T20:11:35.514 INFO:tasks.workunit.client.0.smithi038.stdout:9/744: dread d9/d1e/d3d/f4b [0,4194304] 0 2023-12-16T20:11:35.518 INFO:tasks.workunit.client.0.smithi038.stdout:1/763: unlink d15/d1e/d3b/d48/d37/l43 0 2023-12-16T20:11:35.520 INFO:tasks.workunit.client.0.smithi038.stdout:9/745: symlink d9/d1e/d40/d5e/db5/le7 0 2023-12-16T20:11:35.528 INFO:tasks.workunit.client.0.smithi038.stdout:9/746: rename d9/d1e/d3d/d42/d59/d76/d8d to d9/d1e/d40/d5e/d71/d83/de8 0 2023-12-16T20:11:35.529 INFO:tasks.workunit.client.0.smithi038.stdout:5/793: dwrite d2/d4/d62/f77 [4194304,4194304] 0 2023-12-16T20:11:35.529 INFO:tasks.workunit.client.0.smithi038.stdout:5/794: read - d2/d14/d25/fb7 zero size 2023-12-16T20:11:35.529 INFO:tasks.workunit.client.0.smithi038.stdout:5/795: creat d2/d14/d25/ffe x:0 0 0 2023-12-16T20:11:35.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/747: unlink d9/d1e/l24 0 2023-12-16T20:11:35.532 INFO:tasks.workunit.client.0.smithi038.stdout:5/796: creat d2/d4/fff x:0 0 0 2023-12-16T20:11:35.533 INFO:tasks.workunit.client.0.smithi038.stdout:9/748: mknod d9/d1e/d3d/d42/d59/d76/ce9 0 2023-12-16T20:11:35.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/797: unlink d2/df/d1a/d1f/d4a/d53/d6e/f8d 0 2023-12-16T20:11:35.535 INFO:tasks.workunit.client.0.smithi038.stdout:9/749: truncate d9/d1f/d21/d3e/f49 337711 0 2023-12-16T20:11:35.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/798: link d2/d14/d25/d2d/d4b/d8b/fdc d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4/f100 0 2023-12-16T20:11:35.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/799: fsync d2/df/d1a/d2a/f95 0 2023-12-16T20:11:35.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/800: chown d2/d14/d25/fde 148303457 1 2023-12-16T20:11:35.538 INFO:tasks.workunit.client.0.smithi038.stdout:8/641: dwrite d17/d1b/d25/db7/d82/da9/d50/f67 [0,4194304] 0 2023-12-16T20:11:35.540 INFO:tasks.workunit.client.0.smithi038.stdout:8/642: mknod d17/d1b/d25/db7/d82/da9/d50/db1/cd3 0 2023-12-16T20:11:35.541 INFO:tasks.workunit.client.0.smithi038.stdout:9/750: dread d9/d1e/d40/d5e/f67 [0,4194304] 0 2023-12-16T20:11:35.541 INFO:tasks.workunit.client.0.smithi038.stdout:0/784: dwrite db/d16/d1c/f62 [0,4194304] 0 2023-12-16T20:11:35.542 INFO:tasks.workunit.client.0.smithi038.stdout:4/705: dwrite d13/f91 [0,4194304] 0 2023-12-16T20:11:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/643: getdents d17/d1b/d66/d73/d55/da5 0 2023-12-16T20:11:35.546 INFO:tasks.workunit.client.0.smithi038.stdout:9/751: mkdir d9/dea 0 2023-12-16T20:11:35.546 INFO:tasks.workunit.client.0.smithi038.stdout:9/752: chown d9/d1f/d21/f7e 2 1 2023-12-16T20:11:35.547 INFO:tasks.workunit.client.0.smithi038.stdout:0/785: truncate db/d16/d19/f43 4010357 0 2023-12-16T20:11:35.549 INFO:tasks.workunit.client.1.smithi141.stdout:4/402: dwrite f14 [4194304,4194304] 0 2023-12-16T20:11:35.549 INFO:tasks.workunit.client.0.smithi038.stdout:7/809: dwrite da/d21/d2c/f36 [0,4194304] 0 2023-12-16T20:11:35.552 INFO:tasks.workunit.client.0.smithi038.stdout:8/644: unlink d17/d1b/d25/f8d 0 2023-12-16T20:11:35.554 INFO:tasks.workunit.client.1.smithi141.stdout:4/403: rename d1a/l39 to d1a/d54/d87/l9d 0 2023-12-16T20:11:35.554 INFO:tasks.workunit.client.1.smithi141.stdout:4/404: creat d1a/d59/f9e x:0 0 0 2023-12-16T20:11:35.554 INFO:tasks.workunit.client.0.smithi038.stdout:4/706: dread d13/d69/fbc [0,4194304] 0 2023-12-16T20:11:35.554 INFO:tasks.workunit.client.0.smithi038.stdout:2/812: dwrite d1/d5/d6c/d9f/fc1 [0,4194304] 0 2023-12-16T20:11:35.559 INFO:tasks.workunit.client.0.smithi038.stdout:7/810: write da/dcf/fdb [1634164,63780] 0 2023-12-16T20:11:35.560 INFO:tasks.workunit.client.0.smithi038.stdout:1/764: dwrite d15/d22/fcb [4194304,4194304] 0 2023-12-16T20:11:35.567 INFO:tasks.workunit.client.0.smithi038.stdout:5/801: dwrite f0 [0,4194304] 0 2023-12-16T20:11:35.567 INFO:tasks.workunit.client.0.smithi038.stdout:5/802: write d2/d14/d25/d2d/d17/d55/faa [432273,112569] 0 2023-12-16T20:11:35.572 INFO:tasks.workunit.client.1.smithi141.stdout:4/405: dread f1 [0,4194304] 0 2023-12-16T20:11:35.575 INFO:tasks.workunit.client.1.smithi141.stdout:1/482: sync 2023-12-16T20:11:35.575 INFO:tasks.workunit.client.1.smithi141.stdout:1/483: fsync da/d36/d4b/d4d/d89/f82 0 2023-12-16T20:11:35.575 INFO:tasks.workunit.client.1.smithi141.stdout:1/484: fdatasync da/df/f78 0 2023-12-16T20:11:35.575 INFO:tasks.workunit.client.1.smithi141.stdout:2/282: sync 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.1.smithi141.stdout:2/283: chown d6/da/d33/f3e 1 1 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.1.smithi141.stdout:3/518: sync 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.1.smithi141.stdout:9/414: sync 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.1.smithi141.stdout:9/415: stat d1/d10/d27/d36/f3a 0 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.1.smithi141.stdout:9/416: read d1/d10/f15 [3864075,128163] 0 2023-12-16T20:11:35.576 INFO:tasks.workunit.client.0.smithi038.stdout:2/813: truncate d1/d5/d95/fb7 933560 0 2023-12-16T20:11:35.577 INFO:tasks.workunit.client.1.smithi141.stdout:3/519: readlink d0/l12 0 2023-12-16T20:11:35.580 INFO:tasks.workunit.client.1.smithi141.stdout:9/417: rename d1/d10/d27/f81 to d1/d26/d4a/d73/f92 0 2023-12-16T20:11:35.580 INFO:tasks.workunit.client.1.smithi141.stdout:9/418: chown d1/d10/d14/d20/d3b/f46 367758 1 2023-12-16T20:11:35.580 INFO:tasks.workunit.client.1.smithi141.stdout:9/419: chown d1/d26/d4a/d73/d76 8 1 2023-12-16T20:11:35.581 INFO:tasks.workunit.client.1.smithi141.stdout:1/485: mknod da/d7a/c9e 0 2023-12-16T20:11:35.582 INFO:tasks.workunit.client.0.smithi038.stdout:2/814: read d1/d5/f4e [3020942,111908] 0 2023-12-16T20:11:35.584 INFO:tasks.workunit.client.0.smithi038.stdout:5/803: dread d2/d4/fb [8388608,4194304] 0 2023-12-16T20:11:35.584 INFO:tasks.workunit.client.0.smithi038.stdout:5/804: dread - d2/d14/d25/fde zero size 2023-12-16T20:11:35.585 INFO:tasks.workunit.client.1.smithi141.stdout:9/420: mknod d1/d10/d14/d20/da/c93 0 2023-12-16T20:11:35.587 INFO:tasks.workunit.client.1.smithi141.stdout:1/486: link da/d67/l2d da/d36/d4b/d4d/d89/d6c/l9f 0 2023-12-16T20:11:35.588 INFO:tasks.workunit.client.1.smithi141.stdout:3/520: getdents d0/d1c/d6a 0 2023-12-16T20:11:35.589 INFO:tasks.workunit.client.0.smithi038.stdout:1/765: creat d15/d22/d52/d7f/f106 x:0 0 0 2023-12-16T20:11:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:2/815: link d1/d5/d95/d61/d66/f83 d1/d5/d95/f112 0 2023-12-16T20:11:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:2/816: fdatasync d1/d5/d95/d61/ff6 0 2023-12-16T20:11:35.597 INFO:tasks.workunit.client.1.smithi141.stdout:3/521: rmdir d0/d1c/d40 39 2023-12-16T20:11:35.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/817: readlink d1/d5/d2a/d31/l4b 0 2023-12-16T20:11:35.598 INFO:tasks.workunit.client.1.smithi141.stdout:3/522: chown d0/l32 13 1 2023-12-16T20:11:35.598 INFO:tasks.workunit.client.0.smithi038.stdout:2/818: dread d1/d5/d95/d61/dd4/d10/f5e [0,4194304] 0 2023-12-16T20:11:35.599 INFO:tasks.workunit.client.0.smithi038.stdout:5/805: dread d2/d14/f40 [0,4194304] 0 2023-12-16T20:11:35.600 INFO:tasks.workunit.client.0.smithi038.stdout:1/766: mkdir d15/d1e/d3b/d48/d37/deb/d107 0 2023-12-16T20:11:35.601 INFO:tasks.workunit.client.1.smithi141.stdout:3/523: rmdir d0/d1c/d2c/d72/d74/d8b/da3 39 2023-12-16T20:11:35.601 INFO:tasks.workunit.client.1.smithi141.stdout:3/524: stat d0/d1c/d40/d85/cb2 0 2023-12-16T20:11:35.602 INFO:tasks.workunit.client.0.smithi038.stdout:2/819: creat d1/d5/d95/d61/dd4/d21/f113 x:0 0 0 2023-12-16T20:11:35.604 INFO:tasks.workunit.client.0.smithi038.stdout:1/767: getdents d15/d1e/d3b 0 2023-12-16T20:11:35.605 INFO:tasks.workunit.client.0.smithi038.stdout:5/806: dread d2/df/d1a/d2a/f74 [0,4194304] 0 2023-12-16T20:11:35.605 INFO:tasks.workunit.client.0.smithi038.stdout:5/807: dread - d2/d14/d25/fb7 zero size 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/808: readlink d2/d14/d25/d2d/d17/d51/de9/lf9 0 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/753: dwrite d9/d1e/f74 [0,4194304] 0 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/809: truncate d2/d4/fff 737402 0 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/810: dread - d2/df/d1a/d1f/d4a/dc8/ff0 zero size 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/811: write d2/df/d1a/d2a/d59/ff3 [915268,273] 0 2023-12-16T20:11:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:2/820: rmdir d1/d5/d95/d61/dd4/d21/d9a/db9/d3a 39 2023-12-16T20:11:35.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/754: stat d9/cf 0 2023-12-16T20:11:35.610 INFO:tasks.workunit.client.1.smithi141.stdout:3/525: read d0/f8 [1103352,68177] 0 2023-12-16T20:11:35.610 INFO:tasks.workunit.client.1.smithi141.stdout:3/526: readlink d0/d1c/d40/d3c/l51 0 2023-12-16T20:11:35.610 INFO:tasks.workunit.client.1.smithi141.stdout:3/527: fsync d0/d1c/d2c/f5b 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/821: creat d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f114 x:0 0 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:2/822: fsync d1/d5/d95/d61/dd4/fae 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/768: symlink d15/d1e/d3b/d48/d37/l108 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/769: getdents d15/d4a/ded 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/770: fsync d15/d1e/d23/d34/d86/fa0 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:1/771: write d15/d1e/d23/d34/f38 [4666751,37468] 0 2023-12-16T20:11:35.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/755: symlink d9/d1e/leb 0 2023-12-16T20:11:35.615 INFO:tasks.workunit.client.0.smithi038.stdout:5/812: unlink d2/f12 0 2023-12-16T20:11:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:5/813: dread - d2/df/d1a/d1f/f3d zero size 2023-12-16T20:11:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:5/814: write d2/d14/d25/d2d/f8c [786890,3996] 0 2023-12-16T20:11:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:5/815: write d2/df/d1a/d2a/f3a [3622313,32338] 0 2023-12-16T20:11:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:2/823: mkdir d1/d5/d3d/d115 0 2023-12-16T20:11:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:2/824: fdatasync d1/d5/d2a/fd1 0 2023-12-16T20:11:35.617 INFO:tasks.workunit.client.0.smithi038.stdout:0/786: dwrite db/d16/d70/d7c/f7e [0,4194304] 0 2023-12-16T20:11:35.618 INFO:tasks.workunit.client.0.smithi038.stdout:8/645: dwrite d17/d1b/d25/db7/d82/da9/d50/f6e [0,4194304] 0 2023-12-16T20:11:35.618 INFO:tasks.workunit.client.0.smithi038.stdout:8/646: chown d17/d1b/d25/db7/d82/fa4 243881252 1 2023-12-16T20:11:35.618 INFO:tasks.workunit.client.0.smithi038.stdout:8/647: rename d17/d1b to d17/d1b/d66/d73/d55/da5/da6/dcc/dd4 22 2023-12-16T20:11:35.619 INFO:tasks.workunit.client.0.smithi038.stdout:1/772: symlink d15/d1e/d23/l109 0 2023-12-16T20:11:35.619 INFO:tasks.workunit.client.0.smithi038.stdout:9/756: mknod d9/d1e/d45/cec 0 2023-12-16T20:11:35.621 INFO:tasks.workunit.client.0.smithi038.stdout:5/816: creat d2/f101 x:0 0 0 2023-12-16T20:11:35.622 INFO:tasks.workunit.client.0.smithi038.stdout:2/825: symlink d1/d5/d3d/l116 0 2023-12-16T20:11:35.625 INFO:tasks.workunit.client.0.smithi038.stdout:0/787: truncate db/f3d 3008059 0 2023-12-16T20:11:35.625 INFO:tasks.workunit.client.0.smithi038.stdout:9/757: write d9/d1f/d21/d52/fa7 [208309,34073] 0 2023-12-16T20:11:35.625 INFO:tasks.workunit.client.0.smithi038.stdout:9/758: write d9/d1f/d21/f3a [3451846,8240] 0 2023-12-16T20:11:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:2/826: mknod d1/d5/d2a/d31/c117 0 2023-12-16T20:11:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:2/827: write d1/d5/d95/d61/ff6 [1600479,34503] 0 2023-12-16T20:11:35.628 INFO:tasks.workunit.client.0.smithi038.stdout:0/788: mkdir db/d16/d5a/dff 0 2023-12-16T20:11:35.628 INFO:tasks.workunit.client.0.smithi038.stdout:0/789: dread - db/d16/d19/d80/fbd zero size 2023-12-16T20:11:35.631 INFO:tasks.workunit.client.0.smithi038.stdout:1/773: rename d15/d1e/lff to d15/d1e/d3b/d48/d37/l10a 0 2023-12-16T20:11:35.632 INFO:tasks.workunit.client.0.smithi038.stdout:2/828: truncate d1/d5/f4e 1956522 0 2023-12-16T20:11:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:2/829: creat d1/d5/d3d/ddc/f118 x:0 0 0 2023-12-16T20:11:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:1/774: mknod d15/d22/c10b 0 2023-12-16T20:11:35.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/775: rmdir d15/d1e/d23/d7d/de9 39 2023-12-16T20:11:35.637 INFO:tasks.workunit.client.0.smithi038.stdout:2/830: fsync d1/d5/d95/d61/ff6 0 2023-12-16T20:11:35.639 INFO:tasks.workunit.client.0.smithi038.stdout:1/776: dread d15/d1e/d23/d34/d79/f83 [0,4194304] 0 2023-12-16T20:11:35.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:35 smithi038 ceph-mon[80659]: pgmap v6: 65 pgs: 65 active+clean; 1.5 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 59 MiB/s rd, 82 MiB/s wr, 64 op/s 2023-12-16T20:11:35.644 INFO:tasks.workunit.client.0.smithi038.stdout:1/777: symlink d15/d1e/d23/d7d/l10c 0 2023-12-16T20:11:35.645 INFO:tasks.workunit.client.0.smithi038.stdout:9/759: dread d9/d1e/d3d/d42/d59/fa2 [0,4194304] 0 2023-12-16T20:11:35.646 INFO:tasks.workunit.client.0.smithi038.stdout:7/811: dwrite da/d21/d86/fb0 [4194304,4194304] 0 2023-12-16T20:11:35.646 INFO:tasks.workunit.client.0.smithi038.stdout:4/707: dwrite d13/d17/d62/f9c [0,4194304] 0 2023-12-16T20:11:35.647 INFO:tasks.workunit.client.0.smithi038.stdout:1/778: symlink d15/d1e/d3b/d5a/l10d 0 2023-12-16T20:11:35.650 INFO:tasks.workunit.client.1.smithi141.stdout:1/487: dwrite da/d1a/f95 [0,4194304] 0 2023-12-16T20:11:35.650 INFO:tasks.workunit.client.1.smithi141.stdout:2/284: dwrite d6/d3a/f2c [0,4194304] 0 2023-12-16T20:11:35.650 INFO:tasks.workunit.client.1.smithi141.stdout:2/285: write d6/d12/d1f/d46/f48 [96450,43714] 0 2023-12-16T20:11:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:9/760: symlink d9/d1f/d21/d84/daf/led 0 2023-12-16T20:11:35.652 INFO:tasks.workunit.client.1.smithi141.stdout:4/406: dwrite d1a/f20 [0,4194304] 0 2023-12-16T20:11:35.653 INFO:tasks.workunit.client.0.smithi038.stdout:7/812: mkdir da/d21/d86/de2/d10f 0 2023-12-16T20:11:35.653 INFO:tasks.workunit.client.0.smithi038.stdout:7/813: read - da/dcf/d100/d4d/dc5/fa8 zero size 2023-12-16T20:11:35.654 INFO:tasks.workunit.client.1.smithi141.stdout:9/421: dwrite d1/d10/d14/d20/d3b/f77 [0,4194304] 0 2023-12-16T20:11:35.656 INFO:tasks.workunit.client.1.smithi141.stdout:1/488: symlink da/d36/la0 0 2023-12-16T20:11:35.656 INFO:tasks.workunit.client.1.smithi141.stdout:1/489: write da/d36/d4b/d4d/f56 [565773,106007] 0 2023-12-16T20:11:35.657 INFO:tasks.workunit.client.1.smithi141.stdout:2/286: truncate d6/da/f49 480973 0 2023-12-16T20:11:35.657 INFO:tasks.workunit.client.1.smithi141.stdout:2/287: creat d6/d32/f64 x:0 0 0 2023-12-16T20:11:35.657 INFO:tasks.workunit.client.1.smithi141.stdout:2/288: readlink l5 0 2023-12-16T20:11:35.657 INFO:tasks.workunit.client.1.smithi141.stdout:2/289: getdents d6/d12/d1f/d46/d5a 0 2023-12-16T20:11:35.659 INFO:tasks.workunit.client.1.smithi141.stdout:2/290: write d6/d32/f39 [278950,69411] 0 2023-12-16T20:11:35.659 INFO:tasks.workunit.client.1.smithi141.stdout:2/291: creat d6/d3a/d47/f65 x:0 0 0 2023-12-16T20:11:35.659 INFO:tasks.workunit.client.1.smithi141.stdout:2/292: chown d6/da/c59 6 1 2023-12-16T20:11:35.660 INFO:tasks.workunit.client.1.smithi141.stdout:4/407: creat d1a/d2a/f9f x:0 0 0 2023-12-16T20:11:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:1/779: creat d15/d1e/d3b/d48/d37/deb/d107/f10e x:0 0 0 2023-12-16T20:11:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:1/780: write d15/d1e/d23/d34/d86/d99/fea [671505,99403] 0 2023-12-16T20:11:35.664 INFO:tasks.workunit.client.0.smithi038.stdout:4/708: dread d13/f48 [0,4194304] 0 2023-12-16T20:11:35.664 INFO:tasks.workunit.client.0.smithi038.stdout:4/709: write d13/d17/d62/fbb [372870,124703] 0 2023-12-16T20:11:35.666 INFO:tasks.workunit.client.1.smithi141.stdout:9/422: write d1/d10/d14/d20/d3b/f77 [1309578,31621] 0 2023-12-16T20:11:35.667 INFO:tasks.workunit.client.1.smithi141.stdout:9/423: fdatasync d1/d10/d33/d47/f7f 0 2023-12-16T20:11:35.667 INFO:tasks.workunit.client.1.smithi141.stdout:9/424: chown d1/d10/d14/d20/d3b/f6b 62173 1 2023-12-16T20:11:35.667 INFO:tasks.workunit.client.1.smithi141.stdout:9/425: chown d1/d10/d33/d39/c61 47 1 2023-12-16T20:11:35.667 INFO:tasks.workunit.client.1.smithi141.stdout:9/426: creat d1/d26/d4a/f94 x:0 0 0 2023-12-16T20:11:35.668 INFO:tasks.workunit.client.0.smithi038.stdout:7/814: creat da/dcf/d100/d4d/dae/f110 x:0 0 0 2023-12-16T20:11:35.668 INFO:tasks.workunit.client.0.smithi038.stdout:7/815: chown da/dcf/d100/d4d/dc5/f4a 989497857 1 2023-12-16T20:11:35.671 INFO:tasks.workunit.client.0.smithi038.stdout:4/710: mknod d13/d69/ce6 0 2023-12-16T20:11:35.674 INFO:tasks.workunit.client.0.smithi038.stdout:8/648: dwrite d17/d1b/d25/f5c [4194304,4194304] 0 2023-12-16T20:11:35.675 INFO:tasks.workunit.client.0.smithi038.stdout:8/649: creat d17/d1b/d66/d8e/d97/fd5 x:0 0 0 2023-12-16T20:11:35.675 INFO:tasks.workunit.client.0.smithi038.stdout:8/650: write d17/d1b/d66/d73/d54/fd1 [813464,74488] 0 2023-12-16T20:11:35.675 INFO:tasks.workunit.client.0.smithi038.stdout:8/651: truncate d17/d1b/fd2 909090 0 2023-12-16T20:11:35.675 INFO:tasks.workunit.client.1.smithi141.stdout:1/490: dread da/d1a/d1d/d22/f69 [0,4194304] 0 2023-12-16T20:11:35.675 INFO:tasks.workunit.client.1.smithi141.stdout:3/528: dwrite d0/d1c/d40/d3f/d52/d5a/f71 [0,4194304] 0 2023-12-16T20:11:35.676 INFO:tasks.workunit.client.0.smithi038.stdout:9/761: rmdir d9/d1e/d40/d5e 39 2023-12-16T20:11:35.676 INFO:tasks.workunit.client.0.smithi038.stdout:3/742: sync 2023-12-16T20:11:35.677 INFO:tasks.workunit.client.1.smithi141.stdout:1/491: read da/d36/d4b/f5a [387027,95680] 0 2023-12-16T20:11:35.677 INFO:tasks.workunit.client.1.smithi141.stdout:1/492: read da/df/f1b [943263,103220] 0 2023-12-16T20:11:35.678 INFO:tasks.workunit.client.0.smithi038.stdout:7/816: link da/d21/d2c/f9c da/d21/d2c/d76/d9a/f111 0 2023-12-16T20:11:35.679 INFO:tasks.workunit.client.0.smithi038.stdout:4/711: mknod d13/d17/d2e/d32/ce7 0 2023-12-16T20:11:35.683 INFO:tasks.workunit.client.0.smithi038.stdout:3/743: symlink d4/d67/de1/d4c/d70/d71/db9/dd8/l100 0 2023-12-16T20:11:35.685 INFO:tasks.workunit.client.0.smithi038.stdout:7/817: truncate da/d21/d2c/f47 382415 0 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:7/818: chown da/d21/d86/le9 220438254 1 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:5/817: dwrite d2/df/d1a/d1f/d4a/d53/d6e/d9e/fb4 [0,4194304] 0 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:5/818: read d2/df/d1a/d2a/f50 [793649,90761] 0 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:5/819: chown d2/df/d87/cb1 2892894 1 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:5/820: write d2/d14/d25/ffe [123961,68193] 0 2023-12-16T20:11:35.686 INFO:tasks.workunit.client.0.smithi038.stdout:4/712: symlink d13/d17/d2e/d32/d4d/d6e/le8 0 2023-12-16T20:11:35.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/744: mknod d4/d8/d15/d6d/d7a/d98/c101 0 2023-12-16T20:11:35.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/745: chown d4/d6c/d80/fb3 2318913 1 2023-12-16T20:11:35.692 INFO:tasks.workunit.client.1.smithi141.stdout:3/529: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:35.695 INFO:tasks.workunit.client.1.smithi141.stdout:4/408: dwrite d1a/d2a/d3b/d69/f72 [0,4194304] 0 2023-12-16T20:11:35.696 INFO:tasks.workunit.client.1.smithi141.stdout:4/409: creat d1a/d2a/d3b/d69/fa0 x:0 0 0 2023-12-16T20:11:35.696 INFO:tasks.workunit.client.0.smithi038.stdout:2/831: dwrite d1/d5/d16/f3b [0,4194304] 0 2023-12-16T20:11:35.696 INFO:tasks.workunit.client.0.smithi038.stdout:2/832: chown d1/d5/d95/d61/dd4/d6a/d43/d57/f5a 10 1 2023-12-16T20:11:35.696 INFO:tasks.workunit.client.0.smithi038.stdout:2/833: chown d1/d5/d95/d61/dd4/d10/f71 1597458 1 2023-12-16T20:11:35.697 INFO:tasks.workunit.client.0.smithi038.stdout:2/834: creat d1/d5/d95/d61/dd4/d21/d9a/db9/f119 x:0 0 0 2023-12-16T20:11:35.697 INFO:tasks.workunit.client.0.smithi038.stdout:5/821: truncate d2/d14/d25/f5b 4766918 0 2023-12-16T20:11:35.698 INFO:tasks.workunit.client.0.smithi038.stdout:8/652: dwrite d17/d1b/d66/f94 [0,4194304] 0 2023-12-16T20:11:35.700 INFO:tasks.workunit.client.1.smithi141.stdout:9/427: dwrite d1/d10/d14/d20/f86 [0,4194304] 0 2023-12-16T20:11:35.706 INFO:tasks.workunit.client.1.smithi141.stdout:3/530: rmdir d0 39 2023-12-16T20:11:35.707 INFO:tasks.workunit.client.1.smithi141.stdout:1/493: write da/d36/d4b/d4d/d80/f93 [630414,124741] 0 2023-12-16T20:11:35.709 INFO:tasks.workunit.client.0.smithi038.stdout:0/790: dwrite db/d16/d70/d7c/f7e [0,4194304] 0 2023-12-16T20:11:35.712 INFO:tasks.workunit.client.1.smithi141.stdout:1/494: read da/fc [836920,4598] 0 2023-12-16T20:11:35.714 INFO:tasks.workunit.client.0.smithi038.stdout:8/653: rmdir d17/d1b/d66/d73/d55/da5/da6/dcc 0 2023-12-16T20:11:35.718 INFO:tasks.workunit.client.1.smithi141.stdout:5/332: sync 2023-12-16T20:11:35.719 INFO:tasks.workunit.client.1.smithi141.stdout:6/442: sync 2023-12-16T20:11:35.719 INFO:tasks.workunit.client.1.smithi141.stdout:5/333: fdatasync d0/d9/f34 0 2023-12-16T20:11:35.719 INFO:tasks.workunit.client.0.smithi038.stdout:5/822: getdents d2/df/d1a/d1f/d4a/d53/d6e 0 2023-12-16T20:11:35.719 INFO:tasks.workunit.client.0.smithi038.stdout:5/823: fsync d2/df/d1a/d2a/d59/fad 0 2023-12-16T20:11:35.719 INFO:tasks.workunit.client.0.smithi038.stdout:5/824: stat d2/df/d1a/f46 0 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:6/443: write d1/d12/d20/f6a [152921,95159] 0 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:6/444: readlink d1/d12/d22/d25/l5c 0 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:6/445: stat d1/dd/d2f/f30 0 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:0/425: sync 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:8/456: sync 2023-12-16T20:11:35.720 INFO:tasks.workunit.client.1.smithi141.stdout:7/411: sync 2023-12-16T20:11:35.724 INFO:tasks.workunit.client.1.smithi141.stdout:9/428: rmdir d1/d10 39 2023-12-16T20:11:35.726 INFO:tasks.workunit.client.1.smithi141.stdout:1/495: stat da/d36/d4b/d4d/d89/d6c/l9f 0 2023-12-16T20:11:35.727 INFO:tasks.workunit.client.0.smithi038.stdout:0/791: dread db/d16/d5a/d65/de8/d77/d95/da4/fd7 [0,4194304] 0 2023-12-16T20:11:35.727 INFO:tasks.workunit.client.0.smithi038.stdout:6/664: sync 2023-12-16T20:11:35.727 INFO:tasks.workunit.client.0.smithi038.stdout:4/713: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:35.727 INFO:tasks.workunit.client.0.smithi038.stdout:7/819: dwrite f6 [8388608,4194304] 0 2023-12-16T20:11:35.729 INFO:tasks.workunit.client.1.smithi141.stdout:5/334: creat d0/d25/d30/d67/f71 x:0 0 0 2023-12-16T20:11:35.729 INFO:tasks.workunit.client.1.smithi141.stdout:5/335: chown d0/d9/d16/d2a/d35/d5e/f6b 322 1 2023-12-16T20:11:35.731 INFO:tasks.workunit.client.1.smithi141.stdout:6/446: truncate d1/d12/d22/f88 828189 0 2023-12-16T20:11:35.734 INFO:tasks.workunit.client.1.smithi141.stdout:8/457: rename d14/d19/d1b/d24/c85 to d14/d19/d1b/d24/d4b/d8f/c92 0 2023-12-16T20:11:35.735 INFO:tasks.workunit.client.0.smithi038.stdout:7/820: creat da/dcf/d100/d4d/dc5/d38/d90/f112 x:0 0 0 2023-12-16T20:11:35.736 INFO:tasks.workunit.client.1.smithi141.stdout:1/496: creat da/d36/d4b/d4d/d80/fa1 x:0 0 0 2023-12-16T20:11:35.736 INFO:tasks.workunit.client.1.smithi141.stdout:1/497: chown da/df/f1b 21 1 2023-12-16T20:11:35.737 INFO:tasks.workunit.client.1.smithi141.stdout:2/293: dwrite d6/da/f49 [0,4194304] 0 2023-12-16T20:11:35.737 INFO:tasks.workunit.client.1.smithi141.stdout:0/426: mknod d4/d7/c99 0 2023-12-16T20:11:35.737 INFO:tasks.workunit.client.1.smithi141.stdout:0/427: write d4/d49/d73/d3b/d78/d7f/f90 [20109,106260] 0 2023-12-16T20:11:35.738 INFO:tasks.workunit.client.1.smithi141.stdout:8/458: mknod d14/d19/d1b/d24/d4a/d5b/c93 0 2023-12-16T20:11:35.739 INFO:tasks.workunit.client.1.smithi141.stdout:1/498: mknod da/d36/d4b/d4d/d80/d94/d9d/ca2 0 2023-12-16T20:11:35.741 INFO:tasks.workunit.client.0.smithi038.stdout:4/714: rename d13/d17/d2e/d32/d4d to d13/d17/d2e/d32/d70/d84/d88/dc3/de9 0 2023-12-16T20:11:35.741 INFO:tasks.workunit.client.1.smithi141.stdout:0/428: rename d4/d7/l62 to d4/d49/d8f/l9a 0 2023-12-16T20:11:35.743 INFO:tasks.workunit.client.1.smithi141.stdout:8/459: creat d14/f94 x:0 0 0 2023-12-16T20:11:35.743 INFO:tasks.workunit.client.1.smithi141.stdout:8/460: chown d14/d19/d1b/d24/d4a/d5b 396799258 1 2023-12-16T20:11:35.744 INFO:tasks.workunit.client.0.smithi038.stdout:0/792: dread db/d16/d5a/d65/de8/f7a [0,4194304] 0 2023-12-16T20:11:35.745 INFO:tasks.workunit.client.1.smithi141.stdout:9/429: dread d1/d10/d14/f25 [8388608,4194304] 0 2023-12-16T20:11:35.745 INFO:tasks.workunit.client.1.smithi141.stdout:9/430: write d1/d10/d33/d39/f56 [531245,70879] 0 2023-12-16T20:11:35.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:35 smithi141 ceph-mon[88165]: pgmap v6: 65 pgs: 65 active+clean; 1.5 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 59 MiB/s rd, 82 MiB/s wr, 64 op/s 2023-12-16T20:11:35.746 INFO:tasks.workunit.client.1.smithi141.stdout:0/429: stat d4/d74/l7c 0 2023-12-16T20:11:35.746 INFO:tasks.workunit.client.1.smithi141.stdout:1/499: creat da/d1a/fa3 x:0 0 0 2023-12-16T20:11:35.747 INFO:tasks.workunit.client.1.smithi141.stdout:1/500: mknod da/d36/d4b/d4d/d89/ca4 0 2023-12-16T20:11:35.747 INFO:tasks.workunit.client.0.smithi038.stdout:4/715: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/da6/fea x:0 0 0 2023-12-16T20:11:35.748 INFO:tasks.workunit.client.0.smithi038.stdout:2/835: truncate d1/d5/d16/f3b 2833839 0 2023-12-16T20:11:35.748 INFO:tasks.workunit.client.0.smithi038.stdout:2/836: read d1/d5/d95/d61/d66/ddd/de8/dea/f107 [19931,84452] 0 2023-12-16T20:11:35.749 INFO:tasks.workunit.client.1.smithi141.stdout:0/430: mkdir d4/d49/d73/d8a/d9b 0 2023-12-16T20:11:35.749 INFO:tasks.workunit.client.1.smithi141.stdout:0/431: readlink d4/d49/d4b/l57 0 2023-12-16T20:11:35.749 INFO:tasks.workunit.client.1.smithi141.stdout:0/432: dread - d4/d49/d73/d3b/d78/d7f/d80/d83/f95 zero size 2023-12-16T20:11:35.750 INFO:tasks.workunit.client.0.smithi038.stdout:4/716: link d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/da6/fd7 d13/d17/feb 0 2023-12-16T20:11:35.751 INFO:tasks.workunit.client.1.smithi141.stdout:0/433: mknod d4/d74/c9c 0 2023-12-16T20:11:35.751 INFO:tasks.workunit.client.0.smithi038.stdout:7/821: write da/d21/d2c/f36 [1275197,50758] 0 2023-12-16T20:11:35.751 INFO:tasks.workunit.client.0.smithi038.stdout:2/837: chown d1/d5/d95/d61/dd4/d6a/l90 6 1 2023-12-16T20:11:35.754 INFO:tasks.workunit.client.0.smithi038.stdout:6/665: read d1/f19 [2600876,53601] 0 2023-12-16T20:11:35.755 INFO:tasks.workunit.client.1.smithi141.stdout:0/434: creat d4/d49/d4b/f9d x:0 0 0 2023-12-16T20:11:35.756 INFO:tasks.workunit.client.1.smithi141.stdout:6/447: dread d1/d12/f16 [0,4194304] 0 2023-12-16T20:11:35.756 INFO:tasks.workunit.client.1.smithi141.stdout:6/448: write d1/d12/f33 [4854765,90688] 0 2023-12-16T20:11:35.756 INFO:tasks.workunit.client.1.smithi141.stdout:6/449: fdatasync d1/d12/d22/f64 0 2023-12-16T20:11:35.757 INFO:tasks.workunit.client.0.smithi038.stdout:4/717: link d13/d17/d2e/l8d d13/d69/d7a/da5/lec 0 2023-12-16T20:11:35.757 INFO:tasks.workunit.client.0.smithi038.stdout:4/718: fdatasync d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/fdc 0 2023-12-16T20:11:35.758 INFO:tasks.workunit.client.1.smithi141.stdout:6/450: mknod d1/d12/d20/d44/d65/c93 0 2023-12-16T20:11:35.759 INFO:tasks.workunit.client.1.smithi141.stdout:6/451: truncate d1/fa 2068602 0 2023-12-16T20:11:35.760 INFO:tasks.workunit.client.0.smithi038.stdout:7/822: rmdir da/dcf/d100/d4d/dc5 39 2023-12-16T20:11:35.760 INFO:tasks.workunit.client.0.smithi038.stdout:9/762: dwrite d9/d1f/d21/d3e/d72/f86 [0,4194304] 0 2023-12-16T20:11:35.761 INFO:tasks.workunit.client.1.smithi141.stdout:6/452: mknod d1/d5e/c94 0 2023-12-16T20:11:35.761 INFO:tasks.workunit.client.1.smithi141.stdout:3/531: dwrite d0/d1c/d40/d85/d4c/f8a [0,4194304] 0 2023-12-16T20:11:35.764 INFO:tasks.workunit.client.0.smithi038.stdout:2/838: rename d1/d5/d2a/d31/c40 to d1/d5/c11a 0 2023-12-16T20:11:35.764 INFO:tasks.workunit.client.0.smithi038.stdout:2/839: write d1/d5/d2a/fd3 [316250,62389] 0 2023-12-16T20:11:35.767 INFO:tasks.workunit.client.0.smithi038.stdout:6/666: symlink d1/d4/d1d/d28/db1/dbe/lce 0 2023-12-16T20:11:35.769 INFO:tasks.workunit.client.0.smithi038.stdout:4/719: dread d13/d17/d2e/d32/d4e/fa9 [0,4194304] 0 2023-12-16T20:11:35.769 INFO:tasks.workunit.client.0.smithi038.stdout:4/720: fsync d13/d1f/d35/f92 0 2023-12-16T20:11:35.769 INFO:tasks.workunit.client.0.smithi038.stdout:7/823: creat da/dcf/d100/d4d/dc5/d38/f113 x:0 0 0 2023-12-16T20:11:35.772 INFO:tasks.workunit.client.1.smithi141.stdout:7/412: dwrite d5/d1d/d1e/f74 [0,4194304] 0 2023-12-16T20:11:35.773 INFO:tasks.workunit.client.0.smithi038.stdout:5/825: dwrite d2/d14/d25/d2d/d17/d55/f72 [0,4194304] 0 2023-12-16T20:11:35.773 INFO:tasks.workunit.client.0.smithi038.stdout:8/654: dwrite d17/d1b/d25/f3c [0,4194304] 0 2023-12-16T20:11:35.775 INFO:tasks.workunit.client.0.smithi038.stdout:9/763: symlink d9/d1f/d21/d3e/d4e/d61/d9b/lee 0 2023-12-16T20:11:35.776 INFO:tasks.workunit.client.0.smithi038.stdout:9/764: truncate d9/d1e/d3d/d42/d59/d76/f9a 1968730 0 2023-12-16T20:11:35.776 INFO:tasks.workunit.client.0.smithi038.stdout:6/667: symlink d1/d4/lcf 0 2023-12-16T20:11:35.777 INFO:tasks.workunit.client.0.smithi038.stdout:6/668: creat d1/d16/d23/d5f/fd0 x:0 0 0 2023-12-16T20:11:35.777 INFO:tasks.workunit.client.0.smithi038.stdout:6/669: write d1/d5b/d7d/d9d/f6a [5153540,39202] 0 2023-12-16T20:11:35.777 INFO:tasks.workunit.client.1.smithi141.stdout:7/413: unlink d5/d2a/d45/f4f 0 2023-12-16T20:11:35.777 INFO:tasks.workunit.client.1.smithi141.stdout:6/453: read d1/d12/d22/f53 [233311,51258] 0 2023-12-16T20:11:35.778 INFO:tasks.workunit.client.0.smithi038.stdout:7/824: symlink da/d21/d86/de2/d10f/l114 0 2023-12-16T20:11:35.779 INFO:tasks.workunit.client.1.smithi141.stdout:7/414: symlink d5/d1d/d1e/l85 0 2023-12-16T20:11:35.779 INFO:tasks.workunit.client.1.smithi141.stdout:7/415: write d5/d16/d30/d4e/d6e/f84 [957445,119226] 0 2023-12-16T20:11:35.779 INFO:tasks.workunit.client.1.smithi141.stdout:7/416: fsync d5/d16/d30/d4e/d6e/f77 0 2023-12-16T20:11:35.781 INFO:tasks.workunit.client.0.smithi038.stdout:7/825: dread da/d21/d61/f66 [0,4194304] 0 2023-12-16T20:11:35.781 INFO:tasks.workunit.client.1.smithi141.stdout:6/454: truncate d1/d12/d20/d3a/d45/f81 2148900 0 2023-12-16T20:11:35.782 INFO:tasks.workunit.client.1.smithi141.stdout:6/455: truncate d1/d12/d20/d44/f5b 580437 0 2023-12-16T20:11:35.782 INFO:tasks.workunit.client.1.smithi141.stdout:6/456: readlink d1/d3/lc 0 2023-12-16T20:11:35.782 INFO:tasks.workunit.client.1.smithi141.stdout:0/435: write d4/d49/d4b/f66 [1682964,89468] 0 2023-12-16T20:11:35.783 INFO:tasks.workunit.client.0.smithi038.stdout:9/765: link d9/c15 d9/d1f/d21/d3e/cef 0 2023-12-16T20:11:35.783 INFO:tasks.workunit.client.1.smithi141.stdout:0/436: read d4/d49/d73/d3b/f59 [347831,8197] 0 2023-12-16T20:11:35.783 INFO:tasks.workunit.client.1.smithi141.stdout:0/437: dread - d4/d49/d73/d3b/d78/d7f/d80/d83/f89 zero size 2023-12-16T20:11:35.784 INFO:tasks.workunit.client.1.smithi141.stdout:0/438: stat d4/d49/d4b/l86 0 2023-12-16T20:11:35.785 INFO:tasks.workunit.client.0.smithi038.stdout:4/721: read d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d4f/f53 [1480247,43769] 0 2023-12-16T20:11:35.786 INFO:tasks.workunit.client.1.smithi141.stdout:3/532: dread d0/d1c/d40/d85/d4c/f8a [0,4194304] 0 2023-12-16T20:11:35.790 INFO:tasks.workunit.client.0.smithi038.stdout:4/722: getdents d13/d17/d2e/d32/d70/d84/d88 0 2023-12-16T20:11:35.790 INFO:tasks.workunit.client.1.smithi141.stdout:7/417: read d5/f24 [483801,69967] 0 2023-12-16T20:11:35.790 INFO:tasks.workunit.client.1.smithi141.stdout:7/418: stat d5/d1d/d1e/l2e 0 2023-12-16T20:11:35.790 INFO:tasks.workunit.client.1.smithi141.stdout:6/457: rename d1/d12/d22/d31 to d1/d12/d20/d89/d95 0 2023-12-16T20:11:35.790 INFO:tasks.workunit.client.1.smithi141.stdout:6/458: fdatasync d1/d12/d20/d44/f5b 0 2023-12-16T20:11:35.794 INFO:tasks.workunit.client.1.smithi141.stdout:0/439: getdents d4/d49/d73/d3b 0 2023-12-16T20:11:35.802 INFO:tasks.workunit.client.0.smithi038.stdout:7/826: rmdir da/d21/d2c/d76 39 2023-12-16T20:11:35.802 INFO:tasks.workunit.client.0.smithi038.stdout:7/827: readlink da/dcf/d100/l3d 0 2023-12-16T20:11:35.804 INFO:tasks.workunit.client.0.smithi038.stdout:4/723: getdents d13/d17 0 2023-12-16T20:11:35.806 INFO:tasks.workunit.client.0.smithi038.stdout:5/826: dread d2/d14/d25/d2d/f31 [0,4194304] 0 2023-12-16T20:11:35.806 INFO:tasks.workunit.client.0.smithi038.stdout:7/828: mknod da/dcf/d100/d4d/dc5/d38/d65/d81/c115 0 2023-12-16T20:11:35.808 INFO:tasks.workunit.client.0.smithi038.stdout:5/827: truncate d2/d4/fff 611832 0 2023-12-16T20:11:35.808 INFO:tasks.workunit.client.0.smithi038.stdout:4/724: link d13/d17/d4b/da4/lae d13/d69/d7a/da5/led 0 2023-12-16T20:11:35.809 INFO:tasks.workunit.client.1.smithi141.stdout:4/410: dwrite d1a/d2a/d3b/d69/f72 [4194304,4194304] 0 2023-12-16T20:11:35.809 INFO:tasks.workunit.client.1.smithi141.stdout:4/411: truncate d1a/d2a/d3b/d69/fa0 593147 0 2023-12-16T20:11:35.809 INFO:tasks.workunit.client.1.smithi141.stdout:4/412: fsync d1a/d2a/d3b/d69/f72 0 2023-12-16T20:11:35.810 INFO:tasks.workunit.client.1.smithi141.stdout:8/461: dwrite d14/f43 [0,4194304] 0 2023-12-16T20:11:35.810 INFO:tasks.workunit.client.1.smithi141.stdout:1/501: dwrite da/d36/d4b/f63 [0,4194304] 0 2023-12-16T20:11:35.810 INFO:tasks.workunit.client.0.smithi038.stdout:6/670: dread d1/d4/d1d/d61/f7b [0,4194304] 0 2023-12-16T20:11:35.813 INFO:tasks.workunit.client.1.smithi141.stdout:8/462: truncate d14/f64 223463 0 2023-12-16T20:11:35.814 INFO:tasks.workunit.client.0.smithi038.stdout:6/671: link d1/d4/d1d/d8e/fba d1/d4/d1d/d28/db1/dbe/fd1 0 2023-12-16T20:11:35.819 INFO:tasks.workunit.client.1.smithi141.stdout:2/294: dwrite d6/d12/d15/f4c [0,4194304] 0 2023-12-16T20:11:35.819 INFO:tasks.workunit.client.1.smithi141.stdout:1/502: rename da/fb to da/d7a/fa5 0 2023-12-16T20:11:35.819 INFO:tasks.workunit.client.0.smithi038.stdout:2/840: dwrite d1/d5/d95/d61/dd4/d21/f45 [0,4194304] 0 2023-12-16T20:11:35.819 INFO:tasks.workunit.client.0.smithi038.stdout:6/672: rename d1/d16/d23/d5f/fac to d1/d5b/d7d/fd2 0 2023-12-16T20:11:35.821 INFO:tasks.workunit.client.0.smithi038.stdout:2/841: unlink d1/d5/d95/d61/d66/ddd/de8/dea/fa9 0 2023-12-16T20:11:35.822 INFO:tasks.workunit.client.0.smithi038.stdout:2/842: creat d1/d5/d95/f11b x:0 0 0 2023-12-16T20:11:35.822 INFO:tasks.workunit.client.0.smithi038.stdout:6/673: getdents d1/d4/d1d/d28/db1/dbe/db3 0 2023-12-16T20:11:35.822 INFO:tasks.workunit.client.0.smithi038.stdout:6/674: read - d1/d4/d1d/fae zero size 2023-12-16T20:11:35.824 INFO:tasks.workunit.client.1.smithi141.stdout:2/295: mkdir d6/d3a/d47/d58/d66 0 2023-12-16T20:11:35.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/503: write da/f2c [711452,604] 0 2023-12-16T20:11:35.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/504: fdatasync da/d36/f3f 0 2023-12-16T20:11:35.825 INFO:tasks.workunit.client.0.smithi038.stdout:6/675: read d1/d4/f9c [439005,65265] 0 2023-12-16T20:11:35.830 INFO:tasks.workunit.client.0.smithi038.stdout:6/676: creat d1/d4/d1d/d28/d2f/d85/da2/da5/fd3 x:0 0 0 2023-12-16T20:11:35.831 INFO:tasks.workunit.client.0.smithi038.stdout:6/677: write d1/d4/d1d/d28/d2f/d85/da2/da5/fd3 [383799,58223] 0 2023-12-16T20:11:35.831 INFO:tasks.workunit.client.1.smithi141.stdout:2/296: unlink d6/da/ce 0 2023-12-16T20:11:35.832 INFO:tasks.workunit.client.1.smithi141.stdout:2/297: write d6/d12/d1f/d46/f63 [760112,15320] 0 2023-12-16T20:11:35.832 INFO:tasks.workunit.client.1.smithi141.stdout:2/298: stat d6/da/d33/d4f/d5f/c62 0 2023-12-16T20:11:35.833 INFO:tasks.workunit.client.1.smithi141.stdout:1/505: creat da/d36/d4b/d7c/fa6 x:0 0 0 2023-12-16T20:11:35.833 INFO:tasks.workunit.client.1.smithi141.stdout:9/431: dwrite d1/d10/f6c [0,4194304] 0 2023-12-16T20:11:35.833 INFO:tasks.workunit.client.1.smithi141.stdout:8/463: dread d14/d19/f1c [0,4194304] 0 2023-12-16T20:11:35.833 INFO:tasks.workunit.client.1.smithi141.stdout:8/464: write d14/d19/d1b/f21 [3924647,119048] 0 2023-12-16T20:11:35.833 INFO:tasks.workunit.client.0.smithi038.stdout:6/678: rmdir d1/d4/d1d/d61/da4 39 2023-12-16T20:11:35.837 INFO:tasks.workunit.client.0.smithi038.stdout:5/828: dread d2/d14/d25/f3f [0,4194304] 0 2023-12-16T20:11:35.837 INFO:tasks.workunit.client.1.smithi141.stdout:9/432: symlink d1/d10/d33/d6a/d72/l95 0 2023-12-16T20:11:35.839 INFO:tasks.workunit.client.1.smithi141.stdout:8/465: mkdir d14/d19/d95 0 2023-12-16T20:11:35.840 INFO:tasks.workunit.client.0.smithi038.stdout:2/843: dread d1/d5/d95/d61/dd4/d21/f3c [0,4194304] 0 2023-12-16T20:11:35.841 INFO:tasks.workunit.client.1.smithi141.stdout:2/299: dread d6/d3a/f2c [0,4194304] 0 2023-12-16T20:11:35.842 INFO:tasks.workunit.client.0.smithi038.stdout:6/679: getdents d1/d4/d1d/d28 0 2023-12-16T20:11:35.842 INFO:tasks.workunit.client.1.smithi141.stdout:9/433: link d1/d26/d4a/d73/l48 d1/d26/l96 0 2023-12-16T20:11:35.844 INFO:tasks.workunit.client.0.smithi038.stdout:9/766: dwrite d9/d1f/d21/d55/f65 [0,4194304] 0 2023-12-16T20:11:35.844 INFO:tasks.workunit.client.1.smithi141.stdout:9/434: symlink d1/d10/d14/d20/da/d89/l97 0 2023-12-16T20:11:35.844 INFO:tasks.workunit.client.1.smithi141.stdout:6/459: dwrite d1/fa [0,4194304] 0 2023-12-16T20:11:35.844 INFO:tasks.workunit.client.1.smithi141.stdout:6/460: readlink d1/d12/d22/d25/l5c 0 2023-12-16T20:11:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/829: symlink d2/d4/l102 0 2023-12-16T20:11:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/830: chown d2/d14/d25/d2d/d17/da9/cc7 2 1 2023-12-16T20:11:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/831: fdatasync d2/d14/d25/fca 0 2023-12-16T20:11:35.846 INFO:tasks.workunit.client.1.smithi141.stdout:9/435: creat d1/d10/d14/d20/da/d3f/f98 x:0 0 0 2023-12-16T20:11:35.849 INFO:tasks.workunit.client.1.smithi141.stdout:6/461: symlink d1/d12/d22/d25/d38/l96 0 2023-12-16T20:11:35.849 INFO:tasks.workunit.client.1.smithi141.stdout:6/462: chown d1/d3/d4b/f66 20 1 2023-12-16T20:11:35.849 INFO:tasks.workunit.client.1.smithi141.stdout:6/463: getdents d1/d77 0 2023-12-16T20:11:35.850 INFO:tasks.workunit.client.1.smithi141.stdout:6/464: write d1/d12/d22/d25/f2e [124930,72432] 0 2023-12-16T20:11:35.850 INFO:tasks.workunit.client.1.smithi141.stdout:6/465: write d1/d12/d20/d44/f5b [636582,103634] 0 2023-12-16T20:11:35.850 INFO:tasks.workunit.client.0.smithi038.stdout:6/680: rename d1/d4/d1d/d67/d73/lc3 to d1/d4/d1d/d28/db1/dbe/db3/ld4 0 2023-12-16T20:11:35.850 INFO:tasks.workunit.client.0.smithi038.stdout:6/681: chown d1/d5b/d7d/l97 0 1 2023-12-16T20:11:35.853 INFO:tasks.workunit.client.0.smithi038.stdout:2/844: rmdir d1/d5/d3d/d9e 39 2023-12-16T20:11:35.853 INFO:tasks.workunit.client.0.smithi038.stdout:2/845: write d1/d5/d2a/f35 [37057,79834] 0 2023-12-16T20:11:35.853 INFO:tasks.workunit.client.0.smithi038.stdout:2/846: chown d1/f104 0 1 2023-12-16T20:11:35.853 INFO:tasks.workunit.client.0.smithi038.stdout:2/847: truncate d1/d5/d95/d61/dd4/f62 88711 0 2023-12-16T20:11:35.854 INFO:tasks.workunit.client.1.smithi141.stdout:1/506: fsync da/d7a/fa5 0 2023-12-16T20:11:35.854 INFO:tasks.workunit.client.0.smithi038.stdout:6/682: creat d1/d4/d1d/d8e/dbf/fd5 x:0 0 0 2023-12-16T20:11:35.856 INFO:tasks.workunit.client.0.smithi038.stdout:2/848: rename d1/d5/d95/d61/dd4/d21/f93 to d1/d5/d2a/d31/f11c 0 2023-12-16T20:11:35.858 INFO:tasks.workunit.client.0.smithi038.stdout:2/849: mkdir d1/d5/d95/d61/dd4/d10/d109/dce/d11d 0 2023-12-16T20:11:35.860 INFO:tasks.workunit.client.0.smithi038.stdout:2/850: symlink d1/d88/l11e 0 2023-12-16T20:11:35.861 INFO:tasks.workunit.client.1.smithi141.stdout:1/507: read da/d1a/f73 [1647060,105084] 0 2023-12-16T20:11:35.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/419: dwrite d5/d16/d46/f5d [0,4194304] 0 2023-12-16T20:11:35.861 INFO:tasks.workunit.client.1.smithi141.stdout:7/420: fdatasync d5/d16/d1a/d40/f7b 0 2023-12-16T20:11:35.862 INFO:tasks.workunit.client.1.smithi141.stdout:7/421: chown d5/d1d/d1e/d71 182004 1 2023-12-16T20:11:35.862 INFO:tasks.workunit.client.1.smithi141.stdout:7/422: creat d5/d2a/f86 x:0 0 0 2023-12-16T20:11:35.862 INFO:tasks.workunit.client.1.smithi141.stdout:6/466: rename d1/d12/d22/l67 to d1/dd/d43/l97 0 2023-12-16T20:11:35.862 INFO:tasks.workunit.client.1.smithi141.stdout:6/467: chown d1/d12/d22/f64 2061087 1 2023-12-16T20:11:35.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/851: creat d1/d5/d95/d61/d66/ddd/de8/f11f x:0 0 0 2023-12-16T20:11:35.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/852: write d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fb6 [175545,15241] 0 2023-12-16T20:11:35.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/853: chown d1/d5/d95/f11b 2065767 1 2023-12-16T20:11:35.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/854: write d1/d5/d95/d61/dd4/d10/f77 [419306,119163] 0 2023-12-16T20:11:35.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/436: write d1/d10/d14/d20/f54 [70806,6578] 0 2023-12-16T20:11:35.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/437: creat d1/d26/d4a/f99 x:0 0 0 2023-12-16T20:11:35.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/438: dread - d1/d26/d4a/f94 zero size 2023-12-16T20:11:35.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/439: getdents d1/d10/d14/d20/d90 0 2023-12-16T20:11:35.866 INFO:tasks.workunit.client.1.smithi141.stdout:1/508: link da/d1a/d31/l39 da/d1a/d1d/d33/la7 0 2023-12-16T20:11:35.866 INFO:tasks.workunit.client.0.smithi038.stdout:2/855: unlink d1/d5/d95/d61/dd4/d21/d9a/db9/c3e 0 2023-12-16T20:11:35.867 INFO:tasks.workunit.client.0.smithi038.stdout:6/683: write d1/f22 [1601288,110425] 0 2023-12-16T20:11:35.867 INFO:tasks.workunit.client.0.smithi038.stdout:9/767: dwrite d9/d1e/d3d/d42/d59/d76/f9a [0,4194304] 0 2023-12-16T20:11:35.867 INFO:tasks.workunit.client.0.smithi038.stdout:9/768: write d9/d1e/d40/f58 [3528237,51349] 0 2023-12-16T20:11:35.868 INFO:tasks.workunit.client.0.smithi038.stdout:9/769: dread - d9/d1f/d6a/f97 zero size 2023-12-16T20:11:35.868 INFO:tasks.workunit.client.1.smithi141.stdout:7/423: rmdir d5/d16/d46/d61 39 2023-12-16T20:11:35.869 INFO:tasks.workunit.client.0.smithi038.stdout:2/856: rmdir d1/d5/d95/d61/dd4/d6a/d43/de9 0 2023-12-16T20:11:35.872 INFO:tasks.workunit.client.1.smithi141.stdout:6/468: symlink d1/d3/l98 0 2023-12-16T20:11:35.877 INFO:tasks.workunit.client.1.smithi141.stdout:2/300: dwrite d6/d12/d1f/d46/f63 [0,4194304] 0 2023-12-16T20:11:35.877 INFO:tasks.workunit.client.1.smithi141.stdout:2/301: stat d6/da/d33/d4f/d5f/c62 0 2023-12-16T20:11:35.877 INFO:tasks.workunit.client.1.smithi141.stdout:2/302: chown d6/d12/d1f/l25 0 1 2023-12-16T20:11:35.879 INFO:tasks.workunit.client.0.smithi038.stdout:7/829: dwrite da/d21/d2c/d76/d9a/f111 [0,4194304] 0 2023-12-16T20:11:35.884 INFO:tasks.workunit.client.1.smithi141.stdout:9/440: dread d1/d10/d27/f79 [0,4194304] 0 2023-12-16T20:11:35.884 INFO:tasks.workunit.client.1.smithi141.stdout:4/413: dwrite d1a/d54/f6a [0,4194304] 0 2023-12-16T20:11:35.884 INFO:tasks.workunit.client.1.smithi141.stdout:4/414: readlink d1a/l4a 0 2023-12-16T20:11:35.884 INFO:tasks.workunit.client.1.smithi141.stdout:7/424: read d5/d16/f3c [1960830,67672] 0 2023-12-16T20:11:35.885 INFO:tasks.workunit.client.1.smithi141.stdout:6/469: creat d1/d3/d4b/d60/f99 x:0 0 0 2023-12-16T20:11:35.889 INFO:tasks.workunit.client.1.smithi141.stdout:2/303: mkdir d6/d12/d67 0 2023-12-16T20:11:35.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/509: dwrite da/df/f34 [0,4194304] 0 2023-12-16T20:11:35.896 INFO:tasks.workunit.client.1.smithi141.stdout:7/425: mkdir d5/d16/d30/d4e/d87 0 2023-12-16T20:11:35.899 INFO:tasks.workunit.client.1.smithi141.stdout:6/470: creat d1/d12/d22/d25/d38/f9a x:0 0 0 2023-12-16T20:11:35.899 INFO:tasks.workunit.client.1.smithi141.stdout:2/304: mkdir d6/da/d68 0 2023-12-16T20:11:35.899 INFO:tasks.workunit.client.1.smithi141.stdout:2/305: truncate d6/f21 4554347 0 2023-12-16T20:11:35.903 INFO:tasks.workunit.client.1.smithi141.stdout:6/471: dread d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:35.903 INFO:tasks.workunit.client.1.smithi141.stdout:1/510: creat da/d36/d4b/d4d/d80/d94/fa8 x:0 0 0 2023-12-16T20:11:35.904 INFO:tasks.workunit.client.1.smithi141.stdout:1/511: fdatasync da/d67/f2f 0 2023-12-16T20:11:35.908 INFO:tasks.workunit.client.1.smithi141.stdout:7/426: rename d5/d16/f6a to d5/d16/d30/d4e/d6e/f88 0 2023-12-16T20:11:35.910 INFO:tasks.workunit.client.0.smithi038.stdout:7/830: dwrite f6 [0,4194304] 0 2023-12-16T20:11:35.910 INFO:tasks.workunit.client.0.smithi038.stdout:7/831: dread - da/d21/d2c/d76/d9a/f101 zero size 2023-12-16T20:11:35.911 INFO:tasks.workunit.client.0.smithi038.stdout:6/684: mknod d1/d5b/d7d/dc6/cd6 0 2023-12-16T20:11:35.911 INFO:tasks.workunit.client.1.smithi141.stdout:2/306: creat d6/da/d1b/f69 x:0 0 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:2/307: readlink d6/d3a/l2a 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:2/308: readlink d6/l8 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/415: dwrite f1 [0,4194304] 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:4/416: write d1a/f9a [470541,89517] 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:9/441: dwrite d1/d26/f91 [0,4194304] 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:6/472: getdents d1/d3/d4f 0 2023-12-16T20:11:35.912 INFO:tasks.workunit.client.1.smithi141.stdout:6/473: readlink d1/d12/l8e 0 2023-12-16T20:11:35.914 INFO:tasks.workunit.client.1.smithi141.stdout:7/427: dread d5/d16/d1a/f1f [0,4194304] 0 2023-12-16T20:11:35.914 INFO:tasks.workunit.client.1.smithi141.stdout:7/428: chown l2 995 1 2023-12-16T20:11:35.914 INFO:tasks.workunit.client.0.smithi038.stdout:5/832: fsync d2/d4/fff 0 2023-12-16T20:11:35.915 INFO:tasks.workunit.client.1.smithi141.stdout:4/417: mkdir d1a/d3c/d9b/da1 0 2023-12-16T20:11:35.916 INFO:tasks.workunit.client.1.smithi141.stdout:6/474: write d1/f19 [1275479,53985] 0 2023-12-16T20:11:35.917 INFO:tasks.workunit.client.1.smithi141.stdout:6/475: creat d1/d3/d4b/d60/f9b x:0 0 0 2023-12-16T20:11:35.917 INFO:tasks.workunit.client.1.smithi141.stdout:6/476: read d1/d12/d22/d25/d38/f3e [1391242,42242] 0 2023-12-16T20:11:35.922 INFO:tasks.workunit.client.1.smithi141.stdout:9/442: rename d1/d10/d14/d20/da/d89/l97 to d1/d10/d14/l9a 0 2023-12-16T20:11:35.923 INFO:tasks.workunit.client.0.smithi038.stdout:9/770: symlink d9/d1e/d40/d5e/d71/d83/lf0 0 2023-12-16T20:11:35.925 INFO:tasks.workunit.client.1.smithi141.stdout:7/429: mkdir d5/d1d/d89 0 2023-12-16T20:11:35.925 INFO:tasks.workunit.client.1.smithi141.stdout:7/430: chown d5/d16/d30/d4e/f72 121 1 2023-12-16T20:11:35.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/857: creat d1/d5/d95/d61/d66/ddd/f120 x:0 0 0 2023-12-16T20:11:35.934 INFO:tasks.workunit.client.1.smithi141.stdout:1/512: dwrite da/d67/f2f [0,4194304] 0 2023-12-16T20:11:35.935 INFO:tasks.workunit.client.1.smithi141.stdout:6/477: dread d1/d12/d20/d3a/d45/d47/f8b [0,4194304] 0 2023-12-16T20:11:35.935 INFO:tasks.workunit.client.1.smithi141.stdout:6/478: fsync d1/d12/d20/d44/f6b 0 2023-12-16T20:11:35.935 INFO:tasks.workunit.client.1.smithi141.stdout:6/479: readlink d1/l1f 0 2023-12-16T20:11:35.939 INFO:tasks.workunit.client.1.smithi141.stdout:1/513: creat da/d1a/d31/d81/fa9 x:0 0 0 2023-12-16T20:11:35.940 INFO:tasks.workunit.client.1.smithi141.stdout:6/480: unlink d1/d3/d4b/c91 0 2023-12-16T20:11:35.940 INFO:tasks.workunit.client.1.smithi141.stdout:6/481: chown d1/d12/d20/d44/d4a/f79 0 1 2023-12-16T20:11:35.940 INFO:tasks.workunit.client.1.smithi141.stdout:6/482: chown d1/d3/l49 0 1 2023-12-16T20:11:35.942 INFO:tasks.workunit.client.1.smithi141.stdout:1/514: mknod da/d36/d4b/d4d/d89/d61/caa 0 2023-12-16T20:11:35.942 INFO:tasks.workunit.client.1.smithi141.stdout:1/515: write da/d36/d4b/d4d/d80/fa1 [471305,49939] 0 2023-12-16T20:11:35.943 INFO:tasks.workunit.client.1.smithi141.stdout:6/483: creat d1/f9c x:0 0 0 2023-12-16T20:11:35.945 INFO:tasks.workunit.client.1.smithi141.stdout:1/516: chown da/d76/c88 3619 1 2023-12-16T20:11:35.947 INFO:tasks.workunit.client.1.smithi141.stdout:6/484: link d1/d77/l7c d1/d12/d20/d44/l9d 0 2023-12-16T20:11:35.947 INFO:tasks.workunit.client.1.smithi141.stdout:6/485: readlink d1/d12/d20/d3a/l62 0 2023-12-16T20:11:35.950 INFO:tasks.workunit.client.1.smithi141.stdout:1/517: rmdir da/d36/d4b/d7c 39 2023-12-16T20:11:35.953 INFO:tasks.workunit.client.1.smithi141.stdout:1/518: rename da/d36/d4b/d4d/d89/d61/c90 to da/d36/d4b/d4d/cab 0 2023-12-16T20:11:35.953 INFO:tasks.workunit.client.1.smithi141.stdout:1/519: truncate da/d36/d4b/d4d/d80/fa1 836935 0 2023-12-16T20:11:35.953 INFO:tasks.workunit.client.1.smithi141.stdout:1/520: fdatasync da/d1a/d31/f49 0 2023-12-16T20:11:35.955 INFO:tasks.workunit.client.1.smithi141.stdout:1/521: rmdir da/d36/d4b/d4d 39 2023-12-16T20:11:35.957 INFO:tasks.workunit.client.1.smithi141.stdout:1/522: creat da/fac x:0 0 0 2023-12-16T20:11:35.962 INFO:tasks.workunit.client.1.smithi141.stdout:9/443: dwrite d1/d10/d33/f8b [0,4194304] 0 2023-12-16T20:11:35.965 INFO:tasks.workunit.client.1.smithi141.stdout:9/444: mkdir d1/d26/d3c/d9b 0 2023-12-16T20:11:35.966 INFO:tasks.workunit.client.1.smithi141.stdout:9/445: truncate d1/d10/d33/d39/f62 4591102 0 2023-12-16T20:11:35.967 INFO:tasks.workunit.client.1.smithi141.stdout:9/446: mknod d1/d10/d14/d20/da/d3f/d8a/c9c 0 2023-12-16T20:11:35.967 INFO:tasks.workunit.client.1.smithi141.stdout:9/447: readlink d1/d10/d14/d20/da/d3f/l45 0 2023-12-16T20:11:35.969 INFO:tasks.workunit.client.1.smithi141.stdout:9/448: mknod d1/d26/d4a/d73/d76/c9d 0 2023-12-16T20:11:35.969 INFO:tasks.workunit.client.1.smithi141.stdout:9/449: stat d1/d10/d27 0 2023-12-16T20:11:35.971 INFO:tasks.workunit.client.1.smithi141.stdout:4/418: dwrite d1a/d2a/d3b/d69/f95 [0,4194304] 0 2023-12-16T20:11:35.972 INFO:tasks.workunit.client.1.smithi141.stdout:9/450: link d1/d10/d27/c2e d1/d10/d14/d20/da/d3f/d66/c9e 0 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:9/451: write d1/d26/d4a/f88 [280014,81499] 0 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:9/452: write d1/d26/d4a/d73/f4e [712061,114848] 0 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:9/453: chown d1/d10/d14/d20/d3b/f77 476 1 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:2/309: dwrite d6/d12/d1f/d46/f48 [0,4194304] 0 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:7/431: dwrite d5/d1d/d1e/f52 [0,4194304] 0 2023-12-16T20:11:35.973 INFO:tasks.workunit.client.1.smithi141.stdout:7/432: readlink d5/d16/d30/l43 0 2023-12-16T20:11:35.975 INFO:tasks.workunit.client.1.smithi141.stdout:1/523: fsync da/d1a/d31/d81/fa9 0 2023-12-16T20:11:35.975 INFO:tasks.workunit.client.1.smithi141.stdout:6/486: dwrite d1/d3/d4b/d60/f9b [0,4194304] 0 2023-12-16T20:11:35.980 INFO:tasks.workunit.client.1.smithi141.stdout:9/454: creat d1/d10/d14/d20/d90/f9f x:0 0 0 2023-12-16T20:11:35.981 INFO:tasks.workunit.client.1.smithi141.stdout:9/455: fsync d1/d10/d27/d36/f3a 0 2023-12-16T20:11:35.985 INFO:tasks.workunit.client.1.smithi141.stdout:1/524: mknod da/d36/cad 0 2023-12-16T20:11:35.990 INFO:tasks.workunit.client.1.smithi141.stdout:7/433: read d5/d1d/d1e/f80 [201558,126343] 0 2023-12-16T20:11:35.992 INFO:tasks.workunit.client.1.smithi141.stdout:2/310: dwrite d6/da/d33/d4f/f51 [0,4194304] 0 2023-12-16T20:11:36.004 INFO:tasks.workunit.client.1.smithi141.stdout:6/487: mkdir d1/d77/d9e 0 2023-12-16T20:11:36.005 INFO:tasks.workunit.client.1.smithi141.stdout:2/311: write d6/d12/d1f/d46/f63 [670278,28086] 0 2023-12-16T20:11:36.011 INFO:tasks.workunit.client.1.smithi141.stdout:7/434: dwrite d5/d16/d1a/f7f [0,4194304] 0 2023-12-16T20:11:36.011 INFO:tasks.workunit.client.1.smithi141.stdout:2/312: mkdir d6/da/d1b/d5b/d6a 0 2023-12-16T20:11:36.011 INFO:tasks.workunit.client.1.smithi141.stdout:2/313: creat d6/d12/d1f/d46/f6b x:0 0 0 2023-12-16T20:11:36.012 INFO:tasks.workunit.client.1.smithi141.stdout:5/336: sync 2023-12-16T20:11:36.015 INFO:tasks.workunit.client.0.smithi038.stdout:7/832: link da/dcf/d100/d4d/dae/f110 da/d21/d2c/dd0/f116 0 2023-12-16T20:11:36.016 INFO:tasks.workunit.client.1.smithi141.stdout:7/435: symlink d5/d16/d30/l8a 0 2023-12-16T20:11:36.018 INFO:tasks.workunit.client.0.smithi038.stdout:6/685: creat d1/d5b/d7d/dc6/fd7 x:0 0 0 2023-12-16T20:11:36.018 INFO:tasks.workunit.client.1.smithi141.stdout:0/440: sync 2023-12-16T20:11:36.018 INFO:tasks.workunit.client.1.smithi141.stdout:8/466: sync 2023-12-16T20:11:36.018 INFO:tasks.workunit.client.1.smithi141.stdout:3/533: sync 2023-12-16T20:11:36.018 INFO:tasks.workunit.client.1.smithi141.stdout:0/441: readlink d4/l2d 0 2023-12-16T20:11:36.019 INFO:tasks.workunit.client.1.smithi141.stdout:3/534: chown d0/d1c/d2c/fa6 129615 1 2023-12-16T20:11:36.019 INFO:tasks.workunit.client.1.smithi141.stdout:8/467: write d14/f15 [2593136,66375] 0 2023-12-16T20:11:36.019 INFO:tasks.workunit.client.1.smithi141.stdout:8/468: fsync d14/f36 0 2023-12-16T20:11:36.019 INFO:tasks.workunit.client.1.smithi141.stdout:0/442: write d4/d49/d73/d3b/d78/d7f/f90 [985789,63182] 0 2023-12-16T20:11:36.021 INFO:tasks.workunit.client.1.smithi141.stdout:2/314: mkdir d6/d3a/d47/d58/d66/d6c 0 2023-12-16T20:11:36.021 INFO:tasks.workunit.client.0.smithi038.stdout:5/833: mknod d2/d14/d25/d2d/d17/d51/d7b/d89/c103 0 2023-12-16T20:11:36.021 INFO:tasks.workunit.client.0.smithi038.stdout:5/834: write d2/d14/d25/f79 [1331952,46110] 0 2023-12-16T20:11:36.021 INFO:tasks.workunit.client.0.smithi038.stdout:5/835: chown d2/d14/d25/d2d/d2f/d98/cb9 400558149 1 2023-12-16T20:11:36.023 INFO:tasks.workunit.client.1.smithi141.stdout:3/535: dread d0/d1c/d40/d3f/d52/f9e [0,4194304] 0 2023-12-16T20:11:36.024 INFO:tasks.workunit.client.1.smithi141.stdout:3/536: fdatasync d0/d1c/fa1 0 2023-12-16T20:11:36.027 INFO:tasks.workunit.client.0.smithi038.stdout:5/836: getdents d2/d14/d25/d2d/d17/d51 0 2023-12-16T20:11:36.027 INFO:tasks.workunit.client.1.smithi141.stdout:8/469: rename d14/d19/d1b/d3d/d5e/f82 to d14/d19/d1b/d3d/f96 0 2023-12-16T20:11:36.036 INFO:tasks.workunit.client.1.smithi141.stdout:8/470: dread d14/f16 [0,4194304] 0 2023-12-16T20:11:36.037 INFO:tasks.workunit.client.1.smithi141.stdout:0/443: rmdir d4/d49 39 2023-12-16T20:11:36.038 INFO:tasks.workunit.client.1.smithi141.stdout:0/444: truncate d4/d49/d73/d3b/d78/d7f/f90 2072123 0 2023-12-16T20:11:36.040 INFO:tasks.workunit.client.1.smithi141.stdout:3/537: truncate d0/f6 1054632 0 2023-12-16T20:11:36.040 INFO:tasks.workunit.client.1.smithi141.stdout:8/471: creat d14/d19/d1b/d24/d4b/f97 x:0 0 0 2023-12-16T20:11:36.042 INFO:tasks.workunit.client.1.smithi141.stdout:0/445: symlink d4/d49/d73/d8a/l9e 0 2023-12-16T20:11:36.044 INFO:tasks.workunit.client.1.smithi141.stdout:3/538: creat d0/d1c/d40/d3f/d52/d63/fb3 x:0 0 0 2023-12-16T20:11:36.045 INFO:tasks.workunit.client.1.smithi141.stdout:0/446: creat d4/d49/d73/d3b/d78/d7f/f9f x:0 0 0 2023-12-16T20:11:36.047 INFO:tasks.workunit.client.1.smithi141.stdout:8/472: rename d14/d19/d1b/f21 to d14/f98 0 2023-12-16T20:11:36.048 INFO:tasks.workunit.client.1.smithi141.stdout:0/447: creat d4/d74/d85/fa0 x:0 0 0 2023-12-16T20:11:36.049 INFO:tasks.workunit.client.1.smithi141.stdout:0/448: getdents d4/d49/d8f 0 2023-12-16T20:11:36.049 INFO:tasks.workunit.client.1.smithi141.stdout:0/449: chown d4/d5c/f68 30915 1 2023-12-16T20:11:36.050 INFO:tasks.workunit.client.0.smithi038.stdout:7/833: dwrite da/d21/d2c/f30 [0,4194304] 0 2023-12-16T20:11:36.051 INFO:tasks.workunit.client.1.smithi141.stdout:0/450: mkdir d4/d49/da1 0 2023-12-16T20:11:36.051 INFO:tasks.workunit.client.1.smithi141.stdout:0/451: dread - d4/d49/d73/d3b/d78/d7f/f9f zero size 2023-12-16T20:11:36.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/781: sync 2023-12-16T20:11:36.053 INFO:tasks.workunit.client.0.smithi038.stdout:3/746: sync 2023-12-16T20:11:36.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/782: mknod d15/d1e/d30/c10f 0 2023-12-16T20:11:36.055 INFO:tasks.workunit.client.0.smithi038.stdout:1/783: dread - d15/d22/d62/f94 zero size 2023-12-16T20:11:36.063 INFO:tasks.workunit.client.1.smithi141.stdout:5/337: dwrite d0/d9/d16/f21 [0,4194304] 0 2023-12-16T20:11:36.064 INFO:tasks.workunit.client.1.smithi141.stdout:5/338: write d0/d9/d16/d2a/d4f/f64 [840358,115652] 0 2023-12-16T20:11:36.064 INFO:tasks.workunit.client.1.smithi141.stdout:5/339: truncate d0/f3e 850573 0 2023-12-16T20:11:36.064 INFO:tasks.workunit.client.1.smithi141.stdout:5/340: mkdir d0/d9/d16/d72 0 2023-12-16T20:11:36.064 INFO:tasks.workunit.client.1.smithi141.stdout:2/315: dwrite d6/da/f35 [0,4194304] 0 2023-12-16T20:11:36.064 INFO:tasks.workunit.client.1.smithi141.stdout:2/316: truncate d6/d12/d1f/f36 255956 0 2023-12-16T20:11:36.065 INFO:tasks.workunit.client.1.smithi141.stdout:0/452: dread d4/f3e [0,4194304] 0 2023-12-16T20:11:36.065 INFO:tasks.workunit.client.1.smithi141.stdout:0/453: getdents d4/d49/da1 0 2023-12-16T20:11:36.065 INFO:tasks.workunit.client.1.smithi141.stdout:7/436: dwrite d5/d1d/f6d [0,4194304] 0 2023-12-16T20:11:36.066 INFO:tasks.workunit.client.1.smithi141.stdout:5/341: symlink d0/d25/d30/d67/d49/l73 0 2023-12-16T20:11:36.067 INFO:tasks.workunit.client.0.smithi038.stdout:6/686: dwrite d1/d4/d1d/d28/db1/dbe/db3/fbc [0,4194304] 0 2023-12-16T20:11:36.067 INFO:tasks.workunit.client.0.smithi038.stdout:6/687: chown d1/d4/d1d/d28/f7a 9 1 2023-12-16T20:11:36.068 INFO:tasks.workunit.client.0.smithi038.stdout:5/837: dwrite d2/d14/d25/f79 [0,4194304] 0 2023-12-16T20:11:36.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/688: dread d1/d4/d1d/f59 [0,4194304] 0 2023-12-16T20:11:36.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/454: rename d4/d7/l7e to d4/d74/la2 0 2023-12-16T20:11:36.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/455: dread - d4/d5c/f87 zero size 2023-12-16T20:11:36.071 INFO:tasks.workunit.client.0.smithi038.stdout:6/689: creat d1/d5b/d7d/d9d/fd8 x:0 0 0 2023-12-16T20:11:36.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/858: symlink d1/d5/d95/d61/dd4/l121 0 2023-12-16T20:11:36.074 INFO:tasks.workunit.client.0.smithi038.stdout:6/690: creat d1/d4/d1d/d61/da4/fd9 x:0 0 0 2023-12-16T20:11:36.074 INFO:tasks.workunit.client.1.smithi141.stdout:7/437: link d5/l48 d5/d16/d30/l8b 0 2023-12-16T20:11:36.075 INFO:tasks.workunit.client.0.smithi038.stdout:2/859: unlink d1/d5/d95/d61/dd4/d6a/d43/faa 0 2023-12-16T20:11:36.077 INFO:tasks.workunit.client.0.smithi038.stdout:6/691: creat d1/d5b/d7d/dc6/fda x:0 0 0 2023-12-16T20:11:36.077 INFO:tasks.workunit.client.0.smithi038.stdout:6/692: read d1/f39 [571508,69046] 0 2023-12-16T20:11:36.077 INFO:tasks.workunit.client.0.smithi038.stdout:6/693: write d1/d4/d1d/d28/f79 [623886,56259] 0 2023-12-16T20:11:36.077 INFO:tasks.workunit.client.0.smithi038.stdout:6/694: chown d1/d4/d1d/d28/d2f/d85/da2 36589223 1 2023-12-16T20:11:36.077 INFO:tasks.workunit.client.0.smithi038.stdout:6/695: chown d1/d4/d1d/d28/d2f/cbb 9522 1 2023-12-16T20:11:36.080 INFO:tasks.workunit.client.0.smithi038.stdout:6/696: symlink d1/d4/d1d/d28/db1/dbe/d94/ldb 0 2023-12-16T20:11:36.080 INFO:tasks.workunit.client.0.smithi038.stdout:6/697: getdents d1/d4/d1d/d28/d2f/d85/da2/dc9 0 2023-12-16T20:11:36.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/860: dread d1/d5/d95/d61/dd4/f7d [0,4194304] 0 2023-12-16T20:11:36.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/861: read - d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f8d zero size 2023-12-16T20:11:36.081 INFO:tasks.workunit.client.0.smithi038.stdout:9/771: rename d9/d1f/d21/d3e/ca6 to d9/d1f/d21/d3e/d4e/cf1 0 2023-12-16T20:11:36.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/862: symlink d1/d5/d95/d61/dd4/d6d/l122 0 2023-12-16T20:11:36.084 INFO:tasks.workunit.client.0.smithi038.stdout:3/747: rename d4/c62 to d4/d67/de1/d7d/c102 0 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/342: mknod d0/d14/d2c/c74 0 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/343: dread - d0/d14/f70 zero size 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/344: chown d0/d14/d2c 152842984 1 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/345: readlink d0/d25/d30/d67/l1f 0 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/346: write d0/d9/d16/d2a/d35/f66 [152859,105049] 0 2023-12-16T20:11:36.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/347: truncate d0/d43/f6e 4838116 0 2023-12-16T20:11:36.087 INFO:tasks.workunit.client.1.smithi141.stdout:2/317: rmdir d6/d12/d1f/d46 39 2023-12-16T20:11:36.087 INFO:tasks.workunit.client.1.smithi141.stdout:2/318: fdatasync d6/d12/d15/f4c 0 2023-12-16T20:11:36.087 INFO:tasks.workunit.client.0.smithi038.stdout:9/772: mknod d9/d1e/d40/d5e/d71/d83/cf2 0 2023-12-16T20:11:36.087 INFO:tasks.workunit.client.0.smithi038.stdout:1/784: write d15/d1e/d3b/d48/d37/f40 [965483,102472] 0 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:1/785: creat d15/d1e/d3b/d48/d37/dde/d75/dc1/f110 x:0 0 0 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/863: mkdir d1/d5/d95/d123 0 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/864: fsync d1/d5/d95/d61/dd4/d6d/f8c 0 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/865: dread - d1/d5/d95/d61/dd4/d21/d9a/db9/f119 zero size 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/866: dread - d1/d5/d95/d61/dd4/fae zero size 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.0.smithi038.stdout:2/867: creat d1/d5/d95/d61/dd4/d6a/d43/d57/f124 x:0 0 0 2023-12-16T20:11:36.088 INFO:tasks.workunit.client.1.smithi141.stdout:7/438: rmdir d5/d1d/d1e 39 2023-12-16T20:11:36.089 INFO:tasks.workunit.client.0.smithi038.stdout:5/838: rename d2/df/d1a/d1f/d4a/cf4 to d2/df/d1a/d1f/d4a/d53/d6e/c104 0 2023-12-16T20:11:36.089 INFO:tasks.workunit.client.0.smithi038.stdout:3/748: rename d4/d67/de1/d4c/d70 to d4/d67/de1/d4c/d70/d71/db9/dd8/d103 22 2023-12-16T20:11:36.089 INFO:tasks.workunit.client.0.smithi038.stdout:2/868: dread d1/d5/d95/d61/dd4/d10/f5e [0,4194304] 0 2023-12-16T20:11:36.089 INFO:tasks.workunit.client.0.smithi038.stdout:5/839: chown d2/d14/d25/d2d/d17/d51/de9 0 1 2023-12-16T20:11:36.090 INFO:tasks.workunit.client.1.smithi141.stdout:2/319: rename d6/d3a/d47/f60 to d6/da/d1b/d5b/f6d 0 2023-12-16T20:11:36.093 INFO:tasks.workunit.client.0.smithi038.stdout:9/773: symlink d9/d1f/d21/d84/daf/lf3 0 2023-12-16T20:11:36.093 INFO:tasks.workunit.client.0.smithi038.stdout:1/786: truncate d15/d1e/d3b/d48/d37/f47 3732177 0 2023-12-16T20:11:36.093 INFO:tasks.workunit.client.1.smithi141.stdout:7/439: mkdir d5/d16/d30/d36/d8c 0 2023-12-16T20:11:36.093 INFO:tasks.workunit.client.1.smithi141.stdout:7/440: chown d5/d1d/d1e/f52 46236 1 2023-12-16T20:11:36.093 INFO:tasks.workunit.client.1.smithi141.stdout:2/320: symlink d6/da/d1b/d5b/d6a/l6e 0 2023-12-16T20:11:36.095 INFO:tasks.workunit.client.1.smithi141.stdout:7/441: creat d5/f8d x:0 0 0 2023-12-16T20:11:36.095 INFO:tasks.workunit.client.1.smithi141.stdout:0/456: dwrite d4/d7/f1e [0,4194304] 0 2023-12-16T20:11:36.096 INFO:tasks.workunit.client.0.smithi038.stdout:3/749: creat d4/d8/dc8/de4/f104 x:0 0 0 2023-12-16T20:11:36.097 INFO:tasks.workunit.client.0.smithi038.stdout:5/840: mknod d2/df/d1a/d1f/d4a/d53/d6e/c105 0 2023-12-16T20:11:36.098 INFO:tasks.workunit.client.1.smithi141.stdout:7/442: dread d5/d16/d30/d4e/d6e/f84 [0,4194304] 0 2023-12-16T20:11:36.100 INFO:tasks.workunit.client.1.smithi141.stdout:5/348: dread d0/d14/d2c/d4a/f51 [0,4194304] 0 2023-12-16T20:11:36.100 INFO:tasks.workunit.client.1.smithi141.stdout:5/349: chown d0/d14/d2c/c6f 13411203 1 2023-12-16T20:11:36.101 INFO:tasks.workunit.client.0.smithi038.stdout:2/869: mkdir d1/d5/d95/d61/dd4/d6a/d43/d57/d125 0 2023-12-16T20:11:36.101 INFO:tasks.workunit.client.0.smithi038.stdout:3/750: readlink d4/d8/d15/d1e/l50 0 2023-12-16T20:11:36.103 INFO:tasks.workunit.client.0.smithi038.stdout:2/870: write d1/d5/d95/d61/dd4/d21/d82/d92/fe2 [293916,81429] 0 2023-12-16T20:11:36.103 INFO:tasks.workunit.client.0.smithi038.stdout:2/871: chown d1/d5/d95/d61/dd4/d10/d2f/la0 1552301 1 2023-12-16T20:11:36.103 INFO:tasks.workunit.client.0.smithi038.stdout:2/872: fsync d1/d5/d95/d61/dd4/d6a/fa6 0 2023-12-16T20:11:36.104 INFO:tasks.workunit.client.1.smithi141.stdout:7/443: rename d5/d2a/d45/d5a/f64 to d5/d1d/d1e/d71/f8e 0 2023-12-16T20:11:36.106 INFO:tasks.workunit.client.0.smithi038.stdout:9/774: dread d9/d1e/f3c [0,4194304] 0 2023-12-16T20:11:36.108 INFO:tasks.workunit.client.0.smithi038.stdout:3/751: dread d4/d8/dc8/fdb [0,4194304] 0 2023-12-16T20:11:36.108 INFO:tasks.workunit.client.0.smithi038.stdout:4/725: sync 2023-12-16T20:11:36.108 INFO:tasks.workunit.client.0.smithi038.stdout:0/793: sync 2023-12-16T20:11:36.110 INFO:tasks.workunit.client.1.smithi141.stdout:5/350: rename d0/d25/d30/d67/d49 to d0/d14/d75 0 2023-12-16T20:11:36.110 INFO:tasks.workunit.client.1.smithi141.stdout:5/351: write d0/d25/d30/d67/f65 [402549,12523] 0 2023-12-16T20:11:36.110 INFO:tasks.workunit.client.0.smithi038.stdout:8/655: sync 2023-12-16T20:11:36.110 INFO:tasks.workunit.client.0.smithi038.stdout:8/656: write f16 [5600002,65239] 0 2023-12-16T20:11:36.110 INFO:tasks.workunit.client.0.smithi038.stdout:2/873: dread d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f4a [0,4194304] 0 2023-12-16T20:11:36.112 INFO:tasks.workunit.client.1.smithi141.stdout:7/444: creat d5/d16/d30/d4e/f8f x:0 0 0 2023-12-16T20:11:36.113 INFO:tasks.workunit.client.0.smithi038.stdout:6/698: dwrite d1/d4/f49 [0,4194304] 0 2023-12-16T20:11:36.114 INFO:tasks.workunit.client.0.smithi038.stdout:3/752: rename d4/dcd/c5e to d4/d6c/d80/c105 0 2023-12-16T20:11:36.115 INFO:tasks.workunit.client.1.smithi141.stdout:5/352: rename d0/d14/d2c/d4a/l5d to d0/d14/l76 0 2023-12-16T20:11:36.118 INFO:tasks.workunit.client.0.smithi038.stdout:4/726: truncate d13/d17/d2e/d32/f39 3125302 0 2023-12-16T20:11:36.118 INFO:tasks.workunit.client.0.smithi038.stdout:6/699: mkdir d1/d16/d23/ddc 0 2023-12-16T20:11:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:6/700: write d1/f25 [2726371,112887] 0 2023-12-16T20:11:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:6/701: chown d1/f56 8386 1 2023-12-16T20:11:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:6/702: creat d1/d4/d1d/d8e/dbf/fdd x:0 0 0 2023-12-16T20:11:36.120 INFO:tasks.workunit.client.0.smithi038.stdout:3/753: creat d4/d6c/d80/da8/f106 x:0 0 0 2023-12-16T20:11:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:2/874: rename d1/d5/d95/d61/dd4/d10/f4f to d1/d5/d95/d61/dd4/d6a/d43/f126 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:3/754: truncate d4/d8/d15/d1e/f22 153206 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:3/755: fsync d4/d8/dc8/fde 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:3/756: stat d4/d27/d23/d26/f68 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/875: symlink d1/d5/d95/d61/dd4/d21/d82/d92/l127 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/876: read - d1/d5/d95/d61/d66/ddd/de8/dea/fdb zero size 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:4/727: dread d13/d17/d4b/da4/d9d/f9b [0,4194304] 0 2023-12-16T20:11:36.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/877: mknod d1/d5/d95/d61/dd4/d21/d82/c128 0 2023-12-16T20:11:36.132 INFO:tasks.workunit.client.1.smithi141.stdout:7/445: dread d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:36.132 INFO:tasks.workunit.client.1.smithi141.stdout:7/446: creat d5/d16/d46/f90 x:0 0 0 2023-12-16T20:11:36.132 INFO:tasks.workunit.client.1.smithi141.stdout:7/447: chown d5/d16/d46/f90 715784450 1 2023-12-16T20:11:36.132 INFO:tasks.workunit.client.1.smithi141.stdout:7/448: write d5/d16/d1a/d40/f7b [324263,119551] 0 2023-12-16T20:11:36.133 INFO:tasks.workunit.client.1.smithi141.stdout:2/321: dwrite d6/d32/f34 [0,4194304] 0 2023-12-16T20:11:36.133 INFO:tasks.workunit.client.0.smithi038.stdout:2/878: write d1/d5/d95/d61/dd4/d21/d9a/db9/f64 [709943,54964] 0 2023-12-16T20:11:36.133 INFO:tasks.workunit.client.0.smithi038.stdout:2/879: write d1/d5/d95/d61/dd4/d10/f108 [1654953,39732] 0 2023-12-16T20:11:36.133 INFO:tasks.workunit.client.0.smithi038.stdout:2/880: readlink d1/d5/d95/d61/dd4/d12/lc8 0 2023-12-16T20:11:36.134 INFO:tasks.workunit.client.0.smithi038.stdout:4/728: truncate d13/d1f/fab 283102 0 2023-12-16T20:11:36.136 INFO:tasks.workunit.client.0.smithi038.stdout:4/729: mkdir d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/dee 0 2023-12-16T20:11:36.137 INFO:tasks.workunit.client.1.smithi141.stdout:2/322: link d6/l11 d6/d12/d1f/d46/d5a/l6f 0 2023-12-16T20:11:36.137 INFO:tasks.workunit.client.1.smithi141.stdout:2/323: readlink d6/d12/d1f/l25 0 2023-12-16T20:11:36.138 INFO:tasks.workunit.client.1.smithi141.stdout:5/353: write d0/d14/d2c/d4a/f51 [3881351,85175] 0 2023-12-16T20:11:36.138 INFO:tasks.workunit.client.1.smithi141.stdout:2/324: rename d6/da/l22 to d6/da/d1b/l70 0 2023-12-16T20:11:36.143 INFO:tasks.workunit.client.1.smithi141.stdout:5/354: dread d0/d25/d30/d67/f58 [0,4194304] 0 2023-12-16T20:11:36.144 INFO:tasks.workunit.client.0.smithi038.stdout:3/757: dread d4/d27/d23/d26/f3e [0,4194304] 0 2023-12-16T20:11:36.145 INFO:tasks.workunit.client.0.smithi038.stdout:3/758: mkdir d4/dcd/d107 0 2023-12-16T20:11:36.146 INFO:tasks.workunit.client.1.smithi141.stdout:7/449: dread d5/d2a/f2d [0,4194304] 0 2023-12-16T20:11:36.146 INFO:tasks.workunit.client.1.smithi141.stdout:5/355: creat d0/d14/d2c/f77 x:0 0 0 2023-12-16T20:11:36.147 INFO:tasks.workunit.client.1.smithi141.stdout:5/356: chown d0/d14/d2c/f68 37283 1 2023-12-16T20:11:36.147 INFO:tasks.workunit.client.1.smithi141.stdout:7/450: stat d5/d16/d30/d4e/d87 0 2023-12-16T20:11:36.148 INFO:tasks.workunit.client.1.smithi141.stdout:7/451: rmdir d5/d2a/d45/d5a 39 2023-12-16T20:11:36.149 INFO:tasks.workunit.client.1.smithi141.stdout:5/357: link d0/d14/d2c/l5f d0/d25/l78 0 2023-12-16T20:11:36.151 INFO:tasks.workunit.client.1.smithi141.stdout:5/358: symlink d0/d43/l79 0 2023-12-16T20:11:36.153 INFO:tasks.workunit.client.1.smithi141.stdout:5/359: mknod d0/d9/d16/d2a/d35/c7a 0 2023-12-16T20:11:36.154 INFO:tasks.workunit.client.1.smithi141.stdout:5/360: truncate d0/d14/d2c/d4a/f63 276742 0 2023-12-16T20:11:36.154 INFO:tasks.workunit.client.1.smithi141.stdout:5/361: dread - d0/d9/f54 zero size 2023-12-16T20:11:36.155 INFO:tasks.workunit.client.1.smithi141.stdout:0/457: dwrite d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:36.155 INFO:tasks.workunit.client.1.smithi141.stdout:0/458: chown d4/d5c/f98 226 1 2023-12-16T20:11:36.156 INFO:tasks.workunit.client.1.smithi141.stdout:5/362: creat d0/d25/f7b x:0 0 0 2023-12-16T20:11:36.156 INFO:tasks.workunit.client.1.smithi141.stdout:5/363: chown d0/d25/d30/d67 108129 1 2023-12-16T20:11:36.158 INFO:tasks.workunit.client.1.smithi141.stdout:0/459: mkdir d4/d49/d4b/da3 0 2023-12-16T20:11:36.160 INFO:tasks.workunit.client.1.smithi141.stdout:5/364: symlink d0/d9/d16/l7c 0 2023-12-16T20:11:36.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/730: write d13/d17/d4b/da4/d34/f58 [1927552,33315] 0 2023-12-16T20:11:36.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/460: mkdir d4/d49/d73/d8a/da4 0 2023-12-16T20:11:36.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/461: truncate d4/d49/d73/d3b/f79 353569 0 2023-12-16T20:11:36.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/462: stat d4/d7/c5e 0 2023-12-16T20:11:36.163 INFO:tasks.workunit.client.1.smithi141.stdout:5/365: dread d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:36.163 INFO:tasks.workunit.client.1.smithi141.stdout:5/366: write d0/d25/d30/d67/f71 [178235,25924] 0 2023-12-16T20:11:36.164 INFO:tasks.workunit.client.0.smithi038.stdout:5/841: dwrite d2/df/d87/fd0 [0,4194304] 0 2023-12-16T20:11:36.169 INFO:tasks.workunit.client.0.smithi038.stdout:5/842: mknod d2/d14/d25/d2d/d17/d55/c106 0 2023-12-16T20:11:36.170 INFO:tasks.workunit.client.0.smithi038.stdout:5/843: dread - d2/df/fea zero size 2023-12-16T20:11:36.170 INFO:tasks.workunit.client.0.smithi038.stdout:5/844: readlink d2/d4/l102 0 2023-12-16T20:11:36.175 INFO:tasks.workunit.client.1.smithi141.stdout:0/463: dread d4/f31 [0,4194304] 0 2023-12-16T20:11:36.175 INFO:tasks.workunit.client.1.smithi141.stdout:0/464: write d4/d49/d4b/f53 [3592199,81262] 0 2023-12-16T20:11:36.177 INFO:tasks.workunit.client.1.smithi141.stdout:0/465: creat d4/d49/d73/d3b/d78/fa5 x:0 0 0 2023-12-16T20:11:36.179 INFO:tasks.workunit.client.1.smithi141.stdout:0/466: rename d4/l4a to d4/d49/d73/d3b/d78/d7f/d80/la6 0 2023-12-16T20:11:36.180 INFO:tasks.workunit.client.0.smithi038.stdout:5/845: dread d2/df/d87/fd0 [0,4194304] 0 2023-12-16T20:11:36.183 INFO:tasks.workunit.client.0.smithi038.stdout:1/787: dwrite d15/d1e/d3b/d48/d37/dde/f92 [0,4194304] 0 2023-12-16T20:11:36.184 INFO:tasks.workunit.client.0.smithi038.stdout:5/846: creat d2/d14/d25/d2d/d17/da9/db0/f107 x:0 0 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.0.smithi038.stdout:4/731: dwrite d13/d17/d2e/d75/f6d [0,4194304] 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.0.smithi038.stdout:9/775: dwrite d9/d1f/f22 [4194304,4194304] 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.0.smithi038.stdout:8/657: dwrite d17/d1b/d66/d73/d9e/f7c [0,4194304] 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.0.smithi038.stdout:8/658: fsync d17/d5a/f63 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.1.smithi141.stdout:2/325: dwrite d6/d12/d1f/d46/f48 [0,4194304] 0 2023-12-16T20:11:36.191 INFO:tasks.workunit.client.1.smithi141.stdout:2/326: stat d6/f7 0 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.1.smithi141.stdout:7/452: dwrite d5/f5f [0,4194304] 0 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.1.smithi141.stdout:7/453: dread - d5/d16/d30/f50 zero size 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/788: creat d15/d1e/d3b/d48/d3d/f111 x:0 0 0 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/789: readlink d15/d1e/d23/d34/d79/l80 0 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/790: readlink d15/d1e/d30/ldf 0 2023-12-16T20:11:36.193 INFO:tasks.workunit.client.0.smithi038.stdout:1/791: dread - d15/d1e/d23/d34/d86/d9a/fa1 zero size 2023-12-16T20:11:36.194 INFO:tasks.workunit.client.0.smithi038.stdout:1/792: truncate d15/d1e/d3b/d48/d37/dde/d75/dc1/fec 537766 0 2023-12-16T20:11:36.194 INFO:tasks.workunit.client.0.smithi038.stdout:3/759: dwrite d4/d6c/d80/f83 [0,4194304] 0 2023-12-16T20:11:36.195 INFO:tasks.workunit.client.1.smithi141.stdout:7/454: dread d5/d16/d1a/f1f [0,4194304] 0 2023-12-16T20:11:36.195 INFO:tasks.workunit.client.1.smithi141.stdout:7/455: chown d5/d16/d30/d36/f39 17013858 1 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.1.smithi141.stdout:2/327: creat d6/d3a/d47/d58/f71 x:0 0 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/847: symlink d2/d4/d62/l108 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/848: stat d2/d14/ddd 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:2/881: dwrite d1/d5/d2a/d31/f36 [0,4194304] 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/849: write d2/d14/d25/d2d/d17/f88 [576037,43812] 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/850: write d2/d14/d25/d2d/d4b/fd7 [704078,98816] 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/851: stat d2/d14/d25/d2d/d4b 0 2023-12-16T20:11:36.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/852: chown d2/d4/l13 0 1 2023-12-16T20:11:36.200 INFO:tasks.workunit.client.0.smithi038.stdout:4/732: mkdir d13/d69/def 0 2023-12-16T20:11:36.202 INFO:tasks.workunit.client.1.smithi141.stdout:5/367: dread d0/d14/d2c/d4a/f51 [0,4194304] 0 2023-12-16T20:11:36.203 INFO:tasks.workunit.client.0.smithi038.stdout:8/659: mknod d17/d1b/d25/db7/d82/da9/cd6 0 2023-12-16T20:11:36.203 INFO:tasks.workunit.client.0.smithi038.stdout:8/660: stat d17/d1b/d25/db7/f71 0 2023-12-16T20:11:36.203 INFO:tasks.workunit.client.0.smithi038.stdout:8/661: write d17/d1b/d57/f65 [1603325,49709] 0 2023-12-16T20:11:36.203 INFO:tasks.workunit.client.0.smithi038.stdout:8/662: dread - d17/d1b/d66/d8e/d97/fbc zero size 2023-12-16T20:11:36.204 INFO:tasks.workunit.client.1.smithi141.stdout:0/467: dwrite d4/d49/d73/f5b [0,4194304] 0 2023-12-16T20:11:36.210 INFO:tasks.workunit.client.0.smithi038.stdout:3/760: creat d4/d8/d15/d1e/f108 x:0 0 0 2023-12-16T20:11:36.218 INFO:tasks.workunit.client.1.smithi141.stdout:2/328: rmdir d6/da/d33/d4f/d5f 39 2023-12-16T20:11:36.218 INFO:tasks.workunit.client.1.smithi141.stdout:2/329: stat d6/d12/d1f/l25 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/853: mkdir d2/d14/d25/d109 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/854: fdatasync d2/d14/d25/d2d/d17/d55/f57 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/855: fsync d2/df/d1a/d2a/f68 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/856: write d2/df/d1a/d2a/f74 [1333797,64016] 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/882: dread d1/d5/d2a/f79 [0,4194304] 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/883: stat d1/d5/d95/d61/d66/f83 0 2023-12-16T20:11:36.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/884: fsync d1/d5/d3d/ddc/f118 0 2023-12-16T20:11:36.220 INFO:tasks.workunit.client.1.smithi141.stdout:5/368: symlink d0/d14/d2c/d4a/l7d 0 2023-12-16T20:11:36.222 INFO:tasks.workunit.client.0.smithi038.stdout:9/776: dwrite d9/d1f/d21/d55/f6f [0,4194304] 0 2023-12-16T20:11:36.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/885: unlink d1/d5/d95/d61/d66/c8b 0 2023-12-16T20:11:36.225 INFO:tasks.workunit.client.1.smithi141.stdout:5/369: rename d0/d14/d2c/d4a/f63 to d0/d43/f7e 0 2023-12-16T20:11:36.225 INFO:tasks.workunit.client.1.smithi141.stdout:5/370: chown d0/d25/d30/d67/c27 127 1 2023-12-16T20:11:36.225 INFO:tasks.workunit.client.1.smithi141.stdout:5/371: write d0/d25/f7b [4176,126243] 0 2023-12-16T20:11:36.226 INFO:tasks.workunit.client.1.smithi141.stdout:5/372: dread - d0/d25/d30/f6c zero size 2023-12-16T20:11:36.228 INFO:tasks.workunit.client.0.smithi038.stdout:9/777: unlink d9/d1f/f29 0 2023-12-16T20:11:36.228 INFO:tasks.workunit.client.0.smithi038.stdout:9/778: fsync d9/d1f/d21/d55/f56 0 2023-12-16T20:11:36.232 INFO:tasks.workunit.client.1.smithi141.stdout:5/373: mkdir d0/d9/d16/d72/d7f 0 2023-12-16T20:11:36.234 INFO:tasks.workunit.client.1.smithi141.stdout:2/330: dread d6/da/d33/f3e [0,4194304] 0 2023-12-16T20:11:36.234 INFO:tasks.workunit.client.1.smithi141.stdout:2/331: creat d6/d3a/d47/d58/f72 x:0 0 0 2023-12-16T20:11:36.250 INFO:tasks.workunit.client.1.smithi141.stdout:2/332: dread d6/d32/f34 [0,4194304] 0 2023-12-16T20:11:36.251 INFO:tasks.workunit.client.1.smithi141.stdout:2/333: fsync d6/d3a/f2c 0 2023-12-16T20:11:36.252 INFO:tasks.workunit.client.1.smithi141.stdout:2/334: mkdir d6/da/d33/d54/d73 0 2023-12-16T20:11:36.253 INFO:tasks.workunit.client.1.smithi141.stdout:2/335: truncate d6/d3a/d47/d58/f72 1000887 0 2023-12-16T20:11:36.253 INFO:tasks.workunit.client.1.smithi141.stdout:2/336: chown d6/da/d4a/c5c 1568795 1 2023-12-16T20:11:36.253 INFO:tasks.workunit.client.1.smithi141.stdout:5/374: write d0/d14/f23 [2619125,93395] 0 2023-12-16T20:11:36.253 INFO:tasks.workunit.client.0.smithi038.stdout:8/663: dwrite d17/d1b/d66/d73/d54/d69/f8f [0,4194304] 0 2023-12-16T20:11:36.254 INFO:tasks.workunit.client.1.smithi141.stdout:5/375: stat d0/d14/d75/c5b 0 2023-12-16T20:11:36.256 INFO:tasks.workunit.client.1.smithi141.stdout:5/376: mknod d0/d9/d16/d2a/c80 0 2023-12-16T20:11:36.256 INFO:tasks.workunit.client.1.smithi141.stdout:5/377: chown d0 0 1 2023-12-16T20:11:36.268 INFO:tasks.workunit.client.0.smithi038.stdout:4/733: dwrite d13/d17/d4b/da4/fd3 [0,4194304] 0 2023-12-16T20:11:36.268 INFO:tasks.workunit.client.1.smithi141.stdout:2/337: dread d6/da/d1b/f30 [0,4194304] 0 2023-12-16T20:11:36.268 INFO:tasks.workunit.client.1.smithi141.stdout:2/338: read - d6/d32/f4e zero size 2023-12-16T20:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout:1/793: dwrite d15/d22/d62/fe7 [0,4194304] 0 2023-12-16T20:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout:1/794: dread - d15/d1e/d3b/d48/d3d/f54 zero size 2023-12-16T20:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout:3/761: dwrite d4/d8/f43 [0,4194304] 0 2023-12-16T20:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout:4/734: creat d13/d17/d4b/d7d/d90/ff0 x:0 0 0 2023-12-16T20:11:36.273 INFO:tasks.workunit.client.0.smithi038.stdout:1/795: symlink d15/d4a/l112 0 2023-12-16T20:11:36.281 INFO:tasks.workunit.client.1.smithi141.stdout:7/456: dwrite d5/d2a/f86 [0,4194304] 0 2023-12-16T20:11:36.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/886: dwrite d1/fad [0,4194304] 0 2023-12-16T20:11:36.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/887: dread - d1/d5/d3d/ddc/f118 zero size 2023-12-16T20:11:36.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/888: chown d1/d5/d95/d61/dd4/d12 0 1 2023-12-16T20:11:36.285 INFO:tasks.workunit.client.0.smithi038.stdout:9/779: dwrite d9/d1f/d21/d52/f8c [0,4194304] 0 2023-12-16T20:11:36.286 INFO:tasks.workunit.client.0.smithi038.stdout:2/889: mknod d1/d5/d2a/d31/d60/c129 0 2023-12-16T20:11:36.287 INFO:tasks.workunit.client.0.smithi038.stdout:4/735: write d13/d17/d62/f9c [3387430,26656] 0 2023-12-16T20:11:36.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/857: dwrite d2/d4/fb [4194304,4194304] 0 2023-12-16T20:11:36.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/858: dread - d2/d14/d25/fb7 zero size 2023-12-16T20:11:36.288 INFO:tasks.workunit.client.0.smithi038.stdout:9/780: dread d9/d1e/f37 [0,4194304] 0 2023-12-16T20:11:36.289 INFO:tasks.workunit.client.0.smithi038.stdout:2/890: rmdir d1/d5/d95/d61/dd4/d10/d109/dce 39 2023-12-16T20:11:36.289 INFO:tasks.workunit.client.0.smithi038.stdout:2/891: fsync d1/d5/d2a/fd1 0 2023-12-16T20:11:36.289 INFO:tasks.workunit.client.0.smithi038.stdout:2/892: creat d1/d5/d2a/f12a x:0 0 0 2023-12-16T20:11:36.291 INFO:tasks.workunit.client.1.smithi141.stdout:7/457: rmdir d5/d16/d1a/d55 0 2023-12-16T20:11:36.292 INFO:tasks.workunit.client.0.smithi038.stdout:5/859: creat d2/d14/d25/d2d/d17/d51/daf/f10a x:0 0 0 2023-12-16T20:11:36.292 INFO:tasks.workunit.client.0.smithi038.stdout:5/860: truncate d2/d14/d25/f3f 4259742 0 2023-12-16T20:11:36.293 INFO:tasks.workunit.client.1.smithi141.stdout:7/458: truncate d5/f24 1008477 0 2023-12-16T20:11:36.293 INFO:tasks.workunit.client.1.smithi141.stdout:7/459: readlink d5/l19 0 2023-12-16T20:11:36.293 INFO:tasks.workunit.client.0.smithi038.stdout:9/781: truncate d9/d1e/d40/f41 81893 0 2023-12-16T20:11:36.296 INFO:tasks.workunit.client.0.smithi038.stdout:2/893: mkdir d1/d5/d2a/d31/d60/ded/dee/d12b 0 2023-12-16T20:11:36.296 INFO:tasks.workunit.client.0.smithi038.stdout:2/894: chown d1/d5/d95/d61/d66/ddd/de8/dea/fdb 0 1 2023-12-16T20:11:36.297 INFO:tasks.workunit.client.1.smithi141.stdout:5/378: dwrite d0/fe [0,4194304] 0 2023-12-16T20:11:36.298 INFO:tasks.workunit.client.0.smithi038.stdout:5/861: rename d2/d14/d25/d2d/d4b/d8b/fdc to d2/d14/d25/d2d/f10b 0 2023-12-16T20:11:36.299 INFO:tasks.workunit.client.1.smithi141.stdout:5/379: unlink d0/d14/d2c/f77 0 2023-12-16T20:11:36.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/456: sync 2023-12-16T20:11:36.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/457: chown d1/d10/f15 9326 1 2023-12-16T20:11:36.301 INFO:tasks.workunit.client.1.smithi141.stdout:9/458: link d1/d10/d33/d6a/d72/l95 d1/d10/d14/d20/d84/la0 0 2023-12-16T20:11:36.301 INFO:tasks.workunit.client.1.smithi141.stdout:9/459: write d1/d10/d33/d47/f7f [1019610,55405] 0 2023-12-16T20:11:36.301 INFO:tasks.workunit.client.1.smithi141.stdout:9/460: fsync d1/d10/d14/f31 0 2023-12-16T20:11:36.301 INFO:tasks.workunit.client.0.smithi038.stdout:9/782: rename d9/d1f/d96/dd5/cdd to d9/d1e/cf4 0 2023-12-16T20:11:36.302 INFO:tasks.workunit.client.0.smithi038.stdout:5/862: rmdir d2/d14/d25/d2d/d17/d51/d7b 39 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:6/488: sync 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:4/419: sync 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:8/473: sync 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:1/525: sync 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:3/539: sync 2023-12-16T20:11:36.304 INFO:tasks.workunit.client.1.smithi141.stdout:3/540: truncate d0/f46 837940 0 2023-12-16T20:11:36.305 INFO:tasks.workunit.client.1.smithi141.stdout:3/541: stat d0/f29 0 2023-12-16T20:11:36.305 INFO:tasks.workunit.client.1.smithi141.stdout:9/461: rename d1/d10/d14/d20/da/d89 to d1/d26/da1 0 2023-12-16T20:11:36.305 INFO:tasks.workunit.client.1.smithi141.stdout:4/420: readlink d1a/d54/l60 0 2023-12-16T20:11:36.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/895: rename d1/d5/d95/d61/dd4/d21/d82/fba to d1/d5/d2a/f12c 0 2023-12-16T20:11:36.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/896: chown d1/l11 7359 1 2023-12-16T20:11:36.307 INFO:tasks.workunit.client.1.smithi141.stdout:1/526: mknod da/d36/d4b/d7c/cae 0 2023-12-16T20:11:36.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/783: rmdir d9/d1e/d3d/d42/d59/dc4 39 2023-12-16T20:11:36.309 INFO:tasks.workunit.client.1.smithi141.stdout:3/542: creat d0/d1c/d2c/d72/d74/d8b/fb4 x:0 0 0 2023-12-16T20:11:36.310 INFO:tasks.workunit.client.0.smithi038.stdout:5/863: rmdir d2/d14/d25/d109 0 2023-12-16T20:11:36.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/897: creat d1/d5/d95/d123/f12d x:0 0 0 2023-12-16T20:11:36.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/898: fsync d1/d5/d95/d61/dd4/d6a/fa6 0 2023-12-16T20:11:36.312 INFO:tasks.workunit.client.1.smithi141.stdout:1/527: creat da/d36/d4b/d4d/d89/d6c/faf x:0 0 0 2023-12-16T20:11:36.313 INFO:tasks.workunit.client.1.smithi141.stdout:0/468: dwrite d4/d7/fd [4194304,4194304] 0 2023-12-16T20:11:36.313 INFO:tasks.workunit.client.0.smithi038.stdout:9/784: mknod d9/d1f/d21/d3e/d72/cf5 0 2023-12-16T20:11:36.313 INFO:tasks.workunit.client.0.smithi038.stdout:9/785: chown d9/d1e/d40/f41 1326 1 2023-12-16T20:11:36.315 INFO:tasks.workunit.client.0.smithi038.stdout:2/899: mknod d1/d5/d2a/d31/d60/c12e 0 2023-12-16T20:11:36.315 INFO:tasks.workunit.client.0.smithi038.stdout:2/900: truncate d1/d5/d6c/d9f/fc1 4758451 0 2023-12-16T20:11:36.315 INFO:tasks.workunit.client.0.smithi038.stdout:2/901: chown d1/d5/d95/d61/dd4/d21/d9a/db9/cfd 0 1 2023-12-16T20:11:36.315 INFO:tasks.workunit.client.1.smithi141.stdout:3/543: dread d0/d1c/d2c/f49 [0,4194304] 0 2023-12-16T20:11:36.317 INFO:tasks.workunit.client.0.smithi038.stdout:9/786: link d9/lc d9/d1e/d3d/d42/d59/dc4/lf6 0 2023-12-16T20:11:36.317 INFO:tasks.workunit.client.0.smithi038.stdout:9/787: write d9/d1e/d40/d5e/d71/d83/f9f [1019359,28271] 0 2023-12-16T20:11:36.318 INFO:tasks.workunit.client.0.smithi038.stdout:9/788: readlink d9/d1f/d21/d3e/d4e/d61/daa/ld2 0 2023-12-16T20:11:36.318 INFO:tasks.workunit.client.1.smithi141.stdout:0/469: unlink d4/f88 0 2023-12-16T20:11:36.318 INFO:tasks.workunit.client.1.smithi141.stdout:1/528: mkdir da/d1a/db0 0 2023-12-16T20:11:36.318 INFO:tasks.workunit.client.1.smithi141.stdout:1/529: chown da/d67/f26 124 1 2023-12-16T20:11:36.319 INFO:tasks.workunit.client.0.smithi038.stdout:2/902: mknod d1/d5/d95/d61/dd4/d10/d2f/c12f 0 2023-12-16T20:11:36.320 INFO:tasks.workunit.client.1.smithi141.stdout:3/544: symlink d0/d1c/da9/lb5 0 2023-12-16T20:11:36.320 INFO:tasks.workunit.client.0.smithi038.stdout:9/789: symlink d9/d1f/d6c/lf7 0 2023-12-16T20:11:36.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/790: mknod d9/d1e/d40/d5e/db5/cf8 0 2023-12-16T20:11:36.323 INFO:tasks.workunit.client.1.smithi141.stdout:0/470: rename d4/d5c/l6c to d4/d49/d8f/la7 0 2023-12-16T20:11:36.323 INFO:tasks.workunit.client.1.smithi141.stdout:0/471: chown d4/d74/d85 5 1 2023-12-16T20:11:36.323 INFO:tasks.workunit.client.1.smithi141.stdout:1/530: symlink da/d1a/db0/lb1 0 2023-12-16T20:11:36.324 INFO:tasks.workunit.client.1.smithi141.stdout:2/339: dwrite d6/d12/d1f/d46/f63 [4194304,4194304] 0 2023-12-16T20:11:36.324 INFO:tasks.workunit.client.0.smithi038.stdout:4/736: dwrite d13/d17/d4b/da4/f44 [0,4194304] 0 2023-12-16T20:11:36.324 INFO:tasks.workunit.client.0.smithi038.stdout:4/737: fdatasync d13/d17/f95 0 2023-12-16T20:11:36.324 INFO:tasks.workunit.client.1.smithi141.stdout:5/380: write d0/d9/f34 [2013443,96525] 0 2023-12-16T20:11:36.325 INFO:tasks.workunit.client.0.smithi038.stdout:9/791: creat d9/d1e/d40/d5e/ff9 x:0 0 0 2023-12-16T20:11:36.325 INFO:tasks.workunit.client.1.smithi141.stdout:0/472: symlink d4/d74/d85/la8 0 2023-12-16T20:11:36.325 INFO:tasks.workunit.client.0.smithi038.stdout:3/762: dwrite d4/d6c/d80/f83 [0,4194304] 0 2023-12-16T20:11:36.326 INFO:tasks.workunit.client.1.smithi141.stdout:3/545: rmdir d0 39 2023-12-16T20:11:36.326 INFO:tasks.workunit.client.0.smithi038.stdout:8/664: dwrite d17/d1b/d66/d73/d4e/fa2 [0,4194304] 0 2023-12-16T20:11:36.329 INFO:tasks.workunit.client.1.smithi141.stdout:0/473: mknod d4/ca9 0 2023-12-16T20:11:36.329 INFO:tasks.workunit.client.1.smithi141.stdout:0/474: chown d4/d49/d73/c60 1960313 1 2023-12-16T20:11:36.329 INFO:tasks.workunit.client.1.smithi141.stdout:0/475: dread - d4/d49/d73/d3b/d78/d7f/d80/d83/f89 zero size 2023-12-16T20:11:36.329 INFO:tasks.workunit.client.0.smithi038.stdout:4/738: unlink d13/d17/d2e/d32/ce7 0 2023-12-16T20:11:36.333 INFO:tasks.workunit.client.0.smithi038.stdout:9/792: getdents d9/d1e/d40/d5e/d71/d83/de8 0 2023-12-16T20:11:36.333 INFO:tasks.workunit.client.1.smithi141.stdout:1/531: mkdir da/d36/d4b/db2 0 2023-12-16T20:11:36.335 INFO:tasks.workunit.client.0.smithi038.stdout:1/796: dwrite d15/d22/d52/f89 [0,4194304] 0 2023-12-16T20:11:36.336 INFO:tasks.workunit.client.0.smithi038.stdout:1/797: chown d15/d1e/d3b/d48/cb2 3871762 1 2023-12-16T20:11:36.336 INFO:tasks.workunit.client.0.smithi038.stdout:1/798: fdatasync d15/d22/d62/fa8 0 2023-12-16T20:11:36.336 INFO:tasks.workunit.client.1.smithi141.stdout:0/476: rename d4/c26 to d4/d49/d73/d3b/d78/d7f/caa 0 2023-12-16T20:11:36.336 INFO:tasks.workunit.client.1.smithi141.stdout:5/381: write d0/fe [705034,95757] 0 2023-12-16T20:11:36.337 INFO:tasks.workunit.client.1.smithi141.stdout:3/546: link d0/d1c/d40/l35 d0/d1c/d40/d85/lb6 0 2023-12-16T20:11:36.338 INFO:tasks.workunit.client.1.smithi141.stdout:0/477: symlink d4/d49/da1/lab 0 2023-12-16T20:11:36.339 INFO:tasks.workunit.client.1.smithi141.stdout:0/478: chown d4/d7/fd 41384 1 2023-12-16T20:11:36.342 INFO:tasks.workunit.client.0.smithi038.stdout:3/763: unlink d4/cb4 0 2023-12-16T20:11:36.343 INFO:tasks.workunit.client.1.smithi141.stdout:5/382: symlink d0/d43/l81 0 2023-12-16T20:11:36.345 INFO:tasks.workunit.client.0.smithi038.stdout:4/739: mknod d13/d17/d4b/d7d/cf1 0 2023-12-16T20:11:36.345 INFO:tasks.workunit.client.0.smithi038.stdout:3/764: write d4/fed [320304,56061] 0 2023-12-16T20:11:36.346 INFO:tasks.workunit.client.0.smithi038.stdout:3/765: fsync d4/f5 0 2023-12-16T20:11:36.346 INFO:tasks.workunit.client.1.smithi141.stdout:3/547: mknod d0/d1c/d40/d85/cb7 0 2023-12-16T20:11:36.346 INFO:tasks.workunit.client.1.smithi141.stdout:3/548: read - d0/d1c/d40/d3f/d52/d5a/fb1 zero size 2023-12-16T20:11:36.347 INFO:tasks.workunit.client.1.smithi141.stdout:3/549: write d0/d1c/d40/d3f/f73 [788112,102840] 0 2023-12-16T20:11:36.347 INFO:tasks.workunit.client.1.smithi141.stdout:3/550: stat d0/d1c/d40/d85/l6b 0 2023-12-16T20:11:36.347 INFO:tasks.workunit.client.1.smithi141.stdout:3/551: chown d0/d1c/d2c/d72/f8e 1704852 1 2023-12-16T20:11:36.347 INFO:tasks.workunit.client.1.smithi141.stdout:3/552: getdents d0/d1c/d40/d3f/d52/d5d/d95 0 2023-12-16T20:11:36.348 INFO:tasks.workunit.client.0.smithi038.stdout:9/793: link d9/d1f/d21/d3e/d72/f86 d9/d1e/d3d/d42/d59/d76/ffa 0 2023-12-16T20:11:36.349 INFO:tasks.workunit.client.1.smithi141.stdout:0/479: rename d4/fe to d4/d49/d8f/fac 0 2023-12-16T20:11:36.349 INFO:tasks.workunit.client.1.smithi141.stdout:0/480: chown d4/d49/f52 0 1 2023-12-16T20:11:36.350 INFO:tasks.workunit.client.0.smithi038.stdout:1/799: truncate d15/d22/d52/f91 93558 0 2023-12-16T20:11:36.352 INFO:tasks.workunit.client.0.smithi038.stdout:3/766: creat d4/dab/f109 x:0 0 0 2023-12-16T20:11:36.352 INFO:tasks.workunit.client.1.smithi141.stdout:5/383: creat d0/f82 x:0 0 0 2023-12-16T20:11:36.352 INFO:tasks.workunit.client.1.smithi141.stdout:5/384: stat d0/f2b 0 2023-12-16T20:11:36.352 INFO:tasks.workunit.client.1.smithi141.stdout:5/385: chown d0/d14/c39 3555 1 2023-12-16T20:11:36.354 INFO:tasks.workunit.client.1.smithi141.stdout:0/481: creat d4/d49/d73/fad x:0 0 0 2023-12-16T20:11:36.355 INFO:tasks.workunit.client.1.smithi141.stdout:5/386: mknod d0/d43/c83 0 2023-12-16T20:11:36.355 INFO:tasks.workunit.client.0.smithi038.stdout:9/794: creat d9/d1f/d6c/ffb x:0 0 0 2023-12-16T20:11:36.356 INFO:tasks.workunit.client.0.smithi038.stdout:4/740: dread d13/f77 [0,4194304] 0 2023-12-16T20:11:36.358 INFO:tasks.workunit.client.0.smithi038.stdout:1/800: unlink d15/d1e/d3b/d48/d37/f47 0 2023-12-16T20:11:36.358 INFO:tasks.workunit.client.0.smithi038.stdout:3/767: creat d4/d27/d2b/f10a x:0 0 0 2023-12-16T20:11:36.364 INFO:tasks.workunit.client.1.smithi141.stdout:3/553: rename d0/c10 to d0/d1c/d40/d3c/cb8 0 2023-12-16T20:11:36.367 INFO:tasks.workunit.client.0.smithi038.stdout:4/741: dread d13/d69/d7a/f89 [0,4194304] 0 2023-12-16T20:11:36.368 INFO:tasks.workunit.client.1.smithi141.stdout:5/387: link d0/l6 d0/d9/d16/d72/l84 0 2023-12-16T20:11:36.369 INFO:tasks.workunit.client.0.smithi038.stdout:4/742: truncate d13/d1f/f8e 327478 0 2023-12-16T20:11:36.370 INFO:tasks.workunit.client.1.smithi141.stdout:3/554: rename d0/d1c/d2c/l3b to d0/d1c/d40/d85/d96/lb9 0 2023-12-16T20:11:36.373 INFO:tasks.workunit.client.1.smithi141.stdout:3/555: creat d0/d1c/d40/d3c/fba x:0 0 0 2023-12-16T20:11:36.377 INFO:tasks.workunit.client.1.smithi141.stdout:6/489: dwrite d1/d12/d20/d44/f6b [0,4194304] 0 2023-12-16T20:11:36.377 INFO:tasks.workunit.client.1.smithi141.stdout:6/490: chown d1/d12/d20/d89/d95/l39 14512 1 2023-12-16T20:11:36.378 INFO:tasks.workunit.client.1.smithi141.stdout:7/460: dwrite d5/fc [4194304,4194304] 0 2023-12-16T20:11:36.384 INFO:tasks.workunit.client.1.smithi141.stdout:6/491: getdents d1/d3/d4b/d60 0 2023-12-16T20:11:36.384 INFO:tasks.workunit.client.1.smithi141.stdout:6/492: write d1/dd/de/f27 [5158468,56975] 0 2023-12-16T20:11:36.384 INFO:tasks.workunit.client.1.smithi141.stdout:6/493: chown d1/d12/l8e 4554323 1 2023-12-16T20:11:36.384 INFO:tasks.workunit.client.1.smithi141.stdout:6/494: chown d1/d12/d20/f6a 268370 1 2023-12-16T20:11:36.388 INFO:tasks.workunit.client.1.smithi141.stdout:9/462: rmdir d1/d26 39 2023-12-16T20:11:36.388 INFO:tasks.workunit.client.1.smithi141.stdout:9/463: readlink d1/d10/d27/l2c 0 2023-12-16T20:11:36.390 INFO:tasks.workunit.client.1.smithi141.stdout:6/495: mknod d1/c9f 0 2023-12-16T20:11:36.390 INFO:tasks.workunit.client.1.smithi141.stdout:6/496: creat d1/d3/fa0 x:0 0 0 2023-12-16T20:11:36.391 INFO:tasks.workunit.client.1.smithi141.stdout:9/464: creat d1/d26/d4a/d73/fa2 x:0 0 0 2023-12-16T20:11:36.393 INFO:tasks.workunit.client.1.smithi141.stdout:9/465: mknod d1/d10/d33/d47/d8d/ca3 0 2023-12-16T20:11:36.394 INFO:tasks.workunit.client.1.smithi141.stdout:7/461: dread d5/d16/d46/f5d [0,4194304] 0 2023-12-16T20:11:36.395 INFO:tasks.workunit.client.1.smithi141.stdout:3/556: dread d0/d1c/d40/d85/f53 [0,4194304] 0 2023-12-16T20:11:36.395 INFO:tasks.workunit.client.1.smithi141.stdout:3/557: write d0/d1c/fa1 [559991,45544] 0 2023-12-16T20:11:36.395 INFO:tasks.workunit.client.1.smithi141.stdout:3/558: write d0/d1c/d40/f39 [1948700,24347] 0 2023-12-16T20:11:36.396 INFO:tasks.workunit.client.1.smithi141.stdout:7/462: rename d5/d16/f3c to d5/d1d/d1e/d71/f91 0 2023-12-16T20:11:36.398 INFO:tasks.workunit.client.1.smithi141.stdout:3/559: rename d0/f46 to d0/d1c/d40/d85/d4c/fbb 0 2023-12-16T20:11:36.399 INFO:tasks.workunit.client.1.smithi141.stdout:7/463: dread d5/d1d/d1e/d71/f91 [0,4194304] 0 2023-12-16T20:11:36.400 INFO:tasks.workunit.client.1.smithi141.stdout:3/560: symlink d0/d1c/d2c/lbc 0 2023-12-16T20:11:36.400 INFO:tasks.workunit.client.1.smithi141.stdout:3/561: write d0/d1c/d2c/d72/d74/d8b/da3/faf [848004,122394] 0 2023-12-16T20:11:36.404 INFO:tasks.workunit.client.0.smithi038.stdout:4/743: dread d13/d69/d7a/fb3 [0,4194304] 0 2023-12-16T20:11:36.405 INFO:tasks.workunit.client.1.smithi141.stdout:7/464: rmdir d5/d16/d30/d4e/d6e 39 2023-12-16T20:11:36.405 INFO:tasks.workunit.client.0.smithi038.stdout:4/744: creat d13/d17/d4b/da4/d34/ff2 x:0 0 0 2023-12-16T20:11:36.406 INFO:tasks.workunit.client.1.smithi141.stdout:6/497: dread d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:36.406 INFO:tasks.workunit.client.1.smithi141.stdout:6/498: creat d1/dd/d2f/d48/fa1 x:0 0 0 2023-12-16T20:11:36.408 INFO:tasks.workunit.client.0.smithi038.stdout:4/745: rename d13/f2f to d13/d1f/db7/db9/ff3 0 2023-12-16T20:11:36.408 INFO:tasks.workunit.client.0.smithi038.stdout:4/746: readlink d13/d17/l79 0 2023-12-16T20:11:36.408 INFO:tasks.workunit.client.1.smithi141.stdout:7/465: creat d5/d1d/d1e/f92 x:0 0 0 2023-12-16T20:11:36.409 INFO:tasks.workunit.client.1.smithi141.stdout:9/466: dwrite d1/d10/d14/d20/da/d3f/f68 [0,4194304] 0 2023-12-16T20:11:36.412 INFO:tasks.workunit.client.1.smithi141.stdout:9/467: mkdir d1/d26/d3c/da4 0 2023-12-16T20:11:36.412 INFO:tasks.workunit.client.1.smithi141.stdout:7/466: dread d5/d2a/f60 [8388608,4194304] 0 2023-12-16T20:11:36.412 INFO:tasks.workunit.client.1.smithi141.stdout:7/467: readlink d5/d16/d30/l8b 0 2023-12-16T20:11:36.412 INFO:tasks.workunit.client.1.smithi141.stdout:7/468: chown d5/d2a/d45/d5a/l69 42 1 2023-12-16T20:11:36.414 INFO:tasks.workunit.client.1.smithi141.stdout:7/469: mknod d5/d16/d46/d61/c93 0 2023-12-16T20:11:36.422 INFO:tasks.workunit.client.1.smithi141.stdout:4/421: dwrite d1a/d2a/f78 [0,4194304] 0 2023-12-16T20:11:36.422 INFO:tasks.workunit.client.1.smithi141.stdout:4/422: dread - d1a/f29 zero size 2023-12-16T20:11:36.422 INFO:tasks.workunit.client.1.smithi141.stdout:4/423: creat d1a/d2a/fa2 x:0 0 0 2023-12-16T20:11:36.423 INFO:tasks.workunit.client.0.smithi038.stdout:5/864: dwrite d2/df/d1a/d1f/f32 [4194304,4194304] 0 2023-12-16T20:11:36.425 INFO:tasks.workunit.client.1.smithi141.stdout:4/424: link d1a/d2a/f76 d1a/d2a/d3b/d69/fa3 0 2023-12-16T20:11:36.428 INFO:tasks.workunit.client.1.smithi141.stdout:7/470: write d5/d16/d30/f32 [5470063,18193] 0 2023-12-16T20:11:36.428 INFO:tasks.workunit.client.1.smithi141.stdout:7/471: dread - d5/d16/d30/d4e/f8f zero size 2023-12-16T20:11:36.430 INFO:tasks.workunit.client.1.smithi141.stdout:7/472: truncate d5/d2a/f60 3041779 0 2023-12-16T20:11:36.430 INFO:tasks.workunit.client.1.smithi141.stdout:7/473: write d5/d16/d1a/f25 [536313,36096] 0 2023-12-16T20:11:36.432 INFO:tasks.workunit.client.1.smithi141.stdout:3/562: dread d0/d1c/fa1 [0,4194304] 0 2023-12-16T20:11:36.432 INFO:tasks.workunit.client.1.smithi141.stdout:7/474: symlink d5/d16/l94 0 2023-12-16T20:11:36.434 INFO:tasks.workunit.client.1.smithi141.stdout:3/563: rename d0/d1c/d40/d85/f62 to d0/d1c/d6a/d8f/fbd 0 2023-12-16T20:11:36.434 INFO:tasks.workunit.client.1.smithi141.stdout:3/564: chown d0/d1c/d40/d3f/d52/d5a 13546 1 2023-12-16T20:11:36.434 INFO:tasks.workunit.client.1.smithi141.stdout:4/425: dread d1a/f32 [0,4194304] 0 2023-12-16T20:11:36.436 INFO:tasks.workunit.client.1.smithi141.stdout:3/565: rename d0/f65 to d0/d1c/d6a/d76/da2/fbe 0 2023-12-16T20:11:36.438 INFO:tasks.workunit.client.0.smithi038.stdout:5/865: write d2/df/d1a/d2a/f95 [1119355,53189] 0 2023-12-16T20:11:36.438 INFO:tasks.workunit.client.1.smithi141.stdout:7/475: write d5/d16/d46/f5d [2498866,123729] 0 2023-12-16T20:11:36.439 INFO:tasks.workunit.client.1.smithi141.stdout:1/532: dwrite da/d1a/d1d/d33/f62 [0,4194304] 0 2023-12-16T20:11:36.442 INFO:tasks.workunit.client.1.smithi141.stdout:7/476: creat d5/d1d/d89/f95 x:0 0 0 2023-12-16T20:11:36.445 INFO:tasks.workunit.client.0.smithi038.stdout:9/795: dwrite d9/d1f/d21/d55/fd9 [0,4194304] 0 2023-12-16T20:11:36.445 INFO:tasks.workunit.client.0.smithi038.stdout:2/903: dwrite d1/d5/d95/d61/dd4/d21/f3c [0,4194304] 0 2023-12-16T20:11:36.446 INFO:tasks.workunit.client.0.smithi038.stdout:5/866: creat d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/f10c x:0 0 0 2023-12-16T20:11:36.446 INFO:tasks.workunit.client.0.smithi038.stdout:5/867: write d2/df/d1a/d2a/f68 [1173286,89564] 0 2023-12-16T20:11:36.446 INFO:tasks.workunit.client.1.smithi141.stdout:7/477: unlink d5/d16/d1a/l2f 0 2023-12-16T20:11:36.446 INFO:tasks.workunit.client.1.smithi141.stdout:7/478: write d5/d16/d30/f57 [310764,96192] 0 2023-12-16T20:11:36.446 INFO:tasks.workunit.client.1.smithi141.stdout:7/479: fsync d5/d2a/f3e 0 2023-12-16T20:11:36.448 INFO:tasks.workunit.client.1.smithi141.stdout:7/480: mkdir d5/d1d/d1e/d71/d96 0 2023-12-16T20:11:36.450 INFO:tasks.workunit.client.0.smithi038.stdout:2/904: mknod d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/c130 0 2023-12-16T20:11:36.451 INFO:tasks.workunit.client.0.smithi038.stdout:3/768: dwrite d4/d27/d23/f57 [0,4194304] 0 2023-12-16T20:11:36.452 INFO:tasks.workunit.client.1.smithi141.stdout:0/482: dwrite d4/d5c/f87 [0,4194304] 0 2023-12-16T20:11:36.452 INFO:tasks.workunit.client.1.smithi141.stdout:2/340: dwrite d6/d32/f57 [0,4194304] 0 2023-12-16T20:11:36.452 INFO:tasks.workunit.client.1.smithi141.stdout:2/341: truncate d6/d12/d1f/f36 615842 0 2023-12-16T20:11:36.452 INFO:tasks.workunit.client.0.smithi038.stdout:1/801: dwrite d15/d1e/f2d [0,4194304] 0 2023-12-16T20:11:36.452 INFO:tasks.workunit.client.0.smithi038.stdout:1/802: write d15/d1e/d3b/d48/d37/dde/d75/dc1/f110 [51917,5529] 0 2023-12-16T20:11:36.456 INFO:tasks.workunit.client.0.smithi038.stdout:8/665: dwrite d17/d1b/d25/db7/d82/da9/d59/f6a [0,4194304] 0 2023-12-16T20:11:36.457 INFO:tasks.workunit.client.0.smithi038.stdout:8/666: write d17/d1b/d25/db7/d82/da9/d50/dc4/fcd [449752,24187] 0 2023-12-16T20:11:36.457 INFO:tasks.workunit.client.0.smithi038.stdout:9/796: write d9/d1f/d21/f28 [69922,101379] 0 2023-12-16T20:11:36.460 INFO:tasks.workunit.client.0.smithi038.stdout:8/667: mkdir d17/d1b/d25/db7/d82/da9/d50/d7d/dd7 0 2023-12-16T20:11:36.463 INFO:tasks.workunit.client.1.smithi141.stdout:7/481: read d5/d2a/f86 [2810520,57756] 0 2023-12-16T20:11:36.464 INFO:tasks.workunit.client.1.smithi141.stdout:2/342: creat d6/d32/d52/d53/f74 x:0 0 0 2023-12-16T20:11:36.465 INFO:tasks.workunit.client.1.smithi141.stdout:6/499: dwrite d1/d12/d22/d25/d38/f9a [0,4194304] 0 2023-12-16T20:11:36.465 INFO:tasks.workunit.client.0.smithi038.stdout:8/668: truncate f13 1179926 0 2023-12-16T20:11:36.465 INFO:tasks.workunit.client.0.smithi038.stdout:4/747: dwrite d13/f77 [0,4194304] 0 2023-12-16T20:11:36.468 INFO:tasks.workunit.client.1.smithi141.stdout:5/388: dwrite d0/d43/f44 [0,4194304] 0 2023-12-16T20:11:36.468 INFO:tasks.workunit.client.1.smithi141.stdout:5/389: readlink d0/d14/l60 0 2023-12-16T20:11:36.468 INFO:tasks.workunit.client.1.smithi141.stdout:5/390: fdatasync d0/d9/d16/d2a/d35/f3f 0 2023-12-16T20:11:36.468 INFO:tasks.workunit.client.1.smithi141.stdout:5/391: chown d0/d14/d2c/f33 50320 1 2023-12-16T20:11:36.469 INFO:tasks.workunit.client.0.smithi038.stdout:5/868: dread d2/fba [4194304,4194304] 0 2023-12-16T20:11:36.470 INFO:tasks.workunit.client.0.smithi038.stdout:5/869: write d2/d14/d25/d2d/d17/da9/db0/f107 [404093,61952] 0 2023-12-16T20:11:36.470 INFO:tasks.workunit.client.1.smithi141.stdout:9/468: dwrite d1/d10/d33/d47/f5f [0,4194304] 0 2023-12-16T20:11:36.470 INFO:tasks.workunit.client.1.smithi141.stdout:0/483: write d4/d49/f52 [4878080,100617] 0 2023-12-16T20:11:36.473 INFO:tasks.workunit.client.1.smithi141.stdout:0/484: dread d4/d49/d4b/f53 [4194304,4194304] 0 2023-12-16T20:11:36.473 INFO:tasks.workunit.client.0.smithi038.stdout:4/748: creat d13/d17/d2e/d32/d70/db2/ff4 x:0 0 0 2023-12-16T20:11:36.473 INFO:tasks.workunit.client.0.smithi038.stdout:1/803: write d15/d1e/d3b/d48/f87 [982057,107586] 0 2023-12-16T20:11:36.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/669: symlink d17/d1b/ld8 0 2023-12-16T20:11:36.476 INFO:tasks.workunit.client.0.smithi038.stdout:8/670: stat d17/d1b/d25/db7/c86 0 2023-12-16T20:11:36.479 INFO:tasks.workunit.client.0.smithi038.stdout:5/870: mknod d2/d14/d25/d2d/d17/d51/d7b/d89/c10d 0 2023-12-16T20:11:36.479 INFO:tasks.workunit.client.0.smithi038.stdout:5/871: readlink d2/d14/d25/d2d/l36 0 2023-12-16T20:11:36.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/671: symlink d17/d1b/d66/d73/d4e/ld9 0 2023-12-16T20:11:36.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/672: write d17/d1b/d25/f6b [4678542,67712] 0 2023-12-16T20:11:36.482 INFO:tasks.workunit.client.1.smithi141.stdout:4/426: dwrite d1a/d2a/f76 [0,4194304] 0 2023-12-16T20:11:36.484 INFO:tasks.workunit.client.0.smithi038.stdout:5/872: mkdir d2/d14/d25/d2d/d17/d51/d7b/d89/d10e 0 2023-12-16T20:11:36.484 INFO:tasks.workunit.client.0.smithi038.stdout:5/873: chown d2/df/d1a/d1f/d4a/d53/d6e/c104 1346503 1 2023-12-16T20:11:36.484 INFO:tasks.workunit.client.1.smithi141.stdout:7/482: truncate d5/d16/d1a/f1f 240484 0 2023-12-16T20:11:36.484 INFO:tasks.workunit.client.1.smithi141.stdout:7/483: chown d5/d16/d1a/d40 290345 1 2023-12-16T20:11:36.486 INFO:tasks.workunit.client.0.smithi038.stdout:6/703: sync 2023-12-16T20:11:36.486 INFO:tasks.workunit.client.0.smithi038.stdout:0/794: sync 2023-12-16T20:11:36.486 INFO:tasks.workunit.client.0.smithi038.stdout:7/834: sync 2023-12-16T20:11:36.486 INFO:tasks.workunit.client.0.smithi038.stdout:0/795: read db/f44 [2101372,15584] 0 2023-12-16T20:11:36.486 INFO:tasks.workunit.client.0.smithi038.stdout:6/704: write d1/d4/d1d/f59 [853522,39296] 0 2023-12-16T20:11:36.487 INFO:tasks.workunit.client.1.smithi141.stdout:2/343: getdents d6/d12/d1f/d46 0 2023-12-16T20:11:36.492 INFO:tasks.workunit.client.0.smithi038.stdout:1/804: dread d15/d22/d52/f81 [0,4194304] 0 2023-12-16T20:11:36.494 INFO:tasks.workunit.client.1.smithi141.stdout:3/566: dwrite d0/d1c/d40/d85/d4c/f4f [0,4194304] 0 2023-12-16T20:11:36.494 INFO:tasks.workunit.client.1.smithi141.stdout:6/500: unlink d1/d12/d22/d25/d38/l96 0 2023-12-16T20:11:36.494 INFO:tasks.workunit.client.1.smithi141.stdout:6/501: fsync d1/dd/d2f/f30 0 2023-12-16T20:11:36.495 INFO:tasks.workunit.client.0.smithi038.stdout:3/769: dwrite d4/d8/f16 [0,4194304] 0 2023-12-16T20:11:36.495 INFO:tasks.workunit.client.0.smithi038.stdout:3/770: read d4/dcd/d9a/fb7 [2933158,103094] 0 2023-12-16T20:11:36.495 INFO:tasks.workunit.client.0.smithi038.stdout:5/874: write d2/d14/d25/f5b [3910493,112587] 0 2023-12-16T20:11:36.495 INFO:tasks.workunit.client.0.smithi038.stdout:5/875: creat d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/dd5/f10f x:0 0 0 2023-12-16T20:11:36.496 INFO:tasks.workunit.client.0.smithi038.stdout:5/876: write d2/df/d1a/d2a/f68 [1344983,97448] 0 2023-12-16T20:11:36.498 INFO:tasks.workunit.client.0.smithi038.stdout:9/797: dwrite d9/d1f/fad [0,4194304] 0 2023-12-16T20:11:36.500 INFO:tasks.workunit.client.1.smithi141.stdout:1/533: dwrite da/d1a/d1d/d22/f69 [0,4194304] 0 2023-12-16T20:11:36.503 INFO:tasks.workunit.client.0.smithi038.stdout:8/673: dread d17/d1b/d25/db7/d82/fad [0,4194304] 0 2023-12-16T20:11:36.504 INFO:tasks.workunit.client.1.smithi141.stdout:9/469: rename d1/d10/d14/d20/d3b/f52 to d1/d10/d33/d47/d83/fa5 0 2023-12-16T20:11:36.509 INFO:tasks.workunit.client.1.smithi141.stdout:7/484: symlink d5/d16/d30/d4e/l97 0 2023-12-16T20:11:36.509 INFO:tasks.workunit.client.1.smithi141.stdout:7/485: creat d5/d1d/d1e/f98 x:0 0 0 2023-12-16T20:11:36.516 INFO:tasks.workunit.client.1.smithi141.stdout:3/567: link d0/d1c/d2c/f49 d0/d1c/d2c/d72/d74/fbf 0 2023-12-16T20:11:36.516 INFO:tasks.workunit.client.1.smithi141.stdout:1/534: dread da/d1a/f95 [0,4194304] 0 2023-12-16T20:11:36.520 INFO:tasks.workunit.client.1.smithi141.stdout:6/502: unlink d1/d12/d22/f2a 0 2023-12-16T20:11:36.524 INFO:tasks.workunit.client.1.smithi141.stdout:5/392: rmdir d0/d9/d16 39 2023-12-16T20:11:36.526 INFO:tasks.workunit.client.1.smithi141.stdout:3/568: write d0/d1c/d40/d85/d4c/f8a [1237307,68799] 0 2023-12-16T20:11:36.527 INFO:tasks.workunit.client.1.smithi141.stdout:3/569: truncate d0/d1c/d2c/f5b 486600 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:4/427: dwrite f15 [0,4194304] 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:2/344: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:2/345: creat d6/da/d33/d4f/f75 x:0 0 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:7/486: creat d5/d16/d46/d61/f99 x:0 0 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:7/487: truncate d5/d16/d46/d61/f6b 971110 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:7/488: write d5/d16/f83 [292000,5668] 0 2023-12-16T20:11:36.531 INFO:tasks.workunit.client.1.smithi141.stdout:7/489: fsync d5/d1d/d1e/d71/f8e 0 2023-12-16T20:11:36.532 INFO:tasks.workunit.client.0.smithi038.stdout:0/796: dwrite db/d16/d1c/f72 [0,4194304] 0 2023-12-16T20:11:36.532 INFO:tasks.workunit.client.0.smithi038.stdout:3/771: dwrite d4/d67/de1/fbb [0,4194304] 0 2023-12-16T20:11:36.532 INFO:tasks.workunit.client.1.smithi141.stdout:9/470: dwrite d1/d10/f22 [0,4194304] 0 2023-12-16T20:11:36.533 INFO:tasks.workunit.client.1.smithi141.stdout:1/535: symlink da/d36/d4b/d4d/d80/d94/lb3 0 2023-12-16T20:11:36.533 INFO:tasks.workunit.client.1.smithi141.stdout:1/536: write f6 [1841823,44857] 0 2023-12-16T20:11:36.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/798: dwrite d9/d1f/d96/fb7 [0,4194304] 0 2023-12-16T20:11:36.535 INFO:tasks.workunit.client.1.smithi141.stdout:6/503: dread d1/d12/d22/d25/f7e [0,4194304] 0 2023-12-16T20:11:36.535 INFO:tasks.workunit.client.1.smithi141.stdout:3/570: getdents d0 0 2023-12-16T20:11:36.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/428: mknod d1a/d4e/d63/ca4 0 2023-12-16T20:11:36.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/429: chown l16 962 1 2023-12-16T20:11:36.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/430: stat fd 0 2023-12-16T20:11:36.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/431: write d1a/f9c [1196357,125401] 0 2023-12-16T20:11:36.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/432: readlink d1a/d2a/d3b/l6e 0 2023-12-16T20:11:36.541 INFO:tasks.workunit.client.1.smithi141.stdout:7/490: symlink d5/d16/d1a/l9a 0 2023-12-16T20:11:36.542 INFO:tasks.workunit.client.1.smithi141.stdout:7/491: write d5/d16/d30/d4e/f8f [866872,9721] 0 2023-12-16T20:11:36.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/835: link da/dcf/d100/d4d/f104 da/d21/d2c/d76/dc9/f117 0 2023-12-16T20:11:36.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/836: write da/d21/d61/dcd/f7b [825620,95155] 0 2023-12-16T20:11:36.543 INFO:tasks.workunit.client.1.smithi141.stdout:9/471: mkdir d1/d26/d3c/da6 0 2023-12-16T20:11:36.543 INFO:tasks.workunit.client.1.smithi141.stdout:9/472: write d1/d10/d33/d47/f7f [1770040,77321] 0 2023-12-16T20:11:36.543 INFO:tasks.workunit.client.1.smithi141.stdout:7/492: dread d5/d16/f83 [0,4194304] 0 2023-12-16T20:11:36.543 INFO:tasks.workunit.client.1.smithi141.stdout:1/537: mknod da/d36/d4b/d4d/cb4 0 2023-12-16T20:11:36.548 INFO:tasks.workunit.client.1.smithi141.stdout:3/571: unlink d0/d1c/d40/d3f/d52/d5a/l86 0 2023-12-16T20:11:36.548 INFO:tasks.workunit.client.1.smithi141.stdout:4/433: mknod d1a/d2a/d3b/d69/ca5 0 2023-12-16T20:11:36.548 INFO:tasks.workunit.client.1.smithi141.stdout:4/434: chown fa 510955223 1 2023-12-16T20:11:36.549 INFO:tasks.workunit.client.1.smithi141.stdout:5/393: dwrite d0/d9/d16/d2a/d35/f6a [0,4194304] 0 2023-12-16T20:11:36.554 INFO:tasks.workunit.client.0.smithi038.stdout:6/705: link d1/d4/d1d/d28/f78 d1/d4/d1d/d28/db1/dbe/d94/fde 0 2023-12-16T20:11:36.554 INFO:tasks.workunit.client.0.smithi038.stdout:6/706: write d1/f71 [6842791,76617] 0 2023-12-16T20:11:36.555 INFO:tasks.workunit.client.0.smithi038.stdout:1/805: symlink d15/d1e/d3b/d48/l113 0 2023-12-16T20:11:36.557 INFO:tasks.workunit.client.1.smithi141.stdout:4/435: dread d1a/d2a/f76 [0,4194304] 0 2023-12-16T20:11:36.561 INFO:tasks.workunit.client.0.smithi038.stdout:5/877: symlink d2/df/d1a/d2a/l110 0 2023-12-16T20:11:36.570 INFO:tasks.workunit.client.0.smithi038.stdout:8/674: mknod d17/d1b/d66/d73/d4e/cda 0 2023-12-16T20:11:36.576 INFO:tasks.workunit.client.0.smithi038.stdout:5/878: dread f0 [0,4194304] 0 2023-12-16T20:11:36.576 INFO:tasks.workunit.client.0.smithi038.stdout:5/879: fdatasync d2/d14/d25/d2d/d17/f88 0 2023-12-16T20:11:36.582 INFO:tasks.workunit.client.0.smithi038.stdout:5/880: dread d2/fba [4194304,4194304] 0 2023-12-16T20:11:36.582 INFO:tasks.workunit.client.0.smithi038.stdout:5/881: write d2/df/d1a/d2a/f95 [2434610,89666] 0 2023-12-16T20:11:36.583 INFO:tasks.workunit.client.1.smithi141.stdout:4/436: dwrite f15 [0,4194304] 0 2023-12-16T20:11:36.584 INFO:tasks.workunit.client.0.smithi038.stdout:6/707: dwrite d1/d4/d1d/d28/db1/dbe/fd1 [0,4194304] 0 2023-12-16T20:11:36.592 INFO:tasks.workunit.client.0.smithi038.stdout:0/797: rename db/d16/d5a/d65/c6d to db/d16/d5a/d65/de8/d77/d95/d9f/c100 0 2023-12-16T20:11:36.592 INFO:tasks.workunit.client.0.smithi038.stdout:0/798: chown db/d16/d1c/d5d/d64/cc2 211 1 2023-12-16T20:11:36.600 INFO:tasks.workunit.client.0.smithi038.stdout:7/837: unlink da/d21/d86/d92/f102 0 2023-12-16T20:11:36.601 INFO:tasks.workunit.client.0.smithi038.stdout:3/772: write d4/d27/d40/fac [802905,83967] 0 2023-12-16T20:11:36.601 INFO:tasks.workunit.client.0.smithi038.stdout:5/882: dwrite d2/d14/d25/d2d/d17/d51/fb6 [0,4194304] 0 2023-12-16T20:11:36.601 INFO:tasks.workunit.client.0.smithi038.stdout:5/883: write d2/d14/d25/d2d/d17/d93/ff8 [1026941,47557] 0 2023-12-16T20:11:36.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/799: dread d9/d1f/d21/d3e/d4e/d61/f99 [0,4194304] 0 2023-12-16T20:11:36.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/800: truncate d9/d1f/f5b 983154 0 2023-12-16T20:11:36.608 INFO:tasks.workunit.client.0.smithi038.stdout:7/838: dread da/dcf/d100/d4d/dc5/f39 [0,4194304] 0 2023-12-16T20:11:36.609 INFO:tasks.workunit.client.0.smithi038.stdout:6/708: rename d1/f56 to d1/d4/d1d/d8e/dbf/fdf 0 2023-12-16T20:11:36.609 INFO:tasks.workunit.client.0.smithi038.stdout:6/709: write d1/f39 [2082647,116795] 0 2023-12-16T20:11:36.610 INFO:tasks.workunit.client.0.smithi038.stdout:6/710: write d1/d4/d1d/d67/d73/faf [377303,99003] 0 2023-12-16T20:11:36.610 INFO:tasks.workunit.client.0.smithi038.stdout:6/711: write d1/d4/f9c [896164,20389] 0 2023-12-16T20:11:36.611 INFO:tasks.workunit.client.0.smithi038.stdout:5/884: dread d2/d14/d25/d2d/d17/d55/f72 [0,4194304] 0 2023-12-16T20:11:36.612 INFO:tasks.workunit.client.0.smithi038.stdout:3/773: dread d4/f28 [0,4194304] 0 2023-12-16T20:11:36.612 INFO:tasks.workunit.client.0.smithi038.stdout:1/806: unlink d15/d22/f26 0 2023-12-16T20:11:36.612 INFO:tasks.workunit.client.0.smithi038.stdout:1/807: creat d15/d1e/d3b/d48/d3d/f114 x:0 0 0 2023-12-16T20:11:36.612 INFO:tasks.workunit.client.0.smithi038.stdout:6/712: dread d1/d4/d1d/d28/f79 [0,4194304] 0 2023-12-16T20:11:36.613 INFO:tasks.workunit.client.0.smithi038.stdout:6/713: read - d1/d16/d23/d5f/fb4 zero size 2023-12-16T20:11:36.616 INFO:tasks.workunit.client.0.smithi038.stdout:0/799: rename db/l2f to db/d16/l101 0 2023-12-16T20:11:36.618 INFO:tasks.workunit.client.0.smithi038.stdout:5/885: creat d2/d14/d25/d2d/d17/d51/d7b/d89/f111 x:0 0 0 2023-12-16T20:11:36.619 INFO:tasks.workunit.client.0.smithi038.stdout:1/808: creat d15/d1e/d23/d34/d86/d9a/f115 x:0 0 0 2023-12-16T20:11:36.619 INFO:tasks.workunit.client.0.smithi038.stdout:1/809: fdatasync d15/d1e/d23/d34/d86/d99/ffa 0 2023-12-16T20:11:36.620 INFO:tasks.workunit.client.0.smithi038.stdout:6/714: link d1/d5b/f99 d1/d5b/d7d/d9d/fe0 0 2023-12-16T20:11:36.622 INFO:tasks.workunit.client.0.smithi038.stdout:9/801: rename d9/d1f/d21/d3e/d4e/d64/f93 to d9/d1e/d40/ffc 0 2023-12-16T20:11:36.623 INFO:tasks.workunit.client.0.smithi038.stdout:9/802: creat d9/ffd x:0 0 0 2023-12-16T20:11:36.623 INFO:tasks.workunit.client.0.smithi038.stdout:8/675: getdents d17/d1b/d66/d73/d4e 0 2023-12-16T20:11:36.623 INFO:tasks.workunit.client.0.smithi038.stdout:0/800: truncate db/d16/d19/d27/f50 1025643 0 2023-12-16T20:11:36.626 INFO:tasks.workunit.client.0.smithi038.stdout:1/810: creat d15/d1e/d23/d34/f116 x:0 0 0 2023-12-16T20:11:36.627 INFO:tasks.workunit.client.0.smithi038.stdout:6/715: mknod d1/d4/d1d/d28/d2f/ce1 0 2023-12-16T20:11:36.635 INFO:tasks.workunit.client.0.smithi038.stdout:6/716: dread d1/d4/d1d/d67/d73/faf [0,4194304] 0 2023-12-16T20:11:36.635 INFO:tasks.workunit.client.0.smithi038.stdout:9/803: write d9/f81 [2157423,69182] 0 2023-12-16T20:11:36.635 INFO:tasks.workunit.client.0.smithi038.stdout:7/839: dwrite da/d21/d2c/d76/fd8 [0,4194304] 0 2023-12-16T20:11:36.635 INFO:tasks.workunit.client.0.smithi038.stdout:5/886: mkdir d2/d112 0 2023-12-16T20:11:36.637 INFO:tasks.workunit.client.0.smithi038.stdout:3/774: rename d4/d27/d40/f5f to d4/d27/d2b/f10b 0 2023-12-16T20:11:36.639 INFO:tasks.workunit.client.0.smithi038.stdout:6/717: unlink d1/d4/d1d/d28/d2f/d85/fc0 0 2023-12-16T20:11:36.644 INFO:tasks.workunit.client.0.smithi038.stdout:1/811: dread d15/d1e/f4c [0,4194304] 0 2023-12-16T20:11:36.647 INFO:tasks.workunit.client.0.smithi038.stdout:6/718: fsync d1/f71 0 2023-12-16T20:11:36.647 INFO:tasks.workunit.client.0.smithi038.stdout:1/812: dread d15/d1e/d3b/d48/d37/dde/d75/dc1/f110 [0,4194304] 0 2023-12-16T20:11:36.650 INFO:tasks.workunit.client.0.smithi038.stdout:9/804: dread d9/d1e/f74 [0,4194304] 0 2023-12-16T20:11:36.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/676: dwrite d17/d1b/d25/db7/d82/da9/d50/dc4/fc5 [0,4194304] 0 2023-12-16T20:11:36.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/677: fsync d17/d1b/d66/d73/d4e/f9f 0 2023-12-16T20:11:36.660 INFO:tasks.workunit.client.0.smithi038.stdout:7/840: dwrite da/d21/d2c/dd0/f116 [0,4194304] 0 2023-12-16T20:11:36.666 INFO:tasks.workunit.client.0.smithi038.stdout:5/887: rename d2/df/d1a/d2a/l65 to d2/df/d1a/d1f/l113 0 2023-12-16T20:11:36.666 INFO:tasks.workunit.client.0.smithi038.stdout:1/813: chown d15/d1e/d3b/d48/d37/dde/fae 6021 1 2023-12-16T20:11:36.666 INFO:tasks.workunit.client.1.smithi141.stdout:2/346: unlink d6/da/d33/d4f/f75 0 2023-12-16T20:11:36.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/719: symlink d1/d4/d1d/d8e/le2 0 2023-12-16T20:11:36.670 INFO:tasks.workunit.client.0.smithi038.stdout:9/805: symlink d9/d1f/d6c/lfe 0 2023-12-16T20:11:36.673 INFO:tasks.workunit.client.1.smithi141.stdout:3/572: mkdir d0/d1c/d2c/dc0 0 2023-12-16T20:11:36.675 INFO:tasks.workunit.client.1.smithi141.stdout:3/573: dread d0/d1c/d2c/d72/d74/d8b/da3/faf [0,4194304] 0 2023-12-16T20:11:36.677 INFO:tasks.workunit.client.1.smithi141.stdout:5/394: mkdir d0/d9/d85 0 2023-12-16T20:11:36.678 INFO:tasks.workunit.client.1.smithi141.stdout:5/395: creat d0/d9/f86 x:0 0 0 2023-12-16T20:11:36.678 INFO:tasks.workunit.client.1.smithi141.stdout:5/396: chown d0/fe 14084 1 2023-12-16T20:11:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:8/678: dwrite d17/d34/fa8 [0,4194304] 0 2023-12-16T20:11:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:8/679: read - d17/d1b/d25/db7/d82/fa4 zero size 2023-12-16T20:11:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:8/680: write d17/d1b/d66/d73/d55/da5/fb4 [666382,566] 0 2023-12-16T20:11:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:6/720: dread d1/d4/d1d/d28/db1/dbe/db3/fbc [0,4194304] 0 2023-12-16T20:11:36.687 INFO:tasks.workunit.client.0.smithi038.stdout:0/801: rmdir db 39 2023-12-16T20:11:36.689 INFO:tasks.workunit.client.0.smithi038.stdout:9/806: write d9/d1f/f35 [2249294,105173] 0 2023-12-16T20:11:36.690 INFO:tasks.workunit.client.0.smithi038.stdout:7/841: symlink da/d21/d86/de2/d10f/l118 0 2023-12-16T20:11:36.691 INFO:tasks.workunit.client.1.smithi141.stdout:4/437: mkdir d1a/d3c/d9b/da1/da6 0 2023-12-16T20:11:36.692 INFO:tasks.workunit.client.0.smithi038.stdout:3/775: link d4/d67/lbc d4/d27/d40/l10c 0 2023-12-16T20:11:36.695 INFO:tasks.workunit.client.0.smithi038.stdout:5/888: rename d2/d14/d25/d2d/d17/d55/c106 to d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/dd5/c114 0 2023-12-16T20:11:36.697 INFO:tasks.workunit.client.1.smithi141.stdout:2/347: unlink d6/da/d33/l43 0 2023-12-16T20:11:36.697 INFO:tasks.workunit.client.1.smithi141.stdout:9/473: symlink d1/la7 0 2023-12-16T20:11:36.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/807: read d9/d1e/d3d/f4b [536164,22348] 0 2023-12-16T20:11:36.698 INFO:tasks.workunit.client.1.smithi141.stdout:7/493: getdents d5 0 2023-12-16T20:11:36.698 INFO:tasks.workunit.client.1.smithi141.stdout:7/494: truncate d5/f8d 995600 0 2023-12-16T20:11:36.699 INFO:tasks.workunit.client.1.smithi141.stdout:5/397: dwrite d0/d43/f44 [0,4194304] 0 2023-12-16T20:11:36.700 INFO:tasks.workunit.client.1.smithi141.stdout:5/398: chown d0/d9/d16/l7c 84208356 1 2023-12-16T20:11:36.700 INFO:tasks.workunit.client.1.smithi141.stdout:5/399: fdatasync d0/d14/d2c/f33 0 2023-12-16T20:11:36.700 INFO:tasks.workunit.client.0.smithi038.stdout:6/721: mknod d1/d16/d23/ce3 0 2023-12-16T20:11:36.700 INFO:tasks.workunit.client.0.smithi038.stdout:8/681: write d17/d1b/d25/db7/d82/da9/d50/f6e [4364691,10639] 0 2023-12-16T20:11:36.700 INFO:tasks.workunit.client.0.smithi038.stdout:6/722: stat d1/d4/d1d/d28/db1/dbe/db3/fbc 0 2023-12-16T20:11:36.701 INFO:tasks.workunit.client.1.smithi141.stdout:1/538: symlink da/d67/lb5 0 2023-12-16T20:11:36.702 INFO:tasks.workunit.client.0.smithi038.stdout:0/802: creat db/d16/d1c/d5d/d64/dd0/f102 x:0 0 0 2023-12-16T20:11:36.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/574: truncate d0/d1c/d6a/f7f 6889972 0 2023-12-16T20:11:36.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/575: readlink d0/d1c/d40/d85/d4c/l60 0 2023-12-16T20:11:36.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/576: dread - d0/d1c/d2c/d72/d74/d8b/fb4 zero size 2023-12-16T20:11:36.704 INFO:tasks.workunit.client.1.smithi141.stdout:3/577: stat d0/d1c/d40/d3f/f80 0 2023-12-16T20:11:36.706 INFO:tasks.workunit.client.0.smithi038.stdout:3/776: mkdir d4/d8/d15/d6d/d7a/d10d 0 2023-12-16T20:11:36.706 INFO:tasks.workunit.client.0.smithi038.stdout:3/777: write d4/d6c/fa6 [986432,69850] 0 2023-12-16T20:11:36.712 INFO:tasks.workunit.client.1.smithi141.stdout:3/578: write d0/d1c/d40/d3f/d52/f9e [875746,66461] 0 2023-12-16T20:11:36.713 INFO:tasks.workunit.client.1.smithi141.stdout:3/579: fsync d0/d1c/d40/d3f/d52/d63/fb3 0 2023-12-16T20:11:36.713 INFO:tasks.workunit.client.0.smithi038.stdout:5/889: unlink d2/df/f7c 0 2023-12-16T20:11:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:9/808: creat d9/dea/fff x:0 0 0 2023-12-16T20:11:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:8/682: unlink d17/d1b/d66/f8a 0 2023-12-16T20:11:36.719 INFO:tasks.workunit.client.0.smithi038.stdout:6/723: creat d1/d4/d1d/d28/d2f/d85/da2/fe4 x:0 0 0 2023-12-16T20:11:36.720 INFO:tasks.workunit.client.0.smithi038.stdout:0/803: getdents db/d16/d70 0 2023-12-16T20:11:36.723 INFO:tasks.workunit.client.0.smithi038.stdout:3/778: rename d4/d67/de1/f65 to d4/d6c/d80/da8/f10e 0 2023-12-16T20:11:36.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/809: symlink d9/d1f/d21/d3e/d4e/d61/l100 0 2023-12-16T20:11:36.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/810: write d9/d1e/d3d/d42/d59/d76/fa4 [982551,97515] 0 2023-12-16T20:11:36.735 INFO:tasks.workunit.client.0.smithi038.stdout:3/779: rename d4/d67/de1/ddd to d4/d8/d15/d6d/d7a/d98/d10f 0 2023-12-16T20:11:36.737 INFO:tasks.workunit.client.0.smithi038.stdout:3/780: mkdir d4/d18/d110 0 2023-12-16T20:11:36.737 INFO:tasks.workunit.client.0.smithi038.stdout:3/781: chown d4/d67/de1/d4c/lc6 128912744 1 2023-12-16T20:11:36.737 INFO:tasks.workunit.client.0.smithi038.stdout:3/782: write d4/d6c/d80/fa3 [1349404,22173] 0 2023-12-16T20:11:36.739 INFO:tasks.workunit.client.1.smithi141.stdout:9/474: getdents d1/d10/d33/d47/d83 0 2023-12-16T20:11:36.739 INFO:tasks.workunit.client.1.smithi141.stdout:9/475: readlink d1/l23 0 2023-12-16T20:11:36.740 INFO:tasks.workunit.client.0.smithi038.stdout:6/724: getdents d1/d4/d1d/d8e 0 2023-12-16T20:11:36.741 INFO:tasks.workunit.client.0.smithi038.stdout:3/783: creat d4/dcd/dcc/f111 x:0 0 0 2023-12-16T20:11:36.743 INFO:tasks.workunit.client.0.smithi038.stdout:6/725: symlink d1/d4/d1d/d61/le5 0 2023-12-16T20:11:36.743 INFO:tasks.workunit.client.0.smithi038.stdout:6/726: chown d1/d4/d1d/d28/db1/dbe/db3/fb5 26183610 1 2023-12-16T20:11:36.743 INFO:tasks.workunit.client.0.smithi038.stdout:6/727: creat d1/d4/d1d/d28/d2f/d85/da2/fe6 x:0 0 0 2023-12-16T20:11:36.744 INFO:tasks.workunit.client.0.smithi038.stdout:3/784: symlink d4/d67/l112 0 2023-12-16T20:11:36.746 INFO:tasks.workunit.client.1.smithi141.stdout:5/400: stat d0/d14/l76 0 2023-12-16T20:11:36.747 INFO:tasks.workunit.client.1.smithi141.stdout:2/348: dwrite d6/d32/f64 [0,4194304] 0 2023-12-16T20:11:36.751 INFO:tasks.workunit.client.1.smithi141.stdout:7/495: getdents d5/d16/d46/d61 0 2023-12-16T20:11:36.754 INFO:tasks.workunit.client.1.smithi141.stdout:9/476: read d1/d10/f12 [4355669,13048] 0 2023-12-16T20:11:36.756 INFO:tasks.workunit.client.1.smithi141.stdout:3/580: getdents d0/d1c/d2c/d72/d74/d8b 0 2023-12-16T20:11:36.758 INFO:tasks.workunit.client.0.smithi038.stdout:4/749: sync 2023-12-16T20:11:36.758 INFO:tasks.workunit.client.0.smithi038.stdout:2/905: sync 2023-12-16T20:11:36.758 INFO:tasks.workunit.client.0.smithi038.stdout:2/906: dread - d1/d5/d95/d61/d66/ddd/de8/f11f zero size 2023-12-16T20:11:36.758 INFO:tasks.workunit.client.0.smithi038.stdout:2/907: write d1/d5/f4e [2309229,36882] 0 2023-12-16T20:11:36.758 INFO:tasks.workunit.client.1.smithi141.stdout:7/496: mkdir d5/d1d/d89/d9b 0 2023-12-16T20:11:36.759 INFO:tasks.workunit.client.1.smithi141.stdout:7/497: dread - d5/d16/d30/d4e/f82 zero size 2023-12-16T20:11:36.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/539: dwrite da/d36/d4b/d4d/d89/f37 [0,4194304] 0 2023-12-16T20:11:36.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/540: chown da/d36/d4b/d4d/f56 7309369 1 2023-12-16T20:11:36.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/541: truncate da/d36/d4b/d4d/f56 1668630 0 2023-12-16T20:11:36.761 INFO:tasks.workunit.client.1.smithi141.stdout:9/477: symlink d1/d26/d4a/d73/d76/la8 0 2023-12-16T20:11:36.761 INFO:tasks.workunit.client.0.smithi038.stdout:4/750: rmdir d13/d69/d7a 39 2023-12-16T20:11:36.762 INFO:tasks.workunit.client.0.smithi038.stdout:7/842: dwrite da/d21/d2c/d76/d9a/fe5 [0,4194304] 0 2023-12-16T20:11:36.762 INFO:tasks.workunit.client.0.smithi038.stdout:7/843: write da/d21/f10d [438907,101711] 0 2023-12-16T20:11:36.762 INFO:tasks.workunit.client.0.smithi038.stdout:7/844: write da/d21/fac [4208506,33941] 0 2023-12-16T20:11:36.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/751: getdents d13/d1f 0 2023-12-16T20:11:36.763 INFO:tasks.workunit.client.1.smithi141.stdout:3/581: mkdir d0/d1c/d40/d3f/dc1 0 2023-12-16T20:11:36.763 INFO:tasks.workunit.client.1.smithi141.stdout:3/582: write d0/d1c/fa1 [638221,17131] 0 2023-12-16T20:11:36.763 INFO:tasks.workunit.client.1.smithi141.stdout:3/583: readlink d0/d1c/d40/d85/lb6 0 2023-12-16T20:11:36.763 INFO:tasks.workunit.client.1.smithi141.stdout:3/584: chown d0/d1c/d40/d3f/dc1 15 1 2023-12-16T20:11:36.763 INFO:tasks.workunit.client.1.smithi141.stdout:2/349: dread d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:36.764 INFO:tasks.workunit.client.1.smithi141.stdout:2/350: write d6/d3a/f2c [4547094,54415] 0 2023-12-16T20:11:36.764 INFO:tasks.workunit.client.1.smithi141.stdout:2/351: chown d6/d12/d1f/d46/f63 0 1 2023-12-16T20:11:36.765 INFO:tasks.workunit.client.1.smithi141.stdout:7/498: link d5/l19 d5/l9c 0 2023-12-16T20:11:36.766 INFO:tasks.workunit.client.1.smithi141.stdout:7/499: readlink d5/d1d/d1e/d27/l42 0 2023-12-16T20:11:36.766 INFO:tasks.workunit.client.1.smithi141.stdout:7/500: dread - d5/d16/d46/f53 zero size 2023-12-16T20:11:36.766 INFO:tasks.workunit.client.1.smithi141.stdout:7/501: creat d5/d1d/d89/f9d x:0 0 0 2023-12-16T20:11:36.769 INFO:tasks.workunit.client.0.smithi038.stdout:8/683: dwrite d17/d1b/d66/d8e/f9a [0,4194304] 0 2023-12-16T20:11:36.770 INFO:tasks.workunit.client.1.smithi141.stdout:1/542: mkdir da/d1a/d31/d81/db6 0 2023-12-16T20:11:36.770 INFO:tasks.workunit.client.1.smithi141.stdout:4/438: dwrite fa [0,4194304] 0 2023-12-16T20:11:36.770 INFO:tasks.workunit.client.1.smithi141.stdout:1/543: truncate da/d36/d4b/d4d/d89/d61/f65 4738903 0 2023-12-16T20:11:36.770 INFO:tasks.workunit.client.1.smithi141.stdout:1/544: dread - da/d1a/d31/d81/fa9 zero size 2023-12-16T20:11:36.771 INFO:tasks.workunit.client.1.smithi141.stdout:9/478: creat d1/d10/d27/fa9 x:0 0 0 2023-12-16T20:11:36.771 INFO:tasks.workunit.client.1.smithi141.stdout:9/479: write d1/d26/d4a/f88 [389062,92539] 0 2023-12-16T20:11:36.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/845: dread da/d21/f28 [0,4194304] 0 2023-12-16T20:11:36.773 INFO:tasks.workunit.client.0.smithi038.stdout:7/846: stat da/d21/d61/le7 0 2023-12-16T20:11:36.773 INFO:tasks.workunit.client.0.smithi038.stdout:7/847: fsync da/f1d 0 2023-12-16T20:11:36.773 INFO:tasks.workunit.client.1.smithi141.stdout:8/474: sync 2023-12-16T20:11:36.774 INFO:tasks.workunit.client.1.smithi141.stdout:3/585: unlink d0/d1c/d40/l4e 0 2023-12-16T20:11:36.774 INFO:tasks.workunit.client.1.smithi141.stdout:3/586: stat d0/d1c/d2c/f5b 0 2023-12-16T20:11:36.775 INFO:tasks.workunit.client.0.smithi038.stdout:9/811: dwrite d9/d1f/fac [0,4194304] 0 2023-12-16T20:11:36.776 INFO:tasks.workunit.client.0.smithi038.stdout:7/848: mkdir da/dcf/d100/d4d/dc5/ddc/d8e/d119 0 2023-12-16T20:11:36.776 INFO:tasks.workunit.client.1.smithi141.stdout:5/401: dwrite d0/f50 [0,4194304] 0 2023-12-16T20:11:36.777 INFO:tasks.workunit.client.1.smithi141.stdout:2/352: creat d6/d12/d1f/d46/d5a/f76 x:0 0 0 2023-12-16T20:11:36.778 INFO:tasks.workunit.client.1.smithi141.stdout:1/545: dread da/d36/d4b/d4d/d89/f2a [0,4194304] 0 2023-12-16T20:11:36.779 INFO:tasks.workunit.client.0.smithi038.stdout:0/804: dwrite db/d16/d1c/fd9 [0,4194304] 0 2023-12-16T20:11:36.779 INFO:tasks.workunit.client.0.smithi038.stdout:5/890: dwrite d2/d14/d25/d2d/d17/f19 [0,4194304] 0 2023-12-16T20:11:36.780 INFO:tasks.workunit.client.1.smithi141.stdout:7/502: symlink d5/d16/d46/d61/l9e 0 2023-12-16T20:11:36.781 INFO:tasks.workunit.client.1.smithi141.stdout:4/439: symlink d1a/d2a/d3b/d69/la7 0 2023-12-16T20:11:36.781 INFO:tasks.workunit.client.1.smithi141.stdout:4/440: write d1a/d3c/d70/f99 [1007694,106195] 0 2023-12-16T20:11:36.782 INFO:tasks.workunit.client.1.smithi141.stdout:2/353: read d6/f1d [164055,63152] 0 2023-12-16T20:11:36.784 INFO:tasks.workunit.client.1.smithi141.stdout:9/480: rename d1/c53 to d1/d26/d3c/da4/caa 0 2023-12-16T20:11:36.784 INFO:tasks.workunit.client.1.smithi141.stdout:9/481: truncate d1/d26/d4a/d73/fa2 387670 0 2023-12-16T20:11:36.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/849: creat da/dcf/d100/db7/f11a x:0 0 0 2023-12-16T20:11:36.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/850: chown da/dcf/d100/d4d/dc5/ddc/ff4 301609290 1 2023-12-16T20:11:36.784 INFO:tasks.workunit.client.0.smithi038.stdout:7/851: write da/d21/d86/de2/fe4 [325695,116940] 0 2023-12-16T20:11:36.785 INFO:tasks.workunit.client.1.smithi141.stdout:6/504: sync 2023-12-16T20:11:36.785 INFO:tasks.workunit.client.1.smithi141.stdout:0/485: sync 2023-12-16T20:11:36.786 INFO:tasks.workunit.client.1.smithi141.stdout:8/475: truncate d14/d19/f78 1000284 0 2023-12-16T20:11:36.787 INFO:tasks.workunit.client.1.smithi141.stdout:8/476: write d14/d19/d1b/d24/d4b/f62 [482086,120143] 0 2023-12-16T20:11:36.787 INFO:tasks.workunit.client.1.smithi141.stdout:8/477: chown d14/c45 789108884 1 2023-12-16T20:11:36.787 INFO:tasks.workunit.client.1.smithi141.stdout:8/478: chown d14/d71/l8d 11708883 1 2023-12-16T20:11:36.790 INFO:tasks.workunit.client.1.smithi141.stdout:3/587: read d0/d1c/d40/d85/d4c/fbb [516671,61045] 0 2023-12-16T20:11:36.790 INFO:tasks.workunit.client.1.smithi141.stdout:7/503: truncate d5/d2a/f60 1399404 0 2023-12-16T20:11:36.793 INFO:tasks.workunit.client.1.smithi141.stdout:9/482: truncate d1/d10/d14/f25 4385902 0 2023-12-16T20:11:36.793 INFO:tasks.workunit.client.1.smithi141.stdout:9/483: truncate d1/d10/d14/d20/d3b/f46 1360475 0 2023-12-16T20:11:36.796 INFO:tasks.workunit.client.1.smithi141.stdout:6/505: symlink d1/d12/d20/la2 0 2023-12-16T20:11:36.798 INFO:tasks.workunit.client.1.smithi141.stdout:7/504: mknod d5/d16/d1a/c9f 0 2023-12-16T20:11:36.799 INFO:tasks.workunit.client.0.smithi038.stdout:0/805: dread db/d16/d5a/d65/de8/d77/d95/d9f/fb9 [0,4194304] 0 2023-12-16T20:11:36.800 INFO:tasks.workunit.client.1.smithi141.stdout:7/505: dread d5/d16/d30/f57 [0,4194304] 0 2023-12-16T20:11:36.801 INFO:tasks.workunit.client.0.smithi038.stdout:5/891: unlink d2/df/d1a/d1f/c5c 0 2023-12-16T20:11:36.801 INFO:tasks.workunit.client.0.smithi038.stdout:5/892: fdatasync d2/df/d87/fd0 0 2023-12-16T20:11:36.803 INFO:tasks.workunit.client.0.smithi038.stdout:9/812: rmdir d9/d1f/d21/d3e/d4e/d61/d9b 39 2023-12-16T20:11:36.804 INFO:tasks.workunit.client.1.smithi141.stdout:4/441: rename d1a/d3c/d70 to d1a/d54/d87/da8 0 2023-12-16T20:11:36.805 INFO:tasks.workunit.client.0.smithi038.stdout:4/752: dwrite d13/d17/d4b/d7d/d90/faf [0,4194304] 0 2023-12-16T20:11:36.805 INFO:tasks.workunit.client.0.smithi038.stdout:4/753: fsync d13/d17/d4b/da4/d9d/db5/fd4 0 2023-12-16T20:11:36.805 INFO:tasks.workunit.client.1.smithi141.stdout:7/506: mkdir d5/d16/d30/d4e/d87/da0 0 2023-12-16T20:11:36.805 INFO:tasks.workunit.client.1.smithi141.stdout:7/507: fsync d5/d16/f75 0 2023-12-16T20:11:36.805 INFO:tasks.workunit.client.1.smithi141.stdout:7/508: read - d5/d16/d30/d4e/f72 zero size 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/785: dwrite d4/fed [0,4194304] 0 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/908: dwrite d1/d5/d3d/ddc/f118 [0,4194304] 0 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/786: dread - d4/d18/f69 zero size 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/909: write d1/d5/d95/d61/d66/ddd/f120 [137919,78445] 0 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/787: write d4/d8/d15/d6d/d7a/feb [868113,118192] 0 2023-12-16T20:11:36.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/788: readlink d4/dcd/ld0 0 2023-12-16T20:11:36.808 INFO:tasks.workunit.client.0.smithi038.stdout:0/806: truncate db/d16/d19/d80/f92 3458591 0 2023-12-16T20:11:36.808 INFO:tasks.workunit.client.0.smithi038.stdout:0/807: chown db/d16/d5a/d65/d90/da7 209076 1 2023-12-16T20:11:36.808 INFO:tasks.workunit.client.0.smithi038.stdout:0/808: chown db 6713475 1 2023-12-16T20:11:36.808 INFO:tasks.workunit.client.1.smithi141.stdout:0/486: dread d4/d7/f50 [0,4194304] 0 2023-12-16T20:11:36.809 INFO:tasks.workunit.client.1.smithi141.stdout:0/487: write d4/d49/f5a [2614959,72070] 0 2023-12-16T20:11:36.809 INFO:tasks.workunit.client.1.smithi141.stdout:0/488: read - d4/d49/d73/d3b/d78/d7f/f9f zero size 2023-12-16T20:11:36.809 INFO:tasks.workunit.client.0.smithi038.stdout:5/893: unlink d2/df/d87/ca2 0 2023-12-16T20:11:36.809 INFO:tasks.workunit.client.0.smithi038.stdout:5/894: chown d2/d14/d25/d2d/d17/da9/db0/ld3 39380 1 2023-12-16T20:11:36.811 INFO:tasks.workunit.client.1.smithi141.stdout:4/442: unlink d1a/f2e 0 2023-12-16T20:11:36.811 INFO:tasks.workunit.client.1.smithi141.stdout:4/443: write d1a/d2a/f4b [1038221,16324] 0 2023-12-16T20:11:36.812 INFO:tasks.workunit.client.0.smithi038.stdout:9/813: symlink d9/d1f/d96/l101 0 2023-12-16T20:11:36.815 INFO:tasks.workunit.client.1.smithi141.stdout:3/588: dread d0/d1c/d40/d3f/d52/d5a/f71 [0,4194304] 0 2023-12-16T20:11:36.818 INFO:tasks.workunit.client.1.smithi141.stdout:3/589: dread d0/d1c/d2c/d72/d74/d8b/da3/faf [0,4194304] 0 2023-12-16T20:11:36.818 INFO:tasks.workunit.client.1.smithi141.stdout:3/590: write d0/d1c/d40/d85/d4c/f8a [2541242,78153] 0 2023-12-16T20:11:36.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/814: dread d9/d1f/d21/d3e/d4e/d61/f89 [0,4194304] 0 2023-12-16T20:11:36.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/815: dwrite d9/d1e/d40/d5e/d71/d83/de8/fca [0,4194304] 0 2023-12-16T20:11:36.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/816: dread - d9/d1e/d40/d5e/fde zero size 2023-12-16T20:11:36.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/817: creat d9/d1e/d3d/d42/d59/d76/f102 x:0 0 0 2023-12-16T20:11:36.839 INFO:tasks.workunit.client.1.smithi141.stdout:2/354: dwrite d6/da/d33/f3e [0,4194304] 0 2023-12-16T20:11:36.839 INFO:tasks.workunit.client.1.smithi141.stdout:5/402: dwrite d0/d25/f7b [0,4194304] 0 2023-12-16T20:11:36.840 INFO:tasks.workunit.client.1.smithi141.stdout:5/403: read d0/d9/d16/d2a/d35/f66 [181693,16620] 0 2023-12-16T20:11:36.844 INFO:tasks.workunit.client.1.smithi141.stdout:6/506: dwrite d1/dd/de/f6f [0,4194304] 0 2023-12-16T20:11:36.845 INFO:tasks.workunit.client.1.smithi141.stdout:8/479: dwrite d14/d19/d1b/f1a [0,4194304] 0 2023-12-16T20:11:36.845 INFO:tasks.workunit.client.0.smithi038.stdout:4/754: dwrite d13/d1f/d98/fd0 [0,4194304] 0 2023-12-16T20:11:36.846 INFO:tasks.workunit.client.0.smithi038.stdout:2/910: dwrite d1/d5/f7 [0,4194304] 0 2023-12-16T20:11:36.856 INFO:tasks.workunit.client.0.smithi038.stdout:9/818: dwrite d9/d1e/f74 [0,4194304] 0 2023-12-16T20:11:36.856 INFO:tasks.workunit.client.0.smithi038.stdout:9/819: chown d9/d1e/d45/ldf 3943 1 2023-12-16T20:11:36.856 INFO:tasks.workunit.client.0.smithi038.stdout:9/820: write d9/d1f/d6a/dc0/fe5 [217831,35760] 0 2023-12-16T20:11:36.856 INFO:tasks.workunit.client.0.smithi038.stdout:9/821: write d9/d1f/d21/f3a [5763257,39689] 0 2023-12-16T20:11:36.856 INFO:tasks.workunit.client.0.smithi038.stdout:9/822: write d9/d1f/d21/d52/fb8 [798733,65622] 0 2023-12-16T20:11:36.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/755: dwrite d13/d69/d7a/fb3 [0,4194304] 0 2023-12-16T20:11:36.934 INFO:tasks.workunit.client.1.smithi141.stdout:4/444: mkdir d1a/d54/d87/da8/da9 0 2023-12-16T20:11:36.935 INFO:tasks.workunit.client.1.smithi141.stdout:9/484: rename d1/d26/d3c/da4 to d1/d10/d14/d20/da/d3f/dab 0 2023-12-16T20:11:36.940 INFO:tasks.workunit.client.1.smithi141.stdout:0/489: link d4/d7/l8b d4/d7/lae 0 2023-12-16T20:11:36.940 INFO:tasks.workunit.client.1.smithi141.stdout:0/490: chown d4/c10 3906 1 2023-12-16T20:11:36.940 INFO:tasks.workunit.client.1.smithi141.stdout:0/491: write d4/d49/d73/d8a/f91 [1162405,11228] 0 2023-12-16T20:11:36.941 INFO:tasks.workunit.client.1.smithi141.stdout:7/509: rmdir d5/d2a 39 2023-12-16T20:11:36.944 INFO:tasks.workunit.client.1.smithi141.stdout:9/485: write d1/d10/f6c [1343022,10307] 0 2023-12-16T20:11:36.944 INFO:tasks.workunit.client.1.smithi141.stdout:9/486: chown d1/d10/d14/d20/da/f41 2869785 1 2023-12-16T20:11:36.944 INFO:tasks.workunit.client.1.smithi141.stdout:3/591: mknod d0/d1c/d40/d3f/d52/cc2 0 2023-12-16T20:11:36.946 INFO:tasks.workunit.client.1.smithi141.stdout:2/355: truncate d6/d3a/d47/d58/f72 12597 0 2023-12-16T20:11:36.951 INFO:tasks.workunit.client.1.smithi141.stdout:5/404: link d0/d43/l81 d0/d25/l87 0 2023-12-16T20:11:36.954 INFO:tasks.workunit.client.1.smithi141.stdout:6/507: stat d1/d3/lc 0 2023-12-16T20:11:36.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/480: symlink d14/d19/d1b/l99 0 2023-12-16T20:11:36.960 INFO:tasks.workunit.client.1.smithi141.stdout:0/492: dwrite d4/d49/d73/d3b/d78/d7f/d80/d83/f89 [0,4194304] 0 2023-12-16T20:11:36.960 INFO:tasks.workunit.client.1.smithi141.stdout:0/493: chown d4/d49/d8f/la7 47 1 2023-12-16T20:11:36.960 INFO:tasks.workunit.client.1.smithi141.stdout:0/494: chown d4/d7 0 1 2023-12-16T20:11:36.960 INFO:tasks.workunit.client.1.smithi141.stdout:0/495: readlink d4/d49/da1/lab 0 2023-12-16T20:11:36.963 INFO:tasks.workunit.client.1.smithi141.stdout:6/508: write d1/d3/d4b/d60/f9b [2627157,94585] 0 2023-12-16T20:11:36.969 INFO:tasks.workunit.client.1.smithi141.stdout:0/496: write d4/f33 [3201463,57366] 0 2023-12-16T20:11:36.969 INFO:tasks.workunit.client.1.smithi141.stdout:0/497: chown d4/d7/l48 487719 1 2023-12-16T20:11:36.972 INFO:tasks.workunit.client.1.smithi141.stdout:4/445: mkdir d1a/d4e/d63/daa 0 2023-12-16T20:11:36.974 INFO:tasks.workunit.client.1.smithi141.stdout:4/446: dread d1a/d54/d87/da8/f99 [0,4194304] 0 2023-12-16T20:11:36.974 INFO:tasks.workunit.client.1.smithi141.stdout:4/447: chown d1a/d4e/d63/l93 25308 1 2023-12-16T20:11:36.975 INFO:tasks.workunit.client.1.smithi141.stdout:7/510: unlink d5/d1d/d1e/d71/c78 0 2023-12-16T20:11:36.977 INFO:tasks.workunit.client.1.smithi141.stdout:9/487: creat d1/d10/d33/d6a/d72/fac x:0 0 0 2023-12-16T20:11:36.980 INFO:tasks.workunit.client.1.smithi141.stdout:2/356: symlink d6/d32/l77 0 2023-12-16T20:11:36.980 INFO:tasks.workunit.client.1.smithi141.stdout:2/357: fdatasync d6/f1d 0 2023-12-16T20:11:36.980 INFO:tasks.workunit.client.1.smithi141.stdout:2/358: write d6/d32/f39 [1333464,27579] 0 2023-12-16T20:11:36.982 INFO:tasks.workunit.client.1.smithi141.stdout:5/405: symlink d0/d25/d30/l88 0 2023-12-16T20:11:36.982 INFO:tasks.workunit.client.1.smithi141.stdout:5/406: creat d0/d9/f89 x:0 0 0 2023-12-16T20:11:36.982 INFO:tasks.workunit.client.1.smithi141.stdout:5/407: stat d0/d9/d16/d2a 0 2023-12-16T20:11:36.982 INFO:tasks.workunit.client.1.smithi141.stdout:8/481: truncate d14/d19/d1b/d24/d4a/d5b/f89 4155544 0 2023-12-16T20:11:36.983 INFO:tasks.workunit.client.1.smithi141.stdout:8/482: read - d14/d19/d1b/d24/d4b/f5c zero size 2023-12-16T20:11:36.983 INFO:tasks.workunit.client.1.smithi141.stdout:8/483: write d14/f94 [219048,56319] 0 2023-12-16T20:11:36.984 INFO:tasks.workunit.client.1.smithi141.stdout:8/484: dread d14/d19/d1b/d3d/f37 [0,4194304] 0 2023-12-16T20:11:36.992 INFO:tasks.workunit.client.0.smithi038.stdout:6/728: rename d1/d4/d1d/d28 to d1/d5b/d7d/d9d/dc8/de7 0 2023-12-16T20:11:37.003 INFO:tasks.workunit.client.1.smithi141.stdout:8/485: dwrite d14/d35/f70 [0,4194304] 0 2023-12-16T20:11:37.004 INFO:tasks.workunit.client.1.smithi141.stdout:8/486: readlink d14/d19/d1b/d24/d4b/l4d 0 2023-12-16T20:11:37.004 INFO:tasks.workunit.client.1.smithi141.stdout:8/487: chown cd 723035867 1 2023-12-16T20:11:37.023 INFO:tasks.workunit.client.1.smithi141.stdout:6/509: symlink d1/dd/d2f/d48/la3 0 2023-12-16T20:11:37.023 INFO:tasks.workunit.client.1.smithi141.stdout:6/510: readlink d1/dd/d43/l97 0 2023-12-16T20:11:37.024 INFO:tasks.workunit.client.1.smithi141.stdout:0/498: rmdir d4/d49/d8f 39 2023-12-16T20:11:37.024 INFO:tasks.workunit.client.1.smithi141.stdout:0/499: stat d4/d74/l7c 0 2023-12-16T20:11:37.028 INFO:tasks.workunit.client.1.smithi141.stdout:6/511: write d1/d12/d20/d3a/d45/f81 [537585,102498] 0 2023-12-16T20:11:37.040 INFO:tasks.workunit.client.1.smithi141.stdout:0/500: dwrite d4/d49/d73/d8a/f91 [0,4194304] 0 2023-12-16T20:11:37.040 INFO:tasks.workunit.client.1.smithi141.stdout:0/501: dread - d4/d49/d8f/f94 zero size 2023-12-16T20:11:37.055 INFO:tasks.workunit.client.0.smithi038.stdout:3/789: symlink d4/dcd/dcc/l113 0 2023-12-16T20:11:37.056 INFO:tasks.workunit.client.1.smithi141.stdout:0/502: dwrite d4/f35 [0,4194304] 0 2023-12-16T20:11:37.056 INFO:tasks.workunit.client.1.smithi141.stdout:0/503: fdatasync d4/d49/d73/d3b/d78/f4f 0 2023-12-16T20:11:37.056 INFO:tasks.workunit.client.1.smithi141.stdout:0/504: read - d4/d49/d73/fad zero size 2023-12-16T20:11:37.057 INFO:tasks.workunit.client.0.smithi038.stdout:0/809: link db/d16/d5a/d65/de8/d77/d95/da4/ld6 db/d16/da6/l103 0 2023-12-16T20:11:37.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/895: unlink d2/df/d1a/d1f/d4a/d53/fa5 0 2023-12-16T20:11:37.063 INFO:tasks.workunit.client.1.smithi141.stdout:4/448: creat d1a/fab x:0 0 0 2023-12-16T20:11:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/823: truncate d9/d1e/d3d/d42/f48 2797519 0 2023-12-16T20:11:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/824: write d9/d1e/d3d/d42/d59/fa2 [4314912,96919] 0 2023-12-16T20:11:37.072 INFO:tasks.workunit.client.1.smithi141.stdout:4/449: dread d1a/d2a/f4b [0,4194304] 0 2023-12-16T20:11:37.072 INFO:tasks.workunit.client.1.smithi141.stdout:4/450: fdatasync d1a/d2a/f4b 0 2023-12-16T20:11:37.073 INFO:tasks.workunit.client.1.smithi141.stdout:4/451: dread d1a/f1c [0,4194304] 0 2023-12-16T20:11:37.074 INFO:tasks.workunit.client.0.smithi038.stdout:4/756: creat d13/d17/d4b/da4/d9d/ddb/ff5 x:0 0 0 2023-12-16T20:11:37.074 INFO:tasks.workunit.client.1.smithi141.stdout:7/511: mknod d5/d1d/d1e/ca1 0 2023-12-16T20:11:37.078 INFO:tasks.workunit.client.1.smithi141.stdout:9/488: creat d1/d26/fad x:0 0 0 2023-12-16T20:11:37.080 INFO:tasks.workunit.client.1.smithi141.stdout:3/592: rmdir d0/d1c/d40/d3f/d52/d5a 39 2023-12-16T20:11:37.080 INFO:tasks.workunit.client.0.smithi038.stdout:7/852: rename da/dcf/d100/d4d/dc5/c42 to da/d21/d2c/d76/dce/c11b 0 2023-12-16T20:11:37.081 INFO:tasks.workunit.client.0.smithi038.stdout:9/825: dread d9/d1e/d40/d5e/d71/d83/de8/fca [0,4194304] 0 2023-12-16T20:11:37.082 INFO:tasks.workunit.client.0.smithi038.stdout:6/729: link d1/d5b/d7d/d9d/dc8/de7/db1/dbe/c55 d1/d5b/d7d/d9d/dc8/ce8 0 2023-12-16T20:11:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:3/790: symlink d4/dcd/dcc/l114 0 2023-12-16T20:11:37.085 INFO:tasks.workunit.client.0.smithi038.stdout:7/853: dread da/dcf/d100/f9f [0,4194304] 0 2023-12-16T20:11:37.086 INFO:tasks.workunit.client.0.smithi038.stdout:1/814: sync 2023-12-16T20:11:37.086 INFO:tasks.workunit.client.0.smithi038.stdout:8/684: sync 2023-12-16T20:11:37.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/685: stat d17/d1b/d25/db7/d82/da9/d50/d7d 0 2023-12-16T20:11:37.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/730: dread d1/d4/d1d/d8e/dbf/fdf [0,4194304] 0 2023-12-16T20:11:37.094 INFO:tasks.workunit.client.0.smithi038.stdout:7/854: dread da/dcf/d100/d4d/dc5/ddc/d8e/f74 [0,4194304] 0 2023-12-16T20:11:37.097 INFO:tasks.workunit.client.1.smithi141.stdout:5/408: unlink d0/d43/f44 0 2023-12-16T20:11:37.097 INFO:tasks.workunit.client.1.smithi141.stdout:5/409: stat d0/d9/d16/d2a/c80 0 2023-12-16T20:11:37.104 INFO:tasks.workunit.client.1.smithi141.stdout:8/488: mknod d14/d19/d1b/d24/d4a/d5b/c9a 0 2023-12-16T20:11:37.104 INFO:tasks.workunit.client.1.smithi141.stdout:8/489: chown d14/d19/d1b/d3d/f33 242 1 2023-12-16T20:11:37.105 INFO:tasks.workunit.client.1.smithi141.stdout:6/512: truncate d1/f19 2497746 0 2023-12-16T20:11:37.106 INFO:tasks.workunit.client.1.smithi141.stdout:9/489: dwrite d1/d26/f91 [0,4194304] 0 2023-12-16T20:11:37.109 INFO:tasks.workunit.client.1.smithi141.stdout:0/505: rmdir d4/d49 39 2023-12-16T20:11:37.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/506: write d4/d7/f24 [2835589,3681] 0 2023-12-16T20:11:37.111 INFO:tasks.workunit.client.1.smithi141.stdout:4/452: creat d1a/d3c/d9b/fac x:0 0 0 2023-12-16T20:11:37.111 INFO:tasks.workunit.client.1.smithi141.stdout:4/453: dread - d1a/d2a/f9f zero size 2023-12-16T20:11:37.111 INFO:tasks.workunit.client.1.smithi141.stdout:4/454: creat d1a/d2a/d3b/fad x:0 0 0 2023-12-16T20:11:37.111 INFO:tasks.workunit.client.1.smithi141.stdout:0/507: read d4/d49/d73/d3b/f79 [297536,99579] 0 2023-12-16T20:11:37.112 INFO:tasks.workunit.client.1.smithi141.stdout:7/512: rename d5/d16/d30/l6f to d5/d16/d30/d4e/d6e/la2 0 2023-12-16T20:11:37.113 INFO:tasks.workunit.client.0.smithi038.stdout:1/815: dwrite d15/d22/d7b/ffb [0,4194304] 0 2023-12-16T20:11:37.113 INFO:tasks.workunit.client.0.smithi038.stdout:6/731: dwrite d1/d4/d1d/d8e/dbf/fdf [4194304,4194304] 0 2023-12-16T20:11:37.115 INFO:tasks.workunit.client.1.smithi141.stdout:3/593: unlink d0/d1c/d6a/c7a 0 2023-12-16T20:11:37.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/490: dread d1/d10/d33/d39/f62 [0,4194304] 0 2023-12-16T20:11:37.116 INFO:tasks.workunit.client.1.smithi141.stdout:5/410: mkdir d0/d25/d30/d8a 0 2023-12-16T20:11:37.116 INFO:tasks.workunit.client.1.smithi141.stdout:5/411: dread - d0/d14/f70 zero size 2023-12-16T20:11:37.117 INFO:tasks.workunit.client.0.smithi038.stdout:1/816: dread d15/d1e/d23/f78 [0,4194304] 0 2023-12-16T20:11:37.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/490: unlink d14/d19/d1b/d24/c26 0 2023-12-16T20:11:37.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/491: fsync d14/d19/f4e 0 2023-12-16T20:11:37.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/492: write d14/d19/d1b/d24/d4a/d69/f88 [104319,117258] 0 2023-12-16T20:11:37.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/493: fsync d14/d19/d1b/d3d/f37 0 2023-12-16T20:11:37.122 INFO:tasks.workunit.client.1.smithi141.stdout:4/455: write d1a/f20 [2235857,119075] 0 2023-12-16T20:11:37.126 INFO:tasks.workunit.client.1.smithi141.stdout:0/508: mkdir d4/d5c/daf 0 2023-12-16T20:11:37.126 INFO:tasks.workunit.client.1.smithi141.stdout:0/509: dread - d4/d49/d73/d3b/d78/fa5 zero size 2023-12-16T20:11:37.126 INFO:tasks.workunit.client.1.smithi141.stdout:0/510: chown d4/l27 12 1 2023-12-16T20:11:37.129 INFO:tasks.workunit.client.1.smithi141.stdout:6/513: rename d1/d12/d20/d3a/d45/d47/f8b to d1/d12/d22/d25/fa4 0 2023-12-16T20:11:37.130 INFO:tasks.workunit.client.1.smithi141.stdout:6/514: readlink d1/d12/d20/d89/d95/l83 0 2023-12-16T20:11:37.130 INFO:tasks.workunit.client.1.smithi141.stdout:6/515: dread - d1/d12/d20/d44/f72 zero size 2023-12-16T20:11:37.131 INFO:tasks.workunit.client.1.smithi141.stdout:3/594: creat d0/d1c/d6a/d76/da2/fc3 x:0 0 0 2023-12-16T20:11:37.131 INFO:tasks.workunit.client.1.smithi141.stdout:3/595: stat d0/d1c/l23 0 2023-12-16T20:11:37.131 INFO:tasks.workunit.client.1.smithi141.stdout:3/596: fdatasync d0/d1c/d6a/d76/da2/fac 0 2023-12-16T20:11:37.132 INFO:tasks.workunit.client.1.smithi141.stdout:9/491: symlink d1/d26/d4a/lae 0 2023-12-16T20:11:37.132 INFO:tasks.workunit.client.1.smithi141.stdout:9/492: readlink d1/d10/d27/l5a 0 2023-12-16T20:11:37.133 INFO:tasks.workunit.client.1.smithi141.stdout:5/412: truncate d0/d25/f7b 1774996 0 2023-12-16T20:11:37.136 INFO:tasks.workunit.client.1.smithi141.stdout:0/511: unlink d4/d7/l55 0 2023-12-16T20:11:37.136 INFO:tasks.workunit.client.1.smithi141.stdout:0/512: readlink d4/d49/d73/d3b/d78/d7f/d80/la6 0 2023-12-16T20:11:37.136 INFO:tasks.workunit.client.1.smithi141.stdout:0/513: readlink d4/l34 0 2023-12-16T20:11:37.137 INFO:tasks.workunit.client.1.smithi141.stdout:6/516: mknod d1/d12/d20/d44/ca5 0 2023-12-16T20:11:37.138 INFO:tasks.workunit.client.1.smithi141.stdout:4/456: dwrite d1a/d2a/d3b/f7f [0,4194304] 0 2023-12-16T20:11:37.138 INFO:tasks.workunit.client.1.smithi141.stdout:3/597: mknod d0/d1c/d40/d3f/d52/d5d/d95/cc4 0 2023-12-16T20:11:37.139 INFO:tasks.workunit.client.1.smithi141.stdout:7/513: getdents d5/d16/d30 0 2023-12-16T20:11:37.140 INFO:tasks.workunit.client.1.smithi141.stdout:4/457: dread d1a/f9c [0,4194304] 0 2023-12-16T20:11:37.140 INFO:tasks.workunit.client.1.smithi141.stdout:4/458: fdatasync d1a/d2a/f37 0 2023-12-16T20:11:37.141 INFO:tasks.workunit.client.1.smithi141.stdout:9/493: mknod d1/d10/d14/d20/da/caf 0 2023-12-16T20:11:37.141 INFO:tasks.workunit.client.1.smithi141.stdout:9/494: readlink d1/l5 0 2023-12-16T20:11:37.143 INFO:tasks.workunit.client.1.smithi141.stdout:5/413: symlink d0/d9/d16/d72/d7f/l8b 0 2023-12-16T20:11:37.143 INFO:tasks.workunit.client.1.smithi141.stdout:5/414: read - d0/f82 zero size 2023-12-16T20:11:37.146 INFO:tasks.workunit.client.1.smithi141.stdout:6/517: mknod d1/d12/d20/d89/d95/ca6 0 2023-12-16T20:11:37.151 INFO:tasks.workunit.client.1.smithi141.stdout:1/546: sync 2023-12-16T20:11:37.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/359: sync 2023-12-16T20:11:37.151 INFO:tasks.workunit.client.1.smithi141.stdout:2/360: chown d6/f1d 1 1 2023-12-16T20:11:37.153 INFO:tasks.workunit.client.1.smithi141.stdout:7/514: creat d5/d16/d30/fa3 x:0 0 0 2023-12-16T20:11:37.156 INFO:tasks.workunit.client.1.smithi141.stdout:5/415: symlink d0/d9/d16/d2a/d4f/l8c 0 2023-12-16T20:11:37.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/518: truncate d1/d12/f33 3909488 0 2023-12-16T20:11:37.161 INFO:tasks.workunit.client.1.smithi141.stdout:1/547: creat da/d1a/d1d/d8f/fb7 x:0 0 0 2023-12-16T20:11:37.164 INFO:tasks.workunit.client.1.smithi141.stdout:2/361: creat d6/da/d1b/d5b/f78 x:0 0 0 2023-12-16T20:11:37.164 INFO:tasks.workunit.client.1.smithi141.stdout:0/514: dwrite d4/d49/d73/d3b/d78/d7f/d80/d83/f89 [4194304,4194304] 0 2023-12-16T20:11:37.166 INFO:tasks.workunit.client.1.smithi141.stdout:5/416: creat d0/d9/d16/d2a/d35/d4c/f8d x:0 0 0 2023-12-16T20:11:37.167 INFO:tasks.workunit.client.1.smithi141.stdout:5/417: creat d0/d9/f8e x:0 0 0 2023-12-16T20:11:37.168 INFO:tasks.workunit.client.1.smithi141.stdout:3/598: dwrite d0/d1c/d40/d3f/d52/d5d/f79 [4194304,4194304] 0 2023-12-16T20:11:37.168 INFO:tasks.workunit.client.1.smithi141.stdout:9/495: dwrite d1/d10/d27/d36/f3a [0,4194304] 0 2023-12-16T20:11:37.169 INFO:tasks.workunit.client.1.smithi141.stdout:6/519: creat d1/d12/d22/d25/fa7 x:0 0 0 2023-12-16T20:11:37.170 INFO:tasks.workunit.client.1.smithi141.stdout:4/459: dwrite f14 [4194304,4194304] 0 2023-12-16T20:11:37.173 INFO:tasks.workunit.client.1.smithi141.stdout:6/520: dread d1/d12/d20/d44/f5b [0,4194304] 0 2023-12-16T20:11:37.173 INFO:tasks.workunit.client.0.smithi038.stdout:4/757: mkdir d13/d17/d2e/d32/d70/df6 0 2023-12-16T20:11:37.177 INFO:tasks.workunit.client.0.smithi038.stdout:2/911: rename d1/d5/d95/d61/dd4/d12/l84 to d1/d5/d95/d61/dd4/d6a/d43/d57/dd6/l131 0 2023-12-16T20:11:37.181 INFO:tasks.workunit.client.0.smithi038.stdout:3/791: creat d4/d18/f115 x:0 0 0 2023-12-16T20:11:37.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/896: symlink d2/l115 0 2023-12-16T20:11:37.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/897: chown d2/d14/d25/d2d/d17/d55/d6b 26173230 1 2023-12-16T20:11:37.183 INFO:tasks.workunit.client.0.smithi038.stdout:8/686: mkdir d17/d34/ddb 0 2023-12-16T20:11:37.183 INFO:tasks.workunit.client.0.smithi038.stdout:8/687: chown d17/d1b/d66/d73/l7a 15036028 1 2023-12-16T20:11:37.185 INFO:tasks.workunit.client.0.smithi038.stdout:7/855: symlink da/d21/d86/d92/l11c 0 2023-12-16T20:11:37.186 INFO:tasks.workunit.client.1.smithi141.stdout:5/418: creat d0/d9/d16/d2a/d4f/f8f x:0 0 0 2023-12-16T20:11:37.187 INFO:tasks.workunit.client.1.smithi141.stdout:3/599: dwrite d0/d1c/d2c/f49 [0,4194304] 0 2023-12-16T20:11:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:6/732: creat d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fe9 x:0 0 0 2023-12-16T20:11:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:4/758: mknod d13/d17/d2e/d32/d70/d84/d88/dc3/de9/cf7 0 2023-12-16T20:11:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:2/912: rmdir d1/d5/d2a/d31/d60/ded/dee 39 2023-12-16T20:11:37.190 INFO:tasks.workunit.client.0.smithi038.stdout:9/826: getdents d9 0 2023-12-16T20:11:37.191 INFO:tasks.workunit.client.0.smithi038.stdout:3/792: mkdir d4/d6c/da7/d116 0 2023-12-16T20:11:37.192 INFO:tasks.workunit.client.0.smithi038.stdout:5/898: creat d2/d14/d25/d2d/d17/d55/d6b/f116 x:0 0 0 2023-12-16T20:11:37.192 INFO:tasks.workunit.client.0.smithi038.stdout:5/899: chown d2/d14/d25/d2d/d17/d55 0 1 2023-12-16T20:11:37.194 INFO:tasks.workunit.client.0.smithi038.stdout:4/759: unlink d13/d1f/fc4 0 2023-12-16T20:11:37.196 INFO:tasks.workunit.client.0.smithi038.stdout:2/913: link d1/d5/d95/d61/dd4/d21/d9a/db9/f64 d1/d5/d95/d61/dd4/d10/d109/f132 0 2023-12-16T20:11:37.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/827: mknod d9/d1f/d21/d3e/d4e/d61/d9e/c103 0 2023-12-16T20:11:37.198 INFO:tasks.workunit.client.0.smithi038.stdout:9/828: chown d9/dea/fff 14521481 1 2023-12-16T20:11:37.199 INFO:tasks.workunit.client.1.smithi141.stdout:9/496: dwrite d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:37.201 INFO:tasks.workunit.client.0.smithi038.stdout:3/793: rename d4/d27/d2b/l79 to d4/d27/d2b/da0/l117 0 2023-12-16T20:11:37.201 INFO:tasks.workunit.client.0.smithi038.stdout:3/794: dread - d4/d27/d2b/f10a zero size 2023-12-16T20:11:37.201 INFO:tasks.workunit.client.0.smithi038.stdout:5/900: mkdir d2/d14/d44/d117 0 2023-12-16T20:11:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:3/795: write d4/d27/d23/f2e [207992,78715] 0 2023-12-16T20:11:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:5/901: dread d2/df/d1a/d1f/d4a/d53/d6e/d9e/dc4/f100 [0,4194304] 0 2023-12-16T20:11:37.203 INFO:tasks.workunit.client.0.smithi038.stdout:2/914: creat d1/d5/d2a/d31/d60/ded/dee/f133 x:0 0 0 2023-12-16T20:11:37.206 INFO:tasks.workunit.client.0.smithi038.stdout:7/856: dread da/f5d [0,4194304] 0 2023-12-16T20:11:37.206 INFO:tasks.workunit.client.0.smithi038.stdout:2/915: link d1/d5/d2a/f35 d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f134 0 2023-12-16T20:11:37.209 INFO:tasks.workunit.client.0.smithi038.stdout:4/760: dread d13/d1f/d35/f38 [0,4194304] 0 2023-12-16T20:11:37.209 INFO:tasks.workunit.client.0.smithi038.stdout:4/761: dread - d13/d17/d2e/d32/d70/f8c zero size 2023-12-16T20:11:37.209 INFO:tasks.workunit.client.0.smithi038.stdout:7/857: rename da/d21/f8f to da/d21/d2c/f11d 0 2023-12-16T20:11:37.211 INFO:tasks.workunit.client.0.smithi038.stdout:2/916: mkdir d1/d5/d95/d123/d135 0 2023-12-16T20:11:37.212 INFO:tasks.workunit.client.1.smithi141.stdout:6/521: dwrite d1/d12/d22/d25/f7e [8388608,4194304] 0 2023-12-16T20:11:37.212 INFO:tasks.workunit.client.1.smithi141.stdout:6/522: write d1/d12/d22/f53 [3251088,85388] 0 2023-12-16T20:11:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/917: mkdir d1/d5/d95/d61/d136 0 2023-12-16T20:11:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/918: write d1/d5/d2a/fd3 [134167,123149] 0 2023-12-16T20:11:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/919: chown d1/d5/d95/d61/dd4/d6a/l90 203 1 2023-12-16T20:11:37.216 INFO:tasks.workunit.client.0.smithi038.stdout:3/796: read d4/f4a [2523705,60105] 0 2023-12-16T20:11:37.216 INFO:tasks.workunit.client.0.smithi038.stdout:2/920: mknod d1/d88/c137 0 2023-12-16T20:11:37.218 INFO:tasks.workunit.client.0.smithi038.stdout:7/858: dread da/f5d [0,4194304] 0 2023-12-16T20:11:37.218 INFO:tasks.workunit.client.0.smithi038.stdout:6/733: dwrite d1/d5b/f99 [0,4194304] 0 2023-12-16T20:11:37.219 INFO:tasks.workunit.client.0.smithi038.stdout:3/797: truncate d4/d8/d15/d6d/ffb 541841 0 2023-12-16T20:11:37.220 INFO:tasks.workunit.client.0.smithi038.stdout:7/859: rename da/dcf/d100/d4d/dc5/d38/d65/d81/lfd to da/d21/d2c/dd0/l11e 0 2023-12-16T20:11:37.221 INFO:tasks.workunit.client.0.smithi038.stdout:7/860: read - da/dcf/d100/d4d/fd2 zero size 2023-12-16T20:11:37.224 INFO:tasks.workunit.client.0.smithi038.stdout:6/734: getdents d1/d5b/d7d/d9d/dc8/de7/db1 0 2023-12-16T20:11:37.224 INFO:tasks.workunit.client.0.smithi038.stdout:3/798: mknod d4/d27/c118 0 2023-12-16T20:11:37.226 INFO:tasks.workunit.client.0.smithi038.stdout:3/799: write d4/d6c/d80/fb3 [763882,111160] 0 2023-12-16T20:11:37.226 INFO:tasks.workunit.client.0.smithi038.stdout:3/800: read - d4/d27/d23/db6/ff7 zero size 2023-12-16T20:11:37.235 INFO:tasks.workunit.client.0.smithi038.stdout:8/688: dwrite d17/d34/f36 [0,4194304] 0 2023-12-16T20:11:37.237 INFO:tasks.workunit.client.0.smithi038.stdout:9/829: dwrite d9/d1f/d21/d3e/d4e/d61/d9b/fdb [0,4194304] 0 2023-12-16T20:11:37.237 INFO:tasks.workunit.client.0.smithi038.stdout:8/689: mknod d17/d1b/d66/d73/cdc 0 2023-12-16T20:11:37.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/830: symlink d9/d1f/d6c/l104 0 2023-12-16T20:11:37.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/831: creat d9/d1f/d21/d3e/d4e/f105 x:0 0 0 2023-12-16T20:11:37.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/832: chown d9/d1f/d21/d3e/d4e/d61/daa/fcf 2923282 1 2023-12-16T20:11:37.242 INFO:tasks.workunit.client.0.smithi038.stdout:9/833: mknod d9/d1f/d6a/dc0/c106 0 2023-12-16T20:11:37.242 INFO:tasks.workunit.client.0.smithi038.stdout:9/834: readlink d9/d1e/d45/l7f 0 2023-12-16T20:11:37.242 INFO:tasks.workunit.client.0.smithi038.stdout:9/835: fdatasync d9/d1f/f5b 0 2023-12-16T20:11:37.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/801: read d4/d8/d15/d1e/f3f [835132,58354] 0 2023-12-16T20:11:37.245 INFO:tasks.workunit.client.0.smithi038.stdout:9/836: rename d9/d1f/d21/d3e/d4e/d61/d9b/fdb to d9/d1f/d21/d84/daf/f107 0 2023-12-16T20:11:37.245 INFO:tasks.workunit.client.0.smithi038.stdout:9/837: creat d9/d1e/d45/f108 x:0 0 0 2023-12-16T20:11:37.245 INFO:tasks.workunit.client.0.smithi038.stdout:9/838: truncate d9/d1e/d3d/d42/d59/d76/f102 270781 0 2023-12-16T20:11:37.246 INFO:tasks.workunit.client.0.smithi038.stdout:3/802: creat d4/d8/dc8/f119 x:0 0 0 2023-12-16T20:11:37.248 INFO:tasks.workunit.client.0.smithi038.stdout:9/839: rename d9/d1e/d40/d5e/d71/d83/de8/fbc to d9/d1e/d3d/d42/d59/dc4/f109 0 2023-12-16T20:11:37.249 INFO:tasks.workunit.client.0.smithi038.stdout:9/840: rmdir d9/d1f/d6a 39 2023-12-16T20:11:37.251 INFO:tasks.workunit.client.0.smithi038.stdout:9/841: rename d9/d1f/d21/d3e/d4e/d64/ca8 to d9/d1f/d96/c10a 0 2023-12-16T20:11:37.251 INFO:tasks.workunit.client.0.smithi038.stdout:9/842: dread - d9/dea/fff zero size 2023-12-16T20:11:37.251 INFO:tasks.workunit.client.0.smithi038.stdout:5/902: dwrite d2/d14/d25/d2d/d17/da9/fb3 [0,4194304] 0 2023-12-16T20:11:37.251 INFO:tasks.workunit.client.0.smithi038.stdout:5/903: fsync d2/d14/d25/d2d/d4b/fac 0 2023-12-16T20:11:37.251 INFO:tasks.workunit.client.0.smithi038.stdout:5/904: chown d2/df/d1a/d1f/f32 22 1 2023-12-16T20:11:37.252 INFO:tasks.workunit.client.0.smithi038.stdout:5/905: write d2/d4/fff [671901,31726] 0 2023-12-16T20:11:37.252 INFO:tasks.workunit.client.0.smithi038.stdout:4/762: dwrite d13/f19 [0,4194304] 0 2023-12-16T20:11:37.254 INFO:tasks.workunit.client.0.smithi038.stdout:9/843: symlink d9/d1f/d21/d3e/d4e/d61/daa/l10b 0 2023-12-16T20:11:37.258 INFO:tasks.workunit.client.0.smithi038.stdout:9/844: mkdir d9/d1f/d21/d52/d10c 0 2023-12-16T20:11:37.258 INFO:tasks.workunit.client.0.smithi038.stdout:5/906: getdents d2/df/d1a/d1f 0 2023-12-16T20:11:37.258 INFO:tasks.workunit.client.0.smithi038.stdout:5/907: write d2/d14/d25/d2d/d17/d55/d6b/f116 [998878,39833] 0 2023-12-16T20:11:37.260 INFO:tasks.workunit.client.0.smithi038.stdout:7/861: dwrite da/d21/d61/f66 [0,4194304] 0 2023-12-16T20:11:37.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/908: symlink d2/df/d1a/d1f/d4a/d53/d97/l118 0 2023-12-16T20:11:37.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/909: chown d2/d14/l2b 110 1 2023-12-16T20:11:37.263 INFO:tasks.workunit.client.0.smithi038.stdout:4/763: write d13/d17/f45 [2480380,12757] 0 2023-12-16T20:11:37.263 INFO:tasks.workunit.client.0.smithi038.stdout:4/764: fdatasync fb 0 2023-12-16T20:11:37.264 INFO:tasks.workunit.client.0.smithi038.stdout:2/921: dwrite d1/d5/d95/d61/dd4/d21/f45 [0,4194304] 0 2023-12-16T20:11:37.264 INFO:tasks.workunit.client.0.smithi038.stdout:2/922: write d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f8d [316985,100355] 0 2023-12-16T20:11:37.270 INFO:tasks.workunit.client.0.smithi038.stdout:4/765: rename d13/d17/d4b/da4/d9d/l8b to d13/d69/def/lf8 0 2023-12-16T20:11:37.272 INFO:tasks.workunit.client.0.smithi038.stdout:8/690: dwrite d17/d1b/d66/d73/d9e/f7c [0,4194304] 0 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:6/735: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/fb9 [0,4194304] 0 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:8/691: chown d17/d1b/d66/d73/d55/da5 129522681 1 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:8/692: readlink d17/d1b/d53/lc9 0 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:8/693: dread - d17/d1b/d66/d73/d55/da5/fc2 zero size 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:5/910: read d2/d14/d25/d2d/f2c [1198452,52206] 0 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:5/911: fdatasync d2/d14/d25/d2d/f2c 0 2023-12-16T20:11:37.273 INFO:tasks.workunit.client.0.smithi038.stdout:5/912: dread - d2/d14/d25/d2d/d17/d55/fbb zero size 2023-12-16T20:11:37.277 INFO:tasks.workunit.client.0.smithi038.stdout:2/923: symlink d1/d5/l138 0 2023-12-16T20:11:37.279 INFO:tasks.workunit.client.0.smithi038.stdout:6/736: mkdir d1/d4/d1d/d8e/dea 0 2023-12-16T20:11:37.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/924: dread d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f134 [0,4194304] 0 2023-12-16T20:11:37.284 INFO:tasks.workunit.client.0.smithi038.stdout:2/925: mknod d1/d5/d95/d61/d66/ddd/c139 0 2023-12-16T20:11:37.286 INFO:tasks.workunit.client.0.smithi038.stdout:2/926: symlink d1/d5/d3d/d115/l13a 0 2023-12-16T20:11:37.286 INFO:tasks.workunit.client.0.smithi038.stdout:4/766: write d13/d17/d2e/f3d [2125489,26008] 0 2023-12-16T20:11:37.286 INFO:tasks.workunit.client.0.smithi038.stdout:2/927: truncate d1/d5/d95/d61/dd4/d6a/d43/d57/f5a 4360026 0 2023-12-16T20:11:37.287 INFO:tasks.workunit.client.0.smithi038.stdout:4/767: symlink d13/d17/d4b/da4/d9d/db5/lf9 0 2023-12-16T20:11:37.288 INFO:tasks.workunit.client.0.smithi038.stdout:4/768: getdents d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78 0 2023-12-16T20:11:37.288 INFO:tasks.workunit.client.0.smithi038.stdout:2/928: dread d1/d5/d95/d61/dd4/d10/f77 [0,4194304] 0 2023-12-16T20:11:37.289 INFO:tasks.workunit.client.0.smithi038.stdout:2/929: mknod d1/d5/d95/d61/dd4/d6a/d43/d57/c13b 0 2023-12-16T20:11:37.290 INFO:tasks.workunit.client.0.smithi038.stdout:8/694: dread f10 [0,4194304] 0 2023-12-16T20:11:37.291 INFO:tasks.workunit.client.0.smithi038.stdout:2/930: mknod d1/d5/d95/d61/d66/ddd/de8/dea/c13c 0 2023-12-16T20:11:37.291 INFO:tasks.workunit.client.0.smithi038.stdout:2/931: fsync d1/d5/d95/d61/dd4/d21/d9a/db9/f119 0 2023-12-16T20:11:37.291 INFO:tasks.workunit.client.0.smithi038.stdout:2/932: readlink d1/d5/l138 0 2023-12-16T20:11:37.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/933: truncate d1/d5/d2a/f35 667695 0 2023-12-16T20:11:37.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/934: chown d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f56 338541 1 2023-12-16T20:11:37.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/935: write d1/d5/d2a/f12c [3016671,128786] 0 2023-12-16T20:11:37.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/936: chown d1/d5/d95/d61/d66/ddd 28527 1 2023-12-16T20:11:37.293 INFO:tasks.workunit.client.0.smithi038.stdout:3/803: dwrite d4/d27/d23/d26/f3e [0,4194304] 0 2023-12-16T20:11:37.295 INFO:tasks.workunit.client.0.smithi038.stdout:9/845: dwrite d9/d1e/f74 [0,4194304] 0 2023-12-16T20:11:37.297 INFO:tasks.workunit.client.0.smithi038.stdout:7/862: dwrite da/d21/d2c/f11d [4194304,4194304] 0 2023-12-16T20:11:37.298 INFO:tasks.workunit.client.0.smithi038.stdout:3/804: stat d4/d8/d15/d1e/l92 0 2023-12-16T20:11:37.300 INFO:tasks.workunit.client.0.smithi038.stdout:9/846: dread d9/d1e/f37 [0,4194304] 0 2023-12-16T20:11:37.310 INFO:tasks.workunit.client.0.smithi038.stdout:7/863: mkdir da/dcf/d11f 0 2023-12-16T20:11:37.310 INFO:tasks.workunit.client.0.smithi038.stdout:3/805: dread d4/d67/de1/fbb [0,4194304] 0 2023-12-16T20:11:37.311 INFO:tasks.workunit.client.0.smithi038.stdout:7/864: mknod da/d21/d86/de2/c120 0 2023-12-16T20:11:37.311 INFO:tasks.workunit.client.0.smithi038.stdout:7/865: chown da/d21/d2c/dd0 76588596 1 2023-12-16T20:11:37.312 INFO:tasks.workunit.client.0.smithi038.stdout:7/866: creat da/d21/d2c/dd0/f121 x:0 0 0 2023-12-16T20:11:37.313 INFO:tasks.workunit.client.0.smithi038.stdout:3/806: unlink d4/dcd/l61 0 2023-12-16T20:11:37.315 INFO:tasks.workunit.client.0.smithi038.stdout:7/867: rename da/dcf/d100/d4d/dc5/cc7 to da/dcf/d100/d4d/dc5/ddc/d8e/d119/c122 0 2023-12-16T20:11:37.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/807: dread - d4/d27/d40/fb5 zero size 2023-12-16T20:11:37.316 INFO:tasks.workunit.client.0.smithi038.stdout:3/808: write d4/d8/d15/d1e/f108 [8264,42584] 0 2023-12-16T20:11:37.317 INFO:tasks.workunit.client.0.smithi038.stdout:7/868: link da/d21/d86/l9b da/d21/d2c/d76/dc9/l123 0 2023-12-16T20:11:37.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/809: link d4/d67/de1/d4c/d70/d71/db9/dd8/ce0 d4/d67/de1/d4c/c11a 0 2023-12-16T20:11:37.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/810: chown d4/dcd/d107 37078 1 2023-12-16T20:11:37.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/811: creat d4/dcd/dcc/f11b x:0 0 0 2023-12-16T20:11:37.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/812: getdents d4/d67/de1/d4c/d70/d71/db9/dd8/ddc 0 2023-12-16T20:11:37.320 INFO:tasks.workunit.client.0.smithi038.stdout:7/869: creat da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/f124 x:0 0 0 2023-12-16T20:11:37.322 INFO:tasks.workunit.client.0.smithi038.stdout:3/813: truncate d4/d67/de1/fd4 3276583 0 2023-12-16T20:11:37.324 INFO:tasks.workunit.client.0.smithi038.stdout:7/870: creat da/dcf/d100/d4d/dc5/ddc/dba/dd9/f125 x:0 0 0 2023-12-16T20:11:37.324 INFO:tasks.workunit.client.0.smithi038.stdout:7/871: write da/d21/d86/de2/fe4 [578585,74619] 0 2023-12-16T20:11:37.325 INFO:tasks.workunit.client.0.smithi038.stdout:7/872: creat da/d21/d61/dcd/f126 x:0 0 0 2023-12-16T20:11:37.326 INFO:tasks.workunit.client.0.smithi038.stdout:7/873: symlink da/dcf/d100/d4d/dc5/d38/d65/l127 0 2023-12-16T20:11:37.326 INFO:tasks.workunit.client.0.smithi038.stdout:7/874: fdatasync da/d21/f50 0 2023-12-16T20:11:37.327 INFO:tasks.workunit.client.0.smithi038.stdout:7/875: dread da/dcf/d100/faf [0,4194304] 0 2023-12-16T20:11:37.328 INFO:tasks.workunit.client.0.smithi038.stdout:7/876: chown da/dcf/d100/d4d/dc5/ddc/d8e/ca1 858329 1 2023-12-16T20:11:37.328 INFO:tasks.workunit.client.0.smithi038.stdout:9/847: dwrite d9/f81 [0,4194304] 0 2023-12-16T20:11:37.329 INFO:tasks.workunit.client.0.smithi038.stdout:8/695: dwrite d17/d1b/f3f [0,4194304] 0 2023-12-16T20:11:37.330 INFO:tasks.workunit.client.0.smithi038.stdout:4/769: dwrite d13/d1f/d98/fd0 [0,4194304] 0 2023-12-16T20:11:37.330 INFO:tasks.workunit.client.0.smithi038.stdout:7/877: creat da/d21/d86/dee/f128 x:0 0 0 2023-12-16T20:11:37.330 INFO:tasks.workunit.client.0.smithi038.stdout:2/937: dwrite d1/d5/d2a/d31/f11c [0,4194304] 0 2023-12-16T20:11:37.331 INFO:tasks.workunit.client.0.smithi038.stdout:2/938: chown d1/d5/d95/d61/dd4/d6d/l122 152 1 2023-12-16T20:11:37.331 INFO:tasks.workunit.client.0.smithi038.stdout:2/939: fdatasync d1/d5/d95/d61/dd4/fae 0 2023-12-16T20:11:37.331 INFO:tasks.workunit.client.0.smithi038.stdout:2/940: dread - d1/d5/d95/d61/dd4/d21/f113 zero size 2023-12-16T20:11:37.331 INFO:tasks.workunit.client.0.smithi038.stdout:9/848: creat d9/d1e/d3d/f10d x:0 0 0 2023-12-16T20:11:37.332 INFO:tasks.workunit.client.0.smithi038.stdout:2/941: dread d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/fb6 [0,4194304] 0 2023-12-16T20:11:37.332 INFO:tasks.workunit.client.0.smithi038.stdout:8/696: stat d17/d1b/d25/c60 0 2023-12-16T20:11:37.336 INFO:tasks.workunit.client.0.smithi038.stdout:4/770: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/ffa x:0 0 0 2023-12-16T20:11:37.336 INFO:tasks.workunit.client.0.smithi038.stdout:3/814: read d4/d67/de1/d4c/f78 [727428,55779] 0 2023-12-16T20:11:37.337 INFO:tasks.workunit.client.0.smithi038.stdout:7/878: rename da/d21/d2c/d76/dc9/f10c to da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/f129 0 2023-12-16T20:11:37.339 INFO:tasks.workunit.client.0.smithi038.stdout:9/849: link d9/d1f/d6c/ffb d9/d1e/d40/d5e/db5/f10e 0 2023-12-16T20:11:37.339 INFO:tasks.workunit.client.0.smithi038.stdout:9/850: fsync d9/d1f/f35 0 2023-12-16T20:11:37.341 INFO:tasks.workunit.client.0.smithi038.stdout:8/697: mkdir d17/d1b/d25/db7/d82/da9/d50/ddd 0 2023-12-16T20:11:37.341 INFO:tasks.workunit.client.0.smithi038.stdout:8/698: read d17/d1b/d66/f72 [266575,121558] 0 2023-12-16T20:11:37.341 INFO:tasks.workunit.client.0.smithi038.stdout:8/699: fsync d17/d1b/d25/db7/d82/da9/d50/f6e 0 2023-12-16T20:11:37.341 INFO:tasks.workunit.client.0.smithi038.stdout:8/700: fdatasync f16 0 2023-12-16T20:11:37.342 INFO:tasks.workunit.client.0.smithi038.stdout:4/771: mkdir d13/d17/d2e/d32/d70/db2/dfb 0 2023-12-16T20:11:37.345 INFO:tasks.workunit.client.0.smithi038.stdout:3/815: symlink d4/dcd/d9a/dda/l11c 0 2023-12-16T20:11:37.345 INFO:tasks.workunit.client.0.smithi038.stdout:3/816: write d4/d8/dc8/f119 [908576,7749] 0 2023-12-16T20:11:37.347 INFO:tasks.workunit.client.0.smithi038.stdout:8/701: dread d17/d1b/d25/db7/d82/da9/d59/f6a [0,4194304] 0 2023-12-16T20:11:37.348 INFO:tasks.workunit.client.0.smithi038.stdout:4/772: mkdir d13/d17/d2e/d32/d70/df6/dfc 0 2023-12-16T20:11:37.356 INFO:tasks.workunit.client.0.smithi038.stdout:3/817: dread d4/d67/de1/d7d/f91 [0,4194304] 0 2023-12-16T20:11:37.357 INFO:tasks.workunit.client.0.smithi038.stdout:9/851: getdents d9/d1e/d3d 0 2023-12-16T20:11:37.358 INFO:tasks.workunit.client.0.smithi038.stdout:7/879: dwrite da/d21/f10b [0,4194304] 0 2023-12-16T20:11:37.358 INFO:tasks.workunit.client.0.smithi038.stdout:3/818: mknod d4/d8/d15/d6d/d7a/d98/c11d 0 2023-12-16T20:11:37.358 INFO:tasks.workunit.client.0.smithi038.stdout:3/819: fsync d4/d18/f34 0 2023-12-16T20:11:37.359 INFO:tasks.workunit.client.0.smithi038.stdout:3/820: fsync d4/d27/d23/d26/f3e 0 2023-12-16T20:11:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:4/773: write d13/f19 [3919308,7165] 0 2023-12-16T20:11:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:9/852: symlink d9/d1f/d21/d52/d10c/l10f 0 2023-12-16T20:11:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:9/853: dread - d9/ffd zero size 2023-12-16T20:11:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:9/854: creat d9/d1f/d96/f110 x:0 0 0 2023-12-16T20:11:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:9/855: truncate d9/d1e/d40/d5e/ff9 700548 0 2023-12-16T20:11:37.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/821: creat d4/d27/d2b/d64/f11e x:0 0 0 2023-12-16T20:11:37.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/822: chown d4/d67/de1/d4c/d70/d71/db9/dd8 343844 1 2023-12-16T20:11:37.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/823: getdents d4/dcd/d9a/dda/df1 0 2023-12-16T20:11:37.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/824: chown d4/d8/d15/d6d/l88 5120206 1 2023-12-16T20:11:37.366 INFO:tasks.workunit.client.0.smithi038.stdout:8/702: dwrite d17/d1b/d25/f32 [0,4194304] 0 2023-12-16T20:11:37.367 INFO:tasks.workunit.client.0.smithi038.stdout:7/880: write da/d21/f87 [3357693,7332] 0 2023-12-16T20:11:37.367 INFO:tasks.workunit.client.0.smithi038.stdout:4/774: symlink d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/dee/lfd 0 2023-12-16T20:11:37.369 INFO:tasks.workunit.client.0.smithi038.stdout:9/856: mkdir d9/d1f/d21/d3e/d72/d111 0 2023-12-16T20:11:37.377 INFO:tasks.workunit.client.0.smithi038.stdout:8/703: write d17/d1b/d25/db7/d82/d9b/fb3 [3235065,73416] 0 2023-12-16T20:11:37.381 INFO:tasks.workunit.client.1.smithi141.stdout:1/548: unlink da/d36/d4b/c5f 0 2023-12-16T20:11:37.382 INFO:tasks.workunit.client.1.smithi141.stdout:1/549: chown da/d1a/d31/c6a 98680 1 2023-12-16T20:11:37.383 INFO:tasks.workunit.client.0.smithi038.stdout:3/825: unlink d4/d67/de1/d4c/f78 0 2023-12-16T20:11:37.383 INFO:tasks.workunit.client.1.smithi141.stdout:4/460: mkdir d1a/d2a/d3b/d69/dae 0 2023-12-16T20:11:37.386 INFO:tasks.workunit.client.1.smithi141.stdout:2/362: rename d6/d12/d15/f38 to d6/da/d33/d54/d73/f79 0 2023-12-16T20:11:37.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/881: rename da/dcf/d100/d4d/lfa to da/d21/dc0/l12a 0 2023-12-16T20:11:37.388 INFO:tasks.workunit.client.0.smithi038.stdout:7/882: dread da/dcf/d100/f9f [0,4194304] 0 2023-12-16T20:11:37.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/775: creat d13/d17/d2e/d32/d70/d84/de3/ffe x:0 0 0 2023-12-16T20:11:37.392 INFO:tasks.workunit.client.1.smithi141.stdout:0/515: mkdir d4/d7/db0 0 2023-12-16T20:11:37.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/515: link d5/d16/d30/c65 d5/d16/d30/d4e/d6e/ca4 0 2023-12-16T20:11:37.396 INFO:tasks.workunit.client.0.smithi038.stdout:8/704: creat d17/d1b/d25/db7/d82/da9/d50/db1/fde x:0 0 0 2023-12-16T20:11:37.396 INFO:tasks.workunit.client.0.smithi038.stdout:8/705: dread - d17/d1b/d25/db7/d82/fa4 zero size 2023-12-16T20:11:37.399 INFO:tasks.workunit.client.1.smithi141.stdout:5/419: unlink d0/d9/d16/d2a/d4f/l8c 0 2023-12-16T20:11:37.399 INFO:tasks.workunit.client.1.smithi141.stdout:3/600: truncate d0/f41 592750 0 2023-12-16T20:11:37.399 INFO:tasks.workunit.client.1.smithi141.stdout:5/420: fsync d0/d9/d16/d2a/d35/d4c/f8d 0 2023-12-16T20:11:37.400 INFO:tasks.workunit.client.0.smithi038.stdout:3/826: rename d4/d8/d15/d6d/d7a/cf4 to d4/dcd/d9a/dda/df1/c11f 0 2023-12-16T20:11:37.401 INFO:tasks.workunit.client.1.smithi141.stdout:1/550: creat da/fb8 x:0 0 0 2023-12-16T20:11:37.401 INFO:tasks.workunit.client.1.smithi141.stdout:1/551: dread - da/d1a/d1d/d33/f9a zero size 2023-12-16T20:11:37.402 INFO:tasks.workunit.client.0.smithi038.stdout:9/857: getdents d9/d1f/d6c 0 2023-12-16T20:11:37.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/776: write d13/d17/f36 [3507226,113819] 0 2023-12-16T20:11:37.403 INFO:tasks.workunit.client.1.smithi141.stdout:0/516: symlink d4/lb1 0 2023-12-16T20:11:37.404 INFO:tasks.workunit.client.1.smithi141.stdout:9/497: symlink d1/lb0 0 2023-12-16T20:11:37.405 INFO:tasks.workunit.client.0.smithi038.stdout:3/827: mknod d4/d67/de1/d4c/d70/d71/c120 0 2023-12-16T20:11:37.406 INFO:tasks.workunit.client.1.smithi141.stdout:6/523: rmdir d1/dd/de 39 2023-12-16T20:11:37.406 INFO:tasks.workunit.client.1.smithi141.stdout:6/524: creat d1/d3/fa8 x:0 0 0 2023-12-16T20:11:37.406 INFO:tasks.workunit.client.1.smithi141.stdout:3/601: creat d0/fc5 x:0 0 0 2023-12-16T20:11:37.409 INFO:tasks.workunit.client.1.smithi141.stdout:0/517: unlink d4/d49/d73/d3b/d78/d7f/d80/d83/f95 0 2023-12-16T20:11:37.409 INFO:tasks.workunit.client.1.smithi141.stdout:1/552: truncate f6 835835 0 2023-12-16T20:11:37.409 INFO:tasks.workunit.client.0.smithi038.stdout:9/858: mknod d9/d1f/d21/d3e/d72/d111/c112 0 2023-12-16T20:11:37.410 INFO:tasks.workunit.client.1.smithi141.stdout:7/516: read d5/d16/f75 [734203,49447] 0 2023-12-16T20:11:37.410 INFO:tasks.workunit.client.1.smithi141.stdout:9/498: truncate d1/d10/d14/d20/da/d3f/f68 3485875 0 2023-12-16T20:11:37.411 INFO:tasks.workunit.client.1.smithi141.stdout:6/525: mkdir d1/d5e/da9 0 2023-12-16T20:11:37.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/828: rename d4/d8/d15/d1e/f1f to d4/dcd/dcc/f121 0 2023-12-16T20:11:37.413 INFO:tasks.workunit.client.1.smithi141.stdout:0/518: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/lb2 0 2023-12-16T20:11:37.414 INFO:tasks.workunit.client.0.smithi038.stdout:9/859: creat d9/d1f/d21/d3e/d4e/d61/daa/f113 x:0 0 0 2023-12-16T20:11:37.416 INFO:tasks.workunit.client.0.smithi038.stdout:8/706: read d17/d1b/d25/f32 [463815,93443] 0 2023-12-16T20:11:37.416 INFO:tasks.workunit.client.0.smithi038.stdout:8/707: stat d17/d1b/d66/d73/d54/d69/f26 0 2023-12-16T20:11:37.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/517: unlink d5/f14 0 2023-12-16T20:11:37.419 INFO:tasks.workunit.client.1.smithi141.stdout:9/499: rename d1/d10/d14/f71 to d1/d10/d33/d6a/fb1 0 2023-12-16T20:11:37.421 INFO:tasks.workunit.client.1.smithi141.stdout:6/526: unlink d1/d3/f76 0 2023-12-16T20:11:37.423 INFO:tasks.workunit.client.1.smithi141.stdout:0/519: creat d4/d7/fb3 x:0 0 0 2023-12-16T20:11:37.426 INFO:tasks.workunit.client.0.smithi038.stdout:4/777: dread d13/d1f/d35/f92 [0,4194304] 0 2023-12-16T20:11:37.427 INFO:tasks.workunit.client.0.smithi038.stdout:4/778: write d13/d17/d4b/da4/d34/f76 [331297,125159] 0 2023-12-16T20:11:37.432 INFO:tasks.workunit.client.1.smithi141.stdout:4/461: dwrite d1a/d54/d87/da8/f94 [0,4194304] 0 2023-12-16T20:11:37.433 INFO:tasks.workunit.client.0.smithi038.stdout:4/779: dread d13/d17/f45 [0,4194304] 0 2023-12-16T20:11:37.433 INFO:tasks.workunit.client.0.smithi038.stdout:4/780: read d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d4f/f53 [3196197,42511] 0 2023-12-16T20:11:37.434 INFO:tasks.workunit.client.1.smithi141.stdout:2/363: dwrite d6/d12/d1f/d46/f63 [8388608,4194304] 0 2023-12-16T20:11:37.434 INFO:tasks.workunit.client.1.smithi141.stdout:0/520: write d4/d49/f5a [839107,17229] 0 2023-12-16T20:11:37.434 INFO:tasks.workunit.client.1.smithi141.stdout:0/521: write d4/d7/f24 [1506417,50976] 0 2023-12-16T20:11:37.436 INFO:tasks.workunit.client.0.smithi038.stdout:3/829: read d4/d18/f4b [2352356,116488] 0 2023-12-16T20:11:37.437 INFO:tasks.workunit.client.0.smithi038.stdout:4/781: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/fff x:0 0 0 2023-12-16T20:11:37.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/830: link d4/d27/d23/d26/lea d4/l122 0 2023-12-16T20:11:37.440 INFO:tasks.workunit.client.0.smithi038.stdout:3/831: chown d4/d8/d15/ld1 52189 1 2023-12-16T20:11:37.440 INFO:tasks.workunit.client.0.smithi038.stdout:3/832: chown d4/d27/d40/l90 230915 1 2023-12-16T20:11:37.440 INFO:tasks.workunit.client.0.smithi038.stdout:3/833: dread - d4/d67/de1/d4c/dae/ff0 zero size 2023-12-16T20:11:37.441 INFO:tasks.workunit.client.1.smithi141.stdout:5/421: dwrite d0/d9/d16/d2a/d35/f3f [0,4194304] 0 2023-12-16T20:11:37.442 INFO:tasks.workunit.client.1.smithi141.stdout:5/422: write d0/d25/d30/d67/f65 [1088590,70449] 0 2023-12-16T20:11:37.444 INFO:tasks.workunit.client.1.smithi141.stdout:2/364: write d6/d3a/f2c [2524648,48961] 0 2023-12-16T20:11:37.444 INFO:tasks.workunit.client.0.smithi038.stdout:3/834: rename d4/d8/d15/f54 to d4/d67/de1/d4c/d70/d71/db9/f123 0 2023-12-16T20:11:37.444 INFO:tasks.workunit.client.0.smithi038.stdout:3/835: mkdir d4/d67/de1/d4c/dae/d124 0 2023-12-16T20:11:37.445 INFO:tasks.workunit.client.0.smithi038.stdout:3/836: rename d4/d27/d2b/da0/cc1 to d4/d8/dc7/c125 0 2023-12-16T20:11:37.446 INFO:tasks.workunit.client.0.smithi038.stdout:3/837: write d4/d6c/d80/da8/fd9 [969577,103582] 0 2023-12-16T20:11:37.449 INFO:tasks.workunit.client.0.smithi038.stdout:3/838: read d4/d67/de1/fbb [903584,86347] 0 2023-12-16T20:11:37.449 INFO:tasks.workunit.client.0.smithi038.stdout:3/839: readlink d4/dcd/d9a/dda/le3 0 2023-12-16T20:11:37.449 INFO:tasks.workunit.client.0.smithi038.stdout:3/840: read - d4/d27/d2b/ffa zero size 2023-12-16T20:11:37.452 INFO:tasks.workunit.client.0.smithi038.stdout:3/841: rename d4/d27/d2b/d64/f11e to d4/d27/d40/f126 0 2023-12-16T20:11:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:3/842: getdents d4/d67/de1/d4c 0 2023-12-16T20:11:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:3/843: stat d4/d8/f1c 0 2023-12-16T20:11:37.458 INFO:tasks.workunit.client.1.smithi141.stdout:1/553: dwrite da/d1a/d1d/d33/f4e [0,4194304] 0 2023-12-16T20:11:37.459 INFO:tasks.workunit.client.1.smithi141.stdout:1/554: write da/d1a/d1d/d22/f6d [1596310,41547] 0 2023-12-16T20:11:37.459 INFO:tasks.workunit.client.1.smithi141.stdout:3/602: dwrite d0/d1c/d40/d85/d4c/f4f [0,4194304] 0 2023-12-16T20:11:37.459 INFO:tasks.workunit.client.0.smithi038.stdout:8/708: dwrite d17/d5a/f7f [0,4194304] 0 2023-12-16T20:11:37.460 INFO:tasks.workunit.client.1.smithi141.stdout:9/500: dwrite d1/d10/d33/d47/d83/f8f [0,4194304] 0 2023-12-16T20:11:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:8/709: unlink d17/d1b/fcf 0 2023-12-16T20:11:37.464 INFO:tasks.workunit.client.1.smithi141.stdout:7/518: rmdir d5/d16/d30/d4e/d87/da0 0 2023-12-16T20:11:37.464 INFO:tasks.workunit.client.0.smithi038.stdout:9/860: dwrite d9/d1e/d40/d5e/f67 [0,4194304] 0 2023-12-16T20:11:37.467 INFO:tasks.workunit.client.1.smithi141.stdout:6/527: creat d1/d3/d4f/faa x:0 0 0 2023-12-16T20:11:37.468 INFO:tasks.workunit.client.1.smithi141.stdout:1/555: write da/d36/f66 [545046,90453] 0 2023-12-16T20:11:37.468 INFO:tasks.workunit.client.1.smithi141.stdout:1/556: truncate da/d1a/f59 4990128 0 2023-12-16T20:11:37.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/710: mknod d17/d1b/d25/db7/d82/da9/d50/d96/cdf 0 2023-12-16T20:11:37.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/861: write f2 [1982512,23365] 0 2023-12-16T20:11:37.478 INFO:tasks.workunit.client.0.smithi038.stdout:3/844: dwrite d4/dcd/d9a/fb7 [0,4194304] 0 2023-12-16T20:11:37.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/845: mknod d4/d27/d23/db6/c127 0 2023-12-16T20:11:37.482 INFO:tasks.workunit.client.1.smithi141.stdout:4/462: mkdir d1a/d59/d89/daf 0 2023-12-16T20:11:37.482 INFO:tasks.workunit.client.1.smithi141.stdout:4/463: fsync d1a/d54/d87/da8/f7d 0 2023-12-16T20:11:37.482 INFO:tasks.workunit.client.1.smithi141.stdout:4/464: chown d1a/d4e/c7e 357 1 2023-12-16T20:11:37.482 INFO:tasks.workunit.client.0.smithi038.stdout:3/846: mkdir d4/d8/d128 0 2023-12-16T20:11:37.483 INFO:tasks.workunit.client.0.smithi038.stdout:3/847: rename d4/d27/d23/d6e to d4/d6c/d80/d129 0 2023-12-16T20:11:37.484 INFO:tasks.workunit.client.1.smithi141.stdout:0/522: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/lb4 0 2023-12-16T20:11:37.486 INFO:tasks.workunit.client.0.smithi038.stdout:8/711: dread d17/d1b/d66/d73/d9e/f7c [0,4194304] 0 2023-12-16T20:11:37.486 INFO:tasks.workunit.client.0.smithi038.stdout:8/712: fsync d17/d1b/d66/d73/fbf 0 2023-12-16T20:11:37.486 INFO:tasks.workunit.client.0.smithi038.stdout:8/713: truncate d17/d34/fa8 4615608 0 2023-12-16T20:11:37.499 INFO:tasks.workunit.client.0.smithi038.stdout:9/862: dwrite d9/d1f/d21/d3e/d4e/d61/daa/f113 [0,4194304] 0 2023-12-16T20:11:37.510 INFO:tasks.workunit.client.0.smithi038.stdout:9/863: write d9/d1e/d3d/d42/d59/d76/f9a [3465647,38328] 0 2023-12-16T20:11:37.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:37 smithi038 ceph-mon[80659]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 232 MiB/s rd, 297 MiB/s wr, 429 op/s 2023-12-16T20:11:37.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:37 smithi038 ceph-mon[80659]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 -- 172.21.15.38:0/1280665671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c066920 msgr2=0x7fe49c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 --2- 172.21.15.38:0/1280665671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c066920 0x7fe49c0ff7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe48c004940 tx=0x7fe48c009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 -- 172.21.15.38:0/1280665671 shutdown_connections 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 --2- 172.21.15.38:0/1280665671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c0ffd70 0x7fe49c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 --2- 172.21.15.38:0/1280665671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c066920 0x7fe49c0ff7a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 -- 172.21.15.38:0/1280665671 >> 172.21.15.38:0/1280665671 conn(0x7fe49c0f71d0 msgr2=0x7fe49c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 -- 172.21.15.38:0/1280665671 shutdown_connections 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.607+0000 7fe4a1131700 1 -- 172.21.15.38:0/1280665671 wait complete. 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.608+0000 7fe4a1131700 1 Processor -- start 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.608+0000 7fe4a1131700 1 -- start start 2023-12-16T20:11:37.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe4a1131700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe4a1131700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c0ffd70 0x7fe49c10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe49ad9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe4a1131700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c10dff0 con 0x7fe49c0ffd70 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe49ad9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:40028/0 (socket says 172.21.15.38:40028) 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe49ad9d700 1 -- 172.21.15.38:0/390942561 learned_addr learned my addr 172.21.15.38:0/390942561 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe4a1131700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c10e890 con 0x7fe49c066920 2023-12-16T20:11:37.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.609+0000 7fe49a59c700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c0ffd70 0x7fe49c10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:37.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe49ad9d700 1 -- 172.21.15.38:0/390942561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c0ffd70 msgr2=0x7fe49c10d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:37.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe49ad9d700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c0ffd70 0x7fe49c10d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:37.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe49ad9d700 1 -- 172.21.15.38:0/390942561 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c005040 con 0x7fe49c066920 2023-12-16T20:11:37.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe49ad9d700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe48c008f90 tx=0x7fe48c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:37.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c021070 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe48c01c400 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c10eb10 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c00e030 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.610+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c10ef90 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.611+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 24) v1 ==== 45730+0+0 (secure 0 0 0) 0x7fe48c00b760 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.612+0000 7fe4837fe700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 0x7fe48403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.612+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe48c04e3c0 con 0x7fe49c066920 2023-12-16T20:11:37.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.612+0000 7fe49a59c700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 0x7fe48403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:37.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.612+0000 7fe49a59c700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 0x7fe48403ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe490009b80 tx=0x7fe49000b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:37.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.613+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c04bb80 con 0x7fe49c066920 2023-12-16T20:11:37.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:37.622+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe48c00bb00 con 0x7fe49c066920 2023-12-16T20:11:37.651 INFO:tasks.workunit.client.1.smithi141.stdout:5/423: mkdir d0/d14/d2c/d90 0 2023-12-16T20:11:37.652 INFO:tasks.workunit.client.1.smithi141.stdout:2/365: unlink d6/da/d1b/l70 0 2023-12-16T20:11:37.657 INFO:tasks.workunit.client.1.smithi141.stdout:3/603: rename d0/f3a to d0/d1c/d2c/d72/fc6 0 2023-12-16T20:11:37.661 INFO:tasks.workunit.client.1.smithi141.stdout:9/501: creat d1/d10/d14/d20/d84/fb2 x:0 0 0 2023-12-16T20:11:37.661 INFO:tasks.workunit.client.1.smithi141.stdout:5/424: write d0/d9/d16/d2a/d35/f6a [337491,95944] 0 2023-12-16T20:11:37.661 INFO:tasks.workunit.client.1.smithi141.stdout:9/502: read - d1/d10/d14/d20/d84/fb2 zero size 2023-12-16T20:11:37.662 INFO:tasks.workunit.client.1.smithi141.stdout:7/519: stat d5/l67 0 2023-12-16T20:11:37.663 INFO:tasks.workunit.client.1.smithi141.stdout:6/528: stat d1/d12/d22/d25/d38/c61 0 2023-12-16T20:11:37.666 INFO:tasks.workunit.client.1.smithi141.stdout:4/465: link d1a/d2a/f37 d1a/d3c/d9b/da1/fb0 0 2023-12-16T20:11:37.666 INFO:tasks.workunit.client.1.smithi141.stdout:8/494: sync 2023-12-16T20:11:37.671 INFO:tasks.workunit.client.1.smithi141.stdout:0/523: mkdir d4/d49/d73/d3b/d78/d7f/d80/d83/db5 0 2023-12-16T20:11:37.677 INFO:tasks.workunit.client.1.smithi141.stdout:9/503: dread d1/d10/d14/d20/d3b/f77 [0,4194304] 0 2023-12-16T20:11:37.678 INFO:tasks.workunit.client.1.smithi141.stdout:6/529: dread d1/d12/d22/d25/d38/f9a [0,4194304] 0 2023-12-16T20:11:37.681 INFO:tasks.workunit.client.1.smithi141.stdout:8/495: creat d14/d19/d1b/d24/d4a/f9b x:0 0 0 2023-12-16T20:11:37.683 INFO:tasks.workunit.client.1.smithi141.stdout:5/425: dwrite d0/d25/f2e [8388608,4194304] 0 2023-12-16T20:11:37.684 INFO:tasks.workunit.client.1.smithi141.stdout:5/426: dread d0/d43/f7e [0,4194304] 0 2023-12-16T20:11:37.684 INFO:tasks.workunit.client.1.smithi141.stdout:1/557: rename da/df/f34 to da/fb9 0 2023-12-16T20:11:37.691 INFO:tasks.workunit.client.1.smithi141.stdout:3/604: truncate d0/f41 631790 0 2023-12-16T20:11:37.692 INFO:tasks.workunit.client.1.smithi141.stdout:3/605: fsync d0/f37 0 2023-12-16T20:11:37.692 INFO:tasks.workunit.client.1.smithi141.stdout:3/606: write d0/d1c/d40/d3f/f80 [7707184,3229] 0 2023-12-16T20:11:37.693 INFO:tasks.workunit.client.1.smithi141.stdout:0/524: dwrite d4/d49/d4b/f53 [4194304,4194304] 0 2023-12-16T20:11:37.695 INFO:tasks.workunit.client.1.smithi141.stdout:6/530: symlink d1/d12/d20/d44/d4a/lab 0 2023-12-16T20:11:37.696 INFO:tasks.workunit.client.1.smithi141.stdout:6/531: readlink d1/d12/d20/d44/l73 0 2023-12-16T20:11:37.696 INFO:tasks.workunit.client.1.smithi141.stdout:6/532: chown d1/d12/d20/d44/l73 0 1 2023-12-16T20:11:37.697 INFO:tasks.workunit.client.1.smithi141.stdout:8/496: truncate d14/f23 2984836 0 2023-12-16T20:11:37.699 INFO:tasks.workunit.client.1.smithi141.stdout:5/427: mkdir d0/d9/d16/d2a/d35/d91 0 2023-12-16T20:11:37.701 INFO:tasks.workunit.client.1.smithi141.stdout:5/428: dread d0/d9/d16/f21 [4194304,4194304] 0 2023-12-16T20:11:37.703 INFO:tasks.workunit.client.1.smithi141.stdout:7/520: dwrite d5/d16/d30/d36/f4b [0,4194304] 0 2023-12-16T20:11:37.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/607: mknod d0/d1c/d40/d3c/cc7 0 2023-12-16T20:11:37.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/608: chown d0/d1c/d2c/d72/f8e 114 1 2023-12-16T20:11:37.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/609: write d0/f68 [508975,130892] 0 2023-12-16T20:11:37.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/610: stat d0/d1c/d40/d3c/fba 0 2023-12-16T20:11:37.708 INFO:tasks.workunit.client.1.smithi141.stdout:3/611: chown d0/d1c/d40/d3f/d52/d5d 1 1 2023-12-16T20:11:37.709 INFO:tasks.workunit.client.1.smithi141.stdout:0/525: mkdir d4/d49/d73/d8a/db6 0 2023-12-16T20:11:37.711 INFO:tasks.workunit.client.1.smithi141.stdout:8/497: mknod d14/d19/d1b/d3d/d5e/c9c 0 2023-12-16T20:11:37.711 INFO:tasks.workunit.client.1.smithi141.stdout:8/498: chown d14/d19/d1b/d24/d4a/d5b/c9a 73994623 1 2023-12-16T20:11:37.713 INFO:tasks.workunit.client.1.smithi141.stdout:5/429: creat d0/d9/d16/d72/f92 x:0 0 0 2023-12-16T20:11:37.715 INFO:tasks.workunit.client.1.smithi141.stdout:6/533: dwrite d1/d3/d4b/f66 [0,4194304] 0 2023-12-16T20:11:37.715 INFO:tasks.workunit.client.1.smithi141.stdout:6/534: write d1/d12/d22/d25/fa7 [102687,11707] 0 2023-12-16T20:11:37.715 INFO:tasks.workunit.client.1.smithi141.stdout:6/535: truncate d1/dd/d2f/f5f 5026060 0 2023-12-16T20:11:37.715 INFO:tasks.workunit.client.1.smithi141.stdout:6/536: chown d1/d3/d4f 30544367 1 2023-12-16T20:11:37.715 INFO:tasks.workunit.client.1.smithi141.stdout:1/558: rmdir da/d36/d4b/d4d/d80/d94 39 2023-12-16T20:11:37.722 INFO:tasks.workunit.client.1.smithi141.stdout:3/612: creat d0/d1c/d6a/d76/fc8 x:0 0 0 2023-12-16T20:11:37.723 INFO:tasks.workunit.client.1.smithi141.stdout:7/521: dwrite d5/d16/d46/f90 [0,4194304] 0 2023-12-16T20:11:37.725 INFO:tasks.workunit.client.1.smithi141.stdout:0/526: symlink d4/d49/d73/d3b/d78/d7f/d80/lb7 0 2023-12-16T20:11:37.726 INFO:tasks.workunit.client.1.smithi141.stdout:0/527: stat d4/d49/d73/d3b/d78/d7f/d80/d83 0 2023-12-16T20:11:37.727 INFO:tasks.workunit.client.1.smithi141.stdout:8/499: truncate d14/d19/d1b/d24/f49 3038441 0 2023-12-16T20:11:37.728 INFO:tasks.workunit.client.1.smithi141.stdout:5/430: unlink d0/d9/f54 0 2023-12-16T20:11:37.728 INFO:tasks.workunit.client.1.smithi141.stdout:5/431: fdatasync d0/f50 0 2023-12-16T20:11:37.730 INFO:tasks.workunit.client.1.smithi141.stdout:1/559: stat da/l19 0 2023-12-16T20:11:37.732 INFO:tasks.workunit.client.1.smithi141.stdout:2/366: rename d6/da/d33/d4f to d6/d32/d7a 0 2023-12-16T20:11:37.736 INFO:tasks.workunit.client.1.smithi141.stdout:7/522: creat d5/d16/d30/d4e/d6e/fa5 x:0 0 0 2023-12-16T20:11:37.737 INFO:tasks.workunit.client.1.smithi141.stdout:7/523: creat d5/d1d/d89/fa6 x:0 0 0 2023-12-16T20:11:37.739 INFO:tasks.workunit.client.1.smithi141.stdout:5/432: write d0/d43/f6e [3371788,35308] 0 2023-12-16T20:11:37.739 INFO:tasks.workunit.client.1.smithi141.stdout:5/433: creat d0/d25/f93 x:0 0 0 2023-12-16T20:11:37.740 INFO:tasks.workunit.client.1.smithi141.stdout:1/560: symlink da/d1a/db0/lba 0 2023-12-16T20:11:37.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/537: dwrite d1/d12/d20/d44/f72 [0,4194304] 0 2023-12-16T20:11:37.743 INFO:tasks.workunit.client.1.smithi141.stdout:9/504: rename d1/d10/d33/d39 to d1/d10/d14/d20/db3 0 2023-12-16T20:11:37.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:37 smithi141 ceph-mon[88165]: pgmap v7: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 232 MiB/s rd, 297 MiB/s wr, 429 op/s 2023-12-16T20:11:37.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:37 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:11:37.745 INFO:tasks.workunit.client.1.smithi141.stdout:3/613: symlink d0/d1c/d40/lc9 0 2023-12-16T20:11:37.745 INFO:tasks.workunit.client.1.smithi141.stdout:3/614: getdents d0/d1c/d2c/dc0 0 2023-12-16T20:11:37.748 INFO:tasks.workunit.client.1.smithi141.stdout:0/528: getdents d4/d49/d73/d3b/d78/d7f 0 2023-12-16T20:11:37.748 INFO:tasks.workunit.client.1.smithi141.stdout:0/529: write d4/d49/d4b/f66 [1128784,98936] 0 2023-12-16T20:11:37.748 INFO:tasks.workunit.client.1.smithi141.stdout:0/530: chown d4/d49/d73/d3b/l64 5185 1 2023-12-16T20:11:37.748 INFO:tasks.workunit.client.1.smithi141.stdout:0/531: readlink d4/l3c 0 2023-12-16T20:11:37.753 INFO:tasks.workunit.client.0.smithi038.stdout:3/848: rename d4/d6c/da7/d116 to d4/d6c/d80/d12a 0 2023-12-16T20:11:37.753 INFO:tasks.workunit.client.0.smithi038.stdout:3/849: chown d4/d67/de1/d4c/d70/d71/db9/dd8/ddc 3268 1 2023-12-16T20:11:37.753 INFO:tasks.workunit.client.0.smithi038.stdout:3/850: getdents d4/d6c/da7/dfd 0 2023-12-16T20:11:37.753 INFO:tasks.workunit.client.1.smithi141.stdout:2/367: dwrite d6/f17 [0,4194304] 0 2023-12-16T20:11:37.754 INFO:tasks.workunit.client.0.smithi038.stdout:8/714: mknod d17/d1b/d25/db7/d82/da9/d59/ce0 0 2023-12-16T20:11:37.764 INFO:tasks.workunit.client.0.smithi038.stdout:3/851: mkdir d4/d8/d15/d12b 0 2023-12-16T20:11:37.764 INFO:tasks.workunit.client.0.smithi038.stdout:9/864: rename d9/d1f/d21/d55/f56 to d9/d1f/d21/d3e/d4e/d61/d9e/f114 0 2023-12-16T20:11:37.764 INFO:tasks.workunit.client.0.smithi038.stdout:3/852: chown d4/d8/c21 62450 1 2023-12-16T20:11:37.765 INFO:tasks.workunit.client.0.smithi038.stdout:3/853: chown d4/d8/c44 28620703 1 2023-12-16T20:11:37.765 INFO:tasks.workunit.client.0.smithi038.stdout:8/715: truncate d17/d34/f84 2698773 0 2023-12-16T20:11:37.766 INFO:tasks.workunit.client.0.smithi038.stdout:9/865: unlink d9/d1f/d21/d84/daf/cbb 0 2023-12-16T20:11:37.769 INFO:tasks.workunit.client.0.smithi038.stdout:3/854: rmdir d4/d67/de1/d7d 39 2023-12-16T20:11:37.770 INFO:tasks.workunit.client.0.smithi038.stdout:3/855: stat d4/d67/de1/d4c/d70/d71/db9/dd8/ce0 0 2023-12-16T20:11:37.774 INFO:tasks.workunit.client.1.smithi141.stdout:1/561: creat da/d1a/d1d/d22/fbb x:0 0 0 2023-12-16T20:11:37.789 INFO:tasks.workunit.client.1.smithi141.stdout:2/368: dwrite d6/da/d33/f4b [0,4194304] 0 2023-12-16T20:11:37.789 INFO:tasks.workunit.client.1.smithi141.stdout:2/369: truncate d6/d3a/d47/d58/f72 631265 0 2023-12-16T20:11:37.795 INFO:tasks.workunit.client.0.smithi038.stdout:8/716: dwrite d17/d1b/d25/db7/d82/da9/d50/d96/fac [0,4194304] 0 2023-12-16T20:11:37.795 INFO:tasks.workunit.client.0.smithi038.stdout:8/717: readlink d17/d1b/d66/l9d 0 2023-12-16T20:11:37.795 INFO:tasks.workunit.client.0.smithi038.stdout:8/718: truncate f10 5297869 0 2023-12-16T20:11:37.797 INFO:tasks.workunit.client.0.smithi038.stdout:3/856: dwrite d4/d6c/fa6 [0,4194304] 0 2023-12-16T20:11:37.802 INFO:tasks.workunit.client.0.smithi038.stdout:3/857: chown d4/d27/d40/ce7 230777 1 2023-12-16T20:11:37.803 INFO:tasks.workunit.client.0.smithi038.stdout:3/858: rmdir d4/d27/d23/d26 39 2023-12-16T20:11:37.804 INFO:tasks.workunit.client.0.smithi038.stdout:8/719: dread d17/d1b/d66/d73/d54/d69/f26 [0,4194304] 0 2023-12-16T20:11:37.805 INFO:tasks.workunit.client.0.smithi038.stdout:3/859: creat d4/d27/d23/f12c x:0 0 0 2023-12-16T20:11:37.805 INFO:tasks.workunit.client.0.smithi038.stdout:3/860: chown d4/d6c/da7 0 1 2023-12-16T20:11:37.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/861: read d4/d67/de1/f53 [178694,121078] 0 2023-12-16T20:11:37.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/862: creat d4/d18/f12d x:0 0 0 2023-12-16T20:11:37.813 INFO:tasks.workunit.client.0.smithi038.stdout:8/720: write d17/d5a/f63 [3873972,82607] 0 2023-12-16T20:11:37.837 INFO:tasks.workunit.client.0.smithi038.stdout:8/721: mknod d17/d1b/d66/d73/d55/ce1 0 2023-12-16T20:11:37.837 INFO:tasks.workunit.client.0.smithi038.stdout:3/863: getdents d4/d8/dc8 0 2023-12-16T20:11:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/864: stat d4/d67/de1/d7d/c102 0 2023-12-16T20:11:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/865: write d4/dcd/dcc/f11b [1016605,3229] 0 2023-12-16T20:11:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/866: dread - d4/dab/fb8 zero size 2023-12-16T20:11:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:3/867: getdents d4/d8/d15/d6d/d7a/d98/d10f 0 2023-12-16T20:11:37.839 INFO:tasks.workunit.client.0.smithi038.stdout:1/817: sync 2023-12-16T20:11:37.839 INFO:tasks.workunit.client.0.smithi038.stdout:1/818: fdatasync d15/d1e/d3b/d48/d37/dde/fd8 0 2023-12-16T20:11:37.839 INFO:tasks.workunit.client.0.smithi038.stdout:6/737: sync 2023-12-16T20:11:37.840 INFO:tasks.workunit.client.0.smithi038.stdout:3/868: mkdir d4/d8/d15/d12e 0 2023-12-16T20:11:37.844 INFO:tasks.workunit.client.0.smithi038.stdout:6/738: creat d1/d16/feb x:0 0 0 2023-12-16T20:11:37.845 INFO:tasks.workunit.client.0.smithi038.stdout:8/722: write d17/d34/f36 [4039331,53028] 0 2023-12-16T20:11:37.846 INFO:tasks.workunit.client.0.smithi038.stdout:3/869: link d4/dcd/lb0 d4/d27/d23/d26/l12f 0 2023-12-16T20:11:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:5/913: sync 2023-12-16T20:11:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:5/914: chown d2/df/d1a/d2a/l110 7 1 2023-12-16T20:11:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:2/942: sync 2023-12-16T20:11:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:8/723: dread d17/d1b/d66/d73/fbf [0,4194304] 0 2023-12-16T20:11:37.848 INFO:tasks.workunit.client.0.smithi038.stdout:8/724: chown d17/d1b/d25/f6b 0 1 2023-12-16T20:11:37.848 INFO:tasks.workunit.client.0.smithi038.stdout:8/725: write d17/d1b/d66/d73/fbf [1221114,39124] 0 2023-12-16T20:11:37.850 INFO:tasks.workunit.client.0.smithi038.stdout:7/883: sync 2023-12-16T20:11:37.850 INFO:tasks.workunit.client.0.smithi038.stdout:7/884: stat da/dcf/cdd 0 2023-12-16T20:11:37.850 INFO:tasks.workunit.client.0.smithi038.stdout:4/782: sync 2023-12-16T20:11:37.850 INFO:tasks.workunit.client.0.smithi038.stdout:1/819: rename d15/d1e/d23 to d15/d1e/d3b/d117 0 2023-12-16T20:11:37.850 INFO:tasks.workunit.client.0.smithi038.stdout:1/820: truncate d15/d22/f61 1558723 0 2023-12-16T20:11:37.852 INFO:tasks.workunit.client.0.smithi038.stdout:6/739: link d1/d4/d1d/f60 d1/d4/d1d/d67/d73/fec 0 2023-12-16T20:11:37.858 INFO:tasks.workunit.client.0.smithi038.stdout:2/943: rmdir d1/d5/d2a/d31/d60/ded/dee/d12b 0 2023-12-16T20:11:37.862 INFO:tasks.workunit.client.0.smithi038.stdout:4/783: unlink d13/d17/d4b/c5c 0 2023-12-16T20:11:37.865 INFO:tasks.workunit.client.0.smithi038.stdout:3/870: rename d4/d27/d23/d26/l12f to d4/d67/de1/d4c/d70/d71/db9/dd8/l130 0 2023-12-16T20:11:37.867 INFO:tasks.workunit.client.0.smithi038.stdout:1/821: mkdir d15/d1e/d118 0 2023-12-16T20:11:37.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/885: rmdir da/d21/dc0 39 2023-12-16T20:11:37.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/886: chown da/d21/d2c/dd0/fe8 110371302 1 2023-12-16T20:11:37.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/887: chown da/d21/d2c/f30 0 1 2023-12-16T20:11:37.871 INFO:tasks.workunit.client.0.smithi038.stdout:2/944: unlink d1/d5/d95/d61/dd4/d21/d82/d92/db3/cd2 0 2023-12-16T20:11:37.871 INFO:tasks.workunit.client.0.smithi038.stdout:2/945: chown d1/d5/d95/d61/dd4/d6a/d43/d57/dd6/l131 1 1 2023-12-16T20:11:37.873 INFO:tasks.workunit.client.0.smithi038.stdout:4/784: creat d13/d69/def/f100 x:0 0 0 2023-12-16T20:11:37.874 INFO:tasks.workunit.client.0.smithi038.stdout:5/915: dwrite d2/d14/d25/d2d/d17/d51/daf/f10a [0,4194304] 0 2023-12-16T20:11:37.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/726: rename d17/d1b/d66/d73/d54/l83 to d17/d1b/d25/db7/d82/daa/le2 0 2023-12-16T20:11:37.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/727: truncate d17/d1b/d57/f65 2218034 0 2023-12-16T20:11:37.876 INFO:tasks.workunit.client.0.smithi038.stdout:3/871: rmdir d4/d67/de1/d4c/d70/d71/db9/dd8 39 2023-12-16T20:11:37.878 INFO:tasks.workunit.client.0.smithi038.stdout:1/822: creat d15/d1e/d3b/d48/d37/dde/d75/f119 x:0 0 0 2023-12-16T20:11:37.880 INFO:tasks.workunit.client.0.smithi038.stdout:6/740: dwrite d1/d5b/d7d/d9d/f6a [0,4194304] 0 2023-12-16T20:11:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/872: write d4/d27/d23/f57 [2004674,107501] 0 2023-12-16T20:11:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/873: fdatasync d4/dcd/fcf 0 2023-12-16T20:11:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/874: write d4/d67/fa1 [973490,114034] 0 2023-12-16T20:11:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/916: mknod d2/d14/d25/d2d/d17/d51/c119 0 2023-12-16T20:11:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:8/728: mknod d17/d1b/d25/db7/d82/da9/d50/ddd/ce3 0 2023-12-16T20:11:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:8/729: write d17/d5a/f63 [2322017,62644] 0 2023-12-16T20:11:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:8/730: fsync d17/d1b/d25/db7/d82/da9/d50/f6e 0 2023-12-16T20:11:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:8/731: fsync d17/d1b/d25/db7/f71 0 2023-12-16T20:11:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:6/741: dread d1/d4/d1d/f66 [0,4194304] 0 2023-12-16T20:11:37.893 INFO:tasks.workunit.client.0.smithi038.stdout:2/946: rename d1/d5/d95/d61/d66/ddd/de8/f11f to d1/d5/d95/d61/dd4/d10/d109/f13d 0 2023-12-16T20:11:37.893 INFO:tasks.workunit.client.0.smithi038.stdout:2/947: write d1/d5/d95/d61/dd4/d21/d9a/db9/f64 [199865,91242] 0 2023-12-16T20:11:37.894 INFO:tasks.workunit.client.1.smithi141.stdout:6/538: creat d1/d77/fac x:0 0 0 2023-12-16T20:11:37.894 INFO:tasks.workunit.client.1.smithi141.stdout:6/539: chown d1/d12/d22/f64 63785 1 2023-12-16T20:11:37.895 INFO:tasks.workunit.client.0.smithi038.stdout:1/823: mkdir d15/d1e/d3b/d117/d34/d86/d9a/d11a 0 2023-12-16T20:11:37.901 INFO:tasks.workunit.client.0.smithi038.stdout:7/888: rmdir da/d21 39 2023-12-16T20:11:37.903 INFO:tasks.workunit.client.0.smithi038.stdout:3/875: link d4/d27/d23/f4f d4/d27/d2b/d64/f131 0 2023-12-16T20:11:37.903 INFO:tasks.workunit.client.0.smithi038.stdout:3/876: stat d4/d8/d15/d1e/l92 0 2023-12-16T20:11:37.905 INFO:tasks.workunit.client.0.smithi038.stdout:5/917: link d2/d14/d25/d2d/f10b d2/df/d1a/d1f/d4a/dc8/f11a 0 2023-12-16T20:11:37.907 INFO:tasks.workunit.client.0.smithi038.stdout:8/732: creat d17/d1b/d25/db7/d82/da9/fe4 x:0 0 0 2023-12-16T20:11:37.908 INFO:tasks.workunit.client.0.smithi038.stdout:6/742: symlink d1/d5b/d7d/d9d/led 0 2023-12-16T20:11:37.909 INFO:tasks.workunit.client.0.smithi038.stdout:2/948: symlink d1/d88/l13e 0 2023-12-16T20:11:37.910 INFO:tasks.workunit.client.0.smithi038.stdout:1/824: mkdir d15/d1e/d3b/d117/d34/d86/d99/d11b 0 2023-12-16T20:11:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/877: dread d4/d8/f43 [0,4194304] 0 2023-12-16T20:11:37.912 INFO:tasks.workunit.client.0.smithi038.stdout:7/889: getdents da/d21 0 2023-12-16T20:11:37.913 INFO:tasks.workunit.client.0.smithi038.stdout:5/918: creat d2/d14/d25/d2d/d17/d51/de9/f11b x:0 0 0 2023-12-16T20:11:37.915 INFO:tasks.workunit.client.0.smithi038.stdout:8/733: truncate d17/d1b/d66/d73/d4e/f88 5520374 0 2023-12-16T20:11:37.915 INFO:tasks.workunit.client.0.smithi038.stdout:6/743: getdents d1/d5b/d7d/dc6 0 2023-12-16T20:11:37.918 INFO:tasks.workunit.client.0.smithi038.stdout:2/949: creat d1/d5/d95/d61/dd4/d21/d9a/f13f x:0 0 0 2023-12-16T20:11:37.919 INFO:tasks.workunit.client.0.smithi038.stdout:1/825: creat d15/d1e/d3b/d117/da2/f11c x:0 0 0 2023-12-16T20:11:37.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/878: creat d4/d8/d15/d6d/f132 x:0 0 0 2023-12-16T20:11:37.920 INFO:tasks.workunit.client.0.smithi038.stdout:3/879: readlink d4/lb1 0 2023-12-16T20:11:37.921 INFO:tasks.workunit.client.0.smithi038.stdout:8/734: symlink d17/d1b/d25/db7/d82/da9/d59/le5 0 2023-12-16T20:11:37.924 INFO:tasks.workunit.client.0.smithi038.stdout:2/950: mkdir d1/d5/d95/d61/dd4/d6a/d43/d140 0 2023-12-16T20:11:37.931 INFO:tasks.workunit.client.0.smithi038.stdout:1/826: symlink d15/d22/d52/d7f/df7/l11d 0 2023-12-16T20:11:37.933 INFO:tasks.workunit.client.0.smithi038.stdout:3/880: creat d4/d8/d15/d1e/f133 x:0 0 0 2023-12-16T20:11:37.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/810: creat db/d16/da6/f104 x:0 0 0 2023-12-16T20:11:37.934 INFO:tasks.workunit.client.0.smithi038.stdout:8/735: mknod d17/d1b/d53/ce6 0 2023-12-16T20:11:37.936 INFO:tasks.workunit.client.0.smithi038.stdout:3/881: creat d4/d67/de1/d7d/f134 x:0 0 0 2023-12-16T20:11:37.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/882: fdatasync d4/dcd/dcc/f121 0 2023-12-16T20:11:37.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/827: dread d15/d1e/d30/fac [0,4194304] 0 2023-12-16T20:11:37.939 INFO:tasks.workunit.client.0.smithi038.stdout:8/736: mkdir d17/d1b/d66/d73/d55/da5/da6/de7 0 2023-12-16T20:11:37.940 INFO:tasks.workunit.client.0.smithi038.stdout:3/883: mknod d4/d8/c135 0 2023-12-16T20:11:37.941 INFO:tasks.workunit.client.0.smithi038.stdout:1/828: chown d15/d22/f98 0 1 2023-12-16T20:11:37.943 INFO:tasks.workunit.client.0.smithi038.stdout:8/737: symlink d17/d1b/d66/d73/d54/le8 0 2023-12-16T20:11:37.951 INFO:tasks.workunit.client.0.smithi038.stdout:2/951: write d1/d5/f4d [3878395,79736] 0 2023-12-16T20:11:37.957 INFO:tasks.workunit.client.0.smithi038.stdout:5/919: dwrite d2/d14/d25/fbd [0,4194304] 0 2023-12-16T20:11:37.959 INFO:tasks.workunit.client.0.smithi038.stdout:6/744: dwrite d1/d5b/d7d/d9d/dc8/de7/f41 [0,4194304] 0 2023-12-16T20:11:37.961 INFO:tasks.workunit.client.0.smithi038.stdout:5/920: creat d2/d4/d62/f11c x:0 0 0 2023-12-16T20:11:37.963 INFO:tasks.workunit.client.0.smithi038.stdout:6/745: link d1/d16/c4f d1/d4/d1d/d67/d73/cee 0 2023-12-16T20:11:37.963 INFO:tasks.workunit.client.0.smithi038.stdout:6/746: creat d1/d4/d1d/d8e/dbf/fef x:0 0 0 2023-12-16T20:11:37.966 INFO:tasks.workunit.client.0.smithi038.stdout:5/921: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d9e/d11d 0 2023-12-16T20:11:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:7/890: dwrite da/dcf/d100/d4d/d51/f6d [0,4194304] 0 2023-12-16T20:11:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:5/922: creat d2/d14/d25/d2d/d4b/d8b/df6/f11e x:0 0 0 2023-12-16T20:11:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/829: dread d15/d22/f53 [0,4194304] 0 2023-12-16T20:11:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/830: creat d15/d1e/d3b/d48/d37/deb/d107/f11e x:0 0 0 2023-12-16T20:11:37.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/831: readlink d15/d1e/d3b/d48/d3d/l44 0 2023-12-16T20:11:37.975 INFO:tasks.workunit.client.0.smithi038.stdout:5/923: rename d2/df/d1a/d1f/f3d to d2/d14/d25/d2d/d17/d51/d7b/f11f 0 2023-12-16T20:11:37.976 INFO:tasks.workunit.client.0.smithi038.stdout:6/747: write d1/d4/f8 [1071491,24216] 0 2023-12-16T20:11:37.979 INFO:tasks.workunit.client.0.smithi038.stdout:6/748: getdents d1/d4/d1d/d8e 0 2023-12-16T20:11:37.980 INFO:tasks.workunit.client.0.smithi038.stdout:6/749: fdatasync d1/d5b/d7d/d9d/dc8/de7/f7a 0 2023-12-16T20:11:37.980 INFO:tasks.workunit.client.1.smithi141.stdout:3/615: mknod d0/d1c/d40/d85/d96/cca 0 2023-12-16T20:11:37.981 INFO:tasks.workunit.client.1.smithi141.stdout:3/616: write d0/d1c/d40/f99 [266817,130860] 0 2023-12-16T20:11:37.983 INFO:tasks.workunit.client.0.smithi038.stdout:7/891: dread da/d21/d2c/f36 [0,4194304] 0 2023-12-16T20:11:37.983 INFO:tasks.workunit.client.0.smithi038.stdout:6/750: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/ff0 x:0 0 0 2023-12-16T20:11:37.984 INFO:tasks.workunit.client.1.smithi141.stdout:0/532: creat d4/d49/da1/fb8 x:0 0 0 2023-12-16T20:11:37.985 INFO:tasks.workunit.client.0.smithi038.stdout:7/892: truncate da/d21/d61/f66 3157813 0 2023-12-16T20:11:37.988 INFO:tasks.workunit.client.0.smithi038.stdout:6/751: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/ff1 x:0 0 0 2023-12-16T20:11:37.988 INFO:tasks.workunit.client.0.smithi038.stdout:6/752: dread - d1/d4/d1d/d67/d73/f98 zero size 2023-12-16T20:11:37.988 INFO:tasks.workunit.client.0.smithi038.stdout:6/753: chown d1/d4/d1d/d61/f9a 49 1 2023-12-16T20:11:37.991 INFO:tasks.workunit.client.1.smithi141.stdout:5/434: mkdir d0/d94 0 2023-12-16T20:11:37.991 INFO:tasks.workunit.client.1.smithi141.stdout:1/562: creat da/d76/fbc x:0 0 0 2023-12-16T20:11:37.993 INFO:tasks.workunit.client.1.smithi141.stdout:9/505: unlink d1/d10/d14/d20/da/l17 0 2023-12-16T20:11:37.994 INFO:tasks.workunit.client.1.smithi141.stdout:9/506: dread d1/d10/d14/d20/da/f78 [0,4194304] 0 2023-12-16T20:11:37.994 INFO:tasks.workunit.client.1.smithi141.stdout:9/507: chown d1/d10/d33/d47/c69 1 1 2023-12-16T20:11:37.995 INFO:tasks.workunit.client.1.smithi141.stdout:9/508: chown d1/d10/f22 66210570 1 2023-12-16T20:11:37.995 INFO:tasks.workunit.client.1.smithi141.stdout:9/509: chown d1/d10/d14/c42 309756915 1 2023-12-16T20:11:37.999 INFO:tasks.workunit.client.0.smithi038.stdout:6/754: dread d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f47 [0,4194304] 0 2023-12-16T20:11:38.004 INFO:tasks.workunit.client.0.smithi038.stdout:2/952: dwrite d1/d5/d95/d61/dd4/d21/d9a/f13f [0,4194304] 0 2023-12-16T20:11:38.004 INFO:tasks.workunit.client.0.smithi038.stdout:8/738: dwrite d17/d1b/d66/d8e/f9a [0,4194304] 0 2023-12-16T20:11:38.004 INFO:tasks.workunit.client.0.smithi038.stdout:8/739: readlink d17/d1b/d66/d73/d55/da5/da6/laf 0 2023-12-16T20:11:38.004 INFO:tasks.workunit.client.0.smithi038.stdout:6/755: unlink d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/ca9 0 2023-12-16T20:11:38.004 INFO:tasks.workunit.client.0.smithi038.stdout:6/756: chown d1/d5b/d7d/d9d/f48 2022 1 2023-12-16T20:11:38.005 INFO:tasks.workunit.client.1.smithi141.stdout:2/370: creat d6/d3a/d47/d58/d66/f7b x:0 0 0 2023-12-16T20:11:38.005 INFO:tasks.workunit.client.1.smithi141.stdout:2/371: readlink d6/l11 0 2023-12-16T20:11:38.007 INFO:tasks.workunit.client.0.smithi038.stdout:5/924: dwrite d2/df/d1a/d1f/d4a/d53/f5e [0,4194304] 0 2023-12-16T20:11:38.013 INFO:tasks.workunit.client.0.smithi038.stdout:5/925: mkdir d2/df/d120 0 2023-12-16T20:11:38.013 INFO:tasks.workunit.client.0.smithi038.stdout:5/926: fsync d2/d4/f58 0 2023-12-16T20:11:38.018 INFO:tasks.workunit.client.1.smithi141.stdout:3/617: dwrite d0/d1c/d40/f45 [0,4194304] 0 2023-12-16T20:11:38.018 INFO:tasks.workunit.client.1.smithi141.stdout:3/618: chown d0/d1c/d40/f81 3 1 2023-12-16T20:11:38.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/811: rmdir db/d16/d5a/dff 0 2023-12-16T20:11:38.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/812: chown db/d16/d5a/d65/d90/da7 77504125 1 2023-12-16T20:11:38.020 INFO:tasks.workunit.client.0.smithi038.stdout:1/832: dwrite d15/d1e/d3b/d117/d34/d86/d9a/fa4 [4194304,4194304] 0 2023-12-16T20:11:38.021 INFO:tasks.workunit.client.0.smithi038.stdout:8/740: rmdir d17/d1b/d66/d73/d54 39 2023-12-16T20:11:38.024 INFO:tasks.workunit.client.1.smithi141.stdout:2/372: dread d6/da/f49 [0,4194304] 0 2023-12-16T20:11:38.025 INFO:tasks.workunit.client.0.smithi038.stdout:5/927: symlink d2/df/d1a/d2a/d59/l121 0 2023-12-16T20:11:38.025 INFO:tasks.workunit.client.0.smithi038.stdout:5/928: write d2/d14/d25/d2d/d17/da9/db0/f107 [645591,44291] 0 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/833: mknod d15/d1e/d3b/d117/d7d/daa/c11f 0 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/834: chown d15/d1e/d3b/d117/d34/d86/d9a 9 1 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/835: chown d15/d1e/d3b/d117/d34/f69 2858196 1 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/836: dread - d15/d1e/d3b/d117/d34/d79/f9c zero size 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/837: chown d15/d1e/d3b/d48/d3d/ca3 41193 1 2023-12-16T20:11:38.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/838: write d15/d1e/d3b/d48/f36 [270361,1854] 0 2023-12-16T20:11:38.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.031+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49c10f410 con 0x7fe4840387b0 2023-12-16T20:11:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:5/929: creat d2/d14/d25/d2d/d17/d51/d7b/d89/d10e/f122 x:0 0 0 2023-12-16T20:11:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:8/741: dread d17/d1b/d25/db7/d82/da9/d59/f6a [0,4194304] 0 2023-12-16T20:11:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:8/742: creat d17/d1b/d66/d8e/d97/fe9 x:0 0 0 2023-12-16T20:11:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:8/743: fdatasync d17/d1b/d25/f5c 0 2023-12-16T20:11:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:8/744: fdatasync d17/d1b/d25/db7/d82/da9/d50/f6e 0 2023-12-16T20:11:38.034 INFO:tasks.workunit.client.0.smithi038.stdout:1/839: mkdir d15/d1e/d3b/d48/d37/dde/d75/dc6/d120 0 2023-12-16T20:11:38.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.035+0000 7fe4837fe700 1 -- 172.21.15.38:0/390942561 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe49c10f410 con 0x7fe4840387b0 2023-12-16T20:11:38.038 INFO:tasks.workunit.client.0.smithi038.stdout:8/745: mknod d17/d1b/d66/d73/d55/da5/da6/de7/cea 0 2023-12-16T20:11:38.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.042+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 msgr2=0x7fe48403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.042+0000 7fe4a1131700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 0x7fe48403ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe490009b80 tx=0x7fe49000b040 comp rx=0 tx=0).stop 2023-12-16T20:11:38.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.042+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 msgr2=0x7fe49c10d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.042+0000 7fe4a1131700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe48c008f90 tx=0x7fe48c009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:38.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 shutdown_connections 2023-12-16T20:11:38.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fe4840387b0 0x7fe48403ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe49c066920 0x7fe49c10d4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 --2- 172.21.15.38:0/390942561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49c0ffd70 0x7fe49c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 >> 172.21.15.38:0/390942561 conn(0x7fe49c0f71d0 msgr2=0x7fe49c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 shutdown_connections 2023-12-16T20:11:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.048+0000 7fe4a1131700 1 -- 172.21.15.38:0/390942561 wait complete. 2023-12-16T20:11:38.049 INFO:tasks.workunit.client.0.smithi038.stdout:2/953: dwrite d1/d5/d2a/f12a [0,4194304] 0 2023-12-16T20:11:38.050 INFO:tasks.workunit.client.0.smithi038.stdout:2/954: write d1/d5/d95/d61/dd4/d6a/d43/d57/ff9 [505475,79179] 0 2023-12-16T20:11:38.050 INFO:tasks.workunit.client.1.smithi141.stdout:3/619: dwrite d0/d1c/d6a/f8d [0,4194304] 0 2023-12-16T20:11:38.051 INFO:tasks.workunit.client.0.smithi038.stdout:1/840: dread d15/fb7 [0,4194304] 0 2023-12-16T20:11:38.053 INFO:tasks.workunit.client.0.smithi038.stdout:8/746: write d17/d1b/d25/db7/d82/da9/d50/dc4/fc5 [509667,24200] 0 2023-12-16T20:11:38.053 INFO:tasks.workunit.client.0.smithi038.stdout:2/955: mkdir d1/d5/d95/d61/dd4/d6a/dfb/d141 0 2023-12-16T20:11:38.053 INFO:tasks.workunit.client.0.smithi038.stdout:2/956: truncate d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f4a 1787879 0 2023-12-16T20:11:38.055 INFO:tasks.workunit.client.0.smithi038.stdout:1/841: unlink d15/d4a/cc2 0 2023-12-16T20:11:38.056 INFO:tasks.workunit.client.1.smithi141.stdout:9/510: dwrite d1/d10/d33/d47/d83/f8f [4194304,4194304] 0 2023-12-16T20:11:38.059 INFO:tasks.workunit.client.0.smithi038.stdout:2/957: rename d1/f104 to d1/d5/d3d/d9e/f142 0 2023-12-16T20:11:38.060 INFO:tasks.workunit.client.0.smithi038.stdout:1/842: truncate d15/d1e/f2d 667645 0 2023-12-16T20:11:38.061 INFO:tasks.workunit.client.0.smithi038.stdout:6/757: rmdir d1/d5b/d7d/d9d 39 2023-12-16T20:11:38.063 INFO:tasks.workunit.client.0.smithi038.stdout:0/813: dwrite db/d16/d70/f55 [4194304,4194304] 0 2023-12-16T20:11:38.066 INFO:tasks.workunit.client.0.smithi038.stdout:6/758: mkdir d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2 0 2023-12-16T20:11:38.066 INFO:tasks.workunit.client.0.smithi038.stdout:6/759: chown d1/f2c 1189793 1 2023-12-16T20:11:38.066 INFO:tasks.workunit.client.0.smithi038.stdout:6/760: chown d1/d4/d1d/fae 1432994847 1 2023-12-16T20:11:38.066 INFO:tasks.workunit.client.0.smithi038.stdout:6/761: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/ff3 x:0 0 0 2023-12-16T20:11:38.069 INFO:tasks.workunit.client.0.smithi038.stdout:1/843: dread d15/d22/f61 [0,4194304] 0 2023-12-16T20:11:38.070 INFO:tasks.workunit.client.0.smithi038.stdout:1/844: creat d15/d22/d52/d7f/f121 x:0 0 0 2023-12-16T20:11:38.070 INFO:tasks.workunit.client.0.smithi038.stdout:1/845: fdatasync d15/d1e/d3b/f77 0 2023-12-16T20:11:38.070 INFO:tasks.workunit.client.0.smithi038.stdout:1/846: readlink d15/d1e/d3b/d48/d37/l10a 0 2023-12-16T20:11:38.070 INFO:tasks.workunit.client.0.smithi038.stdout:7/893: dwrite da/d21/d61/f66 [0,4194304] 0 2023-12-16T20:11:38.075 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:11:38.075 INFO:tasks.workunit.client.0.smithi038.stdout:6/762: unlink d1/d5b/d7d/d9d/fd8 0 2023-12-16T20:11:38.075 INFO:tasks.workunit.client.0.smithi038.stdout:6/763: chown d1/d16/c4f 24596 1 2023-12-16T20:11:38.075 INFO:tasks.workunit.client.0.smithi038.stdout:2/958: dread d1/d5/d2a/f30 [0,4194304] 0 2023-12-16T20:11:38.075 INFO:tasks.workunit.client.0.smithi038.stdout:2/959: truncate d1/d5/d2a/f101 34088 0 2023-12-16T20:11:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:8/747: dread d17/d1b/d25/f5c [0,4194304] 0 2023-12-16T20:11:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:8/748: readlink d17/d1b/d25/db7/d82/daa/le2 0 2023-12-16T20:11:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:8/749: creat d17/d1b/d25/db7/d82/d9b/feb x:0 0 0 2023-12-16T20:11:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:5/930: dwrite d2/d14/d25/d2d/f2c [0,4194304] 0 2023-12-16T20:11:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:5/931: dread - d2/d14/d25/fca zero size 2023-12-16T20:11:38.084 INFO:tasks.workunit.client.0.smithi038.stdout:1/847: creat d15/d4a/f122 x:0 0 0 2023-12-16T20:11:38.084 INFO:tasks.workunit.client.0.smithi038.stdout:8/750: creat d17/d1b/d25/db7/d82/da9/d50/d96/dba/fec x:0 0 0 2023-12-16T20:11:38.084 INFO:tasks.workunit.client.0.smithi038.stdout:5/932: symlink d2/df/d120/l123 0 2023-12-16T20:11:38.084 INFO:tasks.workunit.client.0.smithi038.stdout:8/751: write d17/d1b/d66/d73/d55/da5/fc2 [526749,45464] 0 2023-12-16T20:11:38.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/764: mkdir d1/d5b/d7d/df4 0 2023-12-16T20:11:38.088 INFO:tasks.workunit.client.0.smithi038.stdout:5/933: creat d2/df/d1a/d1f/d4a/d53/d6e/f124 x:0 0 0 2023-12-16T20:11:38.090 INFO:tasks.workunit.client.0.smithi038.stdout:8/752: link d17/d1b/d25/db7/f71 d17/d34/ddb/fed 0 2023-12-16T20:11:38.091 INFO:tasks.workunit.client.0.smithi038.stdout:0/814: dwrite db/d16/d5a/d65/de8/d77/d95/da4/fbe [0,4194304] 0 2023-12-16T20:11:38.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/765: mkdir d1/d5b/d7d/d9d/dc8/de7/d2f/d85/df5 0 2023-12-16T20:11:38.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/766: dread - d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fde zero size 2023-12-16T20:11:38.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/767: creat d1/d4/d1d/ff6 x:0 0 0 2023-12-16T20:11:38.094 INFO:tasks.workunit.client.0.smithi038.stdout:5/934: creat d2/d14/d44/d117/f125 x:0 0 0 2023-12-16T20:11:38.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/753: creat d17/d1b/d25/db7/d82/fee x:0 0 0 2023-12-16T20:11:38.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/754: creat d17/d1b/d25/db7/d82/fef x:0 0 0 2023-12-16T20:11:38.096 INFO:tasks.workunit.client.0.smithi038.stdout:8/755: write d17/d1b/d66/d73/d54/d69/f7e [878987,43486] 0 2023-12-16T20:11:38.097 INFO:tasks.workunit.client.0.smithi038.stdout:6/768: symlink d1/d4/d1d/d61/lf7 0 2023-12-16T20:11:38.100 INFO:tasks.workunit.client.0.smithi038.stdout:8/756: symlink d17/d1b/d66/d73/d9e/lf0 0 2023-12-16T20:11:38.102 INFO:tasks.workunit.client.0.smithi038.stdout:6/769: link d1/d4/d1d/ff6 d1/d4/d1d/d8e/dbf/ff8 0 2023-12-16T20:11:38.102 INFO:tasks.workunit.client.0.smithi038.stdout:5/935: rmdir d2/d14/d25/d2d/d17/d93 39 2023-12-16T20:11:38.106 INFO:tasks.workunit.client.0.smithi038.stdout:0/815: creat db/d16/d19/d27/df5/f105 x:0 0 0 2023-12-16T20:11:38.106 INFO:tasks.workunit.client.0.smithi038.stdout:2/960: dwrite d1/d5/d95/d61/dd4/d21/d82/d92/fe2 [0,4194304] 0 2023-12-16T20:11:38.106 INFO:tasks.workunit.client.0.smithi038.stdout:6/770: symlink d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/lf9 0 2023-12-16T20:11:38.113 INFO:tasks.workunit.client.0.smithi038.stdout:5/936: write d2/d14/d25/d2d/d17/d51/daf/f10a [3990934,23838] 0 2023-12-16T20:11:38.113 INFO:tasks.workunit.client.0.smithi038.stdout:5/937: creat d2/d14/d25/d2d/d17/da9/f126 x:0 0 0 2023-12-16T20:11:38.116 INFO:tasks.workunit.client.0.smithi038.stdout:2/961: link d1/d5/d3d/ddc/f118 d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f143 0 2023-12-16T20:11:38.116 INFO:tasks.workunit.client.0.smithi038.stdout:2/962: creat d1/d5/d95/d61/dd4/d6a/d43/d57/f144 x:0 0 0 2023-12-16T20:11:38.116 INFO:tasks.workunit.client.0.smithi038.stdout:1/848: dwrite d15/d22/fcb [4194304,4194304] 0 2023-12-16T20:11:38.117 INFO:tasks.workunit.client.0.smithi038.stdout:6/771: mknod d1/d5b/d7d/d9d/dc8/de7/db1/cfa 0 2023-12-16T20:11:38.117 INFO:tasks.workunit.client.0.smithi038.stdout:6/772: dread - d1/d5b/d7d/dc6/fcb zero size 2023-12-16T20:11:38.117 INFO:tasks.workunit.client.0.smithi038.stdout:6/773: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/fb6 [2457100,127734] 0 2023-12-16T20:11:38.118 INFO:tasks.workunit.client.0.smithi038.stdout:5/938: mknod d2/df/d1a/d1f/d4a/d53/d6e/d85/dd1/c127 0 2023-12-16T20:11:38.118 INFO:tasks.workunit.client.0.smithi038.stdout:5/939: dread - d2/df/d1a/d2a/d59/fa4 zero size 2023-12-16T20:11:38.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/940: mknod d2/df/d87/c128 0 2023-12-16T20:11:38.120 INFO:tasks.workunit.client.0.smithi038.stdout:7/894: dwrite da/d21/fac [0,4194304] 0 2023-12-16T20:11:38.121 INFO:tasks.workunit.client.0.smithi038.stdout:5/941: mkdir d2/df/d1a/d1f/d4a/d53/d6e/d129 0 2023-12-16T20:11:38.127 INFO:tasks.workunit.client.0.smithi038.stdout:1/849: dread d15/d22/fb8 [0,4194304] 0 2023-12-16T20:11:38.127 INFO:tasks.workunit.client.0.smithi038.stdout:1/850: write d15/d1e/d3b/d117/d34/d79/f83 [189511,19166] 0 2023-12-16T20:11:38.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/816: dread db/d16/d70/f55 [0,4194304] 0 2023-12-16T20:11:38.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/817: stat db/d16/d5a/d65/de8/lf0 0 2023-12-16T20:11:38.128 INFO:tasks.workunit.client.0.smithi038.stdout:5/942: dread d2/d14/d25/d2d/d4b/fd7 [0,4194304] 0 2023-12-16T20:11:38.130 INFO:tasks.workunit.client.0.smithi038.stdout:6/774: dread d1/d5b/d7d/d9d/f48 [0,4194304] 0 2023-12-16T20:11:38.130 INFO:tasks.workunit.client.0.smithi038.stdout:6/775: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f8d [584268,86940] 0 2023-12-16T20:11:38.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/963: dread d1/d5/d95/d61/dd4/d10/f108 [0,4194304] 0 2023-12-16T20:11:38.137 INFO:tasks.workunit.client.0.smithi038.stdout:0/818: rename db/d16/d5a to db/d16/d19/d4e/d106 0 2023-12-16T20:11:38.141 INFO:tasks.workunit.client.0.smithi038.stdout:5/943: creat d2/df/d1a/d1f/d4a/d53/f12a x:0 0 0 2023-12-16T20:11:38.144 INFO:tasks.workunit.client.0.smithi038.stdout:1/851: dread d15/d1e/d30/f5b [0,4194304] 0 2023-12-16T20:11:38.144 INFO:tasks.workunit.client.0.smithi038.stdout:1/852: write d15/d1e/d3b/d117/f39 [1157787,32575] 0 2023-12-16T20:11:38.145 INFO:tasks.workunit.client.0.smithi038.stdout:2/964: rename d1/d5/d3d/d9e/f142 to d1/d5/f145 0 2023-12-16T20:11:38.145 INFO:tasks.workunit.client.0.smithi038.stdout:7/895: dwrite da/dcf/d100/d4d/dc5/d38/d90/f16 [4194304,4194304] 0 2023-12-16T20:11:38.145 INFO:tasks.workunit.client.0.smithi038.stdout:7/896: dread - da/fff zero size 2023-12-16T20:11:38.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/944: unlink d2/d4/ld 0 2023-12-16T20:11:38.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/945: readlink d2/d14/l6d 0 2023-12-16T20:11:38.149 INFO:tasks.workunit.client.0.smithi038.stdout:1/853: mkdir d15/d4a/ded/d123 0 2023-12-16T20:11:38.150 INFO:tasks.workunit.client.0.smithi038.stdout:8/757: rmdir d17/d1b 39 2023-12-16T20:11:38.152 INFO:tasks.workunit.client.0.smithi038.stdout:7/897: creat da/dcf/d11f/f12b x:0 0 0 2023-12-16T20:11:38.152 INFO:tasks.workunit.client.0.smithi038.stdout:7/898: truncate da/d21/d2c/dd0/fe8 1026883 0 2023-12-16T20:11:38.152 INFO:tasks.workunit.client.0.smithi038.stdout:7/899: chown da/d21/d2c/f59 345492 1 2023-12-16T20:11:38.152 INFO:tasks.workunit.client.0.smithi038.stdout:7/900: stat da/d21/d86/de2/d10f/l118 0 2023-12-16T20:11:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/946: truncate d2/d14/d25/d2d/d17/da9/fb3 2560273 0 2023-12-16T20:11:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/819: dread f6 [4194304,4194304] 0 2023-12-16T20:11:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:6/776: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fde [0,4194304] 0 2023-12-16T20:11:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:1/854: symlink d15/d22/d52/d7f/df7/l124 0 2023-12-16T20:11:38.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/901: unlink da/d21/d2c/d76/f89 0 2023-12-16T20:11:38.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/902: write da/d21/d61/f9d [105163,28746] 0 2023-12-16T20:11:38.161 INFO:tasks.workunit.client.1.smithi141.stdout:8/500: rename d14/d19/d1b/d24/l2b to d14/d19/d1b/d24/d4b/l9d 0 2023-12-16T20:11:38.161 INFO:tasks.workunit.client.1.smithi141.stdout:8/501: stat d14/d19/f1f 0 2023-12-16T20:11:38.162 INFO:tasks.workunit.client.0.smithi038.stdout:6/777: creat d1/d4/d1d/d8e/d91/ffb x:0 0 0 2023-12-16T20:11:38.164 INFO:tasks.workunit.client.0.smithi038.stdout:1/855: creat d15/d1e/d3b/d48/d3d/dc8/f125 x:0 0 0 2023-12-16T20:11:38.165 INFO:tasks.workunit.client.0.smithi038.stdout:6/778: dread d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fd3 [0,4194304] 0 2023-12-16T20:11:38.165 INFO:tasks.workunit.client.0.smithi038.stdout:7/903: mknod da/dcf/d100/d4d/dc5/ddc/dba/dd9/c12c 0 2023-12-16T20:11:38.167 INFO:tasks.workunit.client.0.smithi038.stdout:7/904: mknod da/c12d 0 2023-12-16T20:11:38.168 INFO:tasks.workunit.client.0.smithi038.stdout:7/905: dread da/d21/d61/fbc [0,4194304] 0 2023-12-16T20:11:38.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/965: dwrite d1/d5/d95/f11b [0,4194304] 0 2023-12-16T20:11:38.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/966: chown d1/d5/d95/d61/dd4/d6d/f8c 120 1 2023-12-16T20:11:38.183 INFO:tasks.workunit.client.0.smithi038.stdout:7/906: dread da/dcf/d100/d4d/dc5/d38/d90/f2d [0,4194304] 0 2023-12-16T20:11:38.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/907: fdatasync da/dcf/d100/d4d/dc5/ddc/f2a 0 2023-12-16T20:11:38.187 INFO:tasks.workunit.client.0.smithi038.stdout:1/856: dread d15/d1e/d3b/d48/d37/f88 [0,4194304] 0 2023-12-16T20:11:38.189 INFO:tasks.workunit.client.0.smithi038.stdout:2/967: link d1/d5/d95/d61/dd4/d10/d109/f13d d1/d5/d3d/d115/f146 0 2023-12-16T20:11:38.189 INFO:tasks.workunit.client.0.smithi038.stdout:2/968: dread - d1/d5/d95/d61/d66/ddd/de8/dea/fdb zero size 2023-12-16T20:11:38.191 INFO:tasks.workunit.client.0.smithi038.stdout:7/908: rename da/d21/d86/d92 to da/d21/d61/d12e 0 2023-12-16T20:11:38.192 INFO:tasks.workunit.client.0.smithi038.stdout:7/909: mknod da/d21/d61/c12f 0 2023-12-16T20:11:38.192 INFO:tasks.workunit.client.0.smithi038.stdout:7/910: fdatasync da/d21/d61/dcd/f126 0 2023-12-16T20:11:38.199 INFO:tasks.workunit.client.0.smithi038.stdout:4/785: sync 2023-12-16T20:11:38.199 INFO:tasks.workunit.client.0.smithi038.stdout:4/786: stat d13/f37 0 2023-12-16T20:11:38.199 INFO:tasks.workunit.client.0.smithi038.stdout:9/866: sync 2023-12-16T20:11:38.199 INFO:tasks.workunit.client.0.smithi038.stdout:3/884: sync 2023-12-16T20:11:38.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/787: mkdir d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/d101 0 2023-12-16T20:11:38.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/788: truncate d13/d1f/d35/f38 3271015 0 2023-12-16T20:11:38.204 INFO:tasks.workunit.client.1.smithi141.stdout:0/533: mkdir d4/d49/db9 0 2023-12-16T20:11:38.204 INFO:tasks.workunit.client.1.smithi141.stdout:0/534: readlink d4/l2d 0 2023-12-16T20:11:38.204 INFO:tasks.workunit.client.0.smithi038.stdout:3/885: creat d4/d67/de1/d4c/dae/d124/f136 x:0 0 0 2023-12-16T20:11:38.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/789: rename d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/fc7 to d13/f102 0 2023-12-16T20:11:38.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/790: readlink d13/d17/d4b/da4/d34/l99 0 2023-12-16T20:11:38.207 INFO:tasks.workunit.client.0.smithi038.stdout:3/886: creat d4/de8/f137 x:0 0 0 2023-12-16T20:11:38.208 INFO:tasks.workunit.client.0.smithi038.stdout:4/791: truncate d13/d17/d4b/da4/fd3 1462058 0 2023-12-16T20:11:38.208 INFO:tasks.workunit.client.1.smithi141.stdout:5/435: mkdir d0/d9/d16/d2a/d35/d5e/d95 0 2023-12-16T20:11:38.209 INFO:tasks.workunit.client.0.smithi038.stdout:3/887: creat d4/d6c/d80/d12a/f138 x:0 0 0 2023-12-16T20:11:38.210 INFO:tasks.workunit.client.0.smithi038.stdout:4/792: creat d13/d69/d7a/da5/f103 x:0 0 0 2023-12-16T20:11:38.210 INFO:tasks.workunit.client.0.smithi038.stdout:3/888: mkdir d4/dcd/d139 0 2023-12-16T20:11:38.210 INFO:tasks.workunit.client.0.smithi038.stdout:5/947: dwrite d2/d14/d25/d2d/d17/d51/f80 [0,4194304] 0 2023-12-16T20:11:38.212 INFO:tasks.workunit.client.0.smithi038.stdout:4/793: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/d101/f104 x:0 0 0 2023-12-16T20:11:38.213 INFO:tasks.workunit.client.0.smithi038.stdout:3/889: mknod d4/d67/de1/d4c/d70/c13a 0 2023-12-16T20:11:38.213 INFO:tasks.workunit.client.0.smithi038.stdout:3/890: chown d4/dcd/fcf 1 1 2023-12-16T20:11:38.214 INFO:tasks.workunit.client.1.smithi141.stdout:2/373: mkdir d6/da/d33/d54/d7c 0 2023-12-16T20:11:38.214 INFO:tasks.workunit.client.0.smithi038.stdout:5/948: mkdir d2/df/d1a/d1f/d4a/d53/d97/d12b 0 2023-12-16T20:11:38.215 INFO:tasks.workunit.client.0.smithi038.stdout:4/794: creat d13/d17/d2e/d32/f105 x:0 0 0 2023-12-16T20:11:38.216 INFO:tasks.workunit.client.0.smithi038.stdout:5/949: symlink d2/d14/ddd/deb/l12c 0 2023-12-16T20:11:38.217 INFO:tasks.workunit.client.0.smithi038.stdout:4/795: link d13/d69/def/lf8 d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/l106 0 2023-12-16T20:11:38.218 INFO:tasks.workunit.client.0.smithi038.stdout:4/796: mkdir d13/d17/d4b/da4/d9d/db5/d107 0 2023-12-16T20:11:38.218 INFO:tasks.workunit.client.0.smithi038.stdout:4/797: fsync d13/d17/d4b/da4/d9d/db5/fd4 0 2023-12-16T20:11:38.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/950: rmdir d2/d14/d25/d2d/d17/da9/db0 39 2023-12-16T20:11:38.224 INFO:tasks.workunit.client.0.smithi038.stdout:4/798: creat d13/d69/f108 x:0 0 0 2023-12-16T20:11:38.228 INFO:tasks.workunit.client.0.smithi038.stdout:3/891: dread d4/f5 [0,4194304] 0 2023-12-16T20:11:38.228 INFO:tasks.workunit.client.0.smithi038.stdout:3/892: chown d4/d67/de1/d4c/lc6 3 1 2023-12-16T20:11:38.229 INFO:tasks.workunit.client.0.smithi038.stdout:4/799: mkdir d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/d109 0 2023-12-16T20:11:38.229 INFO:tasks.workunit.client.0.smithi038.stdout:4/800: write d13/d17/d2e/d32/d70/d84/d88/dc3/de9/fff [847872,90115] 0 2023-12-16T20:11:38.230 INFO:tasks.workunit.client.0.smithi038.stdout:3/893: unlink d4/dcd/fcf 0 2023-12-16T20:11:38.232 INFO:tasks.workunit.client.0.smithi038.stdout:4/801: dread d13/d17/d2e/d32/d4e/f59 [0,4194304] 0 2023-12-16T20:11:38.232 INFO:tasks.workunit.client.0.smithi038.stdout:4/802: write d13/d69/d7a/da5/f103 [443405,83315] 0 2023-12-16T20:11:38.233 INFO:tasks.workunit.client.0.smithi038.stdout:3/894: truncate d4/d8/d15/f56 2627295 0 2023-12-16T20:11:38.233 INFO:tasks.workunit.client.1.smithi141.stdout:3/620: rmdir d0/d1c/d40/d3f/d52/d5d 39 2023-12-16T20:11:38.237 INFO:tasks.workunit.client.0.smithi038.stdout:3/895: dread d4/f5 [4194304,4194304] 0 2023-12-16T20:11:38.238 INFO:tasks.workunit.client.0.smithi038.stdout:3/896: truncate d4/d8/d15/d6d/d7a/d98/fe2 1514179 0 2023-12-16T20:11:38.240 INFO:tasks.workunit.client.0.smithi038.stdout:3/897: rename d4/dab/cc9 to d4/d27/d2b/c13b 0 2023-12-16T20:11:38.240 INFO:tasks.workunit.client.0.smithi038.stdout:3/898: rmdir d4/dcd/d9a/dda/df1 39 2023-12-16T20:11:38.241 INFO:tasks.workunit.client.0.smithi038.stdout:3/899: symlink d4/d27/d23/d26/l13c 0 2023-12-16T20:11:38.241 INFO:tasks.workunit.client.0.smithi038.stdout:3/900: dread - d4/d67/de1/d4c/dae/fa2 zero size 2023-12-16T20:11:38.242 INFO:tasks.workunit.client.0.smithi038.stdout:3/901: truncate d4/d27/d2b/f35 3678573 0 2023-12-16T20:11:38.243 INFO:tasks.workunit.client.0.smithi038.stdout:3/902: mkdir d4/d27/d23/d13d 0 2023-12-16T20:11:38.243 INFO:tasks.workunit.client.0.smithi038.stdout:3/903: fsync d4/d18/f4b 0 2023-12-16T20:11:38.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/904: creat d4/d27/f13e x:0 0 0 2023-12-16T20:11:38.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/905: rmdir d4/dcd/d9a/dda 39 2023-12-16T20:11:38.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/906: truncate d4/d27/d2b/d64/f72 4357792 0 2023-12-16T20:11:38.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/907: dread - d4/dab/fb8 zero size 2023-12-16T20:11:38.247 INFO:tasks.workunit.client.0.smithi038.stdout:3/908: link d4/d8/l5c d4/d67/de1/d4c/dae/l13f 0 2023-12-16T20:11:38.247 INFO:tasks.workunit.client.0.smithi038.stdout:3/909: creat d4/dab/f140 x:0 0 0 2023-12-16T20:11:38.247 INFO:tasks.workunit.client.0.smithi038.stdout:3/910: stat d4/d27/d2b/f32 0 2023-12-16T20:11:38.248 INFO:tasks.workunit.client.0.smithi038.stdout:3/911: truncate d4/f17 4987776 0 2023-12-16T20:11:38.261 INFO:tasks.workunit.client.1.smithi141.stdout:9/511: creat d1/d10/d14/d20/da/d3f/d8a/fb4 x:0 0 0 2023-12-16T20:11:38.262 INFO:tasks.workunit.client.0.smithi038.stdout:8/758: dwrite d17/d1b/d57/f74 [0,4194304] 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:6/779: dwrite d1/f19 [4194304,4194304] 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/857: dwrite d15/d1e/d3b/d48/d37/deb/d107/f10e [0,4194304] 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:6/780: fsync d1/d5b/d7d/d9d/f6a 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/858: fsync d15/d1e/d3b/d117/d34/d86/d99/fea 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/859: truncate d15/d1e/d3b/d117/d34/fbe 1308330 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/860: creat d15/d1e/d3b/d48/d37/deb/d107/f126 x:0 0 0 2023-12-16T20:11:38.264 INFO:tasks.workunit.client.0.smithi038.stdout:1/861: chown d15/d1e/c100 13 1 2023-12-16T20:11:38.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/969: dwrite d1/d5/d3d/d115/f146 [0,4194304] 0 2023-12-16T20:11:38.265 INFO:tasks.workunit.client.0.smithi038.stdout:4/803: dread d13/d17/d2e/d32/d70/db2/fc9 [0,4194304] 0 2023-12-16T20:11:38.265 INFO:tasks.workunit.client.0.smithi038.stdout:4/804: truncate d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/fdc 519244 0 2023-12-16T20:11:38.265 INFO:tasks.workunit.client.0.smithi038.stdout:0/820: dwrite f5 [0,4194304] 0 2023-12-16T20:11:38.265 INFO:tasks.workunit.client.0.smithi038.stdout:8/759: mknod d17/d1b/d25/db7/d82/daa/cf1 0 2023-12-16T20:11:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.264+0000 7fd9eb59e700 1 -- 172.21.15.38:0/1054274832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fcb20 msgr2=0x7fd9ec0fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.264+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/1054274832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec0fcf70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc004940 tx=0x7fd9dc009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.266+0000 7fd9eb59e700 1 -- 172.21.15.38:0/1054274832 shutdown_connections 2023-12-16T20:11:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.266+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/1054274832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec0fcf70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.266+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/1054274832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fb910 0x7fd9ec0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.266+0000 7fd9eb59e700 1 -- 172.21.15.38:0/1054274832 >> 172.21.15.38:0/1054274832 conn(0x7fd9ec0f6fb0 msgr2=0x7fd9ec0f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:38.268 INFO:tasks.workunit.client.0.smithi038.stdout:6/781: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/ffc x:0 0 0 2023-12-16T20:11:38.268 INFO:tasks.workunit.client.0.smithi038.stdout:6/782: read - d1/d16/feb zero size 2023-12-16T20:11:38.268 INFO:tasks.workunit.client.0.smithi038.stdout:6/783: dread - d1/d4/d1d/d67/d73/f98 zero size 2023-12-16T20:11:38.268 INFO:tasks.workunit.client.0.smithi038.stdout:6/784: chown d1/fa8 8688734 1 2023-12-16T20:11:38.269 INFO:tasks.workunit.client.1.smithi141.stdout:7/524: rename d5/d16/d30/d4e/d6e/fa5 to d5/d16/d46/fa7 0 2023-12-16T20:11:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.269+0000 7fd9eb59e700 1 -- 172.21.15.38:0/1054274832 shutdown_connections 2023-12-16T20:11:38.270 INFO:tasks.workunit.client.0.smithi038.stdout:1/862: creat d15/d1e/d3b/d117/d34/d86/d9a/d11a/f127 x:0 0 0 2023-12-16T20:11:38.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.269+0000 7fd9eb59e700 1 -- 172.21.15.38:0/1054274832 wait complete. 2023-12-16T20:11:38.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 Processor -- start 2023-12-16T20:11:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 -- start start 2023-12-16T20:11:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fb910 0x7fd9ec06a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec06af20 con 0x7fd9ec0fb910 2023-12-16T20:11:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.270+0000 7fd9eb59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec06b730 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.273 INFO:tasks.workunit.client.0.smithi038.stdout:9/867: dwrite d9/d1f/d21/d84/fb3 [0,4194304] 0 2023-12-16T20:11:38.273 INFO:tasks.workunit.client.0.smithi038.stdout:4/805: symlink d13/d17/d2e/d32/d70/l10a 0 2023-12-16T20:11:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.272+0000 7fd9ea59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fb910 0x7fd9ec06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.272+0000 7fd9e9d9b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.272+0000 7fd9e9d9b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:40048/0 (socket says 172.21.15.38:40048) 2023-12-16T20:11:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.272+0000 7fd9e9d9b700 1 -- 172.21.15.38:0/3445130456 learned_addr learned my addr 172.21.15.38:0/3445130456 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:38.274 INFO:tasks.workunit.client.0.smithi038.stdout:8/760: creat d17/d1b/d66/d73/ff2 x:0 0 0 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.273+0000 7fd9e9d9b700 1 -- 172.21.15.38:0/3445130456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fb910 msgr2=0x7fd9ec06a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.273+0000 7fd9e9d9b700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fb910 0x7fd9ec06a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.273+0000 7fd9e9d9b700 1 -- 172.21.15.38:0/3445130456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc005040 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.274+0000 7fd9e9d9b700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00bbd0 tx=0x7fd9dc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.275+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9dc00e030 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.275+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd9dc0138d0 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.278 INFO:tasks.workunit.client.0.smithi038.stdout:1/863: rename d15/d1e/d3b/f77 to d15/d1e/d3b/d117/d7d/f128 0 2023-12-16T20:11:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.275+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec06b9b0 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.275+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec06bef0 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.276+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9dc01c710 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.279 INFO:tasks.workunit.client.0.smithi038.stdout:4/806: mknod d13/c10b 0 2023-12-16T20:11:38.279 INFO:tasks.workunit.client.0.smithi038.stdout:4/807: readlink lf 0 2023-12-16T20:11:38.279 INFO:tasks.workunit.client.0.smithi038.stdout:4/808: dread - d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/d101/f104 zero size 2023-12-16T20:11:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.278+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 24) v1 ==== 45730+0+0 (secure 0 0 0) 0x7fd9dc01c870 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.278+0000 7fd9daffd700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 0x7fd9d403ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.278+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd9dc04ec70 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.280 INFO:tasks.workunit.client.1.smithi141.stdout:3/621: dwrite d0/f6 [0,4194304] 0 2023-12-16T20:11:38.280 INFO:tasks.workunit.client.0.smithi038.stdout:8/761: link d17/d1b/d25/db7/d82/da9/d50/f67 d17/d1b/d66/d73/d9e/ff3 0 2023-12-16T20:11:38.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.280+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc0052e0 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.282 INFO:tasks.workunit.client.0.smithi038.stdout:4/809: link d13/d17/d4b/laa d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/dee/l10c 0 2023-12-16T20:11:38.282 INFO:tasks.workunit.client.0.smithi038.stdout:4/810: rmdir d13/d17/d4b/d7d/dc0 39 2023-12-16T20:11:38.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.282+0000 7fd9ea59c700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 0x7fd9d403ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.284 INFO:tasks.workunit.client.0.smithi038.stdout:4/811: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/f10d x:0 0 0 2023-12-16T20:11:38.284 INFO:tasks.workunit.client.0.smithi038.stdout:4/812: fsync d13/d17/d2e/d32/d7c/fa8 0 2023-12-16T20:11:38.284 INFO:tasks.workunit.client.1.smithi141.stdout:0/535: link d4/d49/da1/lab d4/d49/d73/d3b/d78/d7f/d80/d83/db5/lba 0 2023-12-16T20:11:38.285 INFO:tasks.workunit.client.0.smithi038.stdout:4/813: creat d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/dee/f10e x:0 0 0 2023-12-16T20:11:38.286 INFO:tasks.workunit.client.0.smithi038.stdout:1/864: dread d15/d1e/d3b/d48/d3d/fd3 [0,4194304] 0 2023-12-16T20:11:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.286+0000 7fd9ea59c700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 0x7fd9d403ad00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0006fd0 tx=0x7fd9e0008040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:38.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/911: dwrite da/dcf/d100/d4d/dc5/d38/fc6 [0,4194304] 0 2023-12-16T20:11:38.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/912: readlink da/d21/d86/de2/d10f/l114 0 2023-12-16T20:11:38.288 INFO:tasks.workunit.client.0.smithi038.stdout:1/865: mknod d15/d1e/d3b/d48/d37/dde/d75/c129 0 2023-12-16T20:11:38.288 INFO:tasks.workunit.client.0.smithi038.stdout:1/866: fdatasync d15/d1e/d3b/d117/d34/d86/d9a/d11a/f127 0 2023-12-16T20:11:38.289 INFO:tasks.workunit.client.0.smithi038.stdout:0/821: mkdir db/d16/d70/d7c/d107 0 2023-12-16T20:11:38.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.289+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd9dc020070 con 0x7fd9ec0fcb20 2023-12-16T20:11:38.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/970: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/fe5 [0,4194304] 0 2023-12-16T20:11:38.294 INFO:tasks.workunit.client.1.smithi141.stdout:3/622: dread d0/d1c/d40/d3f/d52/f75 [0,4194304] 0 2023-12-16T20:11:38.296 INFO:tasks.workunit.client.1.smithi141.stdout:1/563: link da/d36/d4b/d4d/d89/d61/f71 da/fbd 0 2023-12-16T20:11:38.297 INFO:tasks.workunit.client.1.smithi141.stdout:0/536: read d4/d49/d73/d8a/f91 [353657,127846] 0 2023-12-16T20:11:38.297 INFO:tasks.workunit.client.1.smithi141.stdout:0/537: write d4/d74/d85/fa0 [629808,1125] 0 2023-12-16T20:11:38.297 INFO:tasks.workunit.client.1.smithi141.stdout:4/466: sync 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.1.smithi141.stdout:4/467: truncate fd 3255749 0 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.1.smithi141.stdout:4/468: readlink d1a/d3c/l41 0 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.1.smithi141.stdout:4/469: dread - d1a/d2a/f53 zero size 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.1.smithi141.stdout:4/470: getdents d1a/d3c/d9b/da1/da6 0 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/785: dwrite d1/d5b/d7d/d9d/dc8/de7/f69 [0,4194304] 0 2023-12-16T20:11:38.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/786: fsync d1/d5b/f76 0 2023-12-16T20:11:38.299 INFO:tasks.workunit.client.1.smithi141.stdout:2/374: unlink d6/d12/d1f/c2d 0 2023-12-16T20:11:38.301 INFO:tasks.workunit.client.1.smithi141.stdout:7/525: creat d5/fa8 x:0 0 0 2023-12-16T20:11:38.301 INFO:tasks.workunit.client.0.smithi038.stdout:7/913: write da/dcf/d100/d4d/dc5/f43 [3958445,127025] 0 2023-12-16T20:11:38.303 INFO:tasks.workunit.client.0.smithi038.stdout:3/912: rmdir d4/d8/d15/d6d 39 2023-12-16T20:11:38.304 INFO:tasks.workunit.client.1.smithi141.stdout:6/540: rename d1/d12/l8e to d1/d5e/lad 0 2023-12-16T20:11:38.304 INFO:tasks.workunit.client.1.smithi141.stdout:6/541: truncate d1/d77/fac 389270 0 2023-12-16T20:11:38.305 INFO:tasks.workunit.client.0.smithi038.stdout:7/914: getdents da/d21/d86/de2/d10f 0 2023-12-16T20:11:38.307 INFO:tasks.workunit.client.0.smithi038.stdout:2/971: read d1/d5/d95/d61/dd4/d6a/d43/f126 [74864,120462] 0 2023-12-16T20:11:38.311 INFO:tasks.workunit.client.1.smithi141.stdout:3/623: truncate d0/d1c/d40/d3f/d52/f75 16656 0 2023-12-16T20:11:38.315 INFO:tasks.workunit.client.1.smithi141.stdout:1/564: creat da/d1a/d1d/d33/d7f/fbe x:0 0 0 2023-12-16T20:11:38.315 INFO:tasks.workunit.client.1.smithi141.stdout:1/565: write da/d36/f8d [417753,118281] 0 2023-12-16T20:11:38.317 INFO:tasks.workunit.client.0.smithi038.stdout:3/913: mknod d4/dcd/dcc/c141 0 2023-12-16T20:11:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:3/914: readlink d4/d67/de1/d7d/laa 0 2023-12-16T20:11:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:3/915: creat d4/dab/f142 x:0 0 0 2023-12-16T20:11:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:2/972: mkdir d1/d73/d147 0 2023-12-16T20:11:38.319 INFO:tasks.workunit.client.0.smithi038.stdout:2/973: write d1/d5/d3d/ddc/f118 [4731100,83300] 0 2023-12-16T20:11:38.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/974: mknod d1/d5/d95/d61/dd4/d6a/dfb/c148 0 2023-12-16T20:11:38.323 INFO:tasks.workunit.client.0.smithi038.stdout:2/975: mknod d1/d5/d2a/d31/d60/ded/dee/c149 0 2023-12-16T20:11:38.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/526: creat d5/d2a/fa9 x:0 0 0 2023-12-16T20:11:38.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/527: stat d5/d16/d46/c49 0 2023-12-16T20:11:38.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/528: creat d5/d2a/faa x:0 0 0 2023-12-16T20:11:38.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/529: write d5/d1d/d89/fa6 [735770,13652] 0 2023-12-16T20:11:38.325 INFO:tasks.workunit.client.1.smithi141.stdout:7/530: dread - d5/d1d/d1e/f98 zero size 2023-12-16T20:11:38.325 INFO:tasks.workunit.client.1.smithi141.stdout:7/531: dread - d5/d2a/fa9 zero size 2023-12-16T20:11:38.325 INFO:tasks.workunit.client.0.smithi038.stdout:2/976: unlink d1/d5/d95/d61/dd4/d21/d82/c128 0 2023-12-16T20:11:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/977: mknod d1/d5/d95/d61/dd4/d21/d9a/db9/c14a 0 2023-12-16T20:11:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/978: readlink d1/d5/d16/l80 0 2023-12-16T20:11:38.326 INFO:tasks.workunit.client.0.smithi038.stdout:6/787: dread d1/d4/d1d/f60 [0,4194304] 0 2023-12-16T20:11:38.332 INFO:tasks.workunit.client.0.smithi038.stdout:1/867: rename d15/d1e/d3b/d48/d37/deb/d107 to d15/d1e/d30/d95/d12a 0 2023-12-16T20:11:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:6/788: rmdir d1/d5b/d7d/d9d 39 2023-12-16T20:11:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:6/789: creat d1/d16/d23/d5f/ffd x:0 0 0 2023-12-16T20:11:38.337 INFO:tasks.workunit.client.0.smithi038.stdout:6/790: getdents d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2 0 2023-12-16T20:11:38.339 INFO:tasks.workunit.client.1.smithi141.stdout:4/471: write fa [719373,68397] 0 2023-12-16T20:11:38.340 INFO:tasks.workunit.client.0.smithi038.stdout:1/868: mkdir d15/d1e/d3b/d117/d46/d12b 0 2023-12-16T20:11:38.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/915: dwrite da/dcf/d100/d4d/dc5/d38/d65/d81/fcb [0,4194304] 0 2023-12-16T20:11:38.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/916: truncate da/f1d 591174 0 2023-12-16T20:11:38.344 INFO:tasks.workunit.client.1.smithi141.stdout:8/502: rename d14/f25 to d14/d19/d1b/d24/d4a/d58/d8b/f9e 0 2023-12-16T20:11:38.344 INFO:tasks.workunit.client.0.smithi038.stdout:6/791: mknod d1/d4/d1d/d8e/cfe 0 2023-12-16T20:11:38.344 INFO:tasks.workunit.client.0.smithi038.stdout:6/792: stat d1/d4/d1d/d67/d73 0 2023-12-16T20:11:38.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/869: chown d15/d1e/d3b/d48/d37/dde/l76 175 1 2023-12-16T20:11:38.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/917: dread da/d21/d61/dcd/f7b [0,4194304] 0 2023-12-16T20:11:38.349 INFO:tasks.workunit.client.1.smithi141.stdout:8/503: dread d14/d19/d1b/d3d/f37 [0,4194304] 0 2023-12-16T20:11:38.349 INFO:tasks.workunit.client.1.smithi141.stdout:8/504: stat d14/f94 0 2023-12-16T20:11:38.359 INFO:tasks.workunit.client.1.smithi141.stdout:2/375: mknod d6/d12/d15/c7d 0 2023-12-16T20:11:38.359 INFO:tasks.workunit.client.1.smithi141.stdout:2/376: fdatasync d6/d32/f57 0 2023-12-16T20:11:38.362 INFO:tasks.workunit.client.0.smithi038.stdout:3/916: dread d4/f17 [0,4194304] 0 2023-12-16T20:11:38.368 INFO:tasks.workunit.client.0.smithi038.stdout:0/822: dwrite db/d16/d19/d4e/d106/d65/de8/f73 [4194304,4194304] 0 2023-12-16T20:11:38.372 INFO:tasks.workunit.client.0.smithi038.stdout:2/979: dwrite d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f56 [0,4194304] 0 2023-12-16T20:11:38.376 INFO:tasks.workunit.client.1.smithi141.stdout:7/532: mkdir d5/d16/d1a/d40/dab 0 2023-12-16T20:11:38.384 INFO:tasks.workunit.client.1.smithi141.stdout:5/436: rename d0/d14/d2c/d4a/f61 to d0/d25/f96 0 2023-12-16T20:11:38.388 INFO:tasks.workunit.client.0.smithi038.stdout:2/980: dread d1/d5/d95/d61/dd4/d21/d82/d92/fc9 [0,4194304] 0 2023-12-16T20:11:38.389 INFO:tasks.workunit.client.0.smithi038.stdout:2/981: chown d1/d5/d95/d61/dd4/d6d/d72/f10a 34 1 2023-12-16T20:11:38.391 INFO:tasks.workunit.client.1.smithi141.stdout:8/505: getdents d14/d19/d1b 0 2023-12-16T20:11:38.391 INFO:tasks.workunit.client.1.smithi141.stdout:8/506: creat d14/d35/f9f x:0 0 0 2023-12-16T20:11:38.399 INFO:tasks.workunit.client.1.smithi141.stdout:4/472: dread f9 [0,4194304] 0 2023-12-16T20:11:38.403 INFO:tasks.workunit.client.0.smithi038.stdout:0/823: mkdir db/d16/d19/d4e/d106/d65/d108 0 2023-12-16T20:11:38.408 INFO:tasks.workunit.client.1.smithi141.stdout:2/377: mkdir d6/d32/d7a/d7e 0 2023-12-16T20:11:38.408 INFO:tasks.workunit.client.1.smithi141.stdout:2/378: fdatasync d6/d32/f64 0 2023-12-16T20:11:38.410 INFO:tasks.workunit.client.0.smithi038.stdout:0/824: dread db/d16/d1c/f62 [0,4194304] 0 2023-12-16T20:11:38.410 INFO:tasks.workunit.client.0.smithi038.stdout:0/825: truncate db/d16/d19/d4e/f9d 4744645 0 2023-12-16T20:11:38.410 INFO:tasks.workunit.client.0.smithi038.stdout:0/826: dread - db/d16/d19/d80/ff6 zero size 2023-12-16T20:11:38.418 INFO:tasks.workunit.client.0.smithi038.stdout:6/793: dwrite d1/f2c [0,4194304] 0 2023-12-16T20:11:38.419 INFO:tasks.workunit.client.0.smithi038.stdout:6/794: chown d1/f45 32262670 1 2023-12-16T20:11:38.420 INFO:tasks.workunit.client.1.smithi141.stdout:3/624: rename d0/d1c/d40/d85/d4c/fbb to d0/d1c/d2c/d72/d74/d8b/fcb 0 2023-12-16T20:11:38.423 INFO:tasks.workunit.client.0.smithi038.stdout:0/827: mknod db/d16/d19/d4e/c109 0 2023-12-16T20:11:38.424 INFO:tasks.workunit.client.1.smithi141.stdout:8/507: creat d14/d19/d1b/d24/fa0 x:0 0 0 2023-12-16T20:11:38.425 INFO:tasks.workunit.client.1.smithi141.stdout:8/508: write d14/d19/d1b/d24/d4b/f62 [42180,75554] 0 2023-12-16T20:11:38.425 INFO:tasks.workunit.client.1.smithi141.stdout:8/509: write d14/d19/d1b/d24/d4a/f9b [767960,120134] 0 2023-12-16T20:11:38.426 INFO:tasks.workunit.client.1.smithi141.stdout:6/542: dwrite d1/f9c [0,4194304] 0 2023-12-16T20:11:38.427 INFO:tasks.workunit.client.1.smithi141.stdout:6/543: write d1/f19 [126047,54076] 0 2023-12-16T20:11:38.427 INFO:tasks.workunit.client.1.smithi141.stdout:4/473: unlink c7 0 2023-12-16T20:11:38.427 INFO:tasks.workunit.client.1.smithi141.stdout:4/474: dread - d1a/d54/d87/da8/f97 zero size 2023-12-16T20:11:38.427 INFO:tasks.workunit.client.1.smithi141.stdout:4/475: stat d1a/d59/l8e 0 2023-12-16T20:11:38.427 INFO:tasks.workunit.client.1.smithi141.stdout:5/437: dwrite d0/d43/f7e [0,4194304] 0 2023-12-16T20:11:38.428 INFO:tasks.workunit.client.1.smithi141.stdout:2/379: creat d6/da/d33/d54/f7f x:0 0 0 2023-12-16T20:11:38.428 INFO:tasks.workunit.client.0.smithi038.stdout:3/917: dwrite d4/f5 [0,4194304] 0 2023-12-16T20:11:38.429 INFO:tasks.workunit.client.0.smithi038.stdout:0/828: truncate db/d16/d19/d4e/d106/d65/de8/f7a 3276108 0 2023-12-16T20:11:38.429 INFO:tasks.workunit.client.1.smithi141.stdout:0/538: dwrite d4/d74/d85/fa0 [0,4194304] 0 2023-12-16T20:11:38.429 INFO:tasks.workunit.client.1.smithi141.stdout:1/566: dwrite da/d36/d4b/d4d/d80/fa1 [0,4194304] 0 2023-12-16T20:11:38.429 INFO:tasks.workunit.client.1.smithi141.stdout:0/539: creat d4/d49/d73/d3b/d78/fbb x:0 0 0 2023-12-16T20:11:38.431 INFO:tasks.workunit.client.1.smithi141.stdout:8/510: rmdir d14/d19/d1b/d24/d4a/d58/d8b 39 2023-12-16T20:11:38.431 INFO:tasks.workunit.client.1.smithi141.stdout:6/544: dread d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:38.432 INFO:tasks.workunit.client.0.smithi038.stdout:0/829: truncate db/d16/d19/d4e/d106/d65/de8/d77/d95/da4/fbe 424621 0 2023-12-16T20:11:38.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/830: link db/d16/fa0 db/d16/d70/d7c/f10a 0 2023-12-16T20:11:38.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/831: mknod db/d16/d19/d4e/d106/d65/de8/d77/c10b 0 2023-12-16T20:11:38.444 INFO:tasks.workunit.client.1.smithi141.stdout:4/476: dread d1a/d2a/d3b/d69/f95 [0,4194304] 0 2023-12-16T20:11:38.445 INFO:tasks.workunit.client.1.smithi141.stdout:6/545: dwrite d1/d12/d20/d3a/f80 [0,4194304] 0 2023-12-16T20:11:38.447 INFO:tasks.workunit.client.1.smithi141.stdout:5/438: write d0/d25/f2e [9527268,28276] 0 2023-12-16T20:11:38.447 INFO:tasks.workunit.client.1.smithi141.stdout:7/533: dwrite d5/d16/f83 [0,4194304] 0 2023-12-16T20:11:38.447 INFO:tasks.workunit.client.1.smithi141.stdout:5/439: chown d0/d25/d30/l69 94144665 1 2023-12-16T20:11:38.454 INFO:tasks.workunit.client.0.smithi038.stdout:0/832: write db/d16/d19/f98 [323163,29646] 0 2023-12-16T20:11:38.454 INFO:tasks.workunit.client.0.smithi038.stdout:0/833: dread - db/d16/d19/d27/ff3 zero size 2023-12-16T20:11:38.455 INFO:tasks.workunit.client.1.smithi141.stdout:1/567: mkdir da/d36/d4b/d4d/d89/d6c/dbf 0 2023-12-16T20:11:38.463 INFO:tasks.workunit.client.0.smithi038.stdout:0/834: truncate db/d16/d1c/f72 2039249 0 2023-12-16T20:11:38.464 INFO:tasks.workunit.client.0.smithi038.stdout:0/835: write db/d16/d1c/f32 [669400,44693] 0 2023-12-16T20:11:38.465 INFO:tasks.workunit.client.1.smithi141.stdout:8/511: rename d14/d19/d1b/l1d to d14/d19/d1b/la1 0 2023-12-16T20:11:38.467 INFO:tasks.workunit.client.1.smithi141.stdout:5/440: dwrite d0/d25/d30/d67/f58 [0,4194304] 0 2023-12-16T20:11:38.471 INFO:tasks.workunit.client.0.smithi038.stdout:0/836: unlink db/d16/d19/d27/f4c 0 2023-12-16T20:11:38.472 INFO:tasks.workunit.client.1.smithi141.stdout:2/380: rmdir d6/d3a/d47/d58/d66 39 2023-12-16T20:11:38.472 INFO:tasks.workunit.client.1.smithi141.stdout:2/381: truncate d6/d3a/d47/d58/d66/f7b 660427 0 2023-12-16T20:11:38.472 INFO:tasks.workunit.client.1.smithi141.stdout:2/382: chown d6/da/d1b/d5b/f78 243011212 1 2023-12-16T20:11:38.472 INFO:tasks.workunit.client.1.smithi141.stdout:2/383: chown d6/d12/d1f/l25 3 1 2023-12-16T20:11:38.472 INFO:tasks.workunit.client.1.smithi141.stdout:2/384: fsync d6/d12/f29 0 2023-12-16T20:11:38.477 INFO:tasks.workunit.client.0.smithi038.stdout:0/837: unlink db/l94 0 2023-12-16T20:11:38.480 INFO:tasks.workunit.client.1.smithi141.stdout:4/477: truncate d1a/d2a/d3b/f7f 758395 0 2023-12-16T20:11:38.482 INFO:tasks.workunit.client.1.smithi141.stdout:1/568: dwrite da/d1a/d1d/d33/d7f/fbe [0,4194304] 0 2023-12-16T20:11:38.483 INFO:tasks.workunit.client.1.smithi141.stdout:6/546: symlink d1/d12/d22/d25/lae 0 2023-12-16T20:11:38.498 INFO:tasks.workunit.client.0.smithi038.stdout:7/918: truncate da/d21/d2c/f30 2614175 0 2023-12-16T20:11:38.498 INFO:tasks.workunit.client.0.smithi038.stdout:7/919: write da/d21/d86/fb0 [9392135,6969] 0 2023-12-16T20:11:38.508 INFO:tasks.workunit.client.0.smithi038.stdout:2/982: mkdir d1/d5/d95/d61/dd4/d6d/d14b 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:2/983: fsync d1/d5/f145 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/918: symlink d4/d6c/l143 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/919: write d4/d8/f16 [4800225,29600] 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:1/870: rename d15/d22/d7b/cee to d15/c12c 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:1/871: getdents d15/d1e/d3b/d48/d37/dde/dcf 0 2023-12-16T20:11:38.509 INFO:tasks.workunit.client.0.smithi038.stdout:0/838: dwrite db/d16/d19/d4e/d106/d65/de8/f73 [0,4194304] 0 2023-12-16T20:11:38.510 INFO:tasks.workunit.client.0.smithi038.stdout:7/920: symlink da/d21/d61/dcd/d6b/l130 0 2023-12-16T20:11:38.510 INFO:tasks.workunit.client.1.smithi141.stdout:4/478: dwrite f9 [0,4194304] 0 2023-12-16T20:11:38.517 INFO:tasks.workunit.client.1.smithi141.stdout:7/534: rename d5/d16/d30/c65 to d5/cac 0 2023-12-16T20:11:38.517 INFO:tasks.workunit.client.1.smithi141.stdout:2/385: mkdir d6/da/d33/d54/d73/d80 0 2023-12-16T20:11:38.517 INFO:tasks.workunit.client.1.smithi141.stdout:5/441: unlink d0/d9/d16/d2a/c45 0 2023-12-16T20:11:38.517 INFO:tasks.workunit.client.1.smithi141.stdout:2/386: readlink d6/d12/l56 0 2023-12-16T20:11:38.517 INFO:tasks.workunit.client.1.smithi141.stdout:2/387: chown d6/da/d1b/f27 70916 1 2023-12-16T20:11:38.520 INFO:tasks.workunit.client.0.smithi038.stdout:7/921: write da/d21/d2c/d76/d9a/f111 [3980801,673] 0 2023-12-16T20:11:38.521 INFO:tasks.workunit.client.0.smithi038.stdout:2/984: dread d1/d5/d95/d61/dd4/d6a/d43/d57/f5a [0,4194304] 0 2023-12-16T20:11:38.521 INFO:tasks.workunit.client.1.smithi141.stdout:8/512: dwrite d14/d19/d1b/d3d/f76 [0,4194304] 0 2023-12-16T20:11:38.524 INFO:tasks.workunit.client.0.smithi038.stdout:2/985: mknod d1/d5/d95/d61/dd4/d6d/d72/c14c 0 2023-12-16T20:11:38.524 INFO:tasks.workunit.client.0.smithi038.stdout:2/986: readlink d1/d5/d95/d61/dd4/d21/d9a/db9/lbf 0 2023-12-16T20:11:38.525 INFO:tasks.workunit.client.1.smithi141.stdout:1/569: creat da/d1a/d31/d81/db6/fc0 x:0 0 0 2023-12-16T20:11:38.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/987: mknod d1/d5/c14d 0 2023-12-16T20:11:38.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/988: write d1/d5/d95/fb4 [903309,74928] 0 2023-12-16T20:11:38.530 INFO:tasks.workunit.client.0.smithi038.stdout:1/872: write d15/d1e/d30/d95/d12a/f10e [776677,78945] 0 2023-12-16T20:11:38.531 INFO:tasks.workunit.client.0.smithi038.stdout:0/839: unlink db/d16/d19/f4b 0 2023-12-16T20:11:38.536 INFO:tasks.workunit.client.1.smithi141.stdout:6/547: creat d1/d12/d22/d25/d38/faf x:0 0 0 2023-12-16T20:11:38.536 INFO:tasks.workunit.client.1.smithi141.stdout:4/479: symlink d1a/d59/lb1 0 2023-12-16T20:11:38.538 INFO:tasks.workunit.client.1.smithi141.stdout:8/513: read d14/d19/d1b/d24/f28 [868685,28635] 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.1.smithi141.stdout:4/480: read d1a/f32 [1713726,115529] 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.1.smithi141.stdout:4/481: fsync d1a/d54/d87/da8/f99 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.1.smithi141.stdout:4/482: fsync d1a/d4e/f56 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.1.smithi141.stdout:4/483: chown d1a/d2a/d3b/d69/fa0 90391 1 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.0.smithi038.stdout:2/989: symlink d1/d5/d95/d61/dd4/d6a/d7a/l14e 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.0.smithi038.stdout:1/873: creat d15/d1e/d3b/d48/d37/dde/f12d x:0 0 0 2023-12-16T20:11:38.541 INFO:tasks.workunit.client.0.smithi038.stdout:1/874: write d15/d22/d52/f91 [889738,262] 0 2023-12-16T20:11:38.547 INFO:tasks.workunit.client.1.smithi141.stdout:4/484: dread d1a/f9c [0,4194304] 0 2023-12-16T20:11:38.550 INFO:tasks.workunit.client.0.smithi038.stdout:2/990: dread d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/f134 [0,4194304] 0 2023-12-16T20:11:38.552 INFO:tasks.workunit.client.0.smithi038.stdout:3/920: dwrite d4/d27/d2b/ffa [0,4194304] 0 2023-12-16T20:11:38.552 INFO:tasks.workunit.client.1.smithi141.stdout:7/535: creat d5/d1d/d1e/d71/d96/fad x:0 0 0 2023-12-16T20:11:38.554 INFO:tasks.workunit.client.0.smithi038.stdout:3/921: rmdir d4/d18 39 2023-12-16T20:11:38.555 INFO:tasks.workunit.client.0.smithi038.stdout:3/922: symlink d4/d8/l144 0 2023-12-16T20:11:38.555 INFO:tasks.workunit.client.0.smithi038.stdout:3/923: read d4/d27/d23/f57 [1866309,100777] 0 2023-12-16T20:11:38.557 INFO:tasks.workunit.client.1.smithi141.stdout:5/442: rename d0/d9/f86 to d0/d25/d30/f97 0 2023-12-16T20:11:38.557 INFO:tasks.workunit.client.0.smithi038.stdout:3/924: mknod d4/d27/d23/d26/c145 0 2023-12-16T20:11:38.558 INFO:tasks.workunit.client.0.smithi038.stdout:1/875: dread d15/d1e/d3b/d117/d46/f63 [4194304,4194304] 0 2023-12-16T20:11:38.561 INFO:tasks.workunit.client.0.smithi038.stdout:3/925: symlink d4/dcd/d107/l146 0 2023-12-16T20:11:38.564 INFO:tasks.workunit.client.0.smithi038.stdout:1/876: truncate d15/d22/f6d 139126 0 2023-12-16T20:11:38.566 INFO:tasks.workunit.client.0.smithi038.stdout:6/795: dwrite d1/d5b/d7d/d9d/dc8/de7/f69 [4194304,4194304] 0 2023-12-16T20:11:38.566 INFO:tasks.workunit.client.0.smithi038.stdout:6/796: stat d1/d16/cb 0 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/548: symlink d1/d12/d22/d25/d38/lb0 0 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/549: creat d1/d12/d20/d44/fb1 x:0 0 0 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/550: readlink d1/d12/d22/d25/lae 0 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/551: readlink d1/d12/d20/d3a/l62 0 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/552: chown d1/c9f 3 1 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/553: dread - d1/d12/d22/d25/d38/faf zero size 2023-12-16T20:11:38.567 INFO:tasks.workunit.client.1.smithi141.stdout:6/554: write d1/d12/d20/d44/fb1 [804789,108523] 0 2023-12-16T20:11:38.568 INFO:tasks.workunit.client.0.smithi038.stdout:6/797: mknod d1/d4/d1d/d8e/cff 0 2023-12-16T20:11:38.571 INFO:tasks.workunit.client.0.smithi038.stdout:7/922: dwrite da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/f124 [0,4194304] 0 2023-12-16T20:11:38.571 INFO:tasks.workunit.client.0.smithi038.stdout:7/923: stat da/d21/d61/d12e/l11c 0 2023-12-16T20:11:38.571 INFO:tasks.workunit.client.0.smithi038.stdout:7/924: truncate da/d21/d61/f9d 515517 0 2023-12-16T20:11:38.571 INFO:tasks.workunit.client.1.smithi141.stdout:1/570: dwrite da/d1a/d1d/d22/f69 [0,4194304] 0 2023-12-16T20:11:38.572 INFO:tasks.workunit.client.1.smithi141.stdout:4/485: unlink d1a/d2a/l33 0 2023-12-16T20:11:38.572 INFO:tasks.workunit.client.0.smithi038.stdout:6/798: link d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/ffc d1/d4/f100 0 2023-12-16T20:11:38.572 INFO:tasks.workunit.client.0.smithi038.stdout:6/799: creat d1/d4/d1d/d8e/d91/f101 x:0 0 0 2023-12-16T20:11:38.572 INFO:tasks.workunit.client.0.smithi038.stdout:1/877: dread d15/d1e/d3b/d48/d37/f40 [0,4194304] 0 2023-12-16T20:11:38.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/840: dwrite db/d16/d19/d4e/d106/d65/de8/fcf [0,4194304] 0 2023-12-16T20:11:38.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/841: chown db/d16/d19/d80/fbd 10420375 1 2023-12-16T20:11:38.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/842: readlink db/d16/d70/ld1 0 2023-12-16T20:11:38.575 INFO:tasks.workunit.client.0.smithi038.stdout:7/925: creat da/d21/d86/f131 x:0 0 0 2023-12-16T20:11:38.577 INFO:tasks.workunit.client.1.smithi141.stdout:7/536: mkdir d5/d2a/d45/dae 0 2023-12-16T20:11:38.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/800: link d1/d4/c3a d1/d4/d1d/d61/da4/c102 0 2023-12-16T20:11:38.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/801: truncate d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fe9 822400 0 2023-12-16T20:11:38.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/802: dread - d1/d5b/d7d/dc6/fd7 zero size 2023-12-16T20:11:38.579 INFO:tasks.workunit.client.0.smithi038.stdout:1/878: mkdir d15/d22/d62/d12e 0 2023-12-16T20:11:38.579 INFO:tasks.workunit.client.0.smithi038.stdout:1/879: chown d15/d1e/f4c 5823438 1 2023-12-16T20:11:38.584 INFO:tasks.workunit.client.0.smithi038.stdout:7/926: link f5 da/d21/d2c/d76/f132 0 2023-12-16T20:11:38.584 INFO:tasks.workunit.client.0.smithi038.stdout:7/927: write da/dcf/d100/d4d/fd2 [728573,122708] 0 2023-12-16T20:11:38.584 INFO:tasks.workunit.client.0.smithi038.stdout:7/928: fsync da/d21/d2c/d76/d9a/f101 0 2023-12-16T20:11:38.584 INFO:tasks.workunit.client.0.smithi038.stdout:3/926: dwrite d4/dab/f140 [0,4194304] 0 2023-12-16T20:11:38.585 INFO:tasks.workunit.client.0.smithi038.stdout:2/991: dwrite d1/d5/d3d/d9e/fc3 [0,4194304] 0 2023-12-16T20:11:38.585 INFO:tasks.workunit.client.0.smithi038.stdout:6/803: rename d1/d16/d23/d5f/ffd to d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/f103 0 2023-12-16T20:11:38.586 INFO:tasks.workunit.client.1.smithi141.stdout:5/443: unlink d0/d14/l76 0 2023-12-16T20:11:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/880: symlink d15/d22/d7b/l12f 0 2023-12-16T20:11:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/881: fsync d15/d1e/d3b/d117/d34/f9d 0 2023-12-16T20:11:38.589 INFO:tasks.workunit.client.1.smithi141.stdout:2/388: rmdir d6/d32/d52/d53 39 2023-12-16T20:11:38.589 INFO:tasks.workunit.client.1.smithi141.stdout:8/514: dwrite d14/d19/d1b/d3d/f96 [0,4194304] 0 2023-12-16T20:11:38.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/992: mkdir d1/d5/d95/d61/dd4/d14f 0 2023-12-16T20:11:38.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/993: chown d1/d5/d95/d61/dd4/d21/d9a/db9/d3a/c130 11052 1 2023-12-16T20:11:38.598 INFO:tasks.workunit.client.1.smithi141.stdout:6/555: creat d1/d77/d9e/fb2 x:0 0 0 2023-12-16T20:11:38.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/804: mkdir d1/d16/d23/d104 0 2023-12-16T20:11:38.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/805: truncate d1/d5b/d7d/fd2 625062 0 2023-12-16T20:11:38.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/806: chown d1/d4/d1d/d67/d73/c88 1 1 2023-12-16T20:11:38.601 INFO:tasks.workunit.client.0.smithi038.stdout:7/929: rename da/d21/d86/dee to da/dcf/d133 0 2023-12-16T20:11:38.602 INFO:tasks.workunit.client.0.smithi038.stdout:5/951: sync 2023-12-16T20:11:38.602 INFO:tasks.workunit.client.0.smithi038.stdout:5/952: stat d2/d14/d25/d2d/d17/d51/ff2 0 2023-12-16T20:11:38.602 INFO:tasks.workunit.client.0.smithi038.stdout:9/868: sync 2023-12-16T20:11:38.603 INFO:tasks.workunit.client.0.smithi038.stdout:1/882: creat d15/d1e/d30/d95/f130 x:0 0 0 2023-12-16T20:11:38.607 INFO:tasks.workunit.client.1.smithi141.stdout:1/571: link da/d36/d4b/f63 da/d36/d4b/d7c/fc1 0 2023-12-16T20:11:38.607 INFO:tasks.workunit.client.1.smithi141.stdout:1/572: creat da/d1a/d31/d81/fc2 x:0 0 0 2023-12-16T20:11:38.608 INFO:tasks.workunit.client.0.smithi038.stdout:8/762: sync 2023-12-16T20:11:38.608 INFO:tasks.workunit.client.0.smithi038.stdout:8/763: write d17/d34/f92 [3338278,49587] 0 2023-12-16T20:11:38.608 INFO:tasks.workunit.client.0.smithi038.stdout:0/843: link db/d16/d70/ld1 db/d16/d19/d4e/d106/d65/d108/l10c 0 2023-12-16T20:11:38.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/814: sync 2023-12-16T20:11:38.610 INFO:tasks.workunit.client.1.smithi141.stdout:7/537: rmdir d5/d16 39 2023-12-16T20:11:38.611 INFO:tasks.workunit.client.0.smithi038.stdout:5/953: link d2/d14/d25/d2d/d17/d93/ff8 d2/d14/d25/d2d/d4b/f12d 0 2023-12-16T20:11:38.611 INFO:tasks.workunit.client.0.smithi038.stdout:5/954: read d2/d14/d25/d2d/f31 [925504,24924] 0 2023-12-16T20:11:38.613 INFO:tasks.workunit.client.1.smithi141.stdout:2/389: dwrite d6/d32/f64 [0,4194304] 0 2023-12-16T20:11:38.613 INFO:tasks.workunit.client.0.smithi038.stdout:0/844: creat db/d16/d19/d4e/d106/d65/de8/d77/d95/dd8/f10d x:0 0 0 2023-12-16T20:11:38.614 INFO:tasks.workunit.client.0.smithi038.stdout:1/883: unlink d15/d1e/d3b/d117/d7d/de9/cf0 0 2023-12-16T20:11:38.614 INFO:tasks.workunit.client.0.smithi038.stdout:2/994: dread d1/d5/fc7 [0,4194304] 0 2023-12-16T20:11:38.614 INFO:tasks.workunit.client.0.smithi038.stdout:2/995: chown d1/d5/d16/f3b 6567 1 2023-12-16T20:11:38.614 INFO:tasks.workunit.client.0.smithi038.stdout:2/996: fdatasync d1/d5/d2a/d31/d60/ded/dee/f133 0 2023-12-16T20:11:38.615 INFO:tasks.workunit.client.1.smithi141.stdout:5/444: unlink d0/d14/f22 0 2023-12-16T20:11:38.616 INFO:tasks.workunit.client.0.smithi038.stdout:7/930: rename da/dcf/d100/d4d/dc5/ddc/dba to da/d21/d61/dcd/d6b/ded/d134 0 2023-12-16T20:11:38.616 INFO:tasks.workunit.client.0.smithi038.stdout:7/931: chown da/d21/fb5 8630 1 2023-12-16T20:11:38.616 INFO:tasks.workunit.client.0.smithi038.stdout:0/845: symlink db/d16/db5/l10e 0 2023-12-16T20:11:38.616 INFO:tasks.workunit.client.0.smithi038.stdout:0/846: truncate db/d16/d19/d27/d56/f99 1102359 0 2023-12-16T20:11:38.620 INFO:tasks.workunit.client.0.smithi038.stdout:4/815: unlink d13/d17/d4b/laa 0 2023-12-16T20:11:38.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/847: symlink db/d16/d70/l10f 0 2023-12-16T20:11:38.622 INFO:tasks.workunit.client.0.smithi038.stdout:6/807: dwrite d1/d4/d1d/d8e/dbf/fef [0,4194304] 0 2023-12-16T20:11:38.625 INFO:tasks.workunit.client.0.smithi038.stdout:5/955: symlink d2/d14/d25/d2d/d17/da9/l12e 0 2023-12-16T20:11:38.626 INFO:tasks.workunit.client.0.smithi038.stdout:2/997: creat d1/d5/d95/d61/dd4/d6a/dfb/d141/f150 x:0 0 0 2023-12-16T20:11:38.626 INFO:tasks.workunit.client.0.smithi038.stdout:2/998: fdatasync d1/d88/ffa 0 2023-12-16T20:11:38.626 INFO:tasks.workunit.client.0.smithi038.stdout:2/999: chown d1/d5/d3d/d115 42 1 2023-12-16T20:11:38.629 INFO:tasks.workunit.client.0.smithi038.stdout:3/927: rename d4/d8/d15/d6d/d7a/d98 to d4/d8/d15/d147 0 2023-12-16T20:11:38.629 INFO:tasks.workunit.client.0.smithi038.stdout:7/932: creat da/dcf/d100/d4d/dc5/d38/f135 x:0 0 0 2023-12-16T20:11:38.629 INFO:tasks.workunit.client.0.smithi038.stdout:7/933: write da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/f129 [192390,53707] 0 2023-12-16T20:11:38.631 INFO:tasks.workunit.client.0.smithi038.stdout:4/816: mkdir d13/d17/d4b/d7d/dc0/d10f 0 2023-12-16T20:11:38.636 INFO:tasks.workunit.client.0.smithi038.stdout:0/848: rmdir db/d16/d19/d4e/d89 39 2023-12-16T20:11:38.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/884: rmdir d15/d1e/d3b/d48/d3d/dc8 39 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.1.smithi141.stdout:7/538: dwrite d5/d1d/d1e/d71/f8e [0,4194304] 0 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.1.smithi141.stdout:7/539: write d5/d2a/fa9 [579023,64616] 0 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.1.smithi141.stdout:7/540: fsync d5/d16/f56 0 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.0.smithi038.stdout:3/928: mkdir d4/d67/de1/d4c/dae/d124/d148 0 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.0.smithi038.stdout:3/929: chown d4/d67/de1/d4c/d70/cd6 0 1 2023-12-16T20:11:38.638 INFO:tasks.workunit.client.0.smithi038.stdout:3/930: dread - d4/d67/de1/d4c/dae/d124/f136 zero size 2023-12-16T20:11:38.641 INFO:tasks.workunit.client.0.smithi038.stdout:9/869: rename l5 to d9/d1e/d3d/d42/d59/l115 0 2023-12-16T20:11:38.642 INFO:tasks.workunit.client.0.smithi038.stdout:7/934: creat da/d21/d2c/f136 x:0 0 0 2023-12-16T20:11:38.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/935: chown da/dcf/d133/f128 0 1 2023-12-16T20:11:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:4/817: mknod d13/d17/d2e/d32/d70/db2/dfb/c110 0 2023-12-16T20:11:38.644 INFO:tasks.workunit.client.0.smithi038.stdout:4/818: stat d13/d69/f108 0 2023-12-16T20:11:38.644 INFO:tasks.workunit.client.1.smithi141.stdout:1/573: unlink da/d36/d4b/d4d/cab 0 2023-12-16T20:11:38.644 INFO:tasks.workunit.client.1.smithi141.stdout:1/574: write da/d76/fbc [976842,19351] 0 2023-12-16T20:11:38.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/885: creat d15/d22/d7b/f131 x:0 0 0 2023-12-16T20:11:38.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/931: link d4/d8/dc7/fcb d4/d8/d15/f149 0 2023-12-16T20:11:38.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/932: stat d4/d8/f1c 0 2023-12-16T20:11:38.649 INFO:tasks.workunit.client.0.smithi038.stdout:3/933: stat d4/d67/l112 0 2023-12-16T20:11:38.649 INFO:tasks.workunit.client.0.smithi038.stdout:0/849: dread f6 [0,4194304] 0 2023-12-16T20:11:38.651 INFO:tasks.workunit.client.0.smithi038.stdout:7/936: creat da/d21/d61/f137 x:0 0 0 2023-12-16T20:11:38.653 INFO:tasks.workunit.client.1.smithi141.stdout:7/541: rename d5/d16/d30/d4e/l97 to d5/d16/d30/d36/laf 0 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.1.smithi141.stdout:6/556: rmdir d1/d77/d9e 39 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.1.smithi141.stdout:6/557: fdatasync d1/d12/d22/f53 0 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.0.smithi038.stdout:3/934: dread d4/d67/fa1 [0,4194304] 0 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.0.smithi038.stdout:3/935: chown d4/d27/d23/d26/c7c 0 1 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.0.smithi038.stdout:8/764: dwrite d17/d1b/d66/d8e/f91 [4194304,4194304] 0 2023-12-16T20:11:38.654 INFO:tasks.workunit.client.0.smithi038.stdout:1/886: write d15/d1e/d3b/d117/d34/d86/d99/fea [295575,113421] 0 2023-12-16T20:11:38.655 INFO:tasks.workunit.client.1.smithi141.stdout:2/390: dwrite d6/d32/f4e [0,4194304] 0 2023-12-16T20:11:38.656 INFO:tasks.workunit.client.1.smithi141.stdout:2/391: creat d6/da/d33/f81 x:0 0 0 2023-12-16T20:11:38.656 INFO:tasks.workunit.client.1.smithi141.stdout:2/392: fdatasync d6/d3a/d47/d58/f71 0 2023-12-16T20:11:38.658 INFO:tasks.workunit.client.0.smithi038.stdout:0/850: unlink db/d16/d1c/fd9 0 2023-12-16T20:11:38.659 INFO:tasks.workunit.client.0.smithi038.stdout:3/936: dread d4/d6c/d80/fa3 [0,4194304] 0 2023-12-16T20:11:38.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/870: rename d9/d1f/fad to d9/d1e/d40/d5e/d71/d83/da1/f116 0 2023-12-16T20:11:38.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/871: write d9/d1e/d3d/d42/d59/dc4/f109 [334264,19748] 0 2023-12-16T20:11:38.664 INFO:tasks.workunit.client.1.smithi141.stdout:7/542: dread - d5/d16/d30/f50 zero size 2023-12-16T20:11:38.664 INFO:tasks.workunit.client.1.smithi141.stdout:7/543: readlink d5/d16/l33 0 2023-12-16T20:11:38.664 INFO:tasks.workunit.client.0.smithi038.stdout:7/937: link da/dcf/d100/d4d/dc5/d38/d65/d81/ca4 da/d21/d61/dcd/d6b/ded/d134/dd9/c138 0 2023-12-16T20:11:38.665 INFO:tasks.workunit.client.0.smithi038.stdout:7/938: fdatasync da/d21/f34 0 2023-12-16T20:11:38.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/872: write d9/d1e/d3d/d42/d59/d76/fa4 [496816,24365] 0 2023-12-16T20:11:38.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/873: readlink d9/d1f/d21/d3e/d4e/l4f 0 2023-12-16T20:11:38.668 INFO:tasks.workunit.client.1.smithi141.stdout:5/445: truncate d0/d25/f2e 9854373 0 2023-12-16T20:11:38.670 INFO:tasks.workunit.client.0.smithi038.stdout:5/956: dwrite d2/df/d1a/d1f/d4a/d53/d6e/f124 [0,4194304] 0 2023-12-16T20:11:38.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/808: dwrite d1/d16/d23/d5f/fb4 [0,4194304] 0 2023-12-16T20:11:38.676 INFO:tasks.workunit.client.0.smithi038.stdout:0/851: rename db/d16/d70/cb3 to db/d16/db5/de6/c110 0 2023-12-16T20:11:38.676 INFO:tasks.workunit.client.0.smithi038.stdout:8/765: truncate d17/d1b/d66/d73/d4e/f9f 1099924 0 2023-12-16T20:11:38.677 INFO:tasks.workunit.client.0.smithi038.stdout:8/766: write d17/d1b/d66/d8e/f9a [4733841,91892] 0 2023-12-16T20:11:38.677 INFO:tasks.workunit.client.0.smithi038.stdout:8/767: write d17/d34/ddb/fed [2043324,97439] 0 2023-12-16T20:11:38.680 INFO:tasks.workunit.client.1.smithi141.stdout:1/575: dwrite da/d36/d4b/d4d/d89/d6c/faf [0,4194304] 0 2023-12-16T20:11:38.681 INFO:tasks.workunit.client.0.smithi038.stdout:1/887: unlink d15/d22/d62/f94 0 2023-12-16T20:11:38.685 INFO:tasks.workunit.client.1.smithi141.stdout:6/558: dwrite d1/d12/d22/f64 [0,4194304] 0 2023-12-16T20:11:38.685 INFO:tasks.workunit.client.0.smithi038.stdout:4/819: getdents d13/d1f 0 2023-12-16T20:11:38.685 INFO:tasks.workunit.client.0.smithi038.stdout:4/820: truncate d13/d69/d7a/fcd 503562 0 2023-12-16T20:11:38.686 INFO:tasks.workunit.client.0.smithi038.stdout:3/937: mkdir d4/d18/d110/d14a 0 2023-12-16T20:11:38.686 INFO:tasks.workunit.client.0.smithi038.stdout:3/938: truncate d4/d18/f115 725730 0 2023-12-16T20:11:38.686 INFO:tasks.workunit.client.0.smithi038.stdout:3/939: truncate d4/d67/de1/d7d/f134 708712 0 2023-12-16T20:11:38.686 INFO:tasks.workunit.client.0.smithi038.stdout:9/874: dread d9/d1f/d96/fb7 [0,4194304] 0 2023-12-16T20:11:38.693 INFO:tasks.workunit.client.1.smithi141.stdout:2/393: creat d6/da/d68/f82 x:0 0 0 2023-12-16T20:11:38.695 INFO:tasks.workunit.client.1.smithi141.stdout:8/515: dwrite d14/d19/d1b/d3d/f96 [4194304,4194304] 0 2023-12-16T20:11:38.696 INFO:tasks.workunit.client.0.smithi038.stdout:0/852: write f5 [2812855,82024] 0 2023-12-16T20:11:38.696 INFO:tasks.workunit.client.0.smithi038.stdout:5/957: truncate d2/df/d87/fd0 848475 0 2023-12-16T20:11:38.697 INFO:tasks.workunit.client.0.smithi038.stdout:5/958: write d2/d14/d25/d2d/d17/d93/fab [614760,100215] 0 2023-12-16T20:11:38.699 INFO:tasks.workunit.client.0.smithi038.stdout:6/809: creat d1/d5b/d7d/d9d/dc8/f105 x:0 0 0 2023-12-16T20:11:38.700 INFO:tasks.workunit.client.0.smithi038.stdout:6/810: creat d1/d4/d1d/d61/da4/f106 x:0 0 0 2023-12-16T20:11:38.700 INFO:tasks.workunit.client.0.smithi038.stdout:6/811: chown d1/d5b/d7d/d9d/dc8/de7/c31 72569 1 2023-12-16T20:11:38.700 INFO:tasks.workunit.client.0.smithi038.stdout:6/812: fdatasync d1/d4/d1d/d8e/fba 0 2023-12-16T20:11:38.700 INFO:tasks.workunit.client.0.smithi038.stdout:7/939: rename da/d21/d2c/f47 to da/dcf/d133/f139 0 2023-12-16T20:11:38.700 INFO:tasks.workunit.client.1.smithi141.stdout:2/394: symlink d6/da/d33/l83 0 2023-12-16T20:11:38.701 INFO:tasks.workunit.client.0.smithi038.stdout:0/853: creat db/d16/d1c/d5d/f111 x:0 0 0 2023-12-16T20:11:38.701 INFO:tasks.workunit.client.0.smithi038.stdout:0/854: write db/d16/d19/f98 [851574,49551] 0 2023-12-16T20:11:38.701 INFO:tasks.workunit.client.0.smithi038.stdout:1/888: creat d15/d22/d52/d7f/df7/f132 x:0 0 0 2023-12-16T20:11:38.702 INFO:tasks.workunit.client.1.smithi141.stdout:6/559: write d1/d5e/f7f [3939823,120] 0 2023-12-16T20:11:38.703 INFO:tasks.workunit.client.1.smithi141.stdout:6/560: truncate d1/d12/d20/f6a 641760 0 2023-12-16T20:11:38.703 INFO:tasks.workunit.client.1.smithi141.stdout:8/516: mknod d14/d71/d81/ca2 0 2023-12-16T20:11:38.703 INFO:tasks.workunit.client.0.smithi038.stdout:3/940: link d4/d8/d15/d6d/c7e d4/d67/de1/c14b 0 2023-12-16T20:11:38.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/821: write fb [4525056,62334] 0 2023-12-16T20:11:38.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/822: write d13/d17/d2e/d32/d7c/fde [2883116,11011] 0 2023-12-16T20:11:38.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/823: read d13/d1f/d35/f38 [2334692,71813] 0 2023-12-16T20:11:38.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/824: chown d13/d1f/l46 95233 1 2023-12-16T20:11:38.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/875: mknod d9/d1f/d96/dd5/c117 0 2023-12-16T20:11:38.705 INFO:tasks.workunit.client.0.smithi038.stdout:3/941: write d4/d67/fa1 [696066,6489] 0 2023-12-16T20:11:38.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/876: chown d9/d1e/d3d/d42/d59/d76 812 1 2023-12-16T20:11:38.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/446: dwrite d0/d25/f7b [0,4194304] 0 2023-12-16T20:11:38.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/447: chown d0/d14/d2c/d4a/f4d 1967 1 2023-12-16T20:11:38.706 INFO:tasks.workunit.client.1.smithi141.stdout:6/561: creat d1/dd/d2f/fb3 x:0 0 0 2023-12-16T20:11:38.707 INFO:tasks.workunit.client.0.smithi038.stdout:8/768: dwrite d17/d1b/d66/d73/d54/d69/f8f [0,4194304] 0 2023-12-16T20:11:38.708 INFO:tasks.workunit.client.1.smithi141.stdout:8/517: mkdir d14/d19/d1b/d24/da3 0 2023-12-16T20:11:38.708 INFO:tasks.workunit.client.1.smithi141.stdout:8/518: chown d14/f98 53349162 1 2023-12-16T20:11:38.710 INFO:tasks.workunit.client.0.smithi038.stdout:6/813: link d1/d5b/f63 d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/f107 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:7/940: truncate da/d21/fac 4157362 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:7/941: dread - da/dcf/fd4 zero size 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:4/825: mknod d13/d17/d2e/d32/d4e/c111 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:4/826: write d13/d1f/f8e [888943,55186] 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:4/827: creat d13/d69/f112 x:0 0 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:4/828: creat d13/d69/d7a/da5/f113 x:0 0 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:5/959: mkdir d2/d81/d12f 0 2023-12-16T20:11:38.714 INFO:tasks.workunit.client.0.smithi038.stdout:5/960: creat d2/d4/d62/f130 x:0 0 0 2023-12-16T20:11:38.715 INFO:tasks.workunit.client.0.smithi038.stdout:7/942: symlink da/d21/d61/l13a 0 2023-12-16T20:11:38.715 INFO:tasks.workunit.client.0.smithi038.stdout:7/943: creat da/dcf/d100/d4d/dc5/d38/d90/f13b x:0 0 0 2023-12-16T20:11:38.721 INFO:tasks.workunit.client.0.smithi038.stdout:9/877: read d9/d1e/f33 [717219,95425] 0 2023-12-16T20:11:38.721 INFO:tasks.workunit.client.0.smithi038.stdout:8/769: link d17/l8b d17/d1b/d57/lf4 0 2023-12-16T20:11:38.722 INFO:tasks.workunit.client.1.smithi141.stdout:5/448: mkdir d0/d14/d98 0 2023-12-16T20:11:38.722 INFO:tasks.workunit.client.1.smithi141.stdout:5/449: write d0/d14/d2c/d4a/f51 [366927,28910] 0 2023-12-16T20:11:38.724 INFO:tasks.workunit.client.1.smithi141.stdout:2/395: dread d6/f7 [0,4194304] 0 2023-12-16T20:11:38.724 INFO:tasks.workunit.client.1.smithi141.stdout:2/396: getdents d6/da/d33/d54/d73/d80 0 2023-12-16T20:11:38.725 INFO:tasks.workunit.client.1.smithi141.stdout:6/562: rename d1/d5e/c94 to d1/d77/d9e/cb4 0 2023-12-16T20:11:38.725 INFO:tasks.workunit.client.1.smithi141.stdout:6/563: fsync d1/d3/d4f/faa 0 2023-12-16T20:11:38.725 INFO:tasks.workunit.client.1.smithi141.stdout:6/564: write d1/d12/d20/d44/fb1 [1960707,16089] 0 2023-12-16T20:11:38.725 INFO:tasks.workunit.client.0.smithi038.stdout:7/944: creat da/dcf/d100/f13c x:0 0 0 2023-12-16T20:11:38.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/945: write da/d21/f10d [768627,51549] 0 2023-12-16T20:11:38.726 INFO:tasks.workunit.client.1.smithi141.stdout:5/450: stat d0/d25/d30/c5a 0 2023-12-16T20:11:38.728 INFO:tasks.workunit.client.1.smithi141.stdout:8/519: write d14/f98 [5832040,30271] 0 2023-12-16T20:11:38.728 INFO:tasks.workunit.client.1.smithi141.stdout:8/520: chown d14/d19/d1b/d24/d4a/d5b/l74 542 1 2023-12-16T20:11:38.730 INFO:tasks.workunit.client.0.smithi038.stdout:9/878: write d9/d1f/d21/d3e/d4e/d64/fa0 [3707997,96416] 0 2023-12-16T20:11:38.730 INFO:tasks.workunit.client.0.smithi038.stdout:9/879: stat d9/dea/fff 0 2023-12-16T20:11:38.732 INFO:tasks.workunit.client.0.smithi038.stdout:8/770: mknod d17/d1b/d66/d73/d9e/cf5 0 2023-12-16T20:11:38.732 INFO:tasks.workunit.client.0.smithi038.stdout:8/771: fsync d17/d1b/d66/d73/fbf 0 2023-12-16T20:11:38.733 INFO:tasks.workunit.client.0.smithi038.stdout:8/772: chown d17/d1b/d66/d8e/d97/fe9 12106 1 2023-12-16T20:11:38.733 INFO:tasks.workunit.client.0.smithi038.stdout:8/773: stat d17/d1b/d25/db7/d82/d9b/feb 0 2023-12-16T20:11:38.733 INFO:tasks.workunit.client.0.smithi038.stdout:7/946: rmdir da/d21/d2c/d76 39 2023-12-16T20:11:38.738 INFO:tasks.workunit.client.1.smithi141.stdout:6/565: dread d1/d12/d20/d3a/f6d [0,4194304] 0 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/814: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f43 [0,4194304] 0 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/815: chown d1/d5b/d7d/d9d/dc8/f105 2765 1 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/816: chown d1/d5b/d7d/d9d/dc8/de7/d2f/l3e 1288112 1 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/817: dread - d1/d4/d1d/d8e/dbf/fd5 zero size 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:6/818: truncate d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/ff3 649059 0 2023-12-16T20:11:38.739 INFO:tasks.workunit.client.0.smithi038.stdout:8/774: dread d17/d34/f84 [0,4194304] 0 2023-12-16T20:11:38.745 INFO:tasks.workunit.client.0.smithi038.stdout:4/829: dwrite d13/d17/d2e/d32/d4e/f59 [0,4194304] 0 2023-12-16T20:11:38.745 INFO:tasks.workunit.client.0.smithi038.stdout:4/830: write d13/d17/d4b/f87 [995306,6162] 0 2023-12-16T20:11:38.745 INFO:tasks.workunit.client.0.smithi038.stdout:0/855: rename db/d16/d1c/d5d/d64/dd0 to db/d16/db5/de6/d112 0 2023-12-16T20:11:38.745 INFO:tasks.workunit.client.0.smithi038.stdout:0/856: creat db/d16/d19/d27/d56/def/f113 x:0 0 0 2023-12-16T20:11:38.746 INFO:tasks.workunit.client.0.smithi038.stdout:8/775: rename d17/d1b/d25/c6d to d17/d1b/d25/cf6 0 2023-12-16T20:11:38.746 INFO:tasks.workunit.client.0.smithi038.stdout:1/889: rename d15/d22/d62/fce to d15/d1e/d3b/d117/d34/d79/f133 0 2023-12-16T20:11:38.746 INFO:tasks.workunit.client.0.smithi038.stdout:1/890: dread - d15/d1e/d30/d95/f130 zero size 2023-12-16T20:11:38.746 INFO:tasks.workunit.client.0.smithi038.stdout:1/891: truncate d15/d1e/d3b/d48/d37/dde/d75/f119 302981 0 2023-12-16T20:11:38.748 INFO:tasks.workunit.client.0.smithi038.stdout:1/892: rename d15/d1e/d3b/d48/d3d/f54 to d15/d4a/ded/f134 0 2023-12-16T20:11:38.748 INFO:tasks.workunit.client.0.smithi038.stdout:1/893: chown d15/d1e/d3b/d48/d3d/f58 1 1 2023-12-16T20:11:38.751 INFO:tasks.workunit.client.0.smithi038.stdout:1/894: read d15/d1e/d3b/d48/d37/dde/fae [261183,977] 0 2023-12-16T20:11:38.752 INFO:tasks.workunit.client.0.smithi038.stdout:3/942: rename d4/d6c/d80/lc2 to d4/d8/l14c 0 2023-12-16T20:11:38.752 INFO:tasks.workunit.client.0.smithi038.stdout:3/943: creat d4/d27/d23/f14d x:0 0 0 2023-12-16T20:11:38.752 INFO:tasks.workunit.client.0.smithi038.stdout:3/944: stat d4/fed 0 2023-12-16T20:11:38.752 INFO:tasks.workunit.client.0.smithi038.stdout:1/895: dread d15/d1e/d30/ffc [0,4194304] 0 2023-12-16T20:11:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.753+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9cc000bf0 con 0x7fd9d4038850 2023-12-16T20:11:38.755 INFO:tasks.workunit.client.0.smithi038.stdout:3/945: mknod d4/d27/d2b/da0/c14e 0 2023-12-16T20:11:38.755 INFO:tasks.workunit.client.0.smithi038.stdout:5/961: rename d2/d14/ddd to d2/df/d1a/d1f/d4a/d53/d6e/d129/d131 0 2023-12-16T20:11:38.756 INFO:tasks.workunit.client.0.smithi038.stdout:1/896: rmdir d15/d22/d52 39 2023-12-16T20:11:38.756 INFO:tasks.workunit.client.0.smithi038.stdout:1/897: creat d15/d1e/d3b/d117/da2/f135 x:0 0 0 2023-12-16T20:11:38.756 INFO:tasks.workunit.client.0.smithi038.stdout:1/898: chown d15/d1e/d3b/d117/d7d/cfe 56 1 2023-12-16T20:11:38.758 INFO:tasks.workunit.client.0.smithi038.stdout:3/946: write d4/d8/d15/d1e/f108 [7125,14427] 0 2023-12-16T20:11:38.759 INFO:tasks.workunit.client.1.smithi141.stdout:8/521: write d14/d19/d1b/d24/d4a/d5b/f89 [728698,33327] 0 2023-12-16T20:11:38.760 INFO:tasks.workunit.client.0.smithi038.stdout:6/819: write d1/d4/d1d/d8e/dbf/fdf [6291632,91721] 0 2023-12-16T20:11:38.760 INFO:tasks.workunit.client.0.smithi038.stdout:6/820: fsync d1/f54 0 2023-12-16T20:11:38.761 INFO:tasks.workunit.client.0.smithi038.stdout:5/962: dread d2/d14/d25/d2d/d17/d55/faa [0,4194304] 0 2023-12-16T20:11:38.761 INFO:tasks.workunit.client.0.smithi038.stdout:7/947: rename da/dcf/d100/d4d/dc5/d38/d90/f112 to da/d21/f13d 0 2023-12-16T20:11:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.760+0000 7fd9daffd700 1 -- 172.21.15.38:0/3445130456 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd9cc000bf0 con 0x7fd9d4038850 2023-12-16T20:11:38.765 INFO:tasks.workunit.client.0.smithi038.stdout:3/947: mkdir d4/d67/de1/d4c/d14f 0 2023-12-16T20:11:38.765 INFO:tasks.workunit.client.0.smithi038.stdout:6/821: symlink d1/d4/d1d/d67/d73/l108 0 2023-12-16T20:11:38.766 INFO:tasks.workunit.client.0.smithi038.stdout:6/822: fdatasync d1/d5b/d7d/d9d/dc8/de7/f37 0 2023-12-16T20:11:38.767 INFO:tasks.workunit.client.0.smithi038.stdout:0/857: rename db/d16/d19/d4e/dcb to db/d16/d19/d27/d78/dd5/d114 0 2023-12-16T20:11:38.767 INFO:tasks.workunit.client.0.smithi038.stdout:9/880: dwrite d9/d1e/d40/d5e/d71/d83/f9f [0,4194304] 0 2023-12-16T20:11:38.767 INFO:tasks.workunit.client.0.smithi038.stdout:9/881: fsync d9/d1f/d21/d55/f65 0 2023-12-16T20:11:38.767 INFO:tasks.workunit.client.0.smithi038.stdout:9/882: truncate d9/d1f/d21/d3e/d4e/d61/daa/fcf 1147431 0 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 msgr2=0x7fd9d403ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 0x7fd9d403ad00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0006fd0 tx=0x7fd9e0008040 comp rx=0 tx=0).stop 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 msgr2=0x7fd9ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00bbd0 tx=0x7fd9dc009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 shutdown_connections 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fd9d4038850 0x7fd9d403ad00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ec0fb910 0x7fd9ec06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 --2- 172.21.15.38:0/3445130456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd9ec0fcb20 0x7fd9ec06a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.768+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 >> 172.21.15.38:0/3445130456 conn(0x7fd9ec0f6fb0 msgr2=0x7fd9ec0f7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:38.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.769+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 shutdown_connections 2023-12-16T20:11:38.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.769+0000 7fd9eb59e700 1 -- 172.21.15.38:0/3445130456 wait complete. 2023-12-16T20:11:38.771 INFO:tasks.workunit.client.0.smithi038.stdout:7/948: creat da/d21/d2c/d76/d9a/f13e x:0 0 0 2023-12-16T20:11:38.776 INFO:tasks.workunit.client.0.smithi038.stdout:0/858: dread db/d16/d1c/f32 [0,4194304] 0 2023-12-16T20:11:38.779 INFO:tasks.workunit.client.0.smithi038.stdout:0/859: creat db/d16/d19/d27/d78/f115 x:0 0 0 2023-12-16T20:11:38.781 INFO:tasks.workunit.client.0.smithi038.stdout:0/860: creat db/d16/d19/d4e/d106/dc5/f116 x:0 0 0 2023-12-16T20:11:38.783 INFO:tasks.workunit.client.0.smithi038.stdout:6/823: symlink d1/d5b/l109 0 2023-12-16T20:11:38.783 INFO:tasks.workunit.client.0.smithi038.stdout:6/824: stat d1/d16 0 2023-12-16T20:11:38.783 INFO:tasks.workunit.client.0.smithi038.stdout:3/948: symlink d4/d67/de1/l150 0 2023-12-16T20:11:38.784 INFO:tasks.workunit.client.0.smithi038.stdout:3/949: read d4/d18/f4b [1307280,103904] 0 2023-12-16T20:11:38.784 INFO:tasks.workunit.client.0.smithi038.stdout:1/899: rename d15/d22/f6d to d15/d1e/d3b/d48/d37/deb/f136 0 2023-12-16T20:11:38.784 INFO:tasks.workunit.client.0.smithi038.stdout:9/883: mknod d9/d1f/d21/d3e/d72/c118 0 2023-12-16T20:11:38.784 INFO:tasks.workunit.client.0.smithi038.stdout:9/884: chown d9/d1e/d40/d5e/db5/f10e 316286 1 2023-12-16T20:11:38.785 INFO:tasks.workunit.client.0.smithi038.stdout:7/949: creat da/d21/d61/dcd/d6b/ded/f13f x:0 0 0 2023-12-16T20:11:38.785 INFO:tasks.workunit.client.0.smithi038.stdout:7/950: write da/f5e [1564894,30838] 0 2023-12-16T20:11:38.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/861: unlink db/d16/d19/d4e/d106/d65/de8/f3a 0 2023-12-16T20:11:38.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/862: stat db/d16/d19/d4e/d106/d65/d90/cc9 0 2023-12-16T20:11:38.787 INFO:tasks.workunit.client.0.smithi038.stdout:3/950: link d4/d27/d40/ce7 d4/de8/c151 0 2023-12-16T20:11:38.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/963: rename d2/df/d1a/d1f/d4a/d53/d6e/c104 to d2/d14/d25/d2d/d17/d51/d7b/d89/c132 0 2023-12-16T20:11:38.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/964: truncate d2/d14/d25/d2d/d17/d55/fbb 859523 0 2023-12-16T20:11:38.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/965: stat d2/d14 0 2023-12-16T20:11:38.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/966: getdents d2/d112 0 2023-12-16T20:11:38.792 INFO:tasks.workunit.client.0.smithi038.stdout:0/863: creat db/d16/d1c/f117 x:0 0 0 2023-12-16T20:11:38.792 INFO:tasks.workunit.client.0.smithi038.stdout:0/864: write db/d16/d1c/d5d/f8d [1666594,26696] 0 2023-12-16T20:11:38.792 INFO:tasks.workunit.client.0.smithi038.stdout:0/865: chown db/d16/fa0 470 1 2023-12-16T20:11:38.792 INFO:tasks.workunit.client.0.smithi038.stdout:1/900: mknod d15/d1e/d3b/d48/d3d/c137 0 2023-12-16T20:11:38.792 INFO:tasks.workunit.client.0.smithi038.stdout:7/951: mkdir da/d21/d61/dcd/d6b/d140 0 2023-12-16T20:11:38.793 INFO:tasks.workunit.client.0.smithi038.stdout:7/952: truncate da/dcf/d100/d4d/f104 238641 0 2023-12-16T20:11:38.794 INFO:tasks.workunit.client.0.smithi038.stdout:3/951: creat d4/d67/de1/d4c/f152 x:0 0 0 2023-12-16T20:11:38.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/952: chown d4/dcd 34 1 2023-12-16T20:11:38.800 INFO:tasks.workunit.client.0.smithi038.stdout:7/953: getdents da/dcf/d100/d4d/dc5/d38/d65/d81/dbd 0 2023-12-16T20:11:38.802 INFO:tasks.workunit.client.0.smithi038.stdout:1/901: rename d15/d1e/d3b/d48/d37/dde/d75/dc1 to d15/d1e/d3b/d117/d46/d138 0 2023-12-16T20:11:38.802 INFO:tasks.workunit.client.0.smithi038.stdout:1/902: fdatasync d15/d1e/d3b/d5a/f9e 0 2023-12-16T20:11:38.806 INFO:tasks.workunit.client.1.smithi141.stdout:5/451: dwrite d0/d25/d30/d67/f1d [0,4194304] 0 2023-12-16T20:11:38.806 INFO:tasks.workunit.client.0.smithi038.stdout:1/903: mkdir d15/d1e/d3b/d117/d46/d139 0 2023-12-16T20:11:38.810 INFO:tasks.workunit.client.1.smithi141.stdout:8/522: dwrite d14/d19/d1b/f3a [0,4194304] 0 2023-12-16T20:11:38.810 INFO:tasks.workunit.client.0.smithi038.stdout:1/904: symlink d15/d1e/db0/l13a 0 2023-12-16T20:11:38.816 INFO:tasks.workunit.client.0.smithi038.stdout:4/831: dwrite d13/d17/d4b/da4/d34/fcb [0,4194304] 0 2023-12-16T20:11:38.817 INFO:tasks.workunit.client.0.smithi038.stdout:4/832: truncate d13/d17/d2e/d32/f39 1617517 0 2023-12-16T20:11:38.817 INFO:tasks.workunit.client.0.smithi038.stdout:4/833: readlink d13/d17/d2e/d32/d4e/l8f 0 2023-12-16T20:11:38.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/834: mkdir d13/d69/def/d114 0 2023-12-16T20:11:38.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/835: write d13/d69/d7a/fcd [647750,86982] 0 2023-12-16T20:11:38.819 INFO:tasks.workunit.client.0.smithi038.stdout:4/836: fsync d13/d17/d4b/da4/d34/f58 0 2023-12-16T20:11:38.822 INFO:tasks.workunit.client.1.smithi141.stdout:8/523: creat d14/fa4 x:0 0 0 2023-12-16T20:11:38.823 INFO:tasks.workunit.client.0.smithi038.stdout:4/837: symlink d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/dee/l115 0 2023-12-16T20:11:38.824 INFO:tasks.workunit.client.0.smithi038.stdout:6/825: dwrite d1/d5b/d7d/d9d/dc8/de7/f69 [4194304,4194304] 0 2023-12-16T20:11:38.824 INFO:tasks.workunit.client.0.smithi038.stdout:6/826: creat d1/d16/d23/f10a x:0 0 0 2023-12-16T20:11:38.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/838: truncate d13/d17/d4b/d7d/fe5 3389533 0 2023-12-16T20:11:38.826 INFO:tasks.workunit.client.1.smithi141.stdout:8/524: creat d14/d19/d1b/d24/d4a/d58/fa5 x:0 0 0 2023-12-16T20:11:38.826 INFO:tasks.workunit.client.1.smithi141.stdout:6/566: dwrite d1/d12/d22/f53 [0,4194304] 0 2023-12-16T20:11:38.828 INFO:tasks.workunit.client.0.smithi038.stdout:4/839: creat d13/d17/d2e/d32/d70/df6/dfc/f116 x:0 0 0 2023-12-16T20:11:38.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/776: dwrite d17/d1b/f22 [0,4194304] 0 2023-12-16T20:11:38.829 INFO:tasks.workunit.client.1.smithi141.stdout:8/525: unlink d14/d19/d1b/la1 0 2023-12-16T20:11:38.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/840: creat d13/d1f/d35/f117 x:0 0 0 2023-12-16T20:11:38.834 INFO:tasks.workunit.client.0.smithi038.stdout:8/777: creat d17/d1b/d25/db7/d82/daa/ff7 x:0 0 0 2023-12-16T20:11:38.834 INFO:tasks.workunit.client.0.smithi038.stdout:8/778: chown d17/d1b/d25/db7/d82/d9b/cb0 14966243 1 2023-12-16T20:11:38.836 INFO:tasks.workunit.client.1.smithi141.stdout:8/526: unlink d14/l6c 0 2023-12-16T20:11:38.836 INFO:tasks.workunit.client.1.smithi141.stdout:8/527: chown d14/f64 32515907 1 2023-12-16T20:11:38.836 INFO:tasks.workunit.client.1.smithi141.stdout:8/528: truncate d14/d19/d1b/f48 1014497 0 2023-12-16T20:11:38.839 INFO:tasks.workunit.client.1.smithi141.stdout:8/529: truncate d14/f15 1701388 0 2023-12-16T20:11:38.839 INFO:tasks.workunit.client.1.smithi141.stdout:8/530: write d14/d19/d1b/d24/d4a/d5b/f89 [383215,129759] 0 2023-12-16T20:11:38.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/885: dwrite d9/d1f/d21/d3e/d4e/d61/d9e/f114 [0,4194304] 0 2023-12-16T20:11:38.842 INFO:tasks.workunit.client.0.smithi038.stdout:7/954: dwrite da/dcf/d100/f13c [0,4194304] 0 2023-12-16T20:11:38.842 INFO:tasks.workunit.client.0.smithi038.stdout:7/955: stat da/dcf/d100/d4d/fd2 0 2023-12-16T20:11:38.842 INFO:tasks.workunit.client.0.smithi038.stdout:7/956: chown da/l6a 131359 1 2023-12-16T20:11:38.848 INFO:tasks.workunit.client.0.smithi038.stdout:9/886: rename d9/d1e/d40/c90 to d9/d1f/d21/d3e/d72/c119 0 2023-12-16T20:11:38.848 INFO:tasks.workunit.client.0.smithi038.stdout:9/887: read d9/d1e/d3d/d42/d59/d76/fa4 [779502,63662] 0 2023-12-16T20:11:38.848 INFO:tasks.workunit.client.0.smithi038.stdout:5/967: dwrite d2/d14/d25/f3f [0,4194304] 0 2023-12-16T20:11:38.849 INFO:tasks.workunit.client.0.smithi038.stdout:5/968: fdatasync d2/df/d1a/d2a/f6c 0 2023-12-16T20:11:38.849 INFO:tasks.workunit.client.0.smithi038.stdout:7/957: creat da/d21/dc0/f141 x:0 0 0 2023-12-16T20:11:38.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/888: link d9/d1e/d3d/f6b d9/d1e/d3d/d42/d59/d76/f11a 0 2023-12-16T20:11:38.852 INFO:tasks.workunit.client.0.smithi038.stdout:7/958: rename da/d21/d86/l9b to da/dcf/d100/d4d/dc5/d38/l142 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:5/969: getdents d2/df/d1a/d1f/d4a/d53/d6e/d85 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:5/970: write d2/f101 [717878,54384] 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:5/971: read d2/df/d1a/d2a/f50 [918177,93105] 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/889: dread d9/d1f/d21/d3e/d4e/d61/f99 [0,4194304] 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/890: fsync d9/d1f/d21/d3e/d4e/f105 0 2023-12-16T20:11:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/891: rename d9/d1f/d21/d3e/d4e/l4f to d9/d1f/d21/d84/l11b 0 2023-12-16T20:11:38.863 INFO:tasks.workunit.client.0.smithi038.stdout:7/959: symlink da/l143 0 2023-12-16T20:11:38.863 INFO:tasks.workunit.client.0.smithi038.stdout:3/953: dwrite d4/d8/d15/f56 [0,4194304] 0 2023-12-16T20:11:38.865 INFO:tasks.workunit.client.0.smithi038.stdout:9/892: write d9/d1f/d21/d3e/f49 [345251,102996] 0 2023-12-16T20:11:38.865 INFO:tasks.workunit.client.0.smithi038.stdout:3/954: creat d4/d8/d15/d12b/f153 x:0 0 0 2023-12-16T20:11:38.871 INFO:tasks.workunit.client.0.smithi038.stdout:3/955: mkdir d4/d8/d15/d154 0 2023-12-16T20:11:38.872 INFO:tasks.workunit.client.0.smithi038.stdout:9/893: creat d9/d1f/d21/d84/daf/f11c x:0 0 0 2023-12-16T20:11:38.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/905: dwrite d15/d1e/d3b/d48/f6f [0,4194304] 0 2023-12-16T20:11:38.886 INFO:tasks.workunit.client.0.smithi038.stdout:0/866: dwrite db/d16/d19/d4e/d106/d65/de8/fcd [0,4194304] 0 2023-12-16T20:11:38.886 INFO:tasks.workunit.client.0.smithi038.stdout:1/906: symlink d15/d4a/ded/d123/l13b 0 2023-12-16T20:11:38.892 INFO:tasks.workunit.client.0.smithi038.stdout:1/907: dread d15/d1e/d3b/d117/d46/f72 [0,4194304] 0 2023-12-16T20:11:38.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/960: dread da/d21/d2c/f9c [0,4194304] 0 2023-12-16T20:11:38.893 INFO:tasks.workunit.client.0.smithi038.stdout:9/894: write d9/d1e/d40/d5e/d71/d83/de8/fca [3731696,8109] 0 2023-12-16T20:11:38.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/908: symlink d15/d1e/d3b/d117/d34/d79/l13c 0 2023-12-16T20:11:38.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/909: getdents d15/d1e/d3b/d117/d34/d86/d99/df5 0 2023-12-16T20:11:38.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/910: fsync d15/d1e/d3b/d48/d37/f88 0 2023-12-16T20:11:38.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/911: chown d15/d1e/d3b/d117/d34/d86/d99 8959530 1 2023-12-16T20:11:38.894 INFO:tasks.workunit.client.0.smithi038.stdout:1/912: dread - d15/d1e/d3b/d5a/fb9 zero size 2023-12-16T20:11:38.896 INFO:tasks.workunit.client.0.smithi038.stdout:6/827: dwrite d1/d4/d1d/d67/fa6 [4194304,4194304] 0 2023-12-16T20:11:38.896 INFO:tasks.workunit.client.0.smithi038.stdout:5/972: dwrite d2/fba [4194304,4194304] 0 2023-12-16T20:11:38.897 INFO:tasks.workunit.client.1.smithi141.stdout:6/567: dwrite d1/d12/d20/d3a/d45/f81 [0,4194304] 0 2023-12-16T20:11:38.897 INFO:tasks.workunit.client.1.smithi141.stdout:8/531: dwrite d14/f94 [0,4194304] 0 2023-12-16T20:11:38.897 INFO:tasks.workunit.client.0.smithi038.stdout:3/956: dwrite f1 [4194304,4194304] 0 2023-12-16T20:11:38.898 INFO:tasks.workunit.client.0.smithi038.stdout:9/895: link d9/l1b d9/d1e/d40/d5e/db5/l11d 0 2023-12-16T20:11:38.903 INFO:tasks.workunit.client.0.smithi038.stdout:6/828: creat d1/d5b/d7d/d9d/f10b x:0 0 0 2023-12-16T20:11:38.903 INFO:tasks.workunit.client.0.smithi038.stdout:6/829: truncate d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fd3 780454 0 2023-12-16T20:11:38.903 INFO:tasks.workunit.client.0.smithi038.stdout:7/961: getdents da/dcf/d100/db7 0 2023-12-16T20:11:38.903 INFO:tasks.workunit.client.0.smithi038.stdout:0/867: dread db/d16/d70/d7c/f7e [0,4194304] 0 2023-12-16T20:11:38.904 INFO:tasks.workunit.client.0.smithi038.stdout:0/868: readlink db/d16/d19/d80/lfd 0 2023-12-16T20:11:38.904 INFO:tasks.workunit.client.0.smithi038.stdout:5/973: symlink d2/d14/d25/d2d/d17/da9/l133 0 2023-12-16T20:11:38.905 INFO:tasks.workunit.client.0.smithi038.stdout:8/779: dwrite d17/d34/f36 [0,4194304] 0 2023-12-16T20:11:38.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/896: symlink d9/d1f/d21/d3e/d4e/d61/daa/l11e 0 2023-12-16T20:11:38.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/830: rmdir d1/d5b 39 2023-12-16T20:11:38.910 INFO:tasks.workunit.client.1.smithi141.stdout:6/568: creat d1/dd/fb5 x:0 0 0 2023-12-16T20:11:38.911 INFO:tasks.workunit.client.0.smithi038.stdout:6/831: read d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fe9 [217581,43799] 0 2023-12-16T20:11:38.914 INFO:tasks.workunit.client.0.smithi038.stdout:5/974: mkdir d2/d14/d25/d2d/d17/d51/daf/dda/d134 0 2023-12-16T20:11:38.922 INFO:tasks.workunit.client.0.smithi038.stdout:9/897: write d9/d1f/d21/d55/f65 [679193,130360] 0 2023-12-16T20:11:38.922 INFO:tasks.workunit.client.0.smithi038.stdout:8/780: creat d17/d1b/d25/db7/d82/da9/d50/d96/dba/ff8 x:0 0 0 2023-12-16T20:11:38.922 INFO:tasks.workunit.client.0.smithi038.stdout:8/781: chown d17/d1b/d25/f5c 133 1 2023-12-16T20:11:38.922 INFO:tasks.workunit.client.0.smithi038.stdout:8/782: chown d17/d1b/d66/d73/d54/d69/c44 157450 1 2023-12-16T20:11:38.922 INFO:tasks.workunit.client.0.smithi038.stdout:9/898: write d9/ffd [288149,45638] 0 2023-12-16T20:11:38.925 INFO:tasks.workunit.client.0.smithi038.stdout:5/975: rename d2/df/d87 to d2/df/d1a/d1f/d4a/d53/d135 0 2023-12-16T20:11:38.926 INFO:tasks.workunit.client.0.smithi038.stdout:6/832: dread d1/d5b/d7d/d9d/dc8/de7/db1/dbe/fb6 [0,4194304] 0 2023-12-16T20:11:38.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/962: dread da/dcf/d133/f139 [0,4194304] 0 2023-12-16T20:11:38.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/532: creat d14/d19/d1b/d24/d4b/d8c/fa6 x:0 0 0 2023-12-16T20:11:38.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/533: truncate d14/d19/d1b/d24/d4b/f80 354074 0 2023-12-16T20:11:38.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/534: chown d14/d19/d1b/d24/d4b/f80 435302735 1 2023-12-16T20:11:38.933 INFO:tasks.workunit.client.1.smithi141.stdout:8/535: dread d14/d19/d1b/d24/d4a/d69/f88 [0,4194304] 0 2023-12-16T20:11:38.933 INFO:tasks.workunit.client.1.smithi141.stdout:8/536: truncate d14/d19/d1b/d24/d4a/d5b/f7b 650253 0 2023-12-16T20:11:38.934 INFO:tasks.workunit.client.0.smithi038.stdout:6/833: rmdir d1/d5b/d7d/d9d/dc8/de7 39 2023-12-16T20:11:38.934 INFO:tasks.workunit.client.0.smithi038.stdout:7/963: mkdir da/d21/d86/d144 0 2023-12-16T20:11:38.934 INFO:tasks.workunit.client.0.smithi038.stdout:9/899: dread d9/d1f/d21/d3e/d4e/d61/d9e/f114 [0,4194304] 0 2023-12-16T20:11:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:0/869: creat db/d16/d1c/d5d/d64/f118 x:0 0 0 2023-12-16T20:11:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:0/870: chown db/d16/d19/d27/d78/faf 971509206 1 2023-12-16T20:11:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:3/957: dwrite d4/dcd/dcc/f111 [0,4194304] 0 2023-12-16T20:11:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:3/958: write d4/d6c/d80/d129/f87 [3378311,31206] 0 2023-12-16T20:11:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/900: write d9/d1f/d21/d84/daf/f107 [4350815,18084] 0 2023-12-16T20:11:38.937 INFO:tasks.workunit.client.1.smithi141.stdout:8/537: symlink d14/d19/d1b/d24/d4a/d69/la7 0 2023-12-16T20:11:38.948 INFO:tasks.workunit.client.1.smithi141.stdout:8/538: rename d14/d71/d81/f87 to d14/d19/fa8 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:3/959: mkdir d4/d67/de1/d7d/d155 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:3/960: read - d4/d67/de1/d4c/f152 zero size 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/913: dwrite d15/d22/d62/fa8 [0,4194304] 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:3/961: write d4/d8/dc7/fcb [654880,116892] 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:9/901: unlink d9/d1f/d96/la5 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/914: getdents d15 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/915: fdatasync d15/d22/f51 0 2023-12-16T20:11:38.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/916: fsync d15/d1e/d3b/d48/d37/fd6 0 2023-12-16T20:11:38.961 INFO:tasks.workunit.client.0.smithi038.stdout:1/917: write d15/d1e/d3b/d48/d37/dde/f92 [939051,31953] 0 2023-12-16T20:11:38.975 INFO:tasks.workunit.client.1.smithi141.stdout:6/569: dwrite d1/dd/de/f6f [0,4194304] 0 2023-12-16T20:11:38.977 INFO:tasks.workunit.client.0.smithi038.stdout:8/783: write d17/d1b/fd2 [1679788,19392] 0 2023-12-16T20:11:38.980 INFO:tasks.workunit.client.0.smithi038.stdout:8/784: truncate d17/d1b/d66/f72 2427925 0 2023-12-16T20:11:38.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 -- 172.21.15.38:0/441068244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540fdf60 msgr2=0x7f0f540fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 --2- 172.21.15.38:0/441068244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540fdf60 0x7f0f540fe3b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0f44004940 tx=0x7f0f44009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:38.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 -- 172.21.15.38:0/441068244 shutdown_connections 2023-12-16T20:11:38.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 --2- 172.21.15.38:0/441068244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540fdf60 0x7f0f540fe3b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 --2- 172.21.15.38:0/441068244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540faed0 0x7f0f540fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.981+0000 7f0f59b37700 1 -- 172.21.15.38:0/441068244 >> 172.21.15.38:0/441068244 conn(0x7f0f540f6950 msgr2=0x7f0f540f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.982+0000 7f0f59b37700 1 -- 172.21.15.38:0/441068244 shutdown_connections 2023-12-16T20:11:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.982+0000 7f0f59b37700 1 -- 172.21.15.38:0/441068244 wait complete. 2023-12-16T20:11:38.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/902: dwrite d9/d1f/d21/f28 [4194304,4194304] 0 2023-12-16T20:11:38.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/903: stat d9/d1e/d3d/f4b 0 2023-12-16T20:11:38.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.983+0000 7f0f59b37700 1 Processor -- start 2023-12-16T20:11:38.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.983+0000 7f0f59b37700 1 -- start start 2023-12-16T20:11:38.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.984+0000 7f0f59b37700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540faed0 0x7f0f5410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.984+0000 7f0f59b37700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.985+0000 7f0f59b37700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5410e0f0 con 0x7f0f540faed0 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.985+0000 7f0f52ffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.985+0000 7f0f52ffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:40060/0 (socket says 172.21.15.38:40060) 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.985+0000 7f0f52ffd700 1 -- 172.21.15.38:0/228507060 learned_addr learned my addr 172.21.15.38:0/228507060 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.985+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5410e990 con 0x7f0f540fdf60 2023-12-16T20:11:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.986+0000 7f0f537fe700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540faed0 0x7f0f5410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.987 INFO:tasks.workunit.client.0.smithi038.stdout:6/834: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f47 [0,4194304] 0 2023-12-16T20:11:38.987 INFO:tasks.workunit.client.0.smithi038.stdout:8/785: truncate d17/d1b/d25/db7/d82/d9b/fb3 3814691 0 2023-12-16T20:11:38.987 INFO:tasks.workunit.client.1.smithi141.stdout:0/540: sync 2023-12-16T20:11:38.987 INFO:tasks.workunit.client.1.smithi141.stdout:9/512: sync 2023-12-16T20:11:38.987 INFO:tasks.workunit.client.1.smithi141.stdout:0/541: write d4/d49/d73/f5b [4848475,9693] 0 2023-12-16T20:11:38.988 INFO:tasks.workunit.client.0.smithi038.stdout:3/962: dwrite d4/d18/f66 [0,4194304] 0 2023-12-16T20:11:38.988 INFO:tasks.workunit.client.0.smithi038.stdout:3/963: chown d4/f5 9662 1 2023-12-16T20:11:38.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.986+0000 7f0f52ffd700 1 -- 172.21.15.38:0/228507060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540faed0 msgr2=0x7f0f5410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:38.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.986+0000 7f0f52ffd700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540faed0 0x7f0f5410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:38.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.986+0000 7f0f52ffd700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44005040 con 0x7f0f540fdf60 2023-12-16T20:11:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.987+0000 7f0f52ffd700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f440040d0 tx=0x7f0f44009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.988+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f44021070 con 0x7f0f540fdf60 2023-12-16T20:11:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.988+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f4401c400 con 0x7f0f540fdf60 2023-12-16T20:11:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.988+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5410ec10 con 0x7f0f540fdf60 2023-12-16T20:11:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.988+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4400e070 con 0x7f0f540fdf60 2023-12-16T20:11:38.989 INFO:tasks.workunit.client.1.smithi141.stdout:6/570: write d1/dd/d43/f6c [5192626,109608] 0 2023-12-16T20:11:38.989 INFO:tasks.workunit.client.0.smithi038.stdout:6/835: rename d1/d5b/d7d/d9d/dc8/de7/f37 to d1/f10c 0 2023-12-16T20:11:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.989+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5410f150 con 0x7f0f540fdf60 2023-12-16T20:11:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.989+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 24) v1 ==== 45730+0+0 (secure 0 0 0) 0x7f0f4400b760 con 0x7f0f540fdf60 2023-12-16T20:11:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.990+0000 7f0f3bfff700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 0x7f0f3c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:38.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.990+0000 7f0f537fe700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 0x7f0f3c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:38.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.990+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0f4401c5e0 con 0x7f0f540fdf60 2023-12-16T20:11:38.991 INFO:tasks.workunit.client.1.smithi141.stdout:9/513: link d1/d10/d27/l2c d1/d10/d33/lb5 0 2023-12-16T20:11:38.994 INFO:tasks.workunit.client.1.smithi141.stdout:3/625: sync 2023-12-16T20:11:38.994 INFO:tasks.workunit.client.1.smithi141.stdout:3/626: fdatasync d0/d1c/d40/f27 0 2023-12-16T20:11:38.994 INFO:tasks.workunit.client.1.smithi141.stdout:4/486: sync 2023-12-16T20:11:38.994 INFO:tasks.workunit.client.1.smithi141.stdout:6/571: creat d1/d77/d9e/fb6 x:0 0 0 2023-12-16T20:11:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.991+0000 7f0f537fe700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 0x7f0f3c03ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b80 tx=0x7f0f4800b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:38.992+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5404bb80 con 0x7f0f540fdf60 2023-12-16T20:11:38.996 INFO:tasks.workunit.client.0.smithi038.stdout:3/964: creat d4/dcd/d139/f156 x:0 0 0 2023-12-16T20:11:38.996 INFO:tasks.workunit.client.0.smithi038.stdout:3/965: fsync d4/d27/d23/f57 0 2023-12-16T20:11:38.997 INFO:tasks.workunit.client.0.smithi038.stdout:0/871: dwrite db/d16/d19/d27/d56/f87 [0,4194304] 0 2023-12-16T20:11:38.998 INFO:tasks.workunit.client.1.smithi141.stdout:0/542: link d4/d7/l29 d4/d49/d73/d3b/d78/d7f/d80/lbc 0 2023-12-16T20:11:38.999 INFO:tasks.workunit.client.1.smithi141.stdout:6/572: write d1/d3/d4b/f66 [784201,113141] 0 2023-12-16T20:11:38.999 INFO:tasks.workunit.client.1.smithi141.stdout:3/627: creat d0/d1c/d40/d3c/fcc x:0 0 0 2023-12-16T20:11:39.002 INFO:tasks.workunit.client.1.smithi141.stdout:4/487: mkdir d1a/d2a/d3b/db2 0 2023-12-16T20:11:39.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.002+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0f44052060 con 0x7f0f540fdf60 2023-12-16T20:11:39.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/872: write db/d16/d19/d4e/d106/d65/de8/d77/d95/da4/fbe [44933,3059] 0 2023-12-16T20:11:39.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/873: write db/d16/d19/d4e/d106/d65/de8/d77/d95/dd8/f10d [695000,13249] 0 2023-12-16T20:11:39.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/874: creat db/d16/d19/d4e/d106/d65/de8/d77/d95/dd8/f119 x:0 0 0 2023-12-16T20:11:39.009 INFO:tasks.workunit.client.0.smithi038.stdout:8/786: write d17/d1b/d66/f98 [1352660,77762] 0 2023-12-16T20:11:39.011 INFO:tasks.workunit.client.1.smithi141.stdout:0/543: dread d4/f3e [0,4194304] 0 2023-12-16T20:11:39.011 INFO:tasks.workunit.client.0.smithi038.stdout:0/875: mkdir db/d16/d19/d4e/d89/d11a 0 2023-12-16T20:11:39.012 INFO:tasks.workunit.client.0.smithi038.stdout:7/964: dwrite da/f5d [0,4194304] 0 2023-12-16T20:11:39.013 INFO:tasks.workunit.client.1.smithi141.stdout:3/628: symlink d0/d1c/d6a/d76/lcd 0 2023-12-16T20:11:39.013 INFO:tasks.workunit.client.1.smithi141.stdout:6/573: symlink d1/d3/d4b/lb7 0 2023-12-16T20:11:39.013 INFO:tasks.workunit.client.1.smithi141.stdout:6/574: fdatasync d1/d12/d22/f53 0 2023-12-16T20:11:39.014 INFO:tasks.workunit.client.1.smithi141.stdout:4/488: dread d1a/d2a/d3b/d69/fa3 [0,4194304] 0 2023-12-16T20:11:39.014 INFO:tasks.workunit.client.1.smithi141.stdout:4/489: dread - d1a/d2a/fa2 zero size 2023-12-16T20:11:39.018 INFO:tasks.workunit.client.0.smithi038.stdout:7/965: mknod da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/c145 0 2023-12-16T20:11:39.018 INFO:tasks.workunit.client.0.smithi038.stdout:8/787: rename d17/d1b/d66/d73/d9e to d17/d1b/d25/db7/d82/da9/d50/ddd/df9 0 2023-12-16T20:11:39.019 INFO:tasks.workunit.client.1.smithi141.stdout:8/539: dwrite d14/d19/d1b/d24/f49 [0,4194304] 0 2023-12-16T20:11:39.020 INFO:tasks.workunit.client.1.smithi141.stdout:6/575: rename d1/dd/d43 to d1/d3/d4b/d60/db8 0 2023-12-16T20:11:39.020 INFO:tasks.workunit.client.1.smithi141.stdout:6/576: creat d1/d77/fb9 x:0 0 0 2023-12-16T20:11:39.023 INFO:tasks.workunit.client.0.smithi038.stdout:8/788: mkdir d17/d1b/d66/dfa 0 2023-12-16T20:11:39.025 INFO:tasks.workunit.client.0.smithi038.stdout:9/904: dwrite d9/fd8 [0,4194304] 0 2023-12-16T20:11:39.025 INFO:tasks.workunit.client.0.smithi038.stdout:9/905: creat d9/dea/f11f x:0 0 0 2023-12-16T20:11:39.030 INFO:tasks.workunit.client.1.smithi141.stdout:4/490: creat d1a/d54/d87/da8/da9/fb3 x:0 0 0 2023-12-16T20:11:39.031 INFO:tasks.workunit.client.1.smithi141.stdout:3/629: rmdir d0/d1c/d6a/d76/da2 39 2023-12-16T20:11:39.032 INFO:tasks.workunit.client.0.smithi038.stdout:7/966: dread da/d21/d2c/f30 [0,4194304] 0 2023-12-16T20:11:39.036 INFO:tasks.workunit.client.0.smithi038.stdout:0/876: dread db/db6/fdb [0,4194304] 0 2023-12-16T20:11:39.043 INFO:tasks.workunit.client.0.smithi038.stdout:3/966: dwrite d4/d27/d2b/d64/f72 [0,4194304] 0 2023-12-16T20:11:39.045 INFO:tasks.workunit.client.0.smithi038.stdout:9/906: dread d9/d1f/d21/d3e/d4e/d64/fa0 [0,4194304] 0 2023-12-16T20:11:39.046 INFO:tasks.workunit.client.1.smithi141.stdout:9/514: dwrite d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:39.048 INFO:tasks.workunit.client.0.smithi038.stdout:8/789: symlink d17/d1b/d25/db7/d82/da9/d50/d96/lfb 0 2023-12-16T20:11:39.049 INFO:tasks.workunit.client.1.smithi141.stdout:4/491: symlink d1a/d2a/lb4 0 2023-12-16T20:11:39.050 INFO:tasks.workunit.client.1.smithi141.stdout:6/577: dwrite d1/d12/d22/d25/d38/faf [0,4194304] 0 2023-12-16T20:11:39.051 INFO:tasks.workunit.client.1.smithi141.stdout:8/540: rename d14/d19/d1b/d3d/f76 to d14/d19/d1b/d24/d4b/fa9 0 2023-12-16T20:11:39.054 INFO:tasks.workunit.client.1.smithi141.stdout:3/630: rmdir d0/d1c/d40/d3c 39 2023-12-16T20:11:39.054 INFO:tasks.workunit.client.0.smithi038.stdout:7/967: rename da/dcf/d100/d4d/dc5/ddc/d8e/f78 to da/dcf/d100/d4d/dc5/ddc/d8e/f146 0 2023-12-16T20:11:39.054 INFO:tasks.workunit.client.0.smithi038.stdout:7/968: readlink da/dcf/d100/d4d/la2 0 2023-12-16T20:11:39.054 INFO:tasks.workunit.client.0.smithi038.stdout:7/969: chown da/dcf/d100/d4d/dc5/d38/d65/d81/ca4 502019 1 2023-12-16T20:11:39.058 INFO:tasks.workunit.client.1.smithi141.stdout:6/578: rmdir d1/d5e 39 2023-12-16T20:11:39.059 INFO:tasks.workunit.client.1.smithi141.stdout:6/579: write d1/d12/d22/d25/f7e [2850863,74136] 0 2023-12-16T20:11:39.059 INFO:tasks.workunit.client.1.smithi141.stdout:6/580: creat d1/dd/d2f/d48/fba x:0 0 0 2023-12-16T20:11:39.059 INFO:tasks.workunit.client.0.smithi038.stdout:3/967: mkdir d4/d8/d15/d6d/d7a/daf/d157 0 2023-12-16T20:11:39.060 INFO:tasks.workunit.client.0.smithi038.stdout:3/968: getdents d4/d67/de1/d4c/dae/d124/d148 0 2023-12-16T20:11:39.061 INFO:tasks.workunit.client.1.smithi141.stdout:3/631: mkdir d0/d1c/d40/d3c/dce 0 2023-12-16T20:11:39.062 INFO:tasks.workunit.client.0.smithi038.stdout:7/970: mkdir da/dcf/d100/d147 0 2023-12-16T20:11:39.062 INFO:tasks.workunit.client.0.smithi038.stdout:7/971: dread - da/d21/d61/dcd/f126 zero size 2023-12-16T20:11:39.062 INFO:tasks.workunit.client.0.smithi038.stdout:7/972: fsync da/d21/f55 0 2023-12-16T20:11:39.062 INFO:tasks.workunit.client.1.smithi141.stdout:4/492: write d1a/d3c/f65 [2283548,84552] 0 2023-12-16T20:11:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/969: rmdir d4/d8/d15/d154 0 2023-12-16T20:11:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/970: write d4/d67/de1/f95 [273676,102357] 0 2023-12-16T20:11:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/971: fsync d4/d27/d40/f126 0 2023-12-16T20:11:39.065 INFO:tasks.workunit.client.0.smithi038.stdout:3/972: chown d4/d67/de1/d7d/d155 11 1 2023-12-16T20:11:39.066 INFO:tasks.workunit.client.0.smithi038.stdout:7/973: unlink da/dcf/cdd 0 2023-12-16T20:11:39.066 INFO:tasks.workunit.client.0.smithi038.stdout:0/877: dwrite db/d16/d1c/f24 [0,4194304] 0 2023-12-16T20:11:39.066 INFO:tasks.workunit.client.0.smithi038.stdout:0/878: creat db/d16/d1c/f11b x:0 0 0 2023-12-16T20:11:39.067 INFO:tasks.workunit.client.0.smithi038.stdout:3/973: rmdir d4/d6c/da7 39 2023-12-16T20:11:39.068 INFO:tasks.workunit.client.0.smithi038.stdout:8/790: dread d17/f3b [0,4194304] 0 2023-12-16T20:11:39.068 INFO:tasks.workunit.client.0.smithi038.stdout:8/791: write d17/d1b/d25/f32 [733520,123217] 0 2023-12-16T20:11:39.069 INFO:tasks.workunit.client.0.smithi038.stdout:7/974: creat da/d21/d61/dcd/d6b/ded/d134/dd9/f148 x:0 0 0 2023-12-16T20:11:39.070 INFO:tasks.workunit.client.1.smithi141.stdout:6/581: rename d1/d12/d22/d25/d38/f9a to d1/d12/d22/d25/fbb 0 2023-12-16T20:11:39.070 INFO:tasks.workunit.client.0.smithi038.stdout:3/974: mknod d4/d6c/d80/d12a/c158 0 2023-12-16T20:11:39.071 INFO:tasks.workunit.client.1.smithi141.stdout:8/541: dread d14/d19/d1b/d24/d4a/d5b/f7b [0,4194304] 0 2023-12-16T20:11:39.072 INFO:tasks.workunit.client.1.smithi141.stdout:8/542: dread - d14/d19/d1b/f90 zero size 2023-12-16T20:11:39.072 INFO:tasks.workunit.client.1.smithi141.stdout:8/543: write d14/d19/d1b/d24/d4a/d5b/f7e [1972823,70500] 0 2023-12-16T20:11:39.072 INFO:tasks.workunit.client.1.smithi141.stdout:8/544: write d14/d19/d1b/d24/d4b/f5c [126518,62598] 0 2023-12-16T20:11:39.072 INFO:tasks.workunit.client.0.smithi038.stdout:8/792: stat d17/d1b/d25/db7/c64 0 2023-12-16T20:11:39.074 INFO:tasks.workunit.client.0.smithi038.stdout:7/975: rename da/d21/c6e to da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/c149 0 2023-12-16T20:11:39.076 INFO:tasks.workunit.client.1.smithi141.stdout:3/632: rename d0/d1c/d2c/d72/d74/f94 to d0/d1c/d6a/d8f/fcf 0 2023-12-16T20:11:39.078 INFO:tasks.workunit.client.0.smithi038.stdout:8/793: rmdir d17/d1b 39 2023-12-16T20:11:39.078 INFO:tasks.workunit.client.1.smithi141.stdout:6/582: unlink d1/f19 0 2023-12-16T20:11:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:7/976: getdents da/d21/d2c/dd0 0 2023-12-16T20:11:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:7/977: write da/d21/d2c/f36 [3242671,42102] 0 2023-12-16T20:11:39.079 INFO:tasks.workunit.client.1.smithi141.stdout:6/583: mknod d1/dd/d2f/cbc 0 2023-12-16T20:11:39.081 INFO:tasks.workunit.client.1.smithi141.stdout:8/545: creat d14/d19/d1b/d24/da3/faa x:0 0 0 2023-12-16T20:11:39.081 INFO:tasks.workunit.client.0.smithi038.stdout:8/794: getdents d17/d1b/d25/db7/d82/da9/d50/ddd/df9 0 2023-12-16T20:11:39.083 INFO:tasks.workunit.client.1.smithi141.stdout:9/515: dwrite d1/d10/d33/d6a/d72/fac [0,4194304] 0 2023-12-16T20:11:39.085 INFO:tasks.workunit.client.1.smithi141.stdout:6/584: mkdir d1/dbd 0 2023-12-16T20:11:39.085 INFO:tasks.workunit.client.1.smithi141.stdout:6/585: dread - d1/d3/fa0 zero size 2023-12-16T20:11:39.088 INFO:tasks.workunit.client.1.smithi141.stdout:8/546: stat d14/d19/d1b/d24/f31 0 2023-12-16T20:11:39.088 INFO:tasks.workunit.client.0.smithi038.stdout:9/907: dwrite d9/d1f/d21/d84/fb3 [0,4194304] 0 2023-12-16T20:11:39.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/795: write d17/d1b/d25/db7/d82/da9/f4c [1500552,91327] 0 2023-12-16T20:11:39.093 INFO:tasks.workunit.client.1.smithi141.stdout:3/633: write d0/d1c/f67 [2614289,17117] 0 2023-12-16T20:11:39.093 INFO:tasks.workunit.client.1.smithi141.stdout:3/634: read d0/d1c/d40/f39 [575072,21489] 0 2023-12-16T20:11:39.094 INFO:tasks.workunit.client.1.smithi141.stdout:9/516: creat d1/d10/fb6 x:0 0 0 2023-12-16T20:11:39.094 INFO:tasks.workunit.client.0.smithi038.stdout:9/908: rmdir d9/d1f/d21/d3e/d4e/d61 39 2023-12-16T20:11:39.097 INFO:tasks.workunit.client.0.smithi038.stdout:8/796: symlink d17/d1b/d66/dfa/lfc 0 2023-12-16T20:11:39.099 INFO:tasks.workunit.client.1.smithi141.stdout:9/517: symlink d1/d10/d14/d20/da/d3f/d66/lb7 0 2023-12-16T20:11:39.099 INFO:tasks.workunit.client.1.smithi141.stdout:8/547: rmdir d14/d35 39 2023-12-16T20:11:39.100 INFO:tasks.workunit.client.0.smithi038.stdout:9/909: rename d9/d1f/fac to d9/d1f/d6c/f120 0 2023-12-16T20:11:39.100 INFO:tasks.workunit.client.1.smithi141.stdout:9/518: symlink d1/d10/d27/lb8 0 2023-12-16T20:11:39.103 INFO:tasks.workunit.client.0.smithi038.stdout:8/797: creat d17/d1b/d57/d90/ffd x:0 0 0 2023-12-16T20:11:39.103 INFO:tasks.workunit.client.0.smithi038.stdout:9/910: mknod d9/d1e/d3d/c121 0 2023-12-16T20:11:39.106 INFO:tasks.workunit.client.0.smithi038.stdout:8/798: symlink d17/d1b/d66/d73/d55/da5/da6/de7/lfe 0 2023-12-16T20:11:39.106 INFO:tasks.workunit.client.0.smithi038.stdout:9/911: link d9/d1f/d21/d3e/la9 d9/d1f/d21/d84/l122 0 2023-12-16T20:11:39.107 INFO:tasks.workunit.client.0.smithi038.stdout:8/799: creat d17/d1b/d25/db7/d82/da9/d50/db1/fff x:0 0 0 2023-12-16T20:11:39.108 INFO:tasks.workunit.client.0.smithi038.stdout:9/912: rename d9/d1e/d3d/d42/d59/fa2 to d9/d1f/d21/d3e/d72/d8a/f123 0 2023-12-16T20:11:39.109 INFO:tasks.workunit.client.0.smithi038.stdout:8/800: rmdir d17/d1b/d25/db7/d82/da9/d50 39 2023-12-16T20:11:39.110 INFO:tasks.workunit.client.1.smithi141.stdout:8/548: write d14/d19/d1b/d3d/f77 [1014869,44365] 0 2023-12-16T20:11:39.110 INFO:tasks.workunit.client.0.smithi038.stdout:9/913: rename d9/d1f/d21/d52/d10c to d9/d1f/d21/d3e/d4e/d61/daa/d124 0 2023-12-16T20:11:39.111 INFO:tasks.workunit.client.0.smithi038.stdout:9/914: mknod d9/d1e/c125 0 2023-12-16T20:11:39.113 INFO:tasks.workunit.client.0.smithi038.stdout:9/915: symlink d9/d1f/d6c/l126 0 2023-12-16T20:11:39.113 INFO:tasks.workunit.client.0.smithi038.stdout:8/801: dread d17/d34/f84 [0,4194304] 0 2023-12-16T20:11:39.113 INFO:tasks.workunit.client.0.smithi038.stdout:9/916: write d9/d1e/d3d/f3f [641652,118857] 0 2023-12-16T20:11:39.113 INFO:tasks.workunit.client.0.smithi038.stdout:9/917: write d9/d1f/d21/d84/daf/f107 [4457855,92968] 0 2023-12-16T20:11:39.114 INFO:tasks.workunit.client.1.smithi141.stdout:8/549: mkdir d14/d19/d95/dab 0 2023-12-16T20:11:39.115 INFO:tasks.workunit.client.0.smithi038.stdout:8/802: symlink d17/d1b/d66/d73/d55/da5/da6/de7/l100 0 2023-12-16T20:11:39.118 INFO:tasks.workunit.client.0.smithi038.stdout:8/803: dread d17/d1b/d66/d73/fbf [0,4194304] 0 2023-12-16T20:11:39.119 INFO:tasks.workunit.client.0.smithi038.stdout:8/804: stat d17/d1b/d25/db7/d82/da9/d50/db1/fde 0 2023-12-16T20:11:39.119 INFO:tasks.workunit.client.0.smithi038.stdout:8/805: fsync d17/d1b/f3f 0 2023-12-16T20:11:39.119 INFO:tasks.workunit.client.0.smithi038.stdout:0/879: dwrite db/d16/d19/d27/ff3 [0,4194304] 0 2023-12-16T20:11:39.119 INFO:tasks.workunit.client.0.smithi038.stdout:0/880: read - db/d16/d1c/fc0 zero size 2023-12-16T20:11:39.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/550: dread d14/f15 [0,4194304] 0 2023-12-16T20:11:39.120 INFO:tasks.workunit.client.1.smithi141.stdout:8/551: stat d14/d19/d1b/d24/d4b/d8f 0 2023-12-16T20:11:39.122 INFO:tasks.workunit.client.0.smithi038.stdout:8/806: dread d17/d1b/d57/f65 [0,4194304] 0 2023-12-16T20:11:39.122 INFO:tasks.workunit.client.0.smithi038.stdout:8/807: truncate d17/d1b/d25/db7/d82/daa/ff7 925471 0 2023-12-16T20:11:39.122 INFO:tasks.workunit.client.0.smithi038.stdout:0/881: mkdir db/d16/d19/d4e/d106/d65/de8/d77/d95/dd8/d11c 0 2023-12-16T20:11:39.123 INFO:tasks.workunit.client.0.smithi038.stdout:8/808: creat d17/f101 x:0 0 0 2023-12-16T20:11:39.124 INFO:tasks.workunit.client.0.smithi038.stdout:8/809: creat d17/d1b/d66/d73/dc8/f102 x:0 0 0 2023-12-16T20:11:39.125 INFO:tasks.workunit.client.0.smithi038.stdout:8/810: symlink d17/d1b/l103 0 2023-12-16T20:11:39.125 INFO:tasks.workunit.client.0.smithi038.stdout:8/811: fdatasync d17/d1b/d25/db7/d82/da9/d50/d96/dba/ff8 0 2023-12-16T20:11:39.126 INFO:tasks.workunit.client.0.smithi038.stdout:8/812: truncate d17/d1b/d66/d73/d54/d69/f8f 559103 0 2023-12-16T20:11:39.127 INFO:tasks.workunit.client.0.smithi038.stdout:8/813: creat d17/d1b/d66/f104 x:0 0 0 2023-12-16T20:11:39.127 INFO:tasks.workunit.client.0.smithi038.stdout:8/814: write f13 [1628142,120636] 0 2023-12-16T20:11:39.127 INFO:tasks.workunit.client.0.smithi038.stdout:8/815: fdatasync d17/d1b/d25/db7/d82/d9b/fc0 0 2023-12-16T20:11:39.129 INFO:tasks.workunit.client.0.smithi038.stdout:8/816: unlink d17/d1b/d25/cf6 0 2023-12-16T20:11:39.133 INFO:tasks.workunit.client.1.smithi141.stdout:7/544: sync 2023-12-16T20:11:39.133 INFO:tasks.workunit.client.1.smithi141.stdout:1/576: sync 2023-12-16T20:11:39.133 INFO:tasks.workunit.client.1.smithi141.stdout:1/577: stat da/d1a/d1d/d22 0 2023-12-16T20:11:39.133 INFO:tasks.workunit.client.1.smithi141.stdout:3/635: dwrite d0/d1c/d40/f99 [0,4194304] 0 2023-12-16T20:11:39.134 INFO:tasks.workunit.client.1.smithi141.stdout:3/636: readlink d0/l12 0 2023-12-16T20:11:39.134 INFO:tasks.workunit.client.0.smithi038.stdout:7/978: dwrite da/f98 [0,4194304] 0 2023-12-16T20:11:39.134 INFO:tasks.workunit.client.0.smithi038.stdout:7/979: chown da/dcf/d100/d4d/dc5/fa8 7 1 2023-12-16T20:11:39.134 INFO:tasks.workunit.client.0.smithi038.stdout:3/975: dwrite d4/d67/de1/d7d/f134 [0,4194304] 0 2023-12-16T20:11:39.135 INFO:tasks.workunit.client.0.smithi038.stdout:3/976: write d4/d67/de1/d4c/fef [1972100,111535] 0 2023-12-16T20:11:39.135 INFO:tasks.workunit.client.1.smithi141.stdout:1/578: chown da/l86 137258 1 2023-12-16T20:11:39.138 INFO:tasks.workunit.client.1.smithi141.stdout:7/545: rename c3 to d5/d1d/d1e/d27/cb0 0 2023-12-16T20:11:39.138 INFO:tasks.workunit.client.1.smithi141.stdout:7/546: dread - d5/d16/d46/f53 zero size 2023-12-16T20:11:39.139 INFO:tasks.workunit.client.1.smithi141.stdout:8/552: dread d14/d19/d1b/d24/f28 [0,4194304] 0 2023-12-16T20:11:39.139 INFO:tasks.workunit.client.1.smithi141.stdout:6/586: dwrite d1/dd/d2f/d48/f84 [0,4194304] 0 2023-12-16T20:11:39.143 INFO:tasks.workunit.client.1.smithi141.stdout:7/547: symlink d5/d16/d30/d36/d8c/lb1 0 2023-12-16T20:11:39.147 INFO:tasks.workunit.client.1.smithi141.stdout:8/553: creat d14/d19/d1b/d24/d4a/fac x:0 0 0 2023-12-16T20:11:39.150 INFO:tasks.workunit.client.0.smithi038.stdout:0/882: dread db/fec [0,4194304] 0 2023-12-16T20:11:39.155 INFO:tasks.workunit.client.1.smithi141.stdout:6/587: mknod d1/d12/cbe 0 2023-12-16T20:11:39.156 INFO:tasks.workunit.client.1.smithi141.stdout:8/554: dread d14/d19/d1b/d24/d4a/d58/d8b/f9e [0,4194304] 0 2023-12-16T20:11:39.156 INFO:tasks.workunit.client.1.smithi141.stdout:8/555: write d14/d19/d1b/d24/d4b/f97 [678306,55014] 0 2023-12-16T20:11:39.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/588: symlink d1/d12/d20/d44/lbf 0 2023-12-16T20:11:39.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/589: chown d1/d5e 12 1 2023-12-16T20:11:39.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/977: creat d4/d18/d110/f159 x:0 0 0 2023-12-16T20:11:39.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/980: rename da/l64 to da/d21/d2c/d76/dc9/l14a 0 2023-12-16T20:11:39.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/981: truncate da/d21/d61/f9d 563599 0 2023-12-16T20:11:39.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/982: symlink da/dcf/d100/d4d/dc5/d38/d65/d81/dbd/l14b 0 2023-12-16T20:11:39.161 INFO:tasks.workunit.client.1.smithi141.stdout:8/556: creat d14/fad x:0 0 0 2023-12-16T20:11:39.162 INFO:tasks.workunit.client.0.smithi038.stdout:7/983: mknod da/dcf/d100/d4d/dae/c14c 0 2023-12-16T20:11:39.163 INFO:tasks.workunit.client.1.smithi141.stdout:7/548: link d5/d16/d30/l43 d5/d16/d30/d4e/d87/lb2 0 2023-12-16T20:11:39.164 INFO:tasks.workunit.client.0.smithi038.stdout:7/984: rename da/d21/d61/le7 to da/d21/d2c/l14d 0 2023-12-16T20:11:39.164 INFO:tasks.workunit.client.0.smithi038.stdout:7/985: creat da/d21/d2c/d76/d9a/f14e x:0 0 0 2023-12-16T20:11:39.164 INFO:tasks.workunit.client.0.smithi038.stdout:7/986: chown da/d21/d2c/d76/fd8 261562 1 2023-12-16T20:11:39.165 INFO:tasks.workunit.client.1.smithi141.stdout:6/590: symlink d1/d12/d20/d3a/d45/d47/lc0 0 2023-12-16T20:11:39.166 INFO:tasks.workunit.client.1.smithi141.stdout:6/591: write d1/dd/f1e [341686,120208] 0 2023-12-16T20:11:39.166 INFO:tasks.workunit.client.1.smithi141.stdout:6/592: fsync d1/d12/d20/d44/d4a/f79 0 2023-12-16T20:11:39.168 INFO:tasks.workunit.client.1.smithi141.stdout:8/557: getdents d14/d19/d1b/d24/da3 0 2023-12-16T20:11:39.168 INFO:tasks.workunit.client.1.smithi141.stdout:8/558: write d14/d35/f66 [1521884,80530] 0 2023-12-16T20:11:39.168 INFO:tasks.workunit.client.0.smithi038.stdout:7/987: truncate da/dcf/d100/d4d/dc5/ddc/f40 701538 0 2023-12-16T20:11:39.169 INFO:tasks.workunit.client.0.smithi038.stdout:3/978: write d4/d27/d40/f7f [3078281,19382] 0 2023-12-16T20:11:39.169 INFO:tasks.workunit.client.1.smithi141.stdout:7/549: rename d5/d16/d30/d36/l6c to d5/d16/d30/lb3 0 2023-12-16T20:11:39.169 INFO:tasks.workunit.client.1.smithi141.stdout:7/550: write d5/f11 [926142,123254] 0 2023-12-16T20:11:39.170 INFO:tasks.workunit.client.0.smithi038.stdout:7/988: rename da/d21/d61/dcd/l10e to da/dcf/d100/d4d/d51/l14f 0 2023-12-16T20:11:39.172 INFO:tasks.workunit.client.1.smithi141.stdout:8/559: dread d14/d19/f20 [0,4194304] 0 2023-12-16T20:11:39.173 INFO:tasks.workunit.client.0.smithi038.stdout:3/979: creat d4/d67/de1/d4c/d14f/f15a x:0 0 0 2023-12-16T20:11:39.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/980: stat d4/d67/de1/d4c 0 2023-12-16T20:11:39.174 INFO:tasks.workunit.client.1.smithi141.stdout:8/560: mkdir d14/d19/d95/dae 0 2023-12-16T20:11:39.177 INFO:tasks.workunit.client.0.smithi038.stdout:7/989: rename da/dcf/d100/d4d/dc5/d38/d65/l127 to da/dcf/d100/d4d/dc5/d38/d65/d81/l150 0 2023-12-16T20:11:39.179 INFO:tasks.workunit.client.1.smithi141.stdout:6/593: read d1/d12/d20/d3a/f80 [2222690,100996] 0 2023-12-16T20:11:39.181 INFO:tasks.workunit.client.0.smithi038.stdout:3/981: creat d4/d8/d15/d6d/d7a/f15b x:0 0 0 2023-12-16T20:11:39.184 INFO:tasks.workunit.client.1.smithi141.stdout:7/551: dread d5/f5f [0,4194304] 0 2023-12-16T20:11:39.185 INFO:tasks.workunit.client.1.smithi141.stdout:3/637: dwrite d0/fc5 [0,4194304] 0 2023-12-16T20:11:39.185 INFO:tasks.workunit.client.1.smithi141.stdout:3/638: readlink d0/d1c/d40/d85/d96/lb9 0 2023-12-16T20:11:39.186 INFO:tasks.workunit.client.1.smithi141.stdout:1/579: dwrite da/d36/d4b/f63 [0,4194304] 0 2023-12-16T20:11:39.187 INFO:tasks.workunit.client.0.smithi038.stdout:0/883: dwrite f8 [4194304,4194304] 0 2023-12-16T20:11:39.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/817: dwrite d17/d1b/d25/db7/d82/d9b/fb3 [0,4194304] 0 2023-12-16T20:11:39.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/818: fsync d17/d1b/d25/db7/d82/fa4 0 2023-12-16T20:11:39.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/819: chown d17/d1b/d66/d73/d55/da5/da6/de7/cea 7 1 2023-12-16T20:11:39.191 INFO:tasks.workunit.client.1.smithi141.stdout:6/594: dread d1/d12/d22/d25/f7e [4194304,4194304] 0 2023-12-16T20:11:39.193 INFO:tasks.workunit.client.1.smithi141.stdout:3/639: rmdir d0/d1c/d6a/d8f 39 2023-12-16T20:11:39.194 INFO:tasks.workunit.client.1.smithi141.stdout:3/640: chown d0/d1c/d40/d3f/d52/d5a/f71 10657639 1 2023-12-16T20:11:39.194 INFO:tasks.workunit.client.0.smithi038.stdout:3/982: dread d4/d8/dc8/f119 [0,4194304] 0 2023-12-16T20:11:39.194 INFO:tasks.workunit.client.0.smithi038.stdout:8/820: rename d17/d34/fa8 to d17/d1b/d57/d90/f105 0 2023-12-16T20:11:39.195 INFO:tasks.workunit.client.0.smithi038.stdout:0/884: symlink db/d16/d19/d27/d56/l11d 0 2023-12-16T20:11:39.195 INFO:tasks.workunit.client.0.smithi038.stdout:8/821: symlink d17/d1b/d25/db7/d82/da9/d50/d7d/l106 0 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:5/976: sync 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:6/836: sync 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:1/918: sync 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:5/977: chown d2/d14/d25 903433394 1 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:1/919: fdatasync d15/d1e/d30/f50 0 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:4/841: sync 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:4/842: fdatasync d13/d17/d2e/d32/d70/d84/d88/dc3/de9/fff 0 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:6/837: write d1/d4/d1d/d61/da4/fd9 [916048,72153] 0 2023-12-16T20:11:39.196 INFO:tasks.workunit.client.0.smithi038.stdout:6/838: fsync d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f8d 0 2023-12-16T20:11:39.197 INFO:tasks.workunit.client.0.smithi038.stdout:8/822: rename d17/d1b/d66/d73/d4e/f88 to d17/d1b/d25/db7/d82/da9/f107 0 2023-12-16T20:11:39.199 INFO:tasks.workunit.client.1.smithi141.stdout:1/580: creat da/d1a/d31/fc3 x:0 0 0 2023-12-16T20:11:39.199 INFO:tasks.workunit.client.1.smithi141.stdout:6/595: creat d1/d12/d20/d3a/d45/d47/fc1 x:0 0 0 2023-12-16T20:11:39.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/978: creat d2/df/d1a/f136 x:0 0 0 2023-12-16T20:11:39.200 INFO:tasks.workunit.client.0.smithi038.stdout:1/920: creat d15/d1e/d3b/d5a/f13d x:0 0 0 2023-12-16T20:11:39.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/839: rename d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/ff0 to d1/d5b/d7d/d9d/dc8/f10d 0 2023-12-16T20:11:39.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/840: creat d1/d4/d1d/f10e x:0 0 0 2023-12-16T20:11:39.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/841: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fde [5212511,21958] 0 2023-12-16T20:11:39.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/842: chown d1/d4/d1d/d67/ca3 7997 1 2023-12-16T20:11:39.203 INFO:tasks.workunit.client.0.smithi038.stdout:8/823: mkdir d17/d1b/d25/db7/d82/da9/d59/d108 0 2023-12-16T20:11:39.205 INFO:tasks.workunit.client.0.smithi038.stdout:1/921: creat d15/d1e/d3b/d117/d7d/de9/f13e x:0 0 0 2023-12-16T20:11:39.206 INFO:tasks.workunit.client.1.smithi141.stdout:8/561: dwrite d14/f94 [0,4194304] 0 2023-12-16T20:11:39.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/843: getdents d13/d17/d4b 0 2023-12-16T20:11:39.209 INFO:tasks.workunit.client.0.smithi038.stdout:8/824: rename d17/d1b/d66/dfa/lfc to d17/d1b/d25/db7/d82/da9/d59/l109 0 2023-12-16T20:11:39.209 INFO:tasks.workunit.client.0.smithi038.stdout:8/825: chown d17/d1b/d25/db7/d82/da9/d50/db1/fff 1232748325 1 2023-12-16T20:11:39.210 INFO:tasks.workunit.client.0.smithi038.stdout:1/922: mknod d15/d1e/d118/c13f 0 2023-12-16T20:11:39.210 INFO:tasks.workunit.client.0.smithi038.stdout:1/923: fdatasync d15/d1e/d3b/d48/d37/dde/d75/f90 0 2023-12-16T20:11:39.211 INFO:tasks.workunit.client.0.smithi038.stdout:4/844: symlink d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/dda/l118 0 2023-12-16T20:11:39.212 INFO:tasks.workunit.client.0.smithi038.stdout:1/924: write d15/d1e/d3b/d117/f78 [675998,31754] 0 2023-12-16T20:11:39.212 INFO:tasks.workunit.client.0.smithi038.stdout:1/925: chown d15/d1e/d3b/d117/d46/d138/fec 93265 1 2023-12-16T20:11:39.213 INFO:tasks.workunit.client.0.smithi038.stdout:8/826: mknod d17/d1b/d25/db7/d82/d9b/c10a 0 2023-12-16T20:11:39.213 INFO:tasks.workunit.client.0.smithi038.stdout:8/827: write d17/d34/f92 [366824,47515] 0 2023-12-16T20:11:39.213 INFO:tasks.workunit.client.0.smithi038.stdout:4/845: creat d13/d69/d7a/f119 x:0 0 0 2023-12-16T20:11:39.214 INFO:tasks.workunit.client.0.smithi038.stdout:1/926: creat d15/d1e/d3b/d48/d37/dde/dcf/f140 x:0 0 0 2023-12-16T20:11:39.215 INFO:tasks.workunit.client.0.smithi038.stdout:1/927: creat d15/d1e/d3b/d48/d37/f141 x:0 0 0 2023-12-16T20:11:39.216 INFO:tasks.workunit.client.0.smithi038.stdout:1/928: mknod d15/d1e/d3b/d117/d34/d86/d9a/c142 0 2023-12-16T20:11:39.216 INFO:tasks.workunit.client.0.smithi038.stdout:1/929: write d15/d4a/fc0 [1298449,65015] 0 2023-12-16T20:11:39.216 INFO:tasks.workunit.client.0.smithi038.stdout:1/930: dread - d15/d1e/d3b/d117/d34/d79/fca zero size 2023-12-16T20:11:39.217 INFO:tasks.workunit.client.0.smithi038.stdout:1/931: creat d15/d1e/d3b/d48/d37/dde/f143 x:0 0 0 2023-12-16T20:11:39.224 INFO:tasks.workunit.client.0.smithi038.stdout:4/846: dread d13/d17/d62/fba [0,4194304] 0 2023-12-16T20:11:39.281 INFO:tasks.workunit.client.0.smithi038.stdout:0/885: symlink db/d16/d19/d4e/d106/d65/de8/d77/d95/d9e/l11e 0 2023-12-16T20:11:39.286 INFO:tasks.workunit.client.1.smithi141.stdout:3/641: mknod d0/d1c/cd0 0 2023-12-16T20:11:39.286 INFO:tasks.workunit.client.1.smithi141.stdout:3/642: chown d0/d1c/d40/f99 4911348 1 2023-12-16T20:11:39.286 INFO:tasks.workunit.client.1.smithi141.stdout:3/643: dread - d0/d1c/d40/d3f/d52/f7b zero size 2023-12-16T20:11:39.291 INFO:tasks.workunit.client.0.smithi038.stdout:0/886: unlink db/d16/d19/d27/l29 0 2023-12-16T20:11:39.292 INFO:tasks.workunit.client.0.smithi038.stdout:0/887: dread - db/d16/d19/d27/f51 zero size 2023-12-16T20:11:39.293 INFO:tasks.workunit.client.1.smithi141.stdout:1/581: creat da/d36/d4b/d4d/d80/d94/fc4 x:0 0 0 2023-12-16T20:11:39.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/596: creat d1/dd/de/d8a/fc2 x:0 0 0 2023-12-16T20:11:39.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/597: dread - d1/dd/de/d8a/fc2 zero size 2023-12-16T20:11:39.299 INFO:tasks.workunit.client.0.smithi038.stdout:5/979: read d2/d14/d25/d2d/f2c [1451758,51269] 0 2023-12-16T20:11:39.299 INFO:tasks.workunit.client.0.smithi038.stdout:1/932: write d15/d22/d62/fe7 [621046,104779] 0 2023-12-16T20:11:39.300 INFO:tasks.workunit.client.1.smithi141.stdout:8/562: truncate d14/d19/d1b/d24/d4a/d5b/f7e 4967748 0 2023-12-16T20:11:39.300 INFO:tasks.workunit.client.1.smithi141.stdout:8/563: fdatasync d14/d19/d1b/f8a 0 2023-12-16T20:11:39.301 INFO:tasks.workunit.client.1.smithi141.stdout:3/644: creat d0/d1c/da9/fd1 x:0 0 0 2023-12-16T20:11:39.302 INFO:tasks.workunit.client.1.smithi141.stdout:6/598: mkdir d1/d12/d22/d25/dc3 0 2023-12-16T20:11:39.302 INFO:tasks.workunit.client.1.smithi141.stdout:6/599: creat d1/fc4 x:0 0 0 2023-12-16T20:11:39.302 INFO:tasks.workunit.client.1.smithi141.stdout:6/600: dread - d1/d3/d4b/d60/f99 zero size 2023-12-16T20:11:39.304 INFO:tasks.workunit.client.1.smithi141.stdout:3/645: creat d0/d1c/d40/d85/d96/fd2 x:0 0 0 2023-12-16T20:11:39.307 INFO:tasks.workunit.client.0.smithi038.stdout:5/980: symlink d2/df/d1a/d1f/d4a/d53/d6e/d129/d131/l137 0 2023-12-16T20:11:39.308 INFO:tasks.workunit.client.0.smithi038.stdout:1/933: creat d15/d1e/d3b/d48/d37/f144 x:0 0 0 2023-12-16T20:11:39.308 INFO:tasks.workunit.client.0.smithi038.stdout:1/934: chown d15/d22/d7b/ffb 26938688 1 2023-12-16T20:11:39.314 INFO:tasks.workunit.client.0.smithi038.stdout:7/990: dwrite da/d21/d2c/d76/fd8 [0,4194304] 0 2023-12-16T20:11:39.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/991: mknod da/dcf/c151 0 2023-12-16T20:11:39.318 INFO:tasks.workunit.client.0.smithi038.stdout:7/992: truncate da/d21/d2c/dd0/ffb 766491 0 2023-12-16T20:11:39.321 INFO:tasks.workunit.client.0.smithi038.stdout:5/981: write d2/df/d1a/d1f/d4a/f52 [2826366,52059] 0 2023-12-16T20:11:39.322 INFO:tasks.workunit.client.0.smithi038.stdout:7/993: symlink da/d21/d86/d144/l152 0 2023-12-16T20:11:39.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/888: write db/f14 [1082268,26810] 0 2023-12-16T20:11:39.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/889: fsync db/d16/d1c/fae 0 2023-12-16T20:11:39.330 INFO:tasks.workunit.client.1.smithi141.stdout:6/601: getdents d1/dd/d2f 0 2023-12-16T20:11:39.332 INFO:tasks.workunit.client.1.smithi141.stdout:6/602: read d1/d12/d20/d44/fb1 [1072218,119656] 0 2023-12-16T20:11:39.332 INFO:tasks.workunit.client.1.smithi141.stdout:6/603: chown d1/d12/d20/d3a/f6d 284565 1 2023-12-16T20:11:39.332 INFO:tasks.workunit.client.1.smithi141.stdout:6/604: getdents d1/d3/d4b/d60/db8/d69 0 2023-12-16T20:11:39.333 INFO:tasks.workunit.client.1.smithi141.stdout:7/552: dwrite d5/d2a/f3d [0,4194304] 0 2023-12-16T20:11:39.333 INFO:tasks.workunit.client.1.smithi141.stdout:6/605: symlink d1/lc5 0 2023-12-16T20:11:39.335 INFO:tasks.workunit.client.1.smithi141.stdout:6/606: dread d1/dd/d2f/f30 [4194304,4194304] 0 2023-12-16T20:11:39.335 INFO:tasks.workunit.client.1.smithi141.stdout:1/582: dwrite da/d1a/d31/f49 [0,4194304] 0 2023-12-16T20:11:39.335 INFO:tasks.workunit.client.0.smithi038.stdout:0/890: mkdir db/d11f 0 2023-12-16T20:11:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.336+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5410f600 con 0x7f0f3c038770 2023-12-16T20:11:39.340 INFO:tasks.workunit.client.0.smithi038.stdout:0/891: creat db/d16/d19/d4e/d106/d65/d90/dca/f120 x:0 0 0 2023-12-16T20:11:39.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/847: dwrite d13/f77 [0,4194304] 0 2023-12-16T20:11:39.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/848: dread - d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/da6/fea zero size 2023-12-16T20:11:39.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/849: truncate d13/d17/d62/fbb 36306 0 2023-12-16T20:11:39.342 INFO:tasks.workunit.client.1.smithi141.stdout:8/564: dwrite d14/d35/f70 [0,4194304] 0 2023-12-16T20:11:39.342 INFO:tasks.workunit.client.1.smithi141.stdout:8/565: creat d14/d19/d1b/d24/d4a/d58/faf x:0 0 0 2023-12-16T20:11:39.343 INFO:tasks.workunit.client.0.smithi038.stdout:8/828: dwrite d17/d1b/d66/d73/ff2 [0,4194304] 0 2023-12-16T20:11:39.343 INFO:tasks.workunit.client.0.smithi038.stdout:8/829: truncate d17/d1b/d57/f79 5006 0 2023-12-16T20:11:39.348 INFO:tasks.workunit.client.0.smithi038.stdout:8/830: creat d17/d1b/d25/db7/d82/da9/d50/d7d/f10b x:0 0 0 2023-12-16T20:11:39.348 INFO:tasks.workunit.client.0.smithi038.stdout:8/831: dread - d17/d1b/d66/d73/d4e/fbe zero size 2023-12-16T20:11:39.351 INFO:tasks.workunit.client.0.smithi038.stdout:1/935: write d15/d1e/d3b/d48/d37/deb/f136 [631458,17642] 0 2023-12-16T20:11:39.353 INFO:tasks.workunit.client.1.smithi141.stdout:8/566: read d14/d19/d1b/f3a [525864,29604] 0 2023-12-16T20:11:39.353 INFO:tasks.workunit.client.0.smithi038.stdout:1/936: mknod d15/d1e/d3b/d117/d34/d86/c145 0 2023-12-16T20:11:39.353 INFO:tasks.workunit.client.0.smithi038.stdout:8/832: dread d17/d1b/d57/f65 [0,4194304] 0 2023-12-16T20:11:39.354 INFO:tasks.workunit.client.1.smithi141.stdout:6/607: mkdir d1/d12/d22/d25/dc3/dc6 0 2023-12-16T20:11:39.354 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:11:39.354 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (4m) 113s ago 5m 24.2M - 0.25.0 c8568f914cd2 3b37fdee0436 2023-12-16T20:11:39.354 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (5m) 113s ago 5m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:11:39.354 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (4m) 31s ago 4m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (4m) 113s ago 5m 83.9M - 9.4.7 954c08fa6188 aef7cc507220 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (2m) 113s ago 2m 15.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (2m) 113s ago 2m 9445k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (2m) 31s ago 119s 37.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (2m) 31s ago 2m 56.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:9283 running (6m) 113s ago 6m 476M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6c2471ed13fc 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 running (37s) 31s ago 4m 45.4M - 19.0.0-202-gc7586e95 e538bb48aa15 db85819a3703 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (6m) 113s ago 6m 47.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (4m) 31s ago 4m 39.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (5m) 113s ago 5m 14.3M - 1.5.0 0da6a335fe13 529b4731a151 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (4m) 31s ago 4m 15.8M - 1.5.0 0da6a335fe13 0c4b9420e095 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (4m) 113s ago 4m 45.5M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (3m) 113s ago 3m 47.9M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:11:39.355 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (3m) 113s ago 3m 45.7M 4289M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:11:39.356 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (3m) 31s ago 3m 87.2M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:11:39.356 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (3m) 31s ago 3m 78.3M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:11:39.356 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (2m) 31s ago 2m 79.3M 5312M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:11:39.356 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 113s ago 5m 42.8M - 2.43.0 a07b618ecd1d aa5366916390 2023-12-16T20:11:39.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.353+0000 7f0f3bfff700 1 -- 172.21.15.38:0/228507060 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0f5410f600 con 0x7f0f3c038770 2023-12-16T20:11:39.356 INFO:tasks.workunit.client.0.smithi038.stdout:1/937: mknod d15/d1e/c146 0 2023-12-16T20:11:39.356 INFO:tasks.workunit.client.0.smithi038.stdout:8/833: getdents d17/d34 0 2023-12-16T20:11:39.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/938: mkdir d15/d1e/d3b/d117/d34/d86/d99/d147 0 2023-12-16T20:11:39.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/939: chown d15/d1e/db0/l13a 1195904 1 2023-12-16T20:11:39.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/940: chown d15/d1e/d3b/d117/d46/d12b 499 1 2023-12-16T20:11:39.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/941: chown d15/d22/d7b/l12f 862 1 2023-12-16T20:11:39.358 INFO:tasks.workunit.client.1.smithi141.stdout:1/583: truncate da/d1a/d1d/d33/f62 1355046 0 2023-12-16T20:11:39.358 INFO:tasks.workunit.client.0.smithi038.stdout:8/834: mknod d17/d5a/c10c 0 2023-12-16T20:11:39.359 INFO:tasks.workunit.client.1.smithi141.stdout:3/646: dwrite d0/d1c/d40/f43 [0,4194304] 0 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 msgr2=0x7f0f3c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 0x7f0f3c03ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b80 tx=0x7f0f4800b040 comp rx=0 tx=0).stop 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 msgr2=0x7f0f5410daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f440040d0 tx=0x7f0f44009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 shutdown_connections 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f3c038770 0x7f0f3c03ac20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f540faed0 0x7f0f5410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 --2- 172.21.15.38:0/228507060 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f540fdf60 0x7f0f5410daf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 >> 172.21.15.38:0/228507060 conn(0x7f0f540f6950 msgr2=0x7f0f54101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:39.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 shutdown_connections 2023-12-16T20:11:39.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.357+0000 7f0f59b37700 1 -- 172.21.15.38:0/228507060 wait complete. 2023-12-16T20:11:39.360 INFO:tasks.workunit.client.0.smithi038.stdout:1/942: rmdir d15/d1e/d3b 39 2023-12-16T20:11:39.361 INFO:tasks.workunit.client.0.smithi038.stdout:6/843: dwrite d1/d4/d1d/d8e/dbf/ff8 [0,4194304] 0 2023-12-16T20:11:39.362 INFO:tasks.workunit.client.0.smithi038.stdout:8/835: symlink d17/d1b/d25/db7/d82/da9/d50/db1/l10d 0 2023-12-16T20:11:39.362 INFO:tasks.workunit.client.0.smithi038.stdout:8/836: readlink d17/d1b/d25/db7/l99 0 2023-12-16T20:11:39.363 INFO:tasks.workunit.client.1.smithi141.stdout:7/553: mknod d5/d16/d30/cb4 0 2023-12-16T20:11:39.363 INFO:tasks.workunit.client.1.smithi141.stdout:7/554: fsync d5/d1d/d1e/f98 0 2023-12-16T20:11:39.363 INFO:tasks.workunit.client.1.smithi141.stdout:7/555: write d5/d2a/fa9 [1686231,58845] 0 2023-12-16T20:11:39.363 INFO:tasks.workunit.client.1.smithi141.stdout:7/556: stat d5/d16/d30/d4e/d6e 0 2023-12-16T20:11:39.365 INFO:tasks.workunit.client.0.smithi038.stdout:0/892: dwrite db/d16/d19/d4e/d106/d65/de8/d77/d95/da4/fb0 [0,4194304] 0 2023-12-16T20:11:39.368 INFO:tasks.workunit.client.1.smithi141.stdout:8/567: rename d14/d71/d81/l41 to d14/d19/d95/dae/lb0 0 2023-12-16T20:11:39.368 INFO:tasks.workunit.client.1.smithi141.stdout:8/568: write d14/d19/d1b/d24/d4a/f5a [587958,85041] 0 2023-12-16T20:11:39.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/844: rename d1/d4/d1d/d61/l89 to d1/d4/d1d/d8e/l10f 0 2023-12-16T20:11:39.371 INFO:tasks.workunit.client.1.smithi141.stdout:5/452: sync 2023-12-16T20:11:39.371 INFO:tasks.workunit.client.1.smithi141.stdout:5/453: dread - d0/d25/f93 zero size 2023-12-16T20:11:39.371 INFO:tasks.workunit.client.1.smithi141.stdout:6/608: getdents d1/d12/d20/d89 0 2023-12-16T20:11:39.372 INFO:tasks.workunit.client.0.smithi038.stdout:8/837: symlink d17/d1b/d25/db7/d82/l10e 0 2023-12-16T20:11:39.374 INFO:tasks.workunit.client.1.smithi141.stdout:2/397: sync 2023-12-16T20:11:39.374 INFO:tasks.workunit.client.1.smithi141.stdout:0/544: sync 2023-12-16T20:11:39.375 INFO:tasks.workunit.client.0.smithi038.stdout:6/845: mkdir d1/d4/d1d/d8e/dbf/d110 0 2023-12-16T20:11:39.375 INFO:tasks.workunit.client.0.smithi038.stdout:6/846: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/ff3 [1661177,20145] 0 2023-12-16T20:11:39.377 INFO:tasks.workunit.client.0.smithi038.stdout:4/850: dwrite d13/d17/d2e/d32/f39 [0,4194304] 0 2023-12-16T20:11:39.378 INFO:tasks.workunit.client.1.smithi141.stdout:7/557: symlink d5/d16/d46/lb5 0 2023-12-16T20:11:39.378 INFO:tasks.workunit.client.0.smithi038.stdout:6/847: rmdir d1/d4/d1d/d8e/dbf/d110 0 2023-12-16T20:11:39.380 INFO:tasks.workunit.client.0.smithi038.stdout:4/851: read d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/fdc [151274,51662] 0 2023-12-16T20:11:39.381 INFO:tasks.workunit.client.1.smithi141.stdout:3/647: dread d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/848: creat d1/d5b/d7d/dc6/f111 x:0 0 0 2023-12-16T20:11:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/849: chown d1/d4/d1d/f10e 57635322 1 2023-12-16T20:11:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/850: fdatasync d1/f54 0 2023-12-16T20:11:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/851: write d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/f107 [4936319,42789] 0 2023-12-16T20:11:39.383 INFO:tasks.workunit.client.0.smithi038.stdout:4/852: write d13/d17/d2e/d32/d4e/fa9 [120088,25097] 0 2023-12-16T20:11:39.383 INFO:tasks.workunit.client.0.smithi038.stdout:4/853: dread - d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/d101/f104 zero size 2023-12-16T20:11:39.383 INFO:tasks.workunit.client.0.smithi038.stdout:4/854: fdatasync d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/f93 0 2023-12-16T20:11:39.384 INFO:tasks.workunit.client.1.smithi141.stdout:8/569: symlink d14/d19/d1b/lb1 0 2023-12-16T20:11:39.384 INFO:tasks.workunit.client.1.smithi141.stdout:8/570: write f12 [2939706,43519] 0 2023-12-16T20:11:39.384 INFO:tasks.workunit.client.1.smithi141.stdout:5/454: rmdir d0/d9/d16 39 2023-12-16T20:11:39.384 INFO:tasks.workunit.client.1.smithi141.stdout:6/609: creat d1/d12/d22/d25/d38/fc7 x:0 0 0 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:0/893: rename db/d16/d1c/d5d/c9c to db/d16/d19/d4e/d106/d65/de8/d77/d95/d9e/c121 0 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/852: mkdir d1/d16/d23/d104/d112 0 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/853: dread - d1/d4/d1d/f10e zero size 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/854: truncate d1/d4/d1d/d61/da4/f106 297705 0 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/855: dread - d1/d5b/d7d/d9d/dc8/f105 zero size 2023-12-16T20:11:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/856: read d1/d4/d1d/f59 [400861,86652] 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.0.smithi038.stdout:4/855: symlink d13/d69/def/l11a 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.1.smithi141.stdout:2/398: getdents d6/d32/d52/d53 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/584: dwrite da/d36/f5c [0,4194304] 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/585: fdatasync da/fb9 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/586: fsync da/d1a/d1d/f5d 0 2023-12-16T20:11:39.386 INFO:tasks.workunit.client.1.smithi141.stdout:3/648: truncate d0/d1c/d40/d85/d4c/f4f 464432 0 2023-12-16T20:11:39.389 INFO:tasks.workunit.client.0.smithi038.stdout:6/857: rename d1/d4/d1d/l9e to d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2/l113 0 2023-12-16T20:11:39.390 INFO:tasks.workunit.client.1.smithi141.stdout:5/455: mkdir d0/d9/d99 0 2023-12-16T20:11:39.390 INFO:tasks.workunit.client.1.smithi141.stdout:5/456: creat d0/d9/d16/d2a/d35/d4c/f9a x:0 0 0 2023-12-16T20:11:39.390 INFO:tasks.workunit.client.1.smithi141.stdout:5/457: creat d0/d14/d2c/d4a/f9b x:0 0 0 2023-12-16T20:11:39.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/856: mkdir d13/d17/d4b/da4/d11b 0 2023-12-16T20:11:39.393 INFO:tasks.workunit.client.1.smithi141.stdout:2/399: unlink d6/f21 0 2023-12-16T20:11:39.393 INFO:tasks.workunit.client.1.smithi141.stdout:2/400: chown d6/d12/d1f/d46 240511 1 2023-12-16T20:11:39.393 INFO:tasks.workunit.client.1.smithi141.stdout:2/401: truncate d6/da/d1b/d5b/f78 304805 0 2023-12-16T20:11:39.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/858: mkdir d1/d4/d1d/d61/da4/d114 0 2023-12-16T20:11:39.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/859: write d1/d5b/d7d/dc6/fda [260023,11598] 0 2023-12-16T20:11:39.396 INFO:tasks.workunit.client.0.smithi038.stdout:1/943: dwrite d15/d1e/d30/d95/d12a/f126 [0,4194304] 0 2023-12-16T20:11:39.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/857: mkdir d13/d69/d7a/d11c 0 2023-12-16T20:11:39.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/545: dread d4/d49/d4b/f66 [0,4194304] 0 2023-12-16T20:11:39.397 INFO:tasks.workunit.client.1.smithi141.stdout:1/587: symlink da/d36/d4b/d4d/d89/d6c/lc5 0 2023-12-16T20:11:39.397 INFO:tasks.workunit.client.1.smithi141.stdout:1/588: write da/df/f27 [4346274,120526] 0 2023-12-16T20:11:39.397 INFO:tasks.workunit.client.1.smithi141.stdout:1/589: dread - da/d36/d4b/d7c/fa6 zero size 2023-12-16T20:11:39.398 INFO:tasks.workunit.client.1.smithi141.stdout:3/649: write d0/d1c/d40/f43 [2285433,95071] 0 2023-12-16T20:11:39.398 INFO:tasks.workunit.client.1.smithi141.stdout:3/650: write d0/d1c/d40/d85/d4c/f55 [1317484,56656] 0 2023-12-16T20:11:39.398 INFO:tasks.workunit.client.0.smithi038.stdout:6/860: rename d1/d16/d23/d104/d112 to d1/d4/d1d/d8e/dbf/d115 0 2023-12-16T20:11:39.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/944: mknod d15/d1e/db0/c148 0 2023-12-16T20:11:39.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/945: chown d15/d1e/d3b/d48/d37/fba 0 1 2023-12-16T20:11:39.402 INFO:tasks.workunit.client.0.smithi038.stdout:0/894: dread db/d16/d70/d7c/f96 [0,4194304] 0 2023-12-16T20:11:39.402 INFO:tasks.workunit.client.0.smithi038.stdout:0/895: truncate db/d16/d19/d4e/d106/d65/d90/ffc 251601 0 2023-12-16T20:11:39.402 INFO:tasks.workunit.client.0.smithi038.stdout:0/896: dread - db/d16/d1c/f11b zero size 2023-12-16T20:11:39.403 INFO:tasks.workunit.client.0.smithi038.stdout:6/861: mknod d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/c116 0 2023-12-16T20:11:39.403 INFO:tasks.workunit.client.0.smithi038.stdout:6/862: write d1/d5b/f76 [2658531,4292] 0 2023-12-16T20:11:39.404 INFO:tasks.workunit.client.1.smithi141.stdout:5/458: symlink d0/d14/d2c/d90/l9c 0 2023-12-16T20:11:39.404 INFO:tasks.workunit.client.1.smithi141.stdout:2/402: creat d6/d12/d1f/d46/f84 x:0 0 0 2023-12-16T20:11:39.404 INFO:tasks.workunit.client.1.smithi141.stdout:2/403: read d6/d3a/f2c [1883839,65827] 0 2023-12-16T20:11:39.406 INFO:tasks.workunit.client.0.smithi038.stdout:8/838: dwrite f16 [4194304,4194304] 0 2023-12-16T20:11:39.407 INFO:tasks.workunit.client.0.smithi038.stdout:4/858: rename d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d4f to d13/d69/d7a/d11d 0 2023-12-16T20:11:39.407 INFO:tasks.workunit.client.1.smithi141.stdout:0/546: mkdir d4/d49/da1/dbd 0 2023-12-16T20:11:39.408 INFO:tasks.workunit.client.1.smithi141.stdout:8/571: dread d14/d19/d1b/d24/d4a/f9b [0,4194304] 0 2023-12-16T20:11:39.408 INFO:tasks.workunit.client.1.smithi141.stdout:8/572: chown d14/d19/d1b/d3d 3577 1 2023-12-16T20:11:39.409 INFO:tasks.workunit.client.0.smithi038.stdout:1/946: mknod d15/d1e/d3b/d117/c149 0 2023-12-16T20:11:39.410 INFO:tasks.workunit.client.1.smithi141.stdout:3/651: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:39.413 INFO:tasks.workunit.client.1.smithi141.stdout:1/590: getdents da/d36/d4b/d7c 0 2023-12-16T20:11:39.415 INFO:tasks.workunit.client.1.smithi141.stdout:1/591: read da/d1a/d1d/d22/f6d [933022,85678] 0 2023-12-16T20:11:39.415 INFO:tasks.workunit.client.1.smithi141.stdout:1/592: dread - da/df/f6f zero size 2023-12-16T20:11:39.415 INFO:tasks.workunit.client.1.smithi141.stdout:1/593: read - da/d1a/d31/d81/fa9 zero size 2023-12-16T20:11:39.418 INFO:tasks.workunit.client.1.smithi141.stdout:6/610: dwrite d1/d12/d20/d44/fb1 [0,4194304] 0 2023-12-16T20:11:39.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/859: creat d13/d17/d4b/da4/d11b/f11e x:0 0 0 2023-12-16T20:11:39.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/860: stat d13/d1f/d35/f63 0 2023-12-16T20:11:39.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/861: chown d13/d17/d4b/da4/lae 163337257 1 2023-12-16T20:11:39.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/862: creat d13/d17/d2e/d32/d70/d84/d88/dc3/f11f x:0 0 0 2023-12-16T20:11:39.419 INFO:tasks.workunit.client.0.smithi038.stdout:0/897: dread db/db6/fdb [0,4194304] 0 2023-12-16T20:11:39.422 INFO:tasks.workunit.client.0.smithi038.stdout:0/898: read db/d16/d19/d4e/d106/d65/de8/f85 [4065,114893] 0 2023-12-16T20:11:39.422 INFO:tasks.workunit.client.0.smithi038.stdout:0/899: write db/d16/d19/d4e/d106/d65/de8/f85 [544544,32381] 0 2023-12-16T20:11:39.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/839: rename d17/d1b/d66/d73/d4e/fa2 to d17/d1b/d25/db7/d82/daa/f10f 0 2023-12-16T20:11:39.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/840: creat d17/d1b/d66/d73/dc8/f110 x:0 0 0 2023-12-16T20:11:39.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/841: creat d17/d1b/d25/db7/d82/da9/d50/d96/dba/f111 x:0 0 0 2023-12-16T20:11:39.425 INFO:tasks.workunit.client.0.smithi038.stdout:1/947: symlink d15/d1e/db0/l14a 0 2023-12-16T20:11:39.425 INFO:tasks.workunit.client.1.smithi141.stdout:1/594: write da/d36/f3f [209896,1206] 0 2023-12-16T20:11:39.425 INFO:tasks.workunit.client.1.smithi141.stdout:1/595: write da/d1a/d1d/d33/f43 [524799,55801] 0 2023-12-16T20:11:39.432 INFO:tasks.workunit.client.0.smithi038.stdout:1/948: symlink d15/d1e/db0/l14b 0 2023-12-16T20:11:39.432 INFO:tasks.workunit.client.0.smithi038.stdout:1/949: fdatasync d15/d1e/d3b/d117/d34/d79/f9c 0 2023-12-16T20:11:39.432 INFO:tasks.workunit.client.1.smithi141.stdout:5/459: mknod d0/d14/d75/c9d 0 2023-12-16T20:11:39.435 INFO:tasks.workunit.client.0.smithi038.stdout:0/900: mknod db/d16/d19/d80/dd4/c122 0 2023-12-16T20:11:39.435 INFO:tasks.workunit.client.0.smithi038.stdout:0/901: fdatasync db/d16/d19/d4e/f9d 0 2023-12-16T20:11:39.435 INFO:tasks.workunit.client.1.smithi141.stdout:2/404: mkdir d6/da/d1b/d5b/d6a/d85 0 2023-12-16T20:11:39.435 INFO:tasks.workunit.client.1.smithi141.stdout:2/405: getdents d6/d12/d67 0 2023-12-16T20:11:39.436 INFO:tasks.workunit.client.1.smithi141.stdout:2/406: chown d6/da/d33/d54/d73/d80 2619491 1 2023-12-16T20:11:39.436 INFO:tasks.workunit.client.1.smithi141.stdout:3/652: rmdir d0/d1c/d40/d3f/d52 39 2023-12-16T20:11:39.436 INFO:tasks.workunit.client.1.smithi141.stdout:3/653: chown d0/d1c/d40/d3f/d52/d63/fb3 3779411 1 2023-12-16T20:11:39.436 INFO:tasks.workunit.client.1.smithi141.stdout:3/654: write d0/d1c/d2c/f2f [4409075,68131] 0 2023-12-16T20:11:39.439 INFO:tasks.workunit.client.1.smithi141.stdout:6/611: mknod d1/d12/cc8 0 2023-12-16T20:11:39.442 INFO:tasks.workunit.client.1.smithi141.stdout:0/547: dwrite d4/d7/f50 [0,4194304] 0 2023-12-16T20:11:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:1/950: write d15/d1e/d3b/d48/d37/f9f [2941756,88595] 0 2023-12-16T20:11:39.447 INFO:tasks.workunit.client.1.smithi141.stdout:2/407: dread d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:39.448 INFO:tasks.workunit.client.1.smithi141.stdout:5/460: rename d0/d9/d16/d2a/l2f to d0/d9/d16/d2a/d35/d4c/l9e 0 2023-12-16T20:11:39.450 INFO:tasks.workunit.client.1.smithi141.stdout:3/655: symlink d0/d1c/d6a/ld3 0 2023-12-16T20:11:39.450 INFO:tasks.workunit.client.1.smithi141.stdout:3/656: chown d0/d1c/d40/d85/ca4 138 1 2023-12-16T20:11:39.450 INFO:tasks.workunit.client.1.smithi141.stdout:3/657: dread d0/d1c/d2c/f5b [0,4194304] 0 2023-12-16T20:11:39.452 INFO:tasks.workunit.client.1.smithi141.stdout:0/548: unlink d4/f1c 0 2023-12-16T20:11:39.455 INFO:tasks.workunit.client.1.smithi141.stdout:5/461: symlink d0/d14/d75/l9f 0 2023-12-16T20:11:39.457 INFO:tasks.workunit.client.1.smithi141.stdout:0/549: mkdir d4/d74/d85/dbe 0 2023-12-16T20:11:39.458 INFO:tasks.workunit.client.1.smithi141.stdout:2/408: getdents d6/d32 0 2023-12-16T20:11:39.460 INFO:tasks.workunit.client.1.smithi141.stdout:0/550: rename d4/d49/d73/c60 to d4/d74/d85/dbe/cbf 0 2023-12-16T20:11:39.462 INFO:tasks.workunit.client.1.smithi141.stdout:2/409: link d6/da/d4a/c5c d6/da/d33/d54/d73/d80/c86 0 2023-12-16T20:11:39.462 INFO:tasks.workunit.client.1.smithi141.stdout:2/410: creat d6/d3a/d47/d58/f87 x:0 0 0 2023-12-16T20:11:39.464 INFO:tasks.workunit.client.1.smithi141.stdout:0/551: link d4/d49/d4b/c4e d4/d5c/daf/cc0 0 2023-12-16T20:11:39.466 INFO:tasks.workunit.client.1.smithi141.stdout:7/558: dwrite d5/d16/f56 [4194304,4194304] 0 2023-12-16T20:11:39.467 INFO:tasks.workunit.client.1.smithi141.stdout:1/596: dwrite da/f2c [0,4194304] 0 2023-12-16T20:11:39.467 INFO:tasks.workunit.client.1.smithi141.stdout:1/597: dread - da/d1a/d1d/d33/f9a zero size 2023-12-16T20:11:39.467 INFO:tasks.workunit.client.1.smithi141.stdout:1/598: chown da/d1a/d1d/d33/d7f 0 1 2023-12-16T20:11:39.469 INFO:tasks.workunit.client.0.smithi038.stdout:8/842: dwrite f13 [0,4194304] 0 2023-12-16T20:11:39.470 INFO:tasks.workunit.client.1.smithi141.stdout:2/411: rename d6/da/d1b/f69 to d6/da/d4a/d5e/f88 0 2023-12-16T20:11:39.470 INFO:tasks.workunit.client.0.smithi038.stdout:4/863: dwrite d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/dc8/fd6 [0,4194304] 0 2023-12-16T20:11:39.472 INFO:tasks.workunit.client.0.smithi038.stdout:8/843: dread d17/d1b/d57/f79 [0,4194304] 0 2023-12-16T20:11:39.472 INFO:tasks.workunit.client.0.smithi038.stdout:8/844: dread - d17/d1b/d66/d73/d4e/fbe zero size 2023-12-16T20:11:39.472 INFO:tasks.workunit.client.1.smithi141.stdout:6/612: dread d1/d12/d22/d25/f7e [0,4194304] 0 2023-12-16T20:11:39.473 INFO:tasks.workunit.client.0.smithi038.stdout:4/864: creat d13/d17/d2e/d32/d70/f120 x:0 0 0 2023-12-16T20:11:39.473 INFO:tasks.workunit.client.1.smithi141.stdout:5/462: dread d0/fe [0,4194304] 0 2023-12-16T20:11:39.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/865: dread d13/d1f/f8e [0,4194304] 0 2023-12-16T20:11:39.481 INFO:tasks.workunit.client.1.smithi141.stdout:7/559: mknod d5/d16/d30/d4e/cb6 0 2023-12-16T20:11:39.481 INFO:tasks.workunit.client.0.smithi038.stdout:9/918: sync 2023-12-16T20:11:39.484 INFO:tasks.workunit.client.1.smithi141.stdout:6/613: truncate d1/d3/d4b/d60/f9b 3055471 0 2023-12-16T20:11:39.484 INFO:tasks.workunit.client.1.smithi141.stdout:6/614: fdatasync d1/dd/d2f/f5f 0 2023-12-16T20:11:39.484 INFO:tasks.workunit.client.1.smithi141.stdout:6/615: fdatasync d1/d12/d20/d3a/d45/f81 0 2023-12-16T20:11:39.484 INFO:tasks.workunit.client.0.smithi038.stdout:8/845: write d17/d1b/d25/f5c [7365419,51523] 0 2023-12-16T20:11:39.488 INFO:tasks.workunit.client.0.smithi038.stdout:8/846: unlink d17/d1b/d57/lf4 0 2023-12-16T20:11:39.488 INFO:tasks.workunit.client.0.smithi038.stdout:8/847: fsync d17/d1b/d66/d8e/d97/fd5 0 2023-12-16T20:11:39.489 INFO:tasks.workunit.client.0.smithi038.stdout:8/848: rmdir d17/d1b/d25/db7 39 2023-12-16T20:11:39.490 INFO:tasks.workunit.client.0.smithi038.stdout:8/849: creat d17/d34/f112 x:0 0 0 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/850: mknod d17/d1b/d66/d73/d54/c113 0 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/851: dread - d17/d1b/d25/db7/d82/da9/d50/d96/dba/f111 zero size 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/852: read - d17/d1b/d25/db7/d82/da9/d50/d96/dba/f111 zero size 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/853: write d17/d1b/d25/db7/d82/d9b/feb [220166,73269] 0 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/854: mkdir d17/d34/ddb/d114 0 2023-12-16T20:11:39.493 INFO:tasks.workunit.client.1.smithi141.stdout:5/463: mkdir d0/d25/d30/d8a/da0 0 2023-12-16T20:11:39.495 INFO:tasks.workunit.client.1.smithi141.stdout:7/560: mknod d5/d16/d1a/cb7 0 2023-12-16T20:11:39.497 INFO:tasks.workunit.client.0.smithi038.stdout:9/919: read d9/d1f/f5b [740058,61966] 0 2023-12-16T20:11:39.498 INFO:tasks.workunit.client.1.smithi141.stdout:1/599: mknod da/cc6 0 2023-12-16T20:11:39.498 INFO:tasks.workunit.client.1.smithi141.stdout:1/600: write da/d1a/f51 [2507752,104983] 0 2023-12-16T20:11:39.498 INFO:tasks.workunit.client.1.smithi141.stdout:1/601: dread - da/d36/d4b/d7c/fa6 zero size 2023-12-16T20:11:39.498 INFO:tasks.workunit.client.0.smithi038.stdout:1/951: dwrite d15/d1e/d3b/d48/d3d/f58 [0,4194304] 0 2023-12-16T20:11:39.499 INFO:tasks.workunit.client.0.smithi038.stdout:9/920: creat d9/d1f/d6c/f127 x:0 0 0 2023-12-16T20:11:39.499 INFO:tasks.workunit.client.0.smithi038.stdout:0/902: dwrite db/d16/d19/d4e/d106/d65/d90/dca/f120 [0,4194304] 0 2023-12-16T20:11:39.501 INFO:tasks.workunit.client.0.smithi038.stdout:1/952: link d15/d1e/db0/c148 d15/d1e/d3b/d117/d34/d86/d99/d147/c14c 0 2023-12-16T20:11:39.501 INFO:tasks.workunit.client.0.smithi038.stdout:1/953: dread - d15/d1e/d3b/d48/d37/dde/d75/dbc/fc3 zero size 2023-12-16T20:11:39.501 INFO:tasks.workunit.client.0.smithi038.stdout:9/921: truncate d9/d1f/d6a/f77 1664162 0 2023-12-16T20:11:39.503 INFO:tasks.workunit.client.0.smithi038.stdout:9/922: link d9/d1e/d40/d5e/db5/lce d9/d1f/d21/d3e/d4e/d64/l128 0 2023-12-16T20:11:39.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/923: stat d9/d1f/d21/d3e/d4e/d61/d9e 0 2023-12-16T20:11:39.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/924: creat d9/d1f/d21/d3e/d4e/d61/d9e/dc2/f129 x:0 0 0 2023-12-16T20:11:39.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/925: symlink d9/d1f/d21/d52/l12a 0 2023-12-16T20:11:39.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/926: fsync f2 0 2023-12-16T20:11:39.507 INFO:tasks.workunit.client.1.smithi141.stdout:2/412: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:39.509 INFO:tasks.workunit.client.0.smithi038.stdout:9/927: mkdir d9/d1f/d21/d3e/d4e/d61/d9b/dd3/d12b 0 2023-12-16T20:11:39.509 INFO:tasks.workunit.client.0.smithi038.stdout:9/928: readlink d9/d1f/d21/d3e/la9 0 2023-12-16T20:11:39.511 INFO:tasks.workunit.client.1.smithi141.stdout:6/616: dwrite d1/d12/d20/d3a/f80 [0,4194304] 0 2023-12-16T20:11:39.511 INFO:tasks.workunit.client.1.smithi141.stdout:6/617: creat d1/d77/d9e/fc9 x:0 0 0 2023-12-16T20:11:39.513 INFO:tasks.workunit.client.1.smithi141.stdout:5/464: creat d0/d14/d98/fa1 x:0 0 0 2023-12-16T20:11:39.513 INFO:tasks.workunit.client.1.smithi141.stdout:5/465: fdatasync d0/d43/f7e 0 2023-12-16T20:11:39.514 INFO:tasks.workunit.client.0.smithi038.stdout:0/903: read db/d16/d19/d27/d56/f99 [60417,118718] 0 2023-12-16T20:11:39.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/866: rmdir d13/d17/d2e/d32 39 2023-12-16T20:11:39.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/867: write d13/d17/d2e/d32/d7c/fa8 [701930,57050] 0 2023-12-16T20:11:39.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/868: dread - d13/d17/d2e/d32/d70/f8c zero size 2023-12-16T20:11:39.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/869: write d13/d17/d2e/d32/d70/d84/d88/dc3/fe2 [921011,79865] 0 2023-12-16T20:11:39.515 INFO:tasks.workunit.client.1.smithi141.stdout:3/658: dwrite d0/d1c/d2c/d72/d74/fbf [4194304,4194304] 0 2023-12-16T20:11:39.517 INFO:tasks.workunit.client.1.smithi141.stdout:7/561: unlink d5/f22 0 2023-12-16T20:11:39.523 INFO:tasks.workunit.client.0.smithi038.stdout:0/904: creat db/d16/d19/d4e/d106/d65/de8/d77/f123 x:0 0 0 2023-12-16T20:11:39.525 INFO:tasks.workunit.client.1.smithi141.stdout:1/602: rename da/d36/d4b/d4d/d80/d94/l98 to da/d1a/d1d/lc7 0 2023-12-16T20:11:39.527 INFO:tasks.workunit.client.0.smithi038.stdout:1/954: dwrite d15/d1e/d3b/d117/da2/f135 [0,4194304] 0 2023-12-16T20:11:39.527 INFO:tasks.workunit.client.0.smithi038.stdout:9/929: dread d9/d1f/d21/f3a [0,4194304] 0 2023-12-16T20:11:39.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/930: creat d9/d1e/d40/f12c x:0 0 0 2023-12-16T20:11:39.535 INFO:tasks.workunit.client.1.smithi141.stdout:0/552: rename d4/d74/d85 to d4/d74/dc1 0 2023-12-16T20:11:39.537 INFO:tasks.workunit.client.1.smithi141.stdout:2/413: creat d6/da/d33/d54/d73/f89 x:0 0 0 2023-12-16T20:11:39.546 INFO:tasks.workunit.client.0.smithi038.stdout:9/931: write d9/d1e/f74 [1811891,3233] 0 2023-12-16T20:11:39.546 INFO:tasks.workunit.client.0.smithi038.stdout:0/905: creat db/d16/d19/d80/f124 x:0 0 0 2023-12-16T20:11:39.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/932: rename d9/dea/fff to d9/d1e/d3d/d42/d59/dc4/f12d 0 2023-12-16T20:11:39.548 INFO:tasks.workunit.client.0.smithi038.stdout:9/933: unlink d9/d1e/d3d/f4b 0 2023-12-16T20:11:39.548 INFO:tasks.workunit.client.0.smithi038.stdout:9/934: fsync d9/d1f/d96/f110 0 2023-12-16T20:11:39.549 INFO:tasks.workunit.client.1.smithi141.stdout:6/618: mkdir d1/d12/d20/d89/d95/dca 0 2023-12-16T20:11:39.549 INFO:tasks.workunit.client.1.smithi141.stdout:6/619: truncate d1/dd/d2f/d48/fa1 770122 0 2023-12-16T20:11:39.550 INFO:tasks.workunit.client.0.smithi038.stdout:9/935: link d9/d1e/d3d/d42/d59/d76/cc7 d9/d1f/d21/d3e/d4e/d61/d9b/dd3/d12b/c12e 0 2023-12-16T20:11:39.550 INFO:tasks.workunit.client.0.smithi038.stdout:9/936: dread - d9/d1f/d21/d3e/fda zero size 2023-12-16T20:11:39.550 INFO:tasks.workunit.client.0.smithi038.stdout:9/937: mknod d9/d1f/d21/d3e/d4e/d61/d9b/dd3/c12f 0 2023-12-16T20:11:39.551 INFO:tasks.workunit.client.0.smithi038.stdout:9/938: symlink d9/d1f/d21/d3e/d4e/d61/l130 0 2023-12-16T20:11:39.554 INFO:tasks.workunit.client.1.smithi141.stdout:5/466: creat d0/d9/d16/d2a/fa2 x:0 0 0 2023-12-16T20:11:39.554 INFO:tasks.workunit.client.1.smithi141.stdout:5/467: chown d0/d9/d16/d2a/c80 12 1 2023-12-16T20:11:39.568 INFO:tasks.workunit.client.1.smithi141.stdout:7/562: symlink d5/d16/d30/d36/lb8 0 2023-12-16T20:11:39.569 INFO:tasks.workunit.client.1.smithi141.stdout:6/620: symlink d1/d12/d22/d25/dc3/lcb 0 2023-12-16T20:11:39.573 INFO:tasks.workunit.client.1.smithi141.stdout:3/659: dwrite d0/d1c/d2c/fa6 [0,4194304] 0 2023-12-16T20:11:39.574 INFO:tasks.workunit.client.0.smithi038.stdout:0/906: write db/d16/d19/d4e/d106/d65/d90/dca/f120 [3795993,58852] 0 2023-12-16T20:11:39.574 INFO:tasks.workunit.client.1.smithi141.stdout:7/563: truncate d5/fc 6792866 0 2023-12-16T20:11:39.574 INFO:tasks.workunit.client.1.smithi141.stdout:7/564: fdatasync d5/d2a/f86 0 2023-12-16T20:11:39.576 INFO:tasks.workunit.client.1.smithi141.stdout:2/414: dread d6/da/f35 [0,4194304] 0 2023-12-16T20:11:39.577 INFO:tasks.workunit.client.1.smithi141.stdout:1/603: write da/f52 [617554,101477] 0 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.577+0000 7fc3aae29700 1 -- 172.21.15.38:0/2989834420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a406fa30 msgr2=0x7fc3a406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.577+0000 7fc3aae29700 1 --2- 172.21.15.38:0/2989834420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a406fa30 0x7fc3a406dea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009ce0 tx=0x7fc39c004d10 comp rx=0 tx=0).stop 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.578+0000 7fc3aae29700 1 -- 172.21.15.38:0/2989834420 shutdown_connections 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.578+0000 7fc3aae29700 1 --2- 172.21.15.38:0/2989834420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a406e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.578+0000 7fc3aae29700 1 --2- 172.21.15.38:0/2989834420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a406fa30 0x7fc3a406dea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.578+0000 7fc3aae29700 1 -- 172.21.15.38:0/2989834420 >> 172.21.15.38:0/2989834420 conn(0x7fc3a4069b70 msgr2=0x7fc3a406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:39.582 INFO:tasks.workunit.client.1.smithi141.stdout:3/660: rmdir d0/d1c 39 2023-12-16T20:11:39.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.580+0000 7fc3aae29700 1 -- 172.21.15.38:0/2989834420 shutdown_connections 2023-12-16T20:11:39.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.582+0000 7fc3aae29700 1 -- 172.21.15.38:0/2989834420 wait complete. 2023-12-16T20:11:39.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.582+0000 7fc3aae29700 1 Processor -- start 2023-12-16T20:11:39.583 INFO:tasks.workunit.client.0.smithi038.stdout:1/955: dwrite d15/d1e/d3b/d48/d37/f3c [4194304,4194304] 0 2023-12-16T20:11:39.589 INFO:tasks.workunit.client.1.smithi141.stdout:1/604: dread f6 [0,4194304] 0 2023-12-16T20:11:39.590 INFO:tasks.workunit.client.1.smithi141.stdout:0/553: dwrite d4/f16 [0,4194304] 0 2023-12-16T20:11:39.590 INFO:tasks.workunit.client.1.smithi141.stdout:0/554: creat d4/d49/d73/d3b/d78/fc2 x:0 0 0 2023-12-16T20:11:39.590 INFO:tasks.workunit.client.1.smithi141.stdout:0/555: stat d4/d7/f1e 0 2023-12-16T20:11:39.591 INFO:tasks.workunit.client.0.smithi038.stdout:0/907: symlink db/d16/db5/l125 0 2023-12-16T20:11:39.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/939: dwrite d9/d1e/d3d/d42/d59/dc4/f109 [0,4194304] 0 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.595+0000 7fc3aae29700 1 -- start start 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.595+0000 7fc3aae29700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.595+0000 7fc3aae29700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a411c850 0x7fc3a411d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.595+0000 7fc3aae29700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a411cd10 con 0x7fc3a411c850 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.595+0000 7fc3aae29700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a411ce50 con 0x7fc3a406e470 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.596+0000 7fc3a9e27700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.596+0000 7fc3a9e27700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:40086/0 (socket says 172.21.15.38:40086) 2023-12-16T20:11:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.596+0000 7fc3a9e27700 1 -- 172.21.15.38:0/3554999806 learned_addr learned my addr 172.21.15.38:0/3554999806 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:39.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.597+0000 7fc3a9626700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a411c850 0x7fc3a411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:39.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.597+0000 7fc3a9e27700 1 -- 172.21.15.38:0/3554999806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a411c850 msgr2=0x7fc3a411d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:39.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.597+0000 7fc3a9e27700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a411c850 0x7fc3a411d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:39.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.597+0000 7fc3a9e27700 1 -- 172.21.15.38:0/3554999806 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c009940 con 0x7fc3a406e470 2023-12-16T20:11:39.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.598+0000 7fc3a9e27700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc39c000f80 tx=0x7fc39c004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:39.599 INFO:tasks.workunit.client.1.smithi141.stdout:7/565: unlink d5/d16/d30/d4e/d87/lb2 0 2023-12-16T20:11:39.599 INFO:tasks.workunit.client.1.smithi141.stdout:7/566: truncate d5/d16/d30/f50 90411 0 2023-12-16T20:11:39.599 INFO:tasks.workunit.client.1.smithi141.stdout:0/556: write d4/f3e [1421390,81474] 0 2023-12-16T20:11:39.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.600+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39c00e040 con 0x7fc3a406e470 2023-12-16T20:11:39.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.600+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a411dcf0 con 0x7fc3a406e470 2023-12-16T20:11:39.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.600+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a411e280 con 0x7fc3a406e470 2023-12-16T20:11:39.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.600+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc39c0049f0 con 0x7fc3a406e470 2023-12-16T20:11:39.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.600+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39c01c640 con 0x7fc3a406e470 2023-12-16T20:11:39.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.601+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 24) v1 ==== 45730+0+0 (secure 0 0 0) 0x7fc39c01c7a0 con 0x7fc3a406e470 2023-12-16T20:11:39.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.601+0000 7fc39a7fc700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 0x7fc39003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:39.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.601+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc39c012410 con 0x7fc3a406e470 2023-12-16T20:11:39.603 INFO:tasks.workunit.client.0.smithi038.stdout:9/940: rename d9/d1e/d40/d5e/d71/d83/da1/f116 to d9/d1e/d40/d5e/f131 0 2023-12-16T20:11:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.602+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3880052e0 con 0x7fc3a406e470 2023-12-16T20:11:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.602+0000 7fc3a9626700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 0x7fc39003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.603+0000 7fc3a9626700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 0x7fc39003ac60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007fd0 tx=0x7fc3a0009040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:39.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/941: creat d9/d1f/d96/dd5/f132 x:0 0 0 2023-12-16T20:11:39.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/942: rmdir d9 39 2023-12-16T20:11:39.606 INFO:tasks.workunit.client.0.smithi038.stdout:9/943: symlink d9/d1f/d21/d3e/d4e/d61/d9b/l133 0 2023-12-16T20:11:39.609 INFO:tasks.workunit.client.0.smithi038.stdout:0/908: rmdir db/d16/d19/d80 39 2023-12-16T20:11:39.609 INFO:tasks.workunit.client.0.smithi038.stdout:0/909: fsync db/d16/d19/d4e/d106/d65/d90/ffc 0 2023-12-16T20:11:39.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/944: truncate d9/d1e/f74 1036568 0 2023-12-16T20:11:39.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/945: write d9/d1e/d40/fe4 [801638,54679] 0 2023-12-16T20:11:39.610 INFO:tasks.workunit.client.0.smithi038.stdout:9/946: mknod d9/d1e/d40/d5e/db5/c134 0 2023-12-16T20:11:39.610 INFO:tasks.workunit.client.0.smithi038.stdout:9/947: dread - d9/d1f/d6c/f127 zero size 2023-12-16T20:11:39.610 INFO:tasks.workunit.client.0.smithi038.stdout:9/948: write d9/d1f/d21/d84/daf/f107 [5511887,40418] 0 2023-12-16T20:11:39.610 INFO:tasks.workunit.client.1.smithi141.stdout:2/415: mknod d6/da/d33/d54/d7c/c8a 0 2023-12-16T20:11:39.610 INFO:tasks.workunit.client.1.smithi141.stdout:6/621: dwrite d1/d3/d4b/f66 [4194304,4194304] 0 2023-12-16T20:11:39.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/468: dwrite d0/d43/f6e [4194304,4194304] 0 2023-12-16T20:11:39.611 INFO:tasks.workunit.client.1.smithi141.stdout:3/661: mknod d0/d1c/d2c/d72/d74/d8b/da3/cd4 0 2023-12-16T20:11:39.611 INFO:tasks.workunit.client.0.smithi038.stdout:0/910: link db/f3d db/d16/db5/de6/d112/f126 0 2023-12-16T20:11:39.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:39.610+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc39c017080 con 0x7fc3a406e470 2023-12-16T20:11:39.614 INFO:tasks.workunit.client.0.smithi038.stdout:3/983: sync 2023-12-16T20:11:39.617 INFO:tasks.workunit.client.1.smithi141.stdout:1/605: creat da/d1a/d1d/fc8 x:0 0 0 2023-12-16T20:11:39.617 INFO:tasks.workunit.client.1.smithi141.stdout:1/606: write da/d67/f8e [122048,41915] 0 2023-12-16T20:11:39.620 INFO:tasks.workunit.client.0.smithi038.stdout:0/911: mknod db/d16/d19/d27/d56/def/c127 0 2023-12-16T20:11:39.620 INFO:tasks.workunit.client.0.smithi038.stdout:0/912: write db/d16/d19/d27/f51 [285051,87793] 0 2023-12-16T20:11:39.626 INFO:tasks.workunit.client.0.smithi038.stdout:0/913: symlink db/d16/d19/l128 0 2023-12-16T20:11:39.629 INFO:tasks.workunit.client.1.smithi141.stdout:7/567: creat d5/d1d/d1e/d71/fb9 x:0 0 0 2023-12-16T20:11:39.630 INFO:tasks.workunit.client.1.smithi141.stdout:0/557: write d4/f33 [4912751,40434] 0 2023-12-16T20:11:39.632 INFO:tasks.workunit.client.0.smithi038.stdout:3/984: dwrite d4/d8/dc8/de4/fee [0,4194304] 0 2023-12-16T20:11:39.633 INFO:tasks.workunit.client.1.smithi141.stdout:2/416: rename d6/d12/l56 to d6/d32/d52/l8b 0 2023-12-16T20:11:39.633 INFO:tasks.workunit.client.1.smithi141.stdout:2/417: write d6/d12/d15/f4c [4977160,126468] 0 2023-12-16T20:11:39.633 INFO:tasks.workunit.client.0.smithi038.stdout:9/949: dwrite d9/d1e/d3d/d42/d59/d76/fa4 [0,4194304] 0 2023-12-16T20:11:39.641 INFO:tasks.workunit.client.1.smithi141.stdout:7/568: symlink d5/d1d/d1e/d27/lba 0 2023-12-16T20:11:39.642 INFO:tasks.workunit.client.1.smithi141.stdout:0/558: mknod d4/d49/d73/cc3 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:0/914: dwrite db/d16/d19/d27/d56/f87 [4194304,4194304] 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/950: dread d9/d1e/d40/d5e/d71/d83/da1/fe0 [0,4194304] 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/951: truncate d9/d1e/d45/f108 835 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/952: write d9/d1f/d21/d3e/d72/f86 [5681448,128864] 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/953: truncate d9/d1e/d40/f41 598005 0 2023-12-16T20:11:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/954: chown d9/d1f/d21/d3e/d4e/d64 0 1 2023-12-16T20:11:39.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/662: rename d0/d1c/d2c/l3e to d0/d1c/d6a/ld5 0 2023-12-16T20:11:39.646 INFO:tasks.workunit.client.1.smithi141.stdout:2/418: unlink d6/d32/l77 0 2023-12-16T20:11:39.648 INFO:tasks.workunit.client.0.smithi038.stdout:0/915: link db/d16/d19/d4e/d106/d65/d108/l10c db/d16/d19/d27/d56/l129 0 2023-12-16T20:11:39.648 INFO:tasks.workunit.client.0.smithi038.stdout:0/916: fdatasync f6 0 2023-12-16T20:11:39.650 INFO:tasks.workunit.client.1.smithi141.stdout:5/469: getdents d0/d43 0 2023-12-16T20:11:39.652 INFO:tasks.workunit.client.1.smithi141.stdout:7/569: creat d5/d16/d46/d61/fbb x:0 0 0 2023-12-16T20:11:39.654 INFO:tasks.workunit.client.0.smithi038.stdout:9/955: dread d9/d1f/d21/d84/daf/f107 [0,4194304] 0 2023-12-16T20:11:39.654 INFO:tasks.workunit.client.0.smithi038.stdout:9/956: dread - d9/d1f/d6a/f97 zero size 2023-12-16T20:11:39.656 INFO:tasks.workunit.client.0.smithi038.stdout:9/957: symlink d9/d1e/d3d/d42/l135 0 2023-12-16T20:11:39.656 INFO:tasks.workunit.client.0.smithi038.stdout:9/958: dread - d9/d1f/d6a/f97 zero size 2023-12-16T20:11:39.658 INFO:tasks.workunit.client.1.smithi141.stdout:0/559: creat d4/d49/da1/dbd/fc4 x:0 0 0 2023-12-16T20:11:39.659 INFO:tasks.workunit.client.1.smithi141.stdout:3/663: creat d0/d1c/d40/d3f/d52/d5d/fd6 x:0 0 0 2023-12-16T20:11:39.661 INFO:tasks.workunit.client.1.smithi141.stdout:2/419: mkdir d6/d3a/d47/d58/d8c 0 2023-12-16T20:11:39.664 INFO:tasks.workunit.client.1.smithi141.stdout:5/470: mknod d0/d25/d30/ca3 0 2023-12-16T20:11:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/959: dread d9/d1f/d21/d3e/d4e/d61/d9e/f114 [0,4194304] 0 2023-12-16T20:11:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/960: fsync d9/d1f/f35 0 2023-12-16T20:11:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:9/961: fdatasync d9/d1f/d21/f7e 0 2023-12-16T20:11:39.670 INFO:tasks.workunit.client.1.smithi141.stdout:0/560: dread d4/d5c/f87 [0,4194304] 0 2023-12-16T20:11:39.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/962: rename d9/d1f/d21/d3e/d4e/d61/d9e/dc2/ld1 to d9/d1f/d21/d3e/d4e/d61/d9b/l136 0 2023-12-16T20:11:39.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/963: dread - d9/d1e/d40/d5e/db5/f10e zero size 2023-12-16T20:11:39.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/964: read d9/d1f/d21/d3e/d72/d8a/f123 [943916,38135] 0 2023-12-16T20:11:39.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/965: read d9/d1e/d40/f58 [2850240,47215] 0 2023-12-16T20:11:39.672 INFO:tasks.workunit.client.1.smithi141.stdout:3/664: symlink d0/d1c/d40/ld7 0 2023-12-16T20:11:39.672 INFO:tasks.workunit.client.0.smithi038.stdout:9/966: symlink d9/d1e/d40/d5e/db5/l137 0 2023-12-16T20:11:39.674 INFO:tasks.workunit.client.0.smithi038.stdout:9/967: read d9/d1e/d3d/f3f [569347,102678] 0 2023-12-16T20:11:39.674 INFO:tasks.workunit.client.1.smithi141.stdout:0/561: creat d4/d49/db9/fc5 x:0 0 0 2023-12-16T20:11:39.674 INFO:tasks.workunit.client.1.smithi141.stdout:0/562: chown d4/d49/d73/d3b/d78/d7f/d80 1 1 2023-12-16T20:11:39.674 INFO:tasks.workunit.client.1.smithi141.stdout:0/563: stat d4/d49/d8f 0 2023-12-16T20:11:39.675 INFO:tasks.workunit.client.1.smithi141.stdout:2/420: dread d6/da/d33/f4b [0,4194304] 0 2023-12-16T20:11:39.676 INFO:tasks.workunit.client.1.smithi141.stdout:3/665: truncate d0/d1c/d40/d3f/f90 431069 0 2023-12-16T20:11:39.676 INFO:tasks.workunit.client.1.smithi141.stdout:3/666: chown d0/l5 926 1 2023-12-16T20:11:39.676 INFO:tasks.workunit.client.1.smithi141.stdout:3/667: chown d0/d1c/d6a/d76/da2/fc3 287 1 2023-12-16T20:11:39.678 INFO:tasks.workunit.client.1.smithi141.stdout:2/421: creat d6/d32/d52/d53/f8d x:0 0 0 2023-12-16T20:11:39.682 INFO:tasks.workunit.client.1.smithi141.stdout:3/668: creat d0/d1c/d40/d85/d4c/fd8 x:0 0 0 2023-12-16T20:11:39.683 INFO:tasks.workunit.client.1.smithi141.stdout:2/422: symlink d6/d12/d1f/d46/l8e 0 2023-12-16T20:11:39.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/985: dwrite d4/d18/f12d [0,4194304] 0 2023-12-16T20:11:39.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/986: creat d4/dcd/d139/f15c x:0 0 0 2023-12-16T20:11:39.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/987: stat d4/d8/d15/d6d/f132 0 2023-12-16T20:11:39.688 INFO:tasks.workunit.client.1.smithi141.stdout:3/669: mkdir d0/d1c/d6a/d76/da2/dd9 0 2023-12-16T20:11:39.688 INFO:tasks.workunit.client.1.smithi141.stdout:3/670: read d0/f68 [568202,41639] 0 2023-12-16T20:11:39.688 INFO:tasks.workunit.client.1.smithi141.stdout:3/671: write d0/d1c/d40/d3f/f73 [2087375,1334] 0 2023-12-16T20:11:39.688 INFO:tasks.workunit.client.1.smithi141.stdout:4/493: sync 2023-12-16T20:11:39.688 INFO:tasks.workunit.client.1.smithi141.stdout:9/519: sync 2023-12-16T20:11:39.689 INFO:tasks.workunit.client.1.smithi141.stdout:4/494: creat d1a/d2a/d3b/fb5 x:0 0 0 2023-12-16T20:11:39.689 INFO:tasks.workunit.client.1.smithi141.stdout:4/495: chown d1a/d2a/d3b/d69/f83 110517548 1 2023-12-16T20:11:39.689 INFO:tasks.workunit.client.1.smithi141.stdout:4/496: creat d1a/d3c/d9b/fb6 x:0 0 0 2023-12-16T20:11:39.689 INFO:tasks.workunit.client.1.smithi141.stdout:9/520: write d1/d10/d14/d20/da/d3f/d8a/fb4 [474904,92000] 0 2023-12-16T20:11:39.689 INFO:tasks.workunit.client.1.smithi141.stdout:9/521: fsync d1/d26/d4a/d73/fa2 0 2023-12-16T20:11:39.690 INFO:tasks.workunit.client.1.smithi141.stdout:3/672: mkdir d0/d1c/d2c/d72/d74/dda 0 2023-12-16T20:11:39.690 INFO:tasks.workunit.client.1.smithi141.stdout:3/673: stat d0/d1c/d6a/ld3 0 2023-12-16T20:11:39.690 INFO:tasks.workunit.client.1.smithi141.stdout:3/674: fdatasync d0/d1c/d40/d3f/d52/f7b 0 2023-12-16T20:11:39.696 INFO:tasks.workunit.client.1.smithi141.stdout:7/570: dwrite d5/d16/d46/f90 [4194304,4194304] 0 2023-12-16T20:11:39.696 INFO:tasks.workunit.client.1.smithi141.stdout:7/571: stat d5/d16/l33 0 2023-12-16T20:11:39.696 INFO:tasks.workunit.client.1.smithi141.stdout:7/572: stat d5/c15 0 2023-12-16T20:11:39.696 INFO:tasks.workunit.client.1.smithi141.stdout:5/471: dwrite d0/f3e [0,4194304] 0 2023-12-16T20:11:39.697 INFO:tasks.workunit.client.0.smithi038.stdout:9/968: dwrite d9/d1e/d40/ffc [0,4194304] 0 2023-12-16T20:11:39.697 INFO:tasks.workunit.client.0.smithi038.stdout:9/969: chown d9/d1f/d21/d3e/d72/d8a/fc9 249368225 1 2023-12-16T20:11:39.697 INFO:tasks.workunit.client.1.smithi141.stdout:9/522: symlink d1/d10/d33/lb9 0 2023-12-16T20:11:39.697 INFO:tasks.workunit.client.1.smithi141.stdout:9/523: write d1/d10/d14/d20/da/f32 [2631432,19975] 0 2023-12-16T20:11:39.699 INFO:tasks.workunit.client.0.smithi038.stdout:9/970: getdents d9/d1f/d21/d3e/d72 0 2023-12-16T20:11:39.701 INFO:tasks.workunit.client.1.smithi141.stdout:2/423: truncate d6/d12/d15/f4c 2237223 0 2023-12-16T20:11:39.702 INFO:tasks.workunit.client.0.smithi038.stdout:9/971: rmdir d9/d1e/d45 39 2023-12-16T20:11:39.703 INFO:tasks.workunit.client.1.smithi141.stdout:3/675: getdents d0/d1c/d2c/d72/d74/d8b/da3 0 2023-12-16T20:11:39.704 INFO:tasks.workunit.client.0.smithi038.stdout:9/972: creat d9/d1e/d40/d5e/d71/d83/f138 x:0 0 0 2023-12-16T20:11:39.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/973: read - d9/d1e/d40/d5e/fde zero size 2023-12-16T20:11:39.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/974: mkdir d9/d1e/d45/d139 0 2023-12-16T20:11:39.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/472: dread d0/d25/f2e [4194304,4194304] 0 2023-12-16T20:11:39.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/473: truncate d0/d9/f34 4529312 0 2023-12-16T20:11:39.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/474: chown d0/d9 11 1 2023-12-16T20:11:39.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/475: creat d0/d25/fa4 x:0 0 0 2023-12-16T20:11:39.709 INFO:tasks.workunit.client.0.smithi038.stdout:9/975: unlink d9/d1f/d21/d84/daf/lf3 0 2023-12-16T20:11:39.711 INFO:tasks.workunit.client.0.smithi038.stdout:0/917: write db/d16/d19/d27/f50 [1275928,94442] 0 2023-12-16T20:11:39.711 INFO:tasks.workunit.client.0.smithi038.stdout:0/918: write db/d16/d19/d80/ff6 [813956,129062] 0 2023-12-16T20:11:39.712 INFO:tasks.workunit.client.0.smithi038.stdout:0/919: readlink db/d16/d19/d27/d56/l81 0 2023-12-16T20:11:39.714 INFO:tasks.workunit.client.0.smithi038.stdout:3/988: dwrite d4/d8/dc8/fdb [0,4194304] 0 2023-12-16T20:11:39.714 INFO:tasks.workunit.client.1.smithi141.stdout:0/564: dwrite d4/d49/d73/f46 [0,4194304] 0 2023-12-16T20:11:39.714 INFO:tasks.workunit.client.1.smithi141.stdout:0/565: chown d4/d49/d73/d8a/db6 926033 1 2023-12-16T20:11:39.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/989: creat d4/d27/d23/d26/f15d x:0 0 0 2023-12-16T20:11:39.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/990: fsync d4/d6c/d80/da8/fd9 0 2023-12-16T20:11:39.718 INFO:tasks.workunit.client.0.smithi038.stdout:3/991: getdents d4/d8 0 2023-12-16T20:11:39.718 INFO:tasks.workunit.client.0.smithi038.stdout:3/992: chown d4/d27/d40/f7f 147681231 1 2023-12-16T20:11:39.719 INFO:tasks.workunit.client.1.smithi141.stdout:5/476: dread d0/d9/d16/d2a/d35/f3f [0,4194304] 0 2023-12-16T20:11:39.720 INFO:tasks.workunit.client.1.smithi141.stdout:9/524: mknod d1/d10/d33/d47/cba 0 2023-12-16T20:11:39.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/976: dread d9/fd8 [0,4194304] 0 2023-12-16T20:11:39.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/977: chown d9/d1e/d3d/c88 66918653 1 2023-12-16T20:11:39.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/978: chown d9/d1f/d96/c10a 5727468 1 2023-12-16T20:11:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:9/979: readlink d9/d1f/d21/d3e/d4e/d61/d9b/lee 0 2023-12-16T20:11:39.723 INFO:tasks.workunit.client.1.smithi141.stdout:2/424: getdents d6/d32/d7a/d5f 0 2023-12-16T20:11:39.725 INFO:tasks.workunit.client.1.smithi141.stdout:4/497: dwrite f9 [0,4194304] 0 2023-12-16T20:11:39.725 INFO:tasks.workunit.client.1.smithi141.stdout:3/676: mknod d0/d1c/d40/d3f/cdb 0 2023-12-16T20:11:39.726 INFO:tasks.workunit.client.0.smithi038.stdout:9/980: mknod d9/d1f/d21/d3e/d4e/d61/d9b/c13a 0 2023-12-16T20:11:39.734 INFO:tasks.workunit.client.1.smithi141.stdout:5/477: dread d0/d14/d2c/f68 [0,4194304] 0 2023-12-16T20:11:39.735 INFO:tasks.workunit.client.1.smithi141.stdout:5/478: chown d0/d9/d16/d2a/d35/d4c/f8d 12554 1 2023-12-16T20:11:39.741 INFO:tasks.workunit.client.1.smithi141.stdout:3/677: read d0/d1c/d40/d3f/d52/d5d/f79 [6617164,27539] 0 2023-12-16T20:11:39.743 INFO:tasks.workunit.client.1.smithi141.stdout:0/566: creat d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 x:0 0 0 2023-12-16T20:11:39.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/425: mknod d6/d12/d1f/d46/c8f 0 2023-12-16T20:11:39.745 INFO:tasks.workunit.client.1.smithi141.stdout:4/498: mkdir d1a/d4e/d63/daa/db7 0 2023-12-16T20:11:39.747 INFO:tasks.workunit.client.1.smithi141.stdout:5/479: creat d0/d9/d16/fa5 x:0 0 0 2023-12-16T20:11:39.748 INFO:tasks.workunit.client.1.smithi141.stdout:4/499: readlink d1a/l2b 0 2023-12-16T20:11:39.748 INFO:tasks.workunit.client.1.smithi141.stdout:4/500: getdents d1a/d59/d89/daf 0 2023-12-16T20:11:39.749 INFO:tasks.workunit.client.1.smithi141.stdout:5/480: mknod d0/d9/d16/d2a/d35/ca6 0 2023-12-16T20:11:39.751 INFO:tasks.workunit.client.1.smithi141.stdout:4/501: unlink d1a/d2a/f53 0 2023-12-16T20:11:39.752 INFO:tasks.workunit.client.1.smithi141.stdout:4/502: unlink d1a/d2a/fa2 0 2023-12-16T20:11:39.752 INFO:tasks.workunit.client.1.smithi141.stdout:4/503: readlink d1a/d2a/d3b/d69/la7 0 2023-12-16T20:11:39.752 INFO:tasks.workunit.client.1.smithi141.stdout:4/504: read d1a/f32 [1803983,2627] 0 2023-12-16T20:11:39.753 INFO:tasks.workunit.client.1.smithi141.stdout:5/481: write d0/d9/d16/d2a/d35/f3f [2565171,82304] 0 2023-12-16T20:11:39.753 INFO:tasks.workunit.client.1.smithi141.stdout:2/426: write d6/f17 [2269414,12410] 0 2023-12-16T20:11:39.753 INFO:tasks.workunit.client.1.smithi141.stdout:4/505: creat d1a/d4e/d63/daa/db7/fb8 x:0 0 0 2023-12-16T20:11:39.753 INFO:tasks.workunit.client.1.smithi141.stdout:2/427: chown d6/d32/d52/d53/f8d 377496193 1 2023-12-16T20:11:39.755 INFO:tasks.workunit.client.1.smithi141.stdout:5/482: unlink d0/d25/d30/d67/f65 0 2023-12-16T20:11:39.755 INFO:tasks.workunit.client.1.smithi141.stdout:5/483: chown d0/d14/d2c/d4a/f55 141535 1 2023-12-16T20:11:39.757 INFO:tasks.workunit.client.1.smithi141.stdout:2/428: creat d6/d12/d1f/f90 x:0 0 0 2023-12-16T20:11:39.758 INFO:tasks.workunit.client.1.smithi141.stdout:5/484: creat d0/d14/fa7 x:0 0 0 2023-12-16T20:11:39.759 INFO:tasks.workunit.client.1.smithi141.stdout:5/485: chown d0/d43/f6e 294 1 2023-12-16T20:11:39.759 INFO:tasks.workunit.client.1.smithi141.stdout:5/486: chown d0/d9/d16/d2a/d35/c7a 79725192 1 2023-12-16T20:11:39.759 INFO:tasks.workunit.client.1.smithi141.stdout:5/487: write d0/d9/d16/d2a/d35/d4c/f8d [240291,81620] 0 2023-12-16T20:11:39.759 INFO:tasks.workunit.client.1.smithi141.stdout:2/429: truncate d6/d32/f34 101055 0 2023-12-16T20:11:39.759 INFO:tasks.workunit.client.1.smithi141.stdout:2/430: creat d6/d12/d1f/f91 x:0 0 0 2023-12-16T20:11:39.760 INFO:tasks.workunit.client.1.smithi141.stdout:2/431: write d6/da/d68/f82 [599728,92493] 0 2023-12-16T20:11:39.762 INFO:tasks.workunit.client.1.smithi141.stdout:5/488: rename d0/d9/d16/d2a/d35/f66 to d0/d9/d16/d2a/fa8 0 2023-12-16T20:11:39.764 INFO:tasks.workunit.client.1.smithi141.stdout:2/432: mkdir d6/d32/d7a/d5f/d92 0 2023-12-16T20:11:39.766 INFO:tasks.workunit.client.1.smithi141.stdout:7/573: dwrite d5/f24 [0,4194304] 0 2023-12-16T20:11:39.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/920: dwrite db/d16/d19/d4e/d106/d65/de8/f73 [4194304,4194304] 0 2023-12-16T20:11:39.767 INFO:tasks.workunit.client.0.smithi038.stdout:0/921: fdatasync db/d16/d19/d27/d56/def/f113 0 2023-12-16T20:11:39.767 INFO:tasks.workunit.client.0.smithi038.stdout:3/993: dwrite d4/d27/d2b/f35 [0,4194304] 0 2023-12-16T20:11:39.769 INFO:tasks.workunit.client.1.smithi141.stdout:2/433: link d6/l2b d6/d12/d1f/d46/l93 0 2023-12-16T20:11:39.769 INFO:tasks.workunit.client.1.smithi141.stdout:2/434: write d6/d12/d1f/d46/f63 [942423,84229] 0 2023-12-16T20:11:39.770 INFO:tasks.workunit.client.0.smithi038.stdout:9/981: dwrite d9/d1f/f5b [0,4194304] 0 2023-12-16T20:11:39.772 INFO:tasks.workunit.client.1.smithi141.stdout:5/489: dread d0/d14/d2c/f33 [0,4194304] 0 2023-12-16T20:11:39.772 INFO:tasks.workunit.client.0.smithi038.stdout:0/922: mknod db/d16/d19/d27/d56/c12a 0 2023-12-16T20:11:39.772 INFO:tasks.workunit.client.0.smithi038.stdout:3/994: rename d4/d27/l6f to d4/d67/de1/d4c/d14f/l15e 0 2023-12-16T20:11:39.775 INFO:tasks.workunit.client.0.smithi038.stdout:3/995: getdents d4/d27/d40 0 2023-12-16T20:11:39.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/982: rename d9/d1f/d21/d55/fd9 to d9/d1f/d21/d3e/d72/d111/f13b 0 2023-12-16T20:11:39.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/983: dread - d9/d1f/d21/d84/daf/fc8 zero size 2023-12-16T20:11:39.781 INFO:tasks.workunit.client.1.smithi141.stdout:5/490: dread d0/d25/d30/d67/f58 [0,4194304] 0 2023-12-16T20:11:39.782 INFO:tasks.workunit.client.0.smithi038.stdout:9/984: mknod d9/d1e/d45/d139/c13c 0 2023-12-16T20:11:39.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/985: unlink d9/d1e/d40/d5e/db5/le7 0 2023-12-16T20:11:39.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/986: fdatasync d9/d1f/d21/d3e/d4e/d61/daa/f113 0 2023-12-16T20:11:39.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/987: chown d9/d1f/d6a/f97 0 1 2023-12-16T20:11:39.785 INFO:tasks.workunit.client.0.smithi038.stdout:9/988: write d9/d1e/d3d/f6b [1488085,54571] 0 2023-12-16T20:11:39.786 INFO:tasks.workunit.client.0.smithi038.stdout:9/989: mkdir d9/d1f/d21/d3e/d4e/d61/d13d 0 2023-12-16T20:11:39.786 INFO:tasks.workunit.client.0.smithi038.stdout:9/990: write d9/d1f/d21/d52/f8c [4966750,29622] 0 2023-12-16T20:11:39.787 INFO:tasks.workunit.client.0.smithi038.stdout:9/991: readlink d9/d1e/d45/l7f 0 2023-12-16T20:11:39.787 INFO:tasks.workunit.client.0.smithi038.stdout:3/996: write d4/d67/de1/d7d/f91 [2155107,111459] 0 2023-12-16T20:11:39.789 INFO:tasks.workunit.client.0.smithi038.stdout:9/992: rename d9/d1e/d40/d5e/d71/d83/lf0 to d9/d1e/d45/d139/l13e 0 2023-12-16T20:11:39.789 INFO:tasks.workunit.client.0.smithi038.stdout:9/993: fdatasync d9/d1f/d21/d3e/d4e/d61/daa/f113 0 2023-12-16T20:11:39.790 INFO:tasks.workunit.client.0.smithi038.stdout:9/994: symlink d9/d1f/d21/d3e/d4e/d61/d9b/dd3/l13f 0 2023-12-16T20:11:39.791 INFO:tasks.workunit.client.1.smithi141.stdout:2/435: mknod d6/d3a/d47/d58/d8c/c94 0 2023-12-16T20:11:39.791 INFO:tasks.workunit.client.1.smithi141.stdout:2/436: fdatasync d6/da/d1b/f5d 0 2023-12-16T20:11:39.795 INFO:tasks.workunit.client.1.smithi141.stdout:5/491: mknod d0/d9/d16/d72/d7f/ca9 0 2023-12-16T20:11:39.802 INFO:tasks.workunit.client.0.smithi038.stdout:0/923: dwrite db/fc3 [0,4194304] 0 2023-12-16T20:11:39.803 INFO:tasks.workunit.client.1.smithi141.stdout:2/437: mknod d6/d3a/c95 0 2023-12-16T20:11:39.805 INFO:tasks.workunit.client.0.smithi038.stdout:9/995: dread d9/d1f/f22 [4194304,4194304] 0 2023-12-16T20:11:39.805 INFO:tasks.workunit.client.0.smithi038.stdout:9/996: chown d9/d1f/d21/d3e/d72 53 1 2023-12-16T20:11:39.805 INFO:tasks.workunit.client.1.smithi141.stdout:0/567: dwrite d4/f33 [0,4194304] 0 2023-12-16T20:11:39.806 INFO:tasks.workunit.client.1.smithi141.stdout:5/492: symlink d0/d14/d98/laa 0 2023-12-16T20:11:39.811 INFO:tasks.workunit.client.0.smithi038.stdout:3/997: dwrite d4/d18/f69 [0,4194304] 0 2023-12-16T20:11:39.811 INFO:tasks.workunit.client.0.smithi038.stdout:3/998: fdatasync d4/d27/d23/f12c 0 2023-12-16T20:11:39.812 INFO:tasks.workunit.client.0.smithi038.stdout:3/999: dread - d4/d8/d15/d12b/f153 zero size 2023-12-16T20:11:39.812 INFO:tasks.workunit.client.1.smithi141.stdout:4/506: rename d1a/d4e/d63/daa/db7 to d1a/d4e/d63/daa/db9 0 2023-12-16T20:11:39.812 INFO:tasks.workunit.client.1.smithi141.stdout:4/507: stat d1a/d4e/l7b 0 2023-12-16T20:11:39.815 INFO:tasks.workunit.client.1.smithi141.stdout:2/438: link d6/c16 d6/da/d1b/d5b/c96 0 2023-12-16T20:11:39.820 INFO:tasks.workunit.client.0.smithi038.stdout:8/855: sync 2023-12-16T20:11:39.820 INFO:tasks.workunit.client.0.smithi038.stdout:4/870: sync 2023-12-16T20:11:39.820 INFO:tasks.workunit.client.0.smithi038.stdout:7/994: sync 2023-12-16T20:11:39.821 INFO:tasks.workunit.client.0.smithi038.stdout:7/995: readlink da/d21/l49 0 2023-12-16T20:11:39.821 INFO:tasks.workunit.client.0.smithi038.stdout:6/863: sync 2023-12-16T20:11:39.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/982: sync 2023-12-16T20:11:39.821 INFO:tasks.workunit.client.0.smithi038.stdout:5/983: fdatasync d2/d14/f40 0 2023-12-16T20:11:39.821 INFO:tasks.workunit.client.0.smithi038.stdout:1/956: sync 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/924: creat db/d16/d19/d4e/d89/d11a/f12b x:0 0 0 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/925: write db/d16/d19/d80/dd4/fdf [936176,12439] 0 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/871: stat d13/d1f/db7/db9/ff3 0 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/872: stat d13/d1f/d98/fd0 0 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/873: chown d13/d69/d7a/da5/lca 44 1 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:6/864: truncate d1/d4/f49 4065680 0 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:6/865: chown d1/d5b/d7d/d9d/dc8/de7/f69 10573 1 2023-12-16T20:11:39.826 INFO:tasks.workunit.client.0.smithi038.stdout:8/856: rename d17/d5a/c10c to d17/d1b/d25/db7/d82/da9/d59/c115 0 2023-12-16T20:11:39.827 INFO:tasks.workunit.client.0.smithi038.stdout:5/984: symlink d2/df/d1a/d2a/l138 0 2023-12-16T20:11:39.828 INFO:tasks.workunit.client.0.smithi038.stdout:6/866: mkdir d1/d5b/d7d/df4/d117 0 2023-12-16T20:11:39.832 INFO:tasks.workunit.client.0.smithi038.stdout:5/985: creat d2/d14/d25/d2d/f139 x:0 0 0 2023-12-16T20:11:39.832 INFO:tasks.workunit.client.0.smithi038.stdout:6/867: read d1/d4/d1d/d61/da4/fd9 [844438,67971] 0 2023-12-16T20:11:39.833 INFO:tasks.workunit.client.1.smithi141.stdout:0/568: chown d4/d7/l21 49706692 1 2023-12-16T20:11:39.834 INFO:tasks.workunit.client.0.smithi038.stdout:5/986: creat d2/df/d1a/d1f/d4a/d53/d135/f13a x:0 0 0 2023-12-16T20:11:39.834 INFO:tasks.workunit.client.0.smithi038.stdout:6/868: symlink d1/d16/d23/l118 0 2023-12-16T20:11:39.834 INFO:tasks.workunit.client.0.smithi038.stdout:6/869: chown c0 43 1 2023-12-16T20:11:39.834 INFO:tasks.workunit.client.0.smithi038.stdout:6/870: truncate d1/d4/d1d/d8e/d91/ffb 48662 0 2023-12-16T20:11:39.836 INFO:tasks.workunit.client.0.smithi038.stdout:5/987: mkdir d2/df/d1a/d1f/d4a/db2/d13b 0 2023-12-16T20:11:39.836 INFO:tasks.workunit.client.0.smithi038.stdout:5/988: read - d2/df/d1a/d1f/d4a/d53/d135/f13a zero size 2023-12-16T20:11:39.836 INFO:tasks.workunit.client.0.smithi038.stdout:0/926: truncate db/d16/d19/d27/d56/f99 1958037 0 2023-12-16T20:11:39.837 INFO:tasks.workunit.client.0.smithi038.stdout:6/871: mkdir d1/d5b/d7d/d9d/d119 0 2023-12-16T20:11:39.837 INFO:tasks.workunit.client.0.smithi038.stdout:6/872: write d1/d4/f8 [1746551,36417] 0 2023-12-16T20:11:39.838 INFO:tasks.workunit.client.1.smithi141.stdout:5/493: mkdir d0/d9/d16/d2a/d35/d4c/dab 0 2023-12-16T20:11:39.838 INFO:tasks.workunit.client.1.smithi141.stdout:5/494: truncate d0/d9/d16/d72/f92 985894 0 2023-12-16T20:11:39.838 INFO:tasks.workunit.client.1.smithi141.stdout:5/495: creat d0/d9/d16/fac x:0 0 0 2023-12-16T20:11:39.839 INFO:tasks.workunit.client.0.smithi038.stdout:6/873: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/f11a x:0 0 0 2023-12-16T20:11:39.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/874: symlink d1/d4/d1d/d8e/dbf/l11b 0 2023-12-16T20:11:39.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/875: chown d1/d5b/d7d/d9d/dc8/de7/d2f/l65 609499164 1 2023-12-16T20:11:39.841 INFO:tasks.workunit.client.0.smithi038.stdout:0/927: mkdir db/d16/d19/d4e/d12c 0 2023-12-16T20:11:39.842 INFO:tasks.workunit.client.0.smithi038.stdout:6/876: rmdir d1/d5b/d7d/d9d/dc8/de7 39 2023-12-16T20:11:39.842 INFO:tasks.workunit.client.0.smithi038.stdout:6/877: creat d1/d4/d1d/f11c x:0 0 0 2023-12-16T20:11:39.843 INFO:tasks.workunit.client.1.smithi141.stdout:4/508: symlink d1a/d54/d87/da8/lba 0 2023-12-16T20:11:39.843 INFO:tasks.workunit.client.1.smithi141.stdout:4/509: readlink d1a/d3c/l64 0 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.1.smithi141.stdout:2/439: rename d6/da/d33/f3e to d6/da/d33/d54/d7c/f97 0 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.1.smithi141.stdout:2/440: chown d6/d32 17279 1 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/510: dread d1a/d54/f98 [0,4194304] 0 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/511: read - d1a/d2a/d3b/d69/f84 zero size 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/512: creat d1a/d59/fbb x:0 0 0 2023-12-16T20:11:39.845 INFO:tasks.workunit.client.0.smithi038.stdout:6/878: mkdir d1/d4/d1d/d8e/d91/d11d 0 2023-12-16T20:11:39.846 INFO:tasks.workunit.client.0.smithi038.stdout:6/879: chown d1/d4/d1d/d61/da4/fd9 166586640 1 2023-12-16T20:11:39.846 INFO:tasks.workunit.client.0.smithi038.stdout:6/880: stat d1/d5b/d7d/d9d/f48 0 2023-12-16T20:11:39.847 INFO:tasks.workunit.client.0.smithi038.stdout:6/881: creat d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2/f11e x:0 0 0 2023-12-16T20:11:39.847 INFO:tasks.workunit.client.0.smithi038.stdout:4/874: read d13/d69/d7a/f89 [3710713,100220] 0 2023-12-16T20:11:39.847 INFO:tasks.workunit.client.0.smithi038.stdout:1/957: dwrite d15/d1e/d3b/d117/da2/f11c [0,4194304] 0 2023-12-16T20:11:39.849 INFO:tasks.workunit.client.0.smithi038.stdout:6/882: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f11f x:0 0 0 2023-12-16T20:11:39.852 INFO:tasks.workunit.client.0.smithi038.stdout:4/875: rename d13/d17/d4b/da4/d9d/db5/lf9 to d13/d17/d4b/da4/d11b/l121 0 2023-12-16T20:11:39.853 INFO:tasks.workunit.client.0.smithi038.stdout:1/958: rmdir d15/d1e/d3b/d117/d46/d138 39 2023-12-16T20:11:39.853 INFO:tasks.workunit.client.1.smithi141.stdout:5/496: mknod d0/d43/cad 0 2023-12-16T20:11:39.854 INFO:tasks.workunit.client.0.smithi038.stdout:6/883: rename d1/d5b/d7d/dc6/f111 to d1/d4/d1d/d8e/dbf/d115/f120 0 2023-12-16T20:11:39.855 INFO:tasks.workunit.client.0.smithi038.stdout:6/884: fdatasync d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/fe6 0 2023-12-16T20:11:39.855 INFO:tasks.workunit.client.0.smithi038.stdout:1/959: read d15/f24 [99518,34714] 0 2023-12-16T20:11:39.855 INFO:tasks.workunit.client.0.smithi038.stdout:1/960: write d15/d4a/ded/f134 [816347,105276] 0 2023-12-16T20:11:39.855 INFO:tasks.workunit.client.0.smithi038.stdout:4/876: rmdir d13/d17/d2e/d32 39 2023-12-16T20:11:39.856 INFO:tasks.workunit.client.0.smithi038.stdout:4/877: unlink ce 0 2023-12-16T20:11:39.857 INFO:tasks.workunit.client.1.smithi141.stdout:2/441: mkdir d6/d3a/d47/d58/d66/d6c/d98 0 2023-12-16T20:11:39.858 INFO:tasks.workunit.client.1.smithi141.stdout:2/442: read d6/d3a/d47/d58/d66/f7b [543332,30748] 0 2023-12-16T20:11:39.859 INFO:tasks.workunit.client.0.smithi038.stdout:1/961: dread d15/d1e/d3b/d117/f78 [0,4194304] 0 2023-12-16T20:11:39.860 INFO:tasks.workunit.client.0.smithi038.stdout:0/928: rmdir db/d16/d19/d4e/d106/d65/de8/d77 39 2023-12-16T20:11:39.860 INFO:tasks.workunit.client.0.smithi038.stdout:0/929: write db/d16/d70/f6c [12859,81674] 0 2023-12-16T20:11:39.860 INFO:tasks.workunit.client.0.smithi038.stdout:0/930: write db/f44 [2223408,85394] 0 2023-12-16T20:11:39.860 INFO:tasks.workunit.client.0.smithi038.stdout:1/962: mknod d15/d1e/d3b/d117/da2/c14d 0 2023-12-16T20:11:39.861 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:39 smithi038 ceph-mon[80659]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:39.861 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:39 smithi038 ceph-mon[80659]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 180 MiB/s rd, 230 MiB/s wr, 333 op/s 2023-12-16T20:11:39.861 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:39 smithi038 ceph-mon[80659]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:39.866 INFO:tasks.workunit.client.1.smithi141.stdout:4/513: link d1a/d2a/l6f d1a/d54/d87/lbc 0 2023-12-16T20:11:39.866 INFO:tasks.workunit.client.1.smithi141.stdout:4/514: creat d1a/d54/d87/da8/da9/fbd x:0 0 0 2023-12-16T20:11:39.866 INFO:tasks.workunit.client.1.smithi141.stdout:4/515: getdents d1a/d2a/d3b/db2 0 2023-12-16T20:11:39.868 INFO:tasks.workunit.client.1.smithi141.stdout:5/497: unlink d0/f82 0 2023-12-16T20:11:39.868 INFO:tasks.workunit.client.1.smithi141.stdout:5/498: dread - d0/d25/f93 zero size 2023-12-16T20:11:39.868 INFO:tasks.workunit.client.1.smithi141.stdout:5/499: dread - d0/d9/d16/fa5 zero size 2023-12-16T20:11:39.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/931: creat db/d16/d19/d27/d56/def/f12d x:0 0 0 2023-12-16T20:11:39.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/932: write db/d16/d1c/d5d/d64/f118 [29430,82460] 0 2023-12-16T20:11:39.870 INFO:tasks.workunit.client.0.smithi038.stdout:0/933: stat db/d16/d19/d4e/d106/d65/de8/d77/d95/dd8/f119 0 2023-12-16T20:11:39.871 INFO:tasks.workunit.client.0.smithi038.stdout:8/857: dwrite d17/d1b/d66/d8e/d97/fb9 [0,4194304] 0 2023-12-16T20:11:39.871 INFO:tasks.workunit.client.0.smithi038.stdout:4/878: write d13/f77 [331187,18450] 0 2023-12-16T20:11:39.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/858: unlink cf 0 2023-12-16T20:11:39.875 INFO:tasks.workunit.client.1.smithi141.stdout:0/569: dwrite d4/d49/d8f/fac [0,4194304] 0 2023-12-16T20:11:39.878 INFO:tasks.workunit.client.1.smithi141.stdout:4/516: rename d1a/d4e/d63/daa/db9/fb8 to d1a/d59/d89/fbe 0 2023-12-16T20:11:39.881 INFO:tasks.workunit.client.0.smithi038.stdout:4/879: mknod d13/d1f/d98/c122 0 2023-12-16T20:11:39.881 INFO:tasks.workunit.client.0.smithi038.stdout:4/880: dread - d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/d101/f104 zero size 2023-12-16T20:11:39.881 INFO:tasks.workunit.client.0.smithi038.stdout:4/881: dread - d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d6e/ffa zero size 2023-12-16T20:11:39.881 INFO:tasks.workunit.client.0.smithi038.stdout:4/882: fsync d13/d17/d4b/f87 0 2023-12-16T20:11:39.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/996: dwrite da/dcf/d100/faf [0,4194304] 0 2023-12-16T20:11:39.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/997: write da/dcf/d100/f6f [3531487,91614] 0 2023-12-16T20:11:39.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/998: dread - da/dcf/fd4 zero size 2023-12-16T20:11:39.884 INFO:tasks.workunit.client.1.smithi141.stdout:5/500: link d0/d9/d16/d2a/d35/d4c/l9e d0/d43/lae 0 2023-12-16T20:11:39.885 INFO:tasks.workunit.client.0.smithi038.stdout:7/999: getdents da/d21/d2c/d76 0 2023-12-16T20:11:39.885 INFO:tasks.workunit.client.1.smithi141.stdout:0/570: mknod d4/d49/d4b/cc7 0 2023-12-16T20:11:39.894 INFO:tasks.workunit.client.1.smithi141.stdout:4/517: mkdir d1a/d54/d87/dbf 0 2023-12-16T20:11:39.897 INFO:tasks.workunit.client.0.smithi038.stdout:6/885: dwrite d1/d4/d1d/f66 [0,4194304] 0 2023-12-16T20:11:39.898 INFO:tasks.workunit.client.1.smithi141.stdout:5/501: creat d0/d9/d16/d72/d7f/faf x:0 0 0 2023-12-16T20:11:39.898 INFO:tasks.workunit.client.1.smithi141.stdout:5/502: dread - d0/d9/f89 zero size 2023-12-16T20:11:39.901 INFO:tasks.workunit.client.0.smithi038.stdout:6/886: unlink d1/d4/d1d/f66 0 2023-12-16T20:11:39.901 INFO:tasks.workunit.client.0.smithi038.stdout:6/887: dread - d1/d4/d1d/d8e/d91/f101 zero size 2023-12-16T20:11:39.903 INFO:tasks.workunit.client.0.smithi038.stdout:8/859: write d17/d1b/d66/d8e/d97/fb9 [3908322,53246] 0 2023-12-16T20:11:39.903 INFO:tasks.workunit.client.1.smithi141.stdout:0/571: symlink d4/d49/d73/d8a/d9b/lc8 0 2023-12-16T20:11:39.909 INFO:tasks.workunit.client.1.smithi141.stdout:4/518: creat d1a/d59/d89/d8a/fc0 x:0 0 0 2023-12-16T20:11:39.909 INFO:tasks.workunit.client.1.smithi141.stdout:4/519: truncate d1a/d59/fbb 407025 0 2023-12-16T20:11:39.910 INFO:tasks.workunit.client.0.smithi038.stdout:6/888: dread d1/d4/d1d/d67/d73/fec [0,4194304] 0 2023-12-16T20:11:39.911 INFO:tasks.workunit.client.0.smithi038.stdout:6/889: truncate d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f43 3036486 0 2023-12-16T20:11:39.913 INFO:tasks.workunit.client.1.smithi141.stdout:4/520: link d1a/d4e/d63/ca4 d1a/d54/d87/dbf/cc1 0 2023-12-16T20:11:39.916 INFO:tasks.workunit.client.0.smithi038.stdout:6/890: rmdir d1/d4/d1d/d61 39 2023-12-16T20:11:39.916 INFO:tasks.workunit.client.0.smithi038.stdout:6/891: truncate d1/d5b/f63 5501242 0 2023-12-16T20:11:39.916 INFO:tasks.workunit.client.0.smithi038.stdout:6/892: fdatasync d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fde 0 2023-12-16T20:11:39.923 INFO:tasks.workunit.client.0.smithi038.stdout:6/893: write d1/d16/d23/d5f/fb4 [3991650,51318] 0 2023-12-16T20:11:39.930 INFO:tasks.workunit.client.0.smithi038.stdout:1/963: dwrite d15/d1e/d3b/d48/d37/f8f [0,4194304] 0 2023-12-16T20:11:39.932 INFO:tasks.workunit.client.0.smithi038.stdout:1/964: link d15/d1e/d30/c10f d15/d1e/d3b/d117/d34/d79/c14e 0 2023-12-16T20:11:39.932 INFO:tasks.workunit.client.0.smithi038.stdout:1/965: write d15/d1e/d3b/d48/ff4 [708945,70965] 0 2023-12-16T20:11:39.932 INFO:tasks.workunit.client.0.smithi038.stdout:6/894: write d1/d5b/d7d/d9d/f6a [437600,41577] 0 2023-12-16T20:11:39.933 INFO:tasks.workunit.client.0.smithi038.stdout:1/966: mkdir d15/d1e/d3b/d117/d34/d86/d99/d147/d14f 0 2023-12-16T20:11:39.933 INFO:tasks.workunit.client.0.smithi038.stdout:1/967: chown d15/d22/d62/d12e 219 1 2023-12-16T20:11:39.934 INFO:tasks.workunit.client.0.smithi038.stdout:1/968: creat d15/d1e/d3b/d117/d34/d86/f150 x:0 0 0 2023-12-16T20:11:39.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/969: symlink d15/d1e/l151 0 2023-12-16T20:11:39.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/970: chown d15/d1e/d3b/d48/l113 419527 1 2023-12-16T20:11:39.939 INFO:tasks.workunit.client.1.smithi141.stdout:5/503: dwrite d0/d14/d2c/d4a/f55 [0,4194304] 0 2023-12-16T20:11:39.939 INFO:tasks.workunit.client.1.smithi141.stdout:5/504: fdatasync d0/d25/f7b 0 2023-12-16T20:11:39.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/883: dwrite d13/d1f/d35/f117 [0,4194304] 0 2023-12-16T20:11:39.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/884: truncate d13/d17/d2e/d32/d70/d84/d88/dc3/de9/d78/f10d 323555 0 2023-12-16T20:11:39.941 INFO:tasks.workunit.client.1.smithi141.stdout:0/572: dwrite d4/d49/d73/d3b/d78/fc2 [0,4194304] 0 2023-12-16T20:11:39.942 INFO:tasks.workunit.client.1.smithi141.stdout:0/573: write d4/d49/d73/d3b/d78/d7f/f90 [1264067,59290] 0 2023-12-16T20:11:39.943 INFO:tasks.workunit.client.0.smithi038.stdout:1/971: dread d15/d1e/d3b/d117/d46/ff9 [0,4194304] 0 2023-12-16T20:11:39.943 INFO:tasks.workunit.client.0.smithi038.stdout:1/972: creat d15/d4a/f152 x:0 0 0 2023-12-16T20:11:39.944 INFO:tasks.workunit.client.1.smithi141.stdout:2/443: dwrite d6/d12/d1f/f36 [0,4194304] 0 2023-12-16T20:11:39.946 INFO:tasks.workunit.client.0.smithi038.stdout:4/885: rename d13/d17/d2e/d32/d70 to d13/d17/d4b/da4/d34/d123 0 2023-12-16T20:11:39.946 INFO:tasks.workunit.client.0.smithi038.stdout:4/886: readlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/l60 0 2023-12-16T20:11:39.948 INFO:tasks.workunit.client.0.smithi038.stdout:4/887: truncate d13/d17/d4b/da4/d34/d123/d84/fad 2906908 0 2023-12-16T20:11:39.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/888: truncate d13/d17/d4b/da4/d34/f58 7947549 0 2023-12-16T20:11:39.955 INFO:tasks.workunit.client.0.smithi038.stdout:6/895: dwrite d1/f8f [0,4194304] 0 2023-12-16T20:11:39.955 INFO:tasks.workunit.client.0.smithi038.stdout:4/889: rename d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/dc8/dda/dee/lfd to d13/d17/d4b/d7d/d90/l124 0 2023-12-16T20:11:39.955 INFO:tasks.workunit.client.0.smithi038.stdout:4/890: readlink d13/d17/d4b/da4/d9d/l82 0 2023-12-16T20:11:39.957 INFO:tasks.workunit.client.1.smithi141.stdout:0/574: dread d4/f31 [4194304,4194304] 0 2023-12-16T20:11:39.962 INFO:tasks.workunit.client.0.smithi038.stdout:6/896: symlink d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/dc9/l121 0 2023-12-16T20:11:39.963 INFO:tasks.workunit.client.1.smithi141.stdout:2/444: rename d6/d12/d1f/f90 to d6/d32/d7a/f99 0 2023-12-16T20:11:39.963 INFO:tasks.workunit.client.1.smithi141.stdout:2/445: write d6/d12/d1f/f91 [48233,55985] 0 2023-12-16T20:11:39.970 INFO:tasks.workunit.client.1.smithi141.stdout:5/505: dwrite d0/d9/d16/d72/f92 [0,4194304] 0 2023-12-16T20:11:39.970 INFO:tasks.workunit.client.1.smithi141.stdout:5/506: fsync d0/d25/f96 0 2023-12-16T20:11:39.977 INFO:tasks.workunit.client.1.smithi141.stdout:5/507: unlink d0/d9/d16/d2a/d35/d4c/l9e 0 2023-12-16T20:11:39.981 INFO:tasks.workunit.client.1.smithi141.stdout:5/508: symlink d0/d9/d16/d2a/d35/d91/lb0 0 2023-12-16T20:11:40.003 INFO:tasks.workunit.client.1.smithi141.stdout:9/525: sync 2023-12-16T20:11:40.013 INFO:tasks.workunit.client.1.smithi141.stdout:1/607: sync 2023-12-16T20:11:40.013 INFO:tasks.workunit.client.1.smithi141.stdout:8/573: sync 2023-12-16T20:11:40.014 INFO:tasks.workunit.client.1.smithi141.stdout:8/574: rename f12 to d14/d71/fb2 0 2023-12-16T20:11:40.015 INFO:tasks.workunit.client.1.smithi141.stdout:1/608: symlink da/d36/d4b/d4d/lc9 0 2023-12-16T20:11:40.015 INFO:tasks.workunit.client.1.smithi141.stdout:1/609: dread - da/d1a/d1d/fc8 zero size 2023-12-16T20:11:40.015 INFO:tasks.workunit.client.1.smithi141.stdout:8/575: readlink d14/d19/d1b/d24/l7f 0 2023-12-16T20:11:40.015 INFO:tasks.workunit.client.1.smithi141.stdout:8/576: fdatasync d14/d19/d1b/d24/d4b/f62 0 2023-12-16T20:11:40.016 INFO:tasks.workunit.client.0.smithi038.stdout:4/891: dwrite d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/f85 [0,4194304] 0 2023-12-16T20:11:40.016 INFO:tasks.workunit.client.1.smithi141.stdout:5/509: dwrite d0/d25/f2e [8388608,4194304] 0 2023-12-16T20:11:40.016 INFO:tasks.workunit.client.1.smithi141.stdout:1/610: mkdir da/d36/d4b/d4d/d80/dca 0 2023-12-16T20:11:40.017 INFO:tasks.workunit.client.1.smithi141.stdout:0/575: dwrite d4/d49/d73/d3b/f7a [0,4194304] 0 2023-12-16T20:11:40.020 INFO:tasks.workunit.client.1.smithi141.stdout:6/622: sync 2023-12-16T20:11:40.021 INFO:tasks.workunit.client.1.smithi141.stdout:9/526: write d1/d10/d33/d6a/d72/fac [2633250,107270] 0 2023-12-16T20:11:40.023 INFO:tasks.workunit.client.1.smithi141.stdout:1/611: mknod da/d36/d4b/d4d/ccb 0 2023-12-16T20:11:40.027 INFO:tasks.workunit.client.1.smithi141.stdout:0/576: rmdir d4/d49/d73/d8a/db6 0 2023-12-16T20:11:40.027 INFO:tasks.workunit.client.1.smithi141.stdout:0/577: write d4/d49/d8f/f94 [710469,102821] 0 2023-12-16T20:11:40.033 INFO:tasks.workunit.client.1.smithi141.stdout:8/577: rmdir d14/d19/d1b 39 2023-12-16T20:11:40.035 INFO:tasks.workunit.client.1.smithi141.stdout:2/446: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:40.036 INFO:tasks.workunit.client.1.smithi141.stdout:9/527: dread d1/d10/d33/f8b [0,4194304] 0 2023-12-16T20:11:40.037 INFO:tasks.workunit.client.1.smithi141.stdout:8/578: symlink d14/d19/d1b/d24/d4b/d8c/lb3 0 2023-12-16T20:11:40.037 INFO:tasks.workunit.client.1.smithi141.stdout:8/579: dread - d14/d35/f67 zero size 2023-12-16T20:11:40.038 INFO:tasks.workunit.client.1.smithi141.stdout:8/580: chown d14/d19/d1b/lb1 347108620 1 2023-12-16T20:11:40.042 INFO:tasks.workunit.client.1.smithi141.stdout:0/578: dread d4/d7/fd [4194304,4194304] 0 2023-12-16T20:11:40.042 INFO:tasks.workunit.client.1.smithi141.stdout:0/579: write d4/d49/d73/d3b/d78/d7f/f9f [845699,4181] 0 2023-12-16T20:11:40.042 INFO:tasks.workunit.client.1.smithi141.stdout:0/580: fdatasync d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 0 2023-12-16T20:11:40.043 INFO:tasks.workunit.client.1.smithi141.stdout:0/581: fdatasync d4/d49/d4b/f9d 0 2023-12-16T20:11:40.043 INFO:tasks.workunit.client.1.smithi141.stdout:0/582: truncate d4/d49/d73/d3b/d78/f4f 2519746 0 2023-12-16T20:11:40.045 INFO:tasks.workunit.client.1.smithi141.stdout:9/528: creat d1/d26/fbb x:0 0 0 2023-12-16T20:11:40.046 INFO:tasks.workunit.client.1.smithi141.stdout:0/583: getdents d4/d5c/daf 0 2023-12-16T20:11:40.048 INFO:tasks.workunit.client.1.smithi141.stdout:9/529: creat d1/d10/d33/d47/fbc x:0 0 0 2023-12-16T20:11:40.050 INFO:tasks.workunit.client.1.smithi141.stdout:0/584: symlink d4/d49/d73/d8a/d9b/lc9 0 2023-12-16T20:11:40.051 INFO:tasks.workunit.client.1.smithi141.stdout:8/581: dread d14/d19/d1b/d24/d4a/d58/d8b/f9e [0,4194304] 0 2023-12-16T20:11:40.052 INFO:tasks.workunit.client.1.smithi141.stdout:0/585: mknod d4/d49/d73/d8a/da4/cca 0 2023-12-16T20:11:40.053 INFO:tasks.workunit.client.1.smithi141.stdout:8/582: rmdir d14/d19/d1b/d24/d4a/d58 39 2023-12-16T20:11:40.054 INFO:tasks.workunit.client.1.smithi141.stdout:0/586: mknod d4/ccb 0 2023-12-16T20:11:40.059 INFO:tasks.workunit.client.1.smithi141.stdout:8/583: rename d14/d19/d1b/d24/d4a to d14/d19/d95/dae/db4 0 2023-12-16T20:11:40.060 INFO:tasks.workunit.client.1.smithi141.stdout:0/587: mkdir d4/d49/d73/d8a/da4/dcc 0 2023-12-16T20:11:40.066 INFO:tasks.workunit.client.1.smithi141.stdout:8/584: dread d14/d19/f2e [0,4194304] 0 2023-12-16T20:11:40.067 INFO:tasks.workunit.client.1.smithi141.stdout:8/585: rename d14/d19/d95/dae/db4/d58/d8b/f9e to d14/d19/d95/dab/fb5 0 2023-12-16T20:11:40.068 INFO:tasks.workunit.client.1.smithi141.stdout:8/586: chown d14/d19/d1b/d24/f55 160 1 2023-12-16T20:11:40.073 INFO:tasks.workunit.client.1.smithi141.stdout:6/623: dwrite d1/d3/d4b/f66 [4194304,4194304] 0 2023-12-16T20:11:40.073 INFO:tasks.workunit.client.1.smithi141.stdout:6/624: write d1/d3/d4b/d60/f99 [34012,103260] 0 2023-12-16T20:11:40.073 INFO:tasks.workunit.client.1.smithi141.stdout:6/625: chown d1/fa 7 1 2023-12-16T20:11:40.082 INFO:tasks.workunit.client.0.smithi038.stdout:4/892: dwrite d13/d17/d4b/da4/d9d/db5/fbe [0,4194304] 0 2023-12-16T20:11:40.083 INFO:tasks.workunit.client.0.smithi038.stdout:4/893: mkdir d13/d17/d4b/da4/d34/d123/d84/d88/d125 0 2023-12-16T20:11:40.083 INFO:tasks.workunit.client.0.smithi038.stdout:4/894: chown d13/d17/d4b/da4/d34/d123/db2 201837480 1 2023-12-16T20:11:40.085 INFO:tasks.workunit.client.0.smithi038.stdout:4/895: mkdir d13/d17/d4b/da4/d34/d123/d84/d126 0 2023-12-16T20:11:40.086 INFO:tasks.workunit.client.0.smithi038.stdout:4/896: chown d13/d17/d4b/da4/d11b/f11e 905 1 2023-12-16T20:11:40.086 INFO:tasks.workunit.client.1.smithi141.stdout:6/626: dread d1/dd/de/f27 [0,4194304] 0 2023-12-16T20:11:40.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/510: dwrite d0/d9/d16/d2a/fa2 [0,4194304] 0 2023-12-16T20:11:40.086 INFO:tasks.workunit.client.1.smithi141.stdout:5/511: readlink d0/l7 0 2023-12-16T20:11:40.087 INFO:tasks.workunit.client.1.smithi141.stdout:6/627: mknod d1/dd/d2f/ccc 0 2023-12-16T20:11:40.087 INFO:tasks.workunit.client.0.smithi038.stdout:4/897: write d13/d17/d2e/d32/d7c/fa8 [534166,105520] 0 2023-12-16T20:11:40.087 INFO:tasks.workunit.client.0.smithi038.stdout:4/898: dread - d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/da6/fea zero size 2023-12-16T20:11:40.087 INFO:tasks.workunit.client.0.smithi038.stdout:4/899: creat d13/d17/d4b/da4/d11b/f127 x:0 0 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.1.smithi141.stdout:1/612: dwrite da/fb8 [0,4194304] 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.1.smithi141.stdout:9/530: dwrite d1/d10/d27/f4b [4194304,4194304] 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.1.smithi141.stdout:9/531: dread - d1/d26/d4a/f94 zero size 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.1.smithi141.stdout:1/613: write da/d67/f8e [920599,33260] 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.0.smithi038.stdout:4/900: creat d13/f128 x:0 0 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.0.smithi038.stdout:4/901: write d13/d69/d7a/fa0 [157336,110400] 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.0.smithi038.stdout:4/902: write d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/fdc [492756,15017] 0 2023-12-16T20:11:40.091 INFO:tasks.workunit.client.0.smithi038.stdout:4/903: chown d13/d1f/d35/ddf 1616 1 2023-12-16T20:11:40.092 INFO:tasks.workunit.client.1.smithi141.stdout:5/512: creat d0/d25/d30/d8a/fb1 x:0 0 0 2023-12-16T20:11:40.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/904: symlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/da6/l129 0 2023-12-16T20:11:40.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/905: write d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/fdc [153560,56178] 0 2023-12-16T20:11:40.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/906: readlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/da6/ldd 0 2023-12-16T20:11:40.093 INFO:tasks.workunit.client.1.smithi141.stdout:8/587: dwrite d14/d19/d1b/d24/fa0 [0,4194304] 0 2023-12-16T20:11:40.105 INFO:tasks.workunit.client.1.smithi141.stdout:1/614: read da/df/f27 [1723830,32429] 0 2023-12-16T20:11:40.108 INFO:tasks.workunit.client.0.smithi038.stdout:4/907: read d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/dc8/fd6 [3747312,21103] 0 2023-12-16T20:11:40.110 INFO:tasks.workunit.client.0.smithi038.stdout:4/908: link d13/d17/d4b/da4/c23 d13/d17/d2e/d32/d4e/c12a 0 2023-12-16T20:11:40.110 INFO:tasks.workunit.client.1.smithi141.stdout:1/615: dread da/d1a/f7b [0,4194304] 0 2023-12-16T20:11:40.111 INFO:tasks.workunit.client.1.smithi141.stdout:1/616: write da/d1a/d1d/fc8 [545128,64355] 0 2023-12-16T20:11:40.112 INFO:tasks.workunit.client.0.smithi038.stdout:4/909: link d13/d17/d2e/d32/d4e/f59 d13/d17/d4b/da4/d34/d123/d84/d88/f12b 0 2023-12-16T20:11:40.112 INFO:tasks.workunit.client.1.smithi141.stdout:3/678: sync 2023-12-16T20:11:40.112 INFO:tasks.workunit.client.1.smithi141.stdout:7/574: sync 2023-12-16T20:11:40.113 INFO:tasks.workunit.client.0.smithi038.stdout:4/910: creat d13/d17/d4b/da4/d34/d123/d84/d88/d125/f12c x:0 0 0 2023-12-16T20:11:40.113 INFO:tasks.workunit.client.0.smithi038.stdout:4/911: write d13/d69/def/f100 [887797,44995] 0 2023-12-16T20:11:40.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/912: readlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/le8 0 2023-12-16T20:11:40.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/913: chown d13/d17/d4b/da4/d34/d123/l10a 2649 1 2023-12-16T20:11:40.114 INFO:tasks.workunit.client.0.smithi038.stdout:4/914: chown d13/d1f/db7/db9/ff3 433 1 2023-12-16T20:11:40.115 INFO:tasks.workunit.client.0.smithi038.stdout:4/915: symlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/l12d 0 2023-12-16T20:11:40.115 INFO:tasks.workunit.client.1.smithi141.stdout:2/447: truncate d6/d3a/d47/f65 2184154 0 2023-12-16T20:11:40.115 INFO:tasks.workunit.client.1.smithi141.stdout:2/448: creat d6/d12/d1f/d46/f9a x:0 0 0 2023-12-16T20:11:40.116 INFO:tasks.workunit.client.1.smithi141.stdout:8/588: creat d14/d19/d1b/d24/d4b/fb6 x:0 0 0 2023-12-16T20:11:40.119 INFO:tasks.workunit.client.1.smithi141.stdout:9/532: unlink d1/d10/d33/d6a/fb1 0 2023-12-16T20:11:40.119 INFO:tasks.workunit.client.1.smithi141.stdout:9/533: readlink d1/d10/d33/lb9 0 2023-12-16T20:11:40.121 INFO:tasks.workunit.client.1.smithi141.stdout:1/617: unlink da/d36/d4b/d4d/lc9 0 2023-12-16T20:11:40.121 INFO:tasks.workunit.client.1.smithi141.stdout:1/618: readlink da/d1a/db0/lb1 0 2023-12-16T20:11:40.126 INFO:tasks.workunit.client.1.smithi141.stdout:7/575: rename d5/d1d/d1e/l66 to d5/d1d/d1e/lbc 0 2023-12-16T20:11:40.127 INFO:tasks.workunit.client.1.smithi141.stdout:3/679: mkdir d0/d1c/d40/d3f/d52/d5d/d95/ddc 0 2023-12-16T20:11:40.128 INFO:tasks.workunit.client.1.smithi141.stdout:5/513: dwrite d0/d9/f89 [0,4194304] 0 2023-12-16T20:11:40.128 INFO:tasks.workunit.client.1.smithi141.stdout:5/514: write d0/d14/d2c/d4a/f51 [5054968,90645] 0 2023-12-16T20:11:40.128 INFO:tasks.workunit.client.1.smithi141.stdout:6/628: dwrite d1/d12/d22/f78 [0,4194304] 0 2023-12-16T20:11:40.128 INFO:tasks.workunit.client.1.smithi141.stdout:6/629: fsync d1/d12/d22/d25/fa4 0 2023-12-16T20:11:40.128 INFO:tasks.workunit.client.1.smithi141.stdout:6/630: fdatasync d1/dd/f1e 0 2023-12-16T20:11:40.130 INFO:tasks.workunit.client.1.smithi141.stdout:2/449: creat d6/da/d33/d54/d73/d80/f9b x:0 0 0 2023-12-16T20:11:40.130 INFO:tasks.workunit.client.1.smithi141.stdout:2/450: fdatasync d6/d12/d15/f4c 0 2023-12-16T20:11:40.133 INFO:tasks.workunit.client.1.smithi141.stdout:2/451: write d6/d3a/d47/d58/f72 [387790,98065] 0 2023-12-16T20:11:40.133 INFO:tasks.workunit.client.1.smithi141.stdout:2/452: stat d6/f17 0 2023-12-16T20:11:40.133 INFO:tasks.workunit.client.1.smithi141.stdout:2/453: fsync d6/da/f35 0 2023-12-16T20:11:40.133 INFO:tasks.workunit.client.1.smithi141.stdout:2/454: write d6/d12/d1f/d46/f84 [683952,81887] 0 2023-12-16T20:11:40.135 INFO:tasks.workunit.client.1.smithi141.stdout:1/619: creat da/d36/d4b/d7c/fcc x:0 0 0 2023-12-16T20:11:40.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/680: dread d0/d1c/d40/d85/d4c/f4f [0,4194304] 0 2023-12-16T20:11:40.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/681: readlink d0/d1c/d6a/d76/l78 0 2023-12-16T20:11:40.140 INFO:tasks.workunit.client.1.smithi141.stdout:7/576: symlink d5/d1d/d1e/lbd 0 2023-12-16T20:11:40.144 INFO:tasks.workunit.client.1.smithi141.stdout:5/515: link d0/d9/d16/d2a/fa8 d0/d14/d2c/fb2 0 2023-12-16T20:11:40.145 INFO:tasks.workunit.client.0.smithi038.stdout:0/934: sync 2023-12-16T20:11:40.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/997: sync 2023-12-16T20:11:40.145 INFO:tasks.workunit.client.0.smithi038.stdout:5/989: sync 2023-12-16T20:11:40.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.145+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc388005860 con 0x7fc3a406e470 2023-12-16T20:11:40.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.146+0000 7fc39a7fc700 1 -- 172.21.15.38:0/3554999806 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc39c020020 con 0x7fc3a406e470 2023-12-16T20:11:40.147 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:11:40.147 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:11:40.148 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:11:40.149 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:11:40.149 INFO:tasks.workunit.client.1.smithi141.stdout:6/631: creat d1/d12/d22/d25/d38/fcd x:0 0 0 2023-12-16T20:11:40.149 INFO:tasks.workunit.client.0.smithi038.stdout:0/935: truncate db/db6/fdb 1540815 0 2023-12-16T20:11:40.150 INFO:tasks.workunit.client.0.smithi038.stdout:9/998: link d9/d1e/d3d/d42/d59/d76/cc7 d9/d1f/d21/d3e/d72/d8a/c140 0 2023-12-16T20:11:40.150 INFO:tasks.workunit.client.0.smithi038.stdout:5/990: link d2/d14/d25/d2d/d17/da9/db0/f107 d2/df/d1a/d1f/d4a/dc8/f13c 0 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 msgr2=0x7fc39003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 0x7fc39003ac60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007fd0 tx=0x7fc3a0009040 comp rx=0 tx=0).stop 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 msgr2=0x7fc3a411c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc39c000f80 tx=0x7fc39c004d10 comp rx=0 tx=0).stop 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 shutdown_connections 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc3900387b0 0x7fc39003ac60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3a406e470 0x7fc3a411c310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 --2- 172.21.15.38:0/3554999806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3a411c850 0x7fc3a411d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 >> 172.21.15.38:0/3554999806 conn(0x7fc3a4069b70 msgr2=0x7fc3a406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 shutdown_connections 2023-12-16T20:11:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.150+0000 7fc3aae29700 1 -- 172.21.15.38:0/3554999806 wait complete. 2023-12-16T20:11:40.152 INFO:tasks.workunit.client.1.smithi141.stdout:1/620: mkdir da/d1a/d1d/d33/dcd 0 2023-12-16T20:11:40.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/991: rename d2/df/d1a/d2a/d59 to d2/df/d1a/d1f/d4a/dc8/d13d 0 2023-12-16T20:11:40.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/992: fsync d2/df/d1a/d1f/d4a/d53/d6e/d85/fb5 0 2023-12-16T20:11:40.154 INFO:tasks.workunit.client.1.smithi141.stdout:3/682: creat d0/d1c/fdd x:0 0 0 2023-12-16T20:11:40.154 INFO:tasks.workunit.client.1.smithi141.stdout:4/521: sync 2023-12-16T20:11:40.154 INFO:tasks.workunit.client.1.smithi141.stdout:4/522: fdatasync d1a/d2a/f37 0 2023-12-16T20:11:40.156 INFO:tasks.workunit.client.0.smithi038.stdout:9/999: rename d9/d1f/d21/d52/f82 to d9/d1e/d40/d5e/db5/f141 0 2023-12-16T20:11:40.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/936: dread db/f14 [0,4194304] 0 2023-12-16T20:11:40.156 INFO:tasks.workunit.client.1.smithi141.stdout:6/632: symlink d1/d12/d20/d3a/d45/d47/lce 0 2023-12-16T20:11:40.156 INFO:tasks.workunit.client.1.smithi141.stdout:6/633: write d1/d77/d9e/fb2 [438823,95874] 0 2023-12-16T20:11:40.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/993: getdents d2/d14/d44/d117 0 2023-12-16T20:11:40.157 INFO:tasks.workunit.client.1.smithi141.stdout:1/621: mknod da/d36/cce 0 2023-12-16T20:11:40.161 INFO:tasks.workunit.client.1.smithi141.stdout:3/683: symlink d0/d1c/d40/d3c/dce/lde 0 2023-12-16T20:11:40.161 INFO:tasks.workunit.client.0.smithi038.stdout:0/937: rename db/d16/d19/d27/d56/l81 to db/d16/d70/dd2/l12e 0 2023-12-16T20:11:40.163 INFO:tasks.workunit.client.1.smithi141.stdout:4/523: unlink d1a/d4e/l75 0 2023-12-16T20:11:40.165 INFO:tasks.workunit.client.1.smithi141.stdout:5/516: dread d0/d25/f2e [0,4194304] 0 2023-12-16T20:11:40.165 INFO:tasks.workunit.client.1.smithi141.stdout:5/517: chown d0/d14/l60 0 1 2023-12-16T20:11:40.165 INFO:tasks.workunit.client.1.smithi141.stdout:5/518: write d0/d9/d16/d2a/d35/d5e/f6b [392092,97276] 0 2023-12-16T20:11:40.166 INFO:tasks.workunit.client.1.smithi141.stdout:5/519: chown d0/d9/d16/d2a/fa8 7 1 2023-12-16T20:11:40.166 INFO:tasks.workunit.client.1.smithi141.stdout:5/520: readlink d0/d9/l18 0 2023-12-16T20:11:40.166 INFO:tasks.workunit.client.1.smithi141.stdout:6/634: write d1/d12/d22/d25/d38/faf [1847639,114378] 0 2023-12-16T20:11:40.166 INFO:tasks.workunit.client.0.smithi038.stdout:0/938: creat db/d16/d19/d4e/d106/f12f x:0 0 0 2023-12-16T20:11:40.166 INFO:tasks.workunit.client.1.smithi141.stdout:7/577: mknod d5/d16/d30/cbe 0 2023-12-16T20:11:40.168 INFO:tasks.workunit.client.1.smithi141.stdout:1/622: link da/d76/c88 da/d36/d4b/d4d/d80/ccf 0 2023-12-16T20:11:40.168 INFO:tasks.workunit.client.1.smithi141.stdout:1/623: creat da/d1a/d31/fd0 x:0 0 0 2023-12-16T20:11:40.169 INFO:tasks.workunit.client.0.smithi038.stdout:0/939: creat db/d16/d19/d4e/d106/dce/f130 x:0 0 0 2023-12-16T20:11:40.169 INFO:tasks.workunit.client.0.smithi038.stdout:0/940: fdatasync db/d16/d19/d4e/d106/d65/de8/fcd 0 2023-12-16T20:11:40.170 INFO:tasks.workunit.client.1.smithi141.stdout:3/684: write d0/d1c/d6a/d76/da2/fbe [3107995,36385] 0 2023-12-16T20:11:40.170 INFO:tasks.workunit.client.1.smithi141.stdout:3/685: write d0/d1c/f67 [2802192,86435] 0 2023-12-16T20:11:40.171 INFO:tasks.workunit.client.1.smithi141.stdout:5/521: truncate d0/d14/d2c/d4a/f4d 3791620 0 2023-12-16T20:11:40.173 INFO:tasks.workunit.client.0.smithi038.stdout:0/941: creat db/d16/d19/d27/d78/dd5/d114/f131 x:0 0 0 2023-12-16T20:11:40.175 INFO:tasks.workunit.client.1.smithi141.stdout:4/524: write f2 [2021098,43053] 0 2023-12-16T20:11:40.176 INFO:tasks.workunit.client.0.smithi038.stdout:0/942: truncate db/f44 1838681 0 2023-12-16T20:11:40.178 INFO:tasks.workunit.client.0.smithi038.stdout:0/943: symlink db/d16/db5/de6/d112/ded/l132 0 2023-12-16T20:11:40.178 INFO:tasks.workunit.client.1.smithi141.stdout:5/522: fsync d0/d43/f7e 0 2023-12-16T20:11:40.179 INFO:tasks.workunit.client.1.smithi141.stdout:5/523: chown d0/d14/d2c/d4a/l7d 9893 1 2023-12-16T20:11:40.179 INFO:tasks.workunit.client.1.smithi141.stdout:5/524: fsync d0/d9/d16/d2a/fa2 0 2023-12-16T20:11:40.179 INFO:tasks.workunit.client.0.smithi038.stdout:0/944: mkdir db/d16/d19/d27/d78/dd5/d114/d133 0 2023-12-16T20:11:40.179 INFO:tasks.workunit.client.0.smithi038.stdout:0/945: stat db/d16/d19/d27/ff3 0 2023-12-16T20:11:40.179 INFO:tasks.workunit.client.0.smithi038.stdout:0/946: dread - db/d16/d19/d4e/d89/d11a/f12b zero size 2023-12-16T20:11:40.181 INFO:tasks.workunit.client.1.smithi141.stdout:6/635: mknod d1/dd/ccf 0 2023-12-16T20:11:40.181 INFO:tasks.workunit.client.1.smithi141.stdout:6/636: write d1/d12/d20/d3a/d45/d47/fc1 [329998,42822] 0 2023-12-16T20:11:40.181 INFO:tasks.workunit.client.1.smithi141.stdout:4/525: mkdir d1a/d2a/dc2 0 2023-12-16T20:11:40.181 INFO:tasks.workunit.client.1.smithi141.stdout:4/526: chown f15 0 1 2023-12-16T20:11:40.182 INFO:tasks.workunit.client.1.smithi141.stdout:1/624: mkdir da/d1a/dd1 0 2023-12-16T20:11:40.182 INFO:tasks.workunit.client.1.smithi141.stdout:5/525: mkdir d0/d94/db3 0 2023-12-16T20:11:40.184 INFO:tasks.workunit.client.1.smithi141.stdout:6/637: mkdir d1/d12/d22/d25/dd0 0 2023-12-16T20:11:40.185 INFO:tasks.workunit.client.1.smithi141.stdout:6/638: rmdir d1/dd/de 39 2023-12-16T20:11:40.185 INFO:tasks.workunit.client.1.smithi141.stdout:6/639: dread - d1/d3/fa0 zero size 2023-12-16T20:11:40.185 INFO:tasks.workunit.client.1.smithi141.stdout:8/589: dwrite d14/d19/d1b/d24/da3/faa [0,4194304] 0 2023-12-16T20:11:40.186 INFO:tasks.workunit.client.1.smithi141.stdout:4/527: dread d1a/f25 [0,4194304] 0 2023-12-16T20:11:40.187 INFO:tasks.workunit.client.0.smithi038.stdout:5/994: dwrite d2/d14/f40 [0,4194304] 0 2023-12-16T20:11:40.187 INFO:tasks.workunit.client.1.smithi141.stdout:6/640: truncate d1/d12/d22/d25/d38/f3e 2333974 0 2023-12-16T20:11:40.189 INFO:tasks.workunit.client.1.smithi141.stdout:9/534: dwrite d1/d26/f4d [0,4194304] 0 2023-12-16T20:11:40.189 INFO:tasks.workunit.client.1.smithi141.stdout:9/535: chown d1/d26/fbb 85252 1 2023-12-16T20:11:40.195 INFO:tasks.workunit.client.1.smithi141.stdout:4/528: dread d1a/d2a/d3b/d69/f83 [0,4194304] 0 2023-12-16T20:11:40.196 INFO:tasks.workunit.client.1.smithi141.stdout:9/536: dread d1/d10/d33/f8b [0,4194304] 0 2023-12-16T20:11:40.197 INFO:tasks.workunit.client.1.smithi141.stdout:7/578: rename d5/d1d/d1e/lbc to d5/d16/d30/d4e/lbf 0 2023-12-16T20:11:40.198 INFO:tasks.workunit.client.0.smithi038.stdout:4/916: dwrite d13/d17/d4b/da4/f94 [0,4194304] 0 2023-12-16T20:11:40.200 INFO:tasks.workunit.client.1.smithi141.stdout:8/590: creat d14/d19/d1b/d24/fb7 x:0 0 0 2023-12-16T20:11:40.204 INFO:tasks.workunit.client.0.smithi038.stdout:4/917: creat d13/d17/d4b/da4/d34/d123/d84/de3/f12e x:0 0 0 2023-12-16T20:11:40.206 INFO:tasks.workunit.client.0.smithi038.stdout:4/918: creat d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/f12f x:0 0 0 2023-12-16T20:11:40.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/995: getdents d2/df/d1a/d2a 0 2023-12-16T20:11:40.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/996: readlink d2/df/d1a/d1f/d4a/db2/lc6 0 2023-12-16T20:11:40.209 INFO:tasks.workunit.client.0.smithi038.stdout:5/997: write d2/d14/d25/d2d/d17/d51/f8e [941397,126762] 0 2023-12-16T20:11:40.209 INFO:tasks.workunit.client.0.smithi038.stdout:4/919: mknod d13/d17/d4b/da4/d34/d123/d84/c130 0 2023-12-16T20:11:40.210 INFO:tasks.workunit.client.0.smithi038.stdout:4/920: symlink d13/d17/d4b/da4/d34/d123/l131 0 2023-12-16T20:11:40.211 INFO:tasks.workunit.client.0.smithi038.stdout:4/921: readlink d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/da6/ldd 0 2023-12-16T20:11:40.211 INFO:tasks.workunit.client.1.smithi141.stdout:9/537: unlink d1/d10/d33/d6a/d72/fac 0 2023-12-16T20:11:40.212 INFO:tasks.workunit.client.1.smithi141.stdout:9/538: write d1/d10/fb6 [417800,11916] 0 2023-12-16T20:11:40.212 INFO:tasks.workunit.client.0.smithi038.stdout:4/922: rmdir d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/d109 0 2023-12-16T20:11:40.212 INFO:tasks.workunit.client.0.smithi038.stdout:4/923: creat d13/d17/d4b/da4/d34/f132 x:0 0 0 2023-12-16T20:11:40.214 INFO:tasks.workunit.client.0.smithi038.stdout:4/924: mknod d13/d17/d4b/da4/d34/d123/c133 0 2023-12-16T20:11:40.214 INFO:tasks.workunit.client.1.smithi141.stdout:3/686: rename d0/d1c/d2c/f2f to d0/d1c/d40/d3f/d52/d5d/d95/fdf 0 2023-12-16T20:11:40.214 INFO:tasks.workunit.client.1.smithi141.stdout:3/687: write d0/d1c/d40/d3f/d52/f75 [509379,81114] 0 2023-12-16T20:11:40.214 INFO:tasks.workunit.client.1.smithi141.stdout:3/688: creat d0/d1c/d40/d3f/d52/d5d/fe0 x:0 0 0 2023-12-16T20:11:40.214 INFO:tasks.workunit.client.1.smithi141.stdout:3/689: truncate d0/d1c/d40/d3f/f90 930795 0 2023-12-16T20:11:40.215 INFO:tasks.workunit.client.1.smithi141.stdout:7/579: getdents d5/d16/d30/d36/d8c 0 2023-12-16T20:11:40.215 INFO:tasks.workunit.client.0.smithi038.stdout:4/925: rmdir d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/dc8 39 2023-12-16T20:11:40.215 INFO:tasks.workunit.client.0.smithi038.stdout:4/926: chown d13/d17 29326396 1 2023-12-16T20:11:40.215 INFO:tasks.workunit.client.0.smithi038.stdout:4/927: write d13/d69/d7a/da5/f113 [450105,78080] 0 2023-12-16T20:11:40.216 INFO:tasks.workunit.client.0.smithi038.stdout:4/928: creat d13/d17/d4b/da4/d34/d123/df6/dfc/f134 x:0 0 0 2023-12-16T20:11:40.216 INFO:tasks.workunit.client.0.smithi038.stdout:4/929: read - d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/d101/f104 zero size 2023-12-16T20:11:40.216 INFO:tasks.workunit.client.0.smithi038.stdout:4/930: chown d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/cf7 486 1 2023-12-16T20:11:40.218 INFO:tasks.workunit.client.1.smithi141.stdout:8/591: rename d14/d19/d1b/d3d/f38 to d14/d19/d95/dae/db4/d58/fb8 0 2023-12-16T20:11:40.221 INFO:tasks.workunit.client.1.smithi141.stdout:7/580: rename d5/d1d/d1e/d27/lba to d5/d16/d46/lc0 0 2023-12-16T20:11:40.223 INFO:tasks.workunit.client.1.smithi141.stdout:7/581: rmdir d5/d1d 39 2023-12-16T20:11:40.223 INFO:tasks.workunit.client.1.smithi141.stdout:7/582: chown d5/d16/d30/cbe 12184 1 2023-12-16T20:11:40.223 INFO:tasks.workunit.client.1.smithi141.stdout:7/583: dread - d5/d1d/d1e/d71/d96/fad zero size 2023-12-16T20:11:40.223 INFO:tasks.workunit.client.1.smithi141.stdout:7/584: write d5/d16/d46/f5d [4335215,72113] 0 2023-12-16T20:11:40.223 INFO:tasks.workunit.client.1.smithi141.stdout:7/585: dread - d5/d16/d46/d61/fbb zero size 2023-12-16T20:11:40.229 INFO:tasks.workunit.client.1.smithi141.stdout:9/539: write d1/d26/f91 [3629357,27014] 0 2023-12-16T20:11:40.235 INFO:tasks.workunit.client.1.smithi141.stdout:9/540: creat d1/d26/d4a/fbd x:0 0 0 2023-12-16T20:11:40.243 INFO:tasks.workunit.client.1.smithi141.stdout:5/526: dwrite d0/d25/d30/f97 [0,4194304] 0 2023-12-16T20:11:40.244 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:39 smithi141 ceph-mon[88165]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:39 smithi141 ceph-mon[88165]: pgmap v8: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 180 MiB/s rd, 230 MiB/s wr, 333 op/s 2023-12-16T20:11:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:39 smithi141 ceph-mon[88165]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:40.248 INFO:tasks.workunit.client.1.smithi141.stdout:5/527: creat d0/fb4 x:0 0 0 2023-12-16T20:11:40.248 INFO:tasks.workunit.client.1.smithi141.stdout:5/528: chown d0/d9/c38 0 1 2023-12-16T20:11:40.253 INFO:tasks.workunit.client.1.smithi141.stdout:5/529: mknod d0/d94/db3/cb5 0 2023-12-16T20:11:40.253 INFO:tasks.workunit.client.1.smithi141.stdout:1/625: dwrite da/df/f27 [4194304,4194304] 0 2023-12-16T20:11:40.253 INFO:tasks.workunit.client.1.smithi141.stdout:4/529: dwrite d1a/d3c/f5d [0,4194304] 0 2023-12-16T20:11:40.257 INFO:tasks.workunit.client.1.smithi141.stdout:4/530: mkdir d1a/d2a/dc3 0 2023-12-16T20:11:40.257 INFO:tasks.workunit.client.1.smithi141.stdout:4/531: chown d1a/d2a/d3b/d69/fa3 5468921 1 2023-12-16T20:11:40.257 INFO:tasks.workunit.client.1.smithi141.stdout:4/532: creat d1a/d4e/fc4 x:0 0 0 2023-12-16T20:11:40.258 INFO:tasks.workunit.client.1.smithi141.stdout:1/626: truncate da/d36/d4b/d7c/fc1 628717 0 2023-12-16T20:11:40.258 INFO:tasks.workunit.client.1.smithi141.stdout:1/627: readlink da/l19 0 2023-12-16T20:11:40.261 INFO:tasks.workunit.client.1.smithi141.stdout:4/533: mknod d1a/d59/d89/cc5 0 2023-12-16T20:11:40.263 INFO:tasks.workunit.client.1.smithi141.stdout:1/628: getdents da/d1a 0 2023-12-16T20:11:40.263 INFO:tasks.workunit.client.1.smithi141.stdout:1/629: creat da/d1a/d31/fd2 x:0 0 0 2023-12-16T20:11:40.267 INFO:tasks.workunit.client.1.smithi141.stdout:1/630: mkdir da/d1a/db0/dd3 0 2023-12-16T20:11:40.267 INFO:tasks.workunit.client.1.smithi141.stdout:1/631: dread - da/d67/f5e zero size 2023-12-16T20:11:40.268 INFO:tasks.workunit.client.1.smithi141.stdout:4/534: mknod d1a/cc6 0 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/632: readlink da/l44 0 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/633: readlink da/l19 0 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/634: read - da/d1a/d31/d81/f83 zero size 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/635: creat da/d1a/d1d/d33/fd4 x:0 0 0 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/636: write da/d67/f68 [905950,75867] 0 2023-12-16T20:11:40.269 INFO:tasks.workunit.client.1.smithi141.stdout:1/637: creat da/d36/d4b/d7c/fd5 x:0 0 0 2023-12-16T20:11:40.270 INFO:tasks.workunit.client.1.smithi141.stdout:1/638: write da/d67/f68 [1060761,32896] 0 2023-12-16T20:11:40.270 INFO:tasks.workunit.client.1.smithi141.stdout:7/586: dwrite d5/d16/d46/d61/f6b [0,4194304] 0 2023-12-16T20:11:40.270 INFO:tasks.workunit.client.1.smithi141.stdout:8/592: dwrite d14/d19/d95/dae/db4/d58/fb8 [0,4194304] 0 2023-12-16T20:11:40.270 INFO:tasks.workunit.client.1.smithi141.stdout:4/535: truncate f9 2918176 0 2023-12-16T20:11:40.277 INFO:tasks.workunit.client.1.smithi141.stdout:7/587: unlink d5/f28 0 2023-12-16T20:11:40.279 INFO:tasks.workunit.client.0.smithi038.stdout:8/860: sync 2023-12-16T20:11:40.280 INFO:tasks.workunit.client.0.smithi038.stdout:8/861: getdents d17/d5a 0 2023-12-16T20:11:40.282 INFO:tasks.workunit.client.0.smithi038.stdout:8/862: creat d17/d1b/d25/db7/f116 x:0 0 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/863: rename d17/d1b/d25/db7/c64 to d17/d1b/d25/db7/d82/da9/c117 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/864: write d17/d1b/d66/d8e/d97/fd5 [39665,47605] 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/865: truncate d17/d34/f61 1186762 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/866: fdatasync d17/d1b/d25/db7/d82/da9/f107 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/867: write d17/d1b/d66/d8e/d97/fbc [785911,110874] 0 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/868: chown d17/d1b/d25/db7/d82/da9/d50/d96/dba 102428 1 2023-12-16T20:11:40.284 INFO:tasks.workunit.client.0.smithi038.stdout:8/869: chown d17/d1b/d25/db7/d82/da9/d50/ddd/df9/lf0 47045 1 2023-12-16T20:11:40.285 INFO:tasks.workunit.client.1.smithi141.stdout:8/593: rename d14/d19/d1b/d3d/d5e/c63 to d14/d19/d95/dae/db4/d58/cb9 0 2023-12-16T20:11:40.285 INFO:tasks.workunit.client.1.smithi141.stdout:8/594: readlink d14/d35/l84 0 2023-12-16T20:11:40.286 INFO:tasks.workunit.client.1.smithi141.stdout:1/639: symlink da/d36/d4b/ld6 0 2023-12-16T20:11:40.286 INFO:tasks.workunit.client.1.smithi141.stdout:1/640: write da/df/f6f [4164,123615] 0 2023-12-16T20:11:40.286 INFO:tasks.workunit.client.1.smithi141.stdout:1/641: readlink da/d36/d4b/d4d/d89/d6c/lc5 0 2023-12-16T20:11:40.287 INFO:tasks.workunit.client.1.smithi141.stdout:7/588: creat d5/d16/d30/d36/fc1 x:0 0 0 2023-12-16T20:11:40.288 INFO:tasks.workunit.client.1.smithi141.stdout:1/642: mkdir da/d36/d4b/d4d/dd7 0 2023-12-16T20:11:40.288 INFO:tasks.workunit.client.1.smithi141.stdout:1/643: readlink da/d36/d4b/d4d/d89/d6c/l9f 0 2023-12-16T20:11:40.288 INFO:tasks.workunit.client.1.smithi141.stdout:1/644: creat da/d1a/d1d/fd8 x:0 0 0 2023-12-16T20:11:40.288 INFO:tasks.workunit.client.1.smithi141.stdout:1/645: write da/d1a/f73 [1798016,28758] 0 2023-12-16T20:11:40.289 INFO:tasks.workunit.client.1.smithi141.stdout:7/589: creat d5/d16/d30/d4e/fc2 x:0 0 0 2023-12-16T20:11:40.289 INFO:tasks.workunit.client.1.smithi141.stdout:1/646: write da/d1a/d1d/d22/f6d [1126749,35486] 0 2023-12-16T20:11:40.294 INFO:tasks.workunit.client.1.smithi141.stdout:1/647: symlink da/d36/d4b/d4d/d80/dca/ld9 0 2023-12-16T20:11:40.294 INFO:tasks.workunit.client.1.smithi141.stdout:8/595: dread d14/d19/d1b/d24/da3/faa [0,4194304] 0 2023-12-16T20:11:40.294 INFO:tasks.workunit.client.1.smithi141.stdout:7/590: rmdir d5/d16/d30/d4e/d6e 39 2023-12-16T20:11:40.296 INFO:tasks.workunit.client.1.smithi141.stdout:1/648: creat da/d36/d4b/d4d/d89/d6c/dbf/fda x:0 0 0 2023-12-16T20:11:40.299 INFO:tasks.workunit.client.1.smithi141.stdout:8/596: rename d14/d71/fb2 to d14/d19/d95/dae/db4/d69/fba 0 2023-12-16T20:11:40.300 INFO:tasks.workunit.client.0.smithi038.stdout:8/870: write d17/f40 [4891356,40840] 0 2023-12-16T20:11:40.302 INFO:tasks.workunit.client.1.smithi141.stdout:7/591: rename d5/d1d/d1e/f74 to d5/d16/d30/d4e/d87/fc3 0 2023-12-16T20:11:40.304 INFO:tasks.workunit.client.1.smithi141.stdout:5/530: dwrite d0/d14/f23 [0,4194304] 0 2023-12-16T20:11:40.307 INFO:tasks.workunit.client.1.smithi141.stdout:4/536: dwrite f2 [0,4194304] 0 2023-12-16T20:11:40.307 INFO:tasks.workunit.client.1.smithi141.stdout:4/537: fsync d1a/d3c/d9b/da1/fb0 0 2023-12-16T20:11:40.308 INFO:tasks.workunit.client.1.smithi141.stdout:4/538: dread - d1a/d54/d87/da8/f97 zero size 2023-12-16T20:11:40.308 INFO:tasks.workunit.client.1.smithi141.stdout:4/539: chown d1a/d54 9 1 2023-12-16T20:11:40.308 INFO:tasks.workunit.client.1.smithi141.stdout:5/531: symlink d0/d9/d16/d2a/d4f/lb6 0 2023-12-16T20:11:40.308 INFO:tasks.workunit.client.1.smithi141.stdout:5/532: creat d0/d9/d16/d2a/d35/d4c/fb7 x:0 0 0 2023-12-16T20:11:40.311 INFO:tasks.workunit.client.1.smithi141.stdout:4/540: truncate d1a/f1f 3323728 0 2023-12-16T20:11:40.313 INFO:tasks.workunit.client.1.smithi141.stdout:5/533: mknod d0/d9/cb8 0 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 -- 172.21.15.38:0/3598957933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8104c40 msgr2=0x7f2db8107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/3598957933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8104c40 0x7f2db8107020 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004940 tx=0x7f2db4009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 -- 172.21.15.38:0/3598957933 shutdown_connections 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/3598957933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8107560 0x7f2db8109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/3598957933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8104c40 0x7f2db8107020 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 -- 172.21.15.38:0/3598957933 >> 172.21.15.38:0/3598957933 conn(0x7f2db8069b20 msgr2=0x7f2db806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:40.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.313+0000 7f2dc01f7700 1 -- 172.21.15.38:0/3598957933 shutdown_connections 2023-12-16T20:11:40.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 -- 172.21.15.38:0/3598957933 wait complete. 2023-12-16T20:11:40.315 INFO:tasks.workunit.client.1.smithi141.stdout:5/534: read d0/d25/d30/d67/f71 [19179,100556] 0 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 Processor -- start 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 -- start start 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8104c40 0x7f2db81095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8108050 con 0x7f2db8107560 2023-12-16T20:11:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.314+0000 7f2dc01f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81081c0 con 0x7f2db8104c40 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.315+0000 7f2dbd792700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.315+0000 7f2dbd792700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51346/0 (socket says 172.21.15.38:51346) 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.315+0000 7f2dbd792700 1 -- 172.21.15.38:0/5894875 learned_addr learned my addr 172.21.15.38:0/5894875 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.315+0000 7f2dbdf93700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8104c40 0x7f2db81095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dbd792700 1 -- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8104c40 msgr2=0x7f2db81095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dbd792700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8104c40 0x7f2db81095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dbd792700 1 -- 172.21.15.38:0/5894875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4005040 con 0x7f2db8107560 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dbd792700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2da800eb70 tx=0x7f2da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da8007cc0 con 0x7f2db8107560 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2da800f040 con 0x7f2db8107560 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.316+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da80095f0 con 0x7f2db8107560 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.317+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db8108440 con 0x7f2db8107560 2023-12-16T20:11:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.317+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db811dd30 con 0x7f2db8107560 2023-12-16T20:11:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.318+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db810fd20 con 0x7f2db8107560 2023-12-16T20:11:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.318+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) v1 ==== 45730+0+0 (secure 0 0 0) 0x7f2da8009750 con 0x7f2db8107560 2023-12-16T20:11:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.318+0000 7f2dae7fc700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 0x7f2da403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:11:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.319+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2da804bd40 con 0x7f2db8107560 2023-12-16T20:11:40.320 INFO:tasks.workunit.client.1.smithi141.stdout:5/535: rename d0/d25/d30/d67/c28 to d0/d9/cb9 0 2023-12-16T20:11:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.319+0000 7f2dbdf93700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 0x7f2da403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:11:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.319+0000 7f2dbdf93700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 0x7f2da403ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009fd0 tx=0x7f2db4009e30 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:11:40.320 INFO:tasks.workunit.client.1.smithi141.stdout:5/536: mknod d0/d14/d98/cba 0 2023-12-16T20:11:40.320 INFO:tasks.workunit.client.1.smithi141.stdout:5/537: write d0/d9/f34 [2322319,53173] 0 2023-12-16T20:11:40.322 INFO:tasks.workunit.client.1.smithi141.stdout:5/538: getdents d0/d9/d16/d2a/d35 0 2023-12-16T20:11:40.325 INFO:tasks.workunit.client.1.smithi141.stdout:5/539: truncate d0/d14/f31 739953 0 2023-12-16T20:11:40.325 INFO:tasks.workunit.client.1.smithi141.stdout:5/540: write d0/d25/f93 [411256,29225] 0 2023-12-16T20:11:40.325 INFO:tasks.workunit.client.1.smithi141.stdout:5/541: readlink d0/d14/d75/l9f 0 2023-12-16T20:11:40.325 INFO:tasks.workunit.client.1.smithi141.stdout:5/542: fdatasync d0/d43/f7e 0 2023-12-16T20:11:40.325 INFO:tasks.workunit.client.1.smithi141.stdout:5/543: creat d0/d9/d16/d72/d7f/fbb x:0 0 0 2023-12-16T20:11:40.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.326+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2da800cba0 con 0x7f2db8107560 2023-12-16T20:11:40.330 INFO:tasks.workunit.client.1.smithi141.stdout:8/597: dwrite d14/d19/f2e [0,4194304] 0 2023-12-16T20:11:40.331 INFO:tasks.workunit.client.1.smithi141.stdout:8/598: dread d14/d19/d1b/f3f [0,4194304] 0 2023-12-16T20:11:40.332 INFO:tasks.workunit.client.1.smithi141.stdout:8/599: link d14/d19/d95/dae/db4/f5a d14/d35/fbb 0 2023-12-16T20:11:40.333 INFO:tasks.workunit.client.1.smithi141.stdout:8/600: symlink d14/d19/d1b/d24/d4b/d8f/lbc 0 2023-12-16T20:11:40.337 INFO:tasks.workunit.client.1.smithi141.stdout:7/592: dwrite d5/d16/d1a/f1f [0,4194304] 0 2023-12-16T20:11:40.341 INFO:tasks.workunit.client.1.smithi141.stdout:7/593: readlink d5/d16/d30/l73 0 2023-12-16T20:11:40.342 INFO:tasks.workunit.client.1.smithi141.stdout:8/601: dread d14/d35/f66 [0,4194304] 0 2023-12-16T20:11:40.342 INFO:tasks.workunit.client.1.smithi141.stdout:7/594: symlink d5/d1d/d1e/lc4 0 2023-12-16T20:11:40.342 INFO:tasks.workunit.client.1.smithi141.stdout:7/595: write d5/d16/d1a/d40/f7b [1095518,130936] 0 2023-12-16T20:11:40.343 INFO:tasks.workunit.client.1.smithi141.stdout:7/596: write d5/d16/f75 [1021581,99962] 0 2023-12-16T20:11:40.344 INFO:tasks.workunit.client.1.smithi141.stdout:7/597: creat d5/d2a/d45/d5a/fc5 x:0 0 0 2023-12-16T20:11:40.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/541: dwrite d1a/d2a/d3b/f7f [0,4194304] 0 2023-12-16T20:11:40.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/542: chown d1a/d54/f6a 297 1 2023-12-16T20:11:40.349 INFO:tasks.workunit.client.1.smithi141.stdout:7/598: rename d5/d16/d46/f53 to d5/d1d/d1e/d71/fc6 0 2023-12-16T20:11:40.349 INFO:tasks.workunit.client.1.smithi141.stdout:7/599: fdatasync d5/d16/d30/d4e/d6e/f77 0 2023-12-16T20:11:40.349 INFO:tasks.workunit.client.1.smithi141.stdout:7/600: chown d5/d16/d1a/f7f 7 1 2023-12-16T20:11:40.349 INFO:tasks.workunit.client.1.smithi141.stdout:7/601: creat d5/d16/d30/d36/fc7 x:0 0 0 2023-12-16T20:11:40.360 INFO:tasks.workunit.client.1.smithi141.stdout:7/602: creat d5/d16/d30/d4e/d6e/fc8 x:0 0 0 2023-12-16T20:11:40.360 INFO:tasks.workunit.client.1.smithi141.stdout:7/603: creat d5/d2a/fc9 x:0 0 0 2023-12-16T20:11:40.361 INFO:tasks.workunit.client.1.smithi141.stdout:4/543: dwrite d1a/f25 [0,4194304] 0 2023-12-16T20:11:40.361 INFO:tasks.workunit.client.1.smithi141.stdout:4/544: write d1a/d3c/d9b/fb6 [901620,112283] 0 2023-12-16T20:11:40.362 INFO:tasks.workunit.client.1.smithi141.stdout:7/604: mknod d5/d16/d1a/cca 0 2023-12-16T20:11:40.362 INFO:tasks.workunit.client.1.smithi141.stdout:7/605: stat d5/f11 0 2023-12-16T20:11:40.362 INFO:tasks.workunit.client.1.smithi141.stdout:7/606: readlink d5/d16/d46/lc0 0 2023-12-16T20:11:40.362 INFO:tasks.workunit.client.1.smithi141.stdout:7/607: chown d5/d16/d46/d61/f99 83464933 1 2023-12-16T20:11:40.364 INFO:tasks.workunit.client.1.smithi141.stdout:4/545: mkdir d1a/d3c/d9b/da1/dc7 0 2023-12-16T20:11:40.364 INFO:tasks.workunit.client.1.smithi141.stdout:4/546: fdatasync d1a/d2a/f78 0 2023-12-16T20:11:40.366 INFO:tasks.workunit.client.1.smithi141.stdout:5/544: dread d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:40.366 INFO:tasks.workunit.client.1.smithi141.stdout:5/545: write d0/d9/d16/d2a/d4f/f8f [383808,119186] 0 2023-12-16T20:11:40.367 INFO:tasks.workunit.client.1.smithi141.stdout:7/608: rename d5/d1d/d1e/d27 to d5/d16/d1a/d40/dcb 0 2023-12-16T20:11:40.367 INFO:tasks.workunit.client.1.smithi141.stdout:7/609: write d5/d16/d30/fa3 [886922,93452] 0 2023-12-16T20:11:40.367 INFO:tasks.workunit.client.1.smithi141.stdout:7/610: chown d5/d16/d30/d36/f4b 11 1 2023-12-16T20:11:40.369 INFO:tasks.workunit.client.1.smithi141.stdout:5/546: mknod d0/d9/d16/d2a/d35/cbc 0 2023-12-16T20:11:40.369 INFO:tasks.workunit.client.1.smithi141.stdout:5/547: write d0/d14/f70 [539919,88626] 0 2023-12-16T20:11:40.371 INFO:tasks.workunit.client.1.smithi141.stdout:4/547: write f9 [236629,79908] 0 2023-12-16T20:11:40.374 INFO:tasks.workunit.client.1.smithi141.stdout:4/548: link d1a/l62 d1a/d4e/d63/daa/lc8 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/611: getdents d5/d16/d46 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/612: creat d5/d16/d1a/d40/fcc x:0 0 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/613: creat d5/d1d/d1e/d71/fcd x:0 0 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/614: chown d5/d16/d1a 2863 1 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/615: write d5/d2a/f2c [2148084,29665] 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/616: fdatasync d5/d1d/d1e/d71/fb9 0 2023-12-16T20:11:40.375 INFO:tasks.workunit.client.1.smithi141.stdout:7/617: dread - d5/d16/d30/d4e/d6e/f88 zero size 2023-12-16T20:11:40.381 INFO:tasks.workunit.client.1.smithi141.stdout:4/549: symlink d1a/d59/lc9 0 2023-12-16T20:11:40.384 INFO:tasks.workunit.client.1.smithi141.stdout:7/618: mkdir d5/d16/d1a/dce 0 2023-12-16T20:11:40.384 INFO:tasks.workunit.client.1.smithi141.stdout:7/619: dread - d5/d16/d1a/d40/dcb/f70 zero size 2023-12-16T20:11:40.384 INFO:tasks.workunit.client.1.smithi141.stdout:7/620: symlink d5/d1d/d89/lcf 0 2023-12-16T20:11:40.387 INFO:tasks.workunit.client.1.smithi141.stdout:4/550: dread d1a/f35 [0,4194304] 0 2023-12-16T20:11:40.388 INFO:tasks.workunit.client.1.smithi141.stdout:4/551: getdents d1a/d4e/d63/daa/db9 0 2023-12-16T20:11:40.389 INFO:tasks.workunit.client.1.smithi141.stdout:4/552: rmdir d1a/d2a/d3b/d69/dae 0 2023-12-16T20:11:40.389 INFO:tasks.workunit.client.1.smithi141.stdout:4/553: write d1a/d3c/d9b/fac [723846,88762] 0 2023-12-16T20:11:40.391 INFO:tasks.workunit.client.1.smithi141.stdout:4/554: dread d1a/d54/d87/da8/f99 [0,4194304] 0 2023-12-16T20:11:40.391 INFO:tasks.workunit.client.1.smithi141.stdout:4/555: chown d1a/d2a/d3b/f7f 160 1 2023-12-16T20:11:40.392 INFO:tasks.workunit.client.1.smithi141.stdout:4/556: read - d1a/d3c/d9b/da1/fb0 zero size 2023-12-16T20:11:40.393 INFO:tasks.workunit.client.1.smithi141.stdout:4/557: getdents d1a/d3c/d9b 0 2023-12-16T20:11:40.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/621: write d5/d2a/f2d [2890396,63541] 0 2023-12-16T20:11:40.395 INFO:tasks.workunit.client.1.smithi141.stdout:4/558: mknod d1a/d54/cca 0 2023-12-16T20:11:40.397 INFO:tasks.workunit.client.1.smithi141.stdout:4/559: mknod d1a/d54/ccb 0 2023-12-16T20:11:40.397 INFO:tasks.workunit.client.1.smithi141.stdout:4/560: creat d1a/d59/d89/d8a/fcc x:0 0 0 2023-12-16T20:11:40.398 INFO:tasks.workunit.client.1.smithi141.stdout:4/561: mkdir d1a/d2a/d3b/dcd 0 2023-12-16T20:11:40.398 INFO:tasks.workunit.client.1.smithi141.stdout:4/562: dread - d1a/d54/d87/da8/da9/fbd zero size 2023-12-16T20:11:40.398 INFO:tasks.workunit.client.1.smithi141.stdout:4/563: write d1a/d2a/f78 [4802534,12569] 0 2023-12-16T20:11:40.445 INFO:tasks.workunit.client.1.smithi141.stdout:0/588: sync 2023-12-16T20:11:40.445 INFO:tasks.workunit.client.1.smithi141.stdout:0/589: mkdir d4/d49/db9/dcd 0 2023-12-16T20:11:40.446 INFO:tasks.workunit.client.1.smithi141.stdout:0/590: fdatasync d4/d49/d73/d3b/f67 0 2023-12-16T20:11:40.446 INFO:tasks.workunit.client.1.smithi141.stdout:0/591: symlink d4/d74/lce 0 2023-12-16T20:11:40.446 INFO:tasks.workunit.client.1.smithi141.stdout:0/592: fdatasync d4/d49/d73/d3b/d78/fc2 0 2023-12-16T20:11:40.447 INFO:tasks.workunit.client.1.smithi141.stdout:0/593: dread - d4/d49/da1/dbd/fc4 zero size 2023-12-16T20:11:40.451 INFO:tasks.workunit.client.1.smithi141.stdout:4/564: dwrite d1a/d4e/f56 [0,4194304] 0 2023-12-16T20:11:40.455 INFO:tasks.workunit.client.1.smithi141.stdout:4/565: rmdir d1a/d54/d87/da8/da9 39 2023-12-16T20:11:40.460 INFO:tasks.workunit.client.1.smithi141.stdout:0/594: read d4/d7/f1e [1874126,32760] 0 2023-12-16T20:11:40.482 INFO:tasks.workunit.client.1.smithi141.stdout:0/595: dwrite d4/d49/f71 [0,4194304] 0 2023-12-16T20:11:40.483 INFO:tasks.workunit.client.1.smithi141.stdout:0/596: stat d4/d7/l25 0 2023-12-16T20:11:40.518 INFO:tasks.workunit.client.0.smithi038.stdout:1/973: sync 2023-12-16T20:11:40.518 INFO:tasks.workunit.client.0.smithi038.stdout:6/897: sync 2023-12-16T20:11:40.519 INFO:tasks.workunit.client.0.smithi038.stdout:6/898: truncate d1/d5b/d7d/d9d/dc8/de7/f78 3038266 0 2023-12-16T20:11:40.519 INFO:tasks.workunit.client.0.smithi038.stdout:6/899: truncate d1/d5b/d7d/d9d/dc8/f10d 574082 0 2023-12-16T20:11:40.531 INFO:tasks.workunit.client.0.smithi038.stdout:1/974: dwrite d15/d1e/d3b/d117/d34/f5d [0,4194304] 0 2023-12-16T20:11:40.532 INFO:tasks.workunit.client.0.smithi038.stdout:1/975: rename d15/d1e/db0/l14b to d15/d1e/d30/d95/d12a/l153 0 2023-12-16T20:11:40.534 INFO:tasks.workunit.client.0.smithi038.stdout:1/976: rename d15/d1e/d3b/d48/l113 to d15/d1e/d3b/d48/d3d/l154 0 2023-12-16T20:11:40.534 INFO:tasks.workunit.client.0.smithi038.stdout:1/977: rmdir d15/d1e/d30/d95/d12a 39 2023-12-16T20:11:40.535 INFO:tasks.workunit.client.0.smithi038.stdout:1/978: fdatasync d15/d4a/f122 0 2023-12-16T20:11:40.535 INFO:tasks.workunit.client.0.smithi038.stdout:1/979: dread - d15/d1e/d30/d95/d12a/f11e zero size 2023-12-16T20:11:40.535 INFO:tasks.workunit.client.0.smithi038.stdout:1/980: symlink d15/d22/d52/d7f/l155 0 2023-12-16T20:11:40.549 INFO:tasks.workunit.client.0.smithi038.stdout:1/981: dwrite d15/d1e/d3b/d117/d34/f8b [0,4194304] 0 2023-12-16T20:11:40.550 INFO:tasks.workunit.client.0.smithi038.stdout:1/982: chown d15/d1e/d118/c13f 297 1 2023-12-16T20:11:40.550 INFO:tasks.workunit.client.0.smithi038.stdout:1/983: write d15/d1e/d30/ff6 [609127,18693] 0 2023-12-16T20:11:40.567 INFO:tasks.workunit.client.0.smithi038.stdout:1/984: dwrite d15/d1e/d3b/d48/d37/f3c [4194304,4194304] 0 2023-12-16T20:11:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:1/985: truncate d15/d22/f51 1182673 0 2023-12-16T20:11:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:1/986: dread - d15/d1e/d3b/d48/d37/f144 zero size 2023-12-16T20:11:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:1/987: chown d15/d1e/d30/d95/d12a/f11e 1749027939 1 2023-12-16T20:11:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:1/988: fsync d15/d1e/d3b/d117/fa9 0 2023-12-16T20:11:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:1/989: creat d15/d1e/d3b/d117/da2/f156 x:0 0 0 2023-12-16T20:11:40.579 INFO:tasks.workunit.client.0.smithi038.stdout:1/990: dwrite d15/f24 [0,4194304] 0 2023-12-16T20:11:40.582 INFO:tasks.workunit.client.0.smithi038.stdout:1/991: symlink d15/d1e/d3b/d117/d7d/daa/l157 0 2023-12-16T20:11:40.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.583+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db802b150 con 0x7f2da4038770 2023-12-16T20:11:40.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.584+0000 7f2dae7fc700 1 -- 172.21.15.38:0/5894875 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2db802b150 con 0x7f2da4038770 2023-12-16T20:11:40.584 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:11:40.585 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:11:40.586 INFO:tasks.workunit.client.0.smithi038.stdout:0/947: sync 2023-12-16T20:11:40.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/998: sync 2023-12-16T20:11:40.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 msgr2=0x7f2da403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 0x7f2da403ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009fd0 tx=0x7f2db4009e30 comp rx=0 tx=0).stop 2023-12-16T20:11:40.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 msgr2=0x7f2db8107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2da800eb70 tx=0x7f2da800b040 comp rx=0 tx=0).stop 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 shutdown_connections 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f2da4038770 0x7f2da403ac20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2db8104c40 0x7f2db81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 --2- 172.21.15.38:0/5894875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2db8107560 0x7f2db8107a50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.587+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 >> 172.21.15.38:0/5894875 conn(0x7f2db8069b20 msgr2=0x7f2db806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:11:40.588 INFO:tasks.workunit.client.0.smithi038.stdout:0/948: mknod db/c134 0 2023-12-16T20:11:40.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.588+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 shutdown_connections 2023-12-16T20:11:40.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:11:40.588+0000 7f2dc01f7700 1 -- 172.21.15.38:0/5894875 wait complete. 2023-12-16T20:11:40.589 INFO:tasks.workunit.client.0.smithi038.stdout:0/949: symlink db/d16/d19/d27/l135 0 2023-12-16T20:11:40.590 INFO:tasks.workunit.client.0.smithi038.stdout:0/950: creat db/d16/d19/d4e/d106/d65/de8/f136 x:0 0 0 2023-12-16T20:11:40.591 INFO:tasks.workunit.client.0.smithi038.stdout:0/951: creat db/d16/d19/d4e/d106/d65/de8/f137 x:0 0 0 2023-12-16T20:11:40.591 INFO:tasks.workunit.client.0.smithi038.stdout:1/992: dread d15/d1e/d3b/d48/f36 [0,4194304] 0 2023-12-16T20:11:40.592 INFO:tasks.workunit.client.0.smithi038.stdout:1/993: truncate d15/d1e/d3b/d117/d34/d86/fa0 3640343 0 2023-12-16T20:11:40.592 INFO:tasks.workunit.client.0.smithi038.stdout:0/952: creat db/d16/db5/de6/d112/f138 x:0 0 0 2023-12-16T20:11:40.594 INFO:tasks.workunit.client.0.smithi038.stdout:0/953: creat db/d16/d19/d4e/d106/d65/de8/d77/f139 x:0 0 0 2023-12-16T20:11:40.596 INFO:tasks.workunit.client.0.smithi038.stdout:0/954: rename db/d16/d19/d27/l135 to db/d16/d1c/d5d/d64/l13a 0 2023-12-16T20:11:40.598 INFO:tasks.workunit.client.0.smithi038.stdout:0/955: mkdir db/d16/d19/d4e/d106/d13b 0 2023-12-16T20:11:40.599 INFO:tasks.workunit.client.0.smithi038.stdout:0/956: mkdir db/d16/d70/dd2/d13c 0 2023-12-16T20:11:40.603 INFO:tasks.workunit.client.0.smithi038.stdout:5/999: dwrite d2/d4/d62/f11c [0,4194304] 0 2023-12-16T20:11:40.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/957: dwrite db/d16/d1c/d5d/f8d [4194304,4194304] 0 2023-12-16T20:11:40.624 INFO:tasks.workunit.client.0.smithi038.stdout:0/958: link db/d16/d19/f43 db/d16/db5/de6/d112/f13d 0 2023-12-16T20:11:40.636 INFO:tasks.workunit.client.1.smithi141.stdout:1/649: sync 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:9/541: sync 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:1/650: fsync da/d36/f3f 0 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:2/455: sync 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:6/641: sync 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:9/542: chown d1/d10/d14/d20/db3/f40 116455656 1 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:1/651: stat da/d1a 0 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:3/690: sync 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:1/652: fdatasync da/d36/d4b/d7c/fcc 0 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:6/642: chown d1/dd/d2f/l57 373 1 2023-12-16T20:11:40.637 INFO:tasks.workunit.client.1.smithi141.stdout:1/653: write da/d36/d4b/d4d/d80/f93 [136673,127347] 0 2023-12-16T20:11:40.639 INFO:tasks.workunit.client.1.smithi141.stdout:3/691: unlink d0/d1c/d40/f45 0 2023-12-16T20:11:40.641 INFO:tasks.workunit.client.1.smithi141.stdout:9/543: creat d1/d10/d14/d20/da/d3f/dab/fbe x:0 0 0 2023-12-16T20:11:40.642 INFO:tasks.workunit.client.1.smithi141.stdout:2/456: dread d6/d3a/f2c [0,4194304] 0 2023-12-16T20:11:40.643 INFO:tasks.workunit.client.1.smithi141.stdout:2/457: truncate d6/da/d33/d54/d73/d80/f9b 478852 0 2023-12-16T20:11:40.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/692: creat d0/d1c/d6a/d8f/fe1 x:0 0 0 2023-12-16T20:11:40.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/693: write d0/d1c/d40/d3f/f90 [1938362,43957] 0 2023-12-16T20:11:40.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/694: creat d0/fe2 x:0 0 0 2023-12-16T20:11:40.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/695: chown d0/d1c/l3d 4936 1 2023-12-16T20:11:40.647 INFO:tasks.workunit.client.1.smithi141.stdout:6/643: rename d1/d12/d20/d3a/d45 to d1/d12/d20/d85/dd1 0 2023-12-16T20:11:40.648 INFO:tasks.workunit.client.1.smithi141.stdout:1/654: getdents da/d1a/d1d/d8f 0 2023-12-16T20:11:40.653 INFO:tasks.workunit.client.1.smithi141.stdout:2/458: creat d6/da/d1b/d5b/d6a/d85/f9c x:0 0 0 2023-12-16T20:11:40.655 INFO:tasks.workunit.client.1.smithi141.stdout:3/696: mkdir d0/d1c/d6a/d76/de3 0 2023-12-16T20:11:40.655 INFO:tasks.workunit.client.1.smithi141.stdout:3/697: fsync d0/d1c/f98 0 2023-12-16T20:11:40.656 INFO:tasks.workunit.client.1.smithi141.stdout:1/655: mknod da/d36/d4b/d4d/d80/d94/cdb 0 2023-12-16T20:11:40.665 INFO:tasks.workunit.client.1.smithi141.stdout:5/548: sync 2023-12-16T20:11:40.665 INFO:tasks.workunit.client.1.smithi141.stdout:5/549: chown d0/d9/l18 15 1 2023-12-16T20:11:40.667 INFO:tasks.workunit.client.1.smithi141.stdout:5/550: symlink d0/d9/lbd 0 2023-12-16T20:11:40.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/602: sync 2023-12-16T20:11:40.672 INFO:tasks.workunit.client.1.smithi141.stdout:6/644: dwrite d1/d12/d20/d89/d95/f75 [0,4194304] 0 2023-12-16T20:11:40.674 INFO:tasks.workunit.client.1.smithi141.stdout:9/544: dwrite d1/d10/d27/d36/f50 [0,4194304] 0 2023-12-16T20:11:40.674 INFO:tasks.workunit.client.1.smithi141.stdout:9/545: chown d1/d10/d33/f8b 33070560 1 2023-12-16T20:11:40.677 INFO:tasks.workunit.client.1.smithi141.stdout:8/603: rename d14/d19/d95/dae/db4/d58/faf to d14/d19/d1b/d24/fbd 0 2023-12-16T20:11:40.682 INFO:tasks.workunit.client.1.smithi141.stdout:2/459: dwrite d6/d3a/f2c [0,4194304] 0 2023-12-16T20:11:40.684 INFO:tasks.workunit.client.1.smithi141.stdout:3/698: dread d0/d1c/d40/d3f/f90 [0,4194304] 0 2023-12-16T20:11:40.684 INFO:tasks.workunit.client.1.smithi141.stdout:3/699: fsync d0/d1c/d40/d3f/d52/f7b 0 2023-12-16T20:11:40.684 INFO:tasks.workunit.client.1.smithi141.stdout:2/460: mkdir d6/d3a/d9d 0 2023-12-16T20:11:40.686 INFO:tasks.workunit.client.1.smithi141.stdout:5/551: dwrite d0/d9/d16/d72/d7f/faf [0,4194304] 0 2023-12-16T20:11:40.690 INFO:tasks.workunit.client.1.smithi141.stdout:5/552: mkdir d0/d9/d16/d2a/d35/dbe 0 2023-12-16T20:11:40.690 INFO:tasks.workunit.client.1.smithi141.stdout:5/553: chown d0/d25/d30/d8a/da0 8000 1 2023-12-16T20:11:40.691 INFO:tasks.workunit.client.1.smithi141.stdout:9/546: read d1/d10/d14/d20/f86 [2924215,28556] 0 2023-12-16T20:11:40.691 INFO:tasks.workunit.client.1.smithi141.stdout:6/645: dwrite d1/d12/f33 [0,4194304] 0 2023-12-16T20:11:40.691 INFO:tasks.workunit.client.1.smithi141.stdout:9/547: creat d1/d10/d14/d20/da/d3f/dab/fbf x:0 0 0 2023-12-16T20:11:40.691 INFO:tasks.workunit.client.1.smithi141.stdout:9/548: creat d1/d10/d14/d20/da/d3f/dab/fc0 x:0 0 0 2023-12-16T20:11:40.691 INFO:tasks.workunit.client.1.smithi141.stdout:9/549: read - d1/d26/fad zero size 2023-12-16T20:11:40.692 INFO:tasks.workunit.client.1.smithi141.stdout:8/604: dread d14/d19/d95/dae/db4/f9b [0,4194304] 0 2023-12-16T20:11:40.692 INFO:tasks.workunit.client.1.smithi141.stdout:1/656: dwrite da/d67/f26 [0,4194304] 0 2023-12-16T20:11:40.692 INFO:tasks.workunit.client.1.smithi141.stdout:9/550: dread d1/d26/d4a/d73/fa2 [0,4194304] 0 2023-12-16T20:11:40.693 INFO:tasks.workunit.client.1.smithi141.stdout:6/646: rmdir d1/d12/d22 39 2023-12-16T20:11:40.693 INFO:tasks.workunit.client.1.smithi141.stdout:6/647: chown d1/d3/d4f/faa 6092666 1 2023-12-16T20:11:40.696 INFO:tasks.workunit.client.1.smithi141.stdout:3/700: write d0/d1c/d6a/d76/da2/fac [2307146,45840] 0 2023-12-16T20:11:40.699 INFO:tasks.workunit.client.1.smithi141.stdout:8/605: mkdir d14/d19/d1b/d3d/d5e/dbe 0 2023-12-16T20:11:40.701 INFO:tasks.workunit.client.1.smithi141.stdout:1/657: mkdir da/d36/d4b/d4d/d80/dca/ddc 0 2023-12-16T20:11:40.701 INFO:tasks.workunit.client.1.smithi141.stdout:1/658: chown da/f2c 45978490 1 2023-12-16T20:11:40.702 INFO:tasks.workunit.client.1.smithi141.stdout:1/659: mknod da/d36/d4b/d4d/d80/cdd 0 2023-12-16T20:11:40.704 INFO:tasks.workunit.client.1.smithi141.stdout:1/660: mknod da/d36/d4b/d4d/cde 0 2023-12-16T20:11:40.706 INFO:tasks.workunit.client.1.smithi141.stdout:6/648: dread d1/d12/d20/d44/f72 [0,4194304] 0 2023-12-16T20:11:40.706 INFO:tasks.workunit.client.1.smithi141.stdout:2/461: dwrite d6/d3a/d47/d58/d66/f7b [0,4194304] 0 2023-12-16T20:11:40.706 INFO:tasks.workunit.client.1.smithi141.stdout:2/462: fdatasync d6/d12/f29 0 2023-12-16T20:11:40.707 INFO:tasks.workunit.client.1.smithi141.stdout:8/606: dread d14/d19/f78 [0,4194304] 0 2023-12-16T20:11:40.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/649: mkdir d1/d3/d4b/d60/db8/d69/dd2 0 2023-12-16T20:11:40.707 INFO:tasks.workunit.client.1.smithi141.stdout:3/701: dread d0/d1c/d40/d85/f53 [0,4194304] 0 2023-12-16T20:11:40.709 INFO:tasks.workunit.client.1.smithi141.stdout:8/607: symlink d14/d71/lbf 0 2023-12-16T20:11:40.709 INFO:tasks.workunit.client.1.smithi141.stdout:8/608: dread - d14/d19/d95/dae/db4/fac zero size 2023-12-16T20:11:40.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/650: truncate d1/d12/d20/d85/dd1/d47/fc1 71124 0 2023-12-16T20:11:40.711 INFO:tasks.workunit.client.1.smithi141.stdout:3/702: link d0/d1c/d6a/d76/c7e d0/d1c/d2c/d72/d74/ce4 0 2023-12-16T20:11:40.714 INFO:tasks.workunit.client.1.smithi141.stdout:5/554: dwrite d0/d9/d16/d72/d7f/faf [0,4194304] 0 2023-12-16T20:11:40.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/661: dread da/d36/d4b/d4d/d89/d61/f65 [0,4194304] 0 2023-12-16T20:11:40.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/662: read - da/d36/d4b/d4d/d80/d94/fc4 zero size 2023-12-16T20:11:40.714 INFO:tasks.workunit.client.1.smithi141.stdout:8/609: rename d14/d71/d81/c5f to d14/d19/d95/dae/db4/d58/cc0 0 2023-12-16T20:11:40.714 INFO:tasks.workunit.client.1.smithi141.stdout:6/651: rmdir d1/d5e 39 2023-12-16T20:11:40.716 INFO:tasks.workunit.client.1.smithi141.stdout:3/703: write d0/d1c/d40/d3f/f90 [326911,18669] 0 2023-12-16T20:11:40.716 INFO:tasks.workunit.client.1.smithi141.stdout:8/610: creat d14/d19/d95/dae/db4/d58/fc1 x:0 0 0 2023-12-16T20:11:40.718 INFO:tasks.workunit.client.1.smithi141.stdout:6/652: creat d1/d12/d22/fd3 x:0 0 0 2023-12-16T20:11:40.721 INFO:tasks.workunit.client.1.smithi141.stdout:3/704: link d0/d1c/c34 d0/d1c/d2c/d72/d74/ce5 0 2023-12-16T20:11:40.724 INFO:tasks.workunit.client.1.smithi141.stdout:1/663: write da/d1a/d1d/d33/f4e [1571478,35104] 0 2023-12-16T20:11:40.724 INFO:tasks.workunit.client.1.smithi141.stdout:1/664: dread - da/d1a/d1d/fd8 zero size 2023-12-16T20:11:40.725 INFO:tasks.workunit.client.1.smithi141.stdout:8/611: creat d14/d19/d95/dae/fc2 x:0 0 0 2023-12-16T20:11:40.726 INFO:tasks.workunit.client.1.smithi141.stdout:2/463: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:40.726 INFO:tasks.workunit.client.1.smithi141.stdout:2/464: chown d6/d3a/d47/d58 10 1 2023-12-16T20:11:40.726 INFO:tasks.workunit.client.1.smithi141.stdout:2/465: write d6/da/d4a/d5e/f88 [152452,129754] 0 2023-12-16T20:11:40.727 INFO:tasks.workunit.client.1.smithi141.stdout:3/705: creat d0/d1c/d2c/d72/d74/dda/fe6 x:0 0 0 2023-12-16T20:11:40.727 INFO:tasks.workunit.client.1.smithi141.stdout:3/706: chown d0/d1c/d2c/fa6 9221 1 2023-12-16T20:11:40.730 INFO:tasks.workunit.client.1.smithi141.stdout:1/665: link da/d1a/d1d/d22/l3d da/d36/d4b/d4d/d80/dca/ddc/ldf 0 2023-12-16T20:11:40.731 INFO:tasks.workunit.client.1.smithi141.stdout:8/612: truncate d14/f23 602357 0 2023-12-16T20:11:40.732 INFO:tasks.workunit.client.1.smithi141.stdout:8/613: dread d14/d19/d1b/f3f [0,4194304] 0 2023-12-16T20:11:40.734 INFO:tasks.workunit.client.1.smithi141.stdout:2/466: creat d6/f9e x:0 0 0 2023-12-16T20:11:40.736 INFO:tasks.workunit.client.1.smithi141.stdout:3/707: symlink d0/d1c/d2c/d72/d74/le7 0 2023-12-16T20:11:40.737 INFO:tasks.workunit.client.1.smithi141.stdout:3/708: fdatasync d0/d1c/d2c/d72/d74/f97 0 2023-12-16T20:11:40.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/653: dwrite d1/d3/d4b/f66 [0,4194304] 0 2023-12-16T20:11:40.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/654: truncate d1/d77/d9e/fb6 915092 0 2023-12-16T20:11:40.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/655: truncate d1/d12/d22/fd3 812635 0 2023-12-16T20:11:40.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/656: chown d1/d3/d4b/d60/db8/l97 27722994 1 2023-12-16T20:11:40.740 INFO:tasks.workunit.client.1.smithi141.stdout:6/657: dread - d1/dd/d2f/fb3 zero size 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:8/614: mkdir d14/d19/d1b/d3d/d5e/dbe/dc3 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:8/615: write d14/d19/d1b/d24/f31 [547382,67245] 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:5/555: dwrite d0/d14/d2c/fb2 [0,4194304] 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/467: link d6/d32/d7a/f51 d6/d32/d7a/d5f/d92/f9f 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:3/709: mkdir d0/d1c/de8 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:3/710: chown d0/d1c/d6a/d8f/fbd 275 1 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:3/711: write d0/d1c/d6a/d8f/fbd [1437798,37878] 0 2023-12-16T20:11:40.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/666: rmdir da/d36/d4b/d7c 39 2023-12-16T20:11:40.747 INFO:tasks.workunit.client.1.smithi141.stdout:6/658: write d1/d12/f33 [317598,120476] 0 2023-12-16T20:11:40.747 INFO:tasks.workunit.client.1.smithi141.stdout:6/659: getdents d1/d12/d20/d89 0 2023-12-16T20:11:40.747 INFO:tasks.workunit.client.1.smithi141.stdout:6/660: truncate d1/d12/d20/d44/f72 5223696 0 2023-12-16T20:11:40.765 INFO:tasks.workunit.client.1.smithi141.stdout:2/468: link d6/d32/f64 d6/d32/d52/d53/fa0 0 2023-12-16T20:11:40.766 INFO:tasks.workunit.client.1.smithi141.stdout:2/469: write d6/d12/d1f/d46/f84 [317681,87013] 0 2023-12-16T20:11:40.766 INFO:tasks.workunit.client.1.smithi141.stdout:2/470: fsync d6/d12/d1f/d46/f48 0 2023-12-16T20:11:40.766 INFO:tasks.workunit.client.1.smithi141.stdout:8/616: dwrite d14/d19/d1b/d24/fbd [0,4194304] 0 2023-12-16T20:11:40.766 INFO:tasks.workunit.client.1.smithi141.stdout:3/712: mkdir d0/d1c/d2c/d72/d74/d8b/de9 0 2023-12-16T20:11:40.767 INFO:tasks.workunit.client.1.smithi141.stdout:5/556: dwrite d0/d9/f89 [4194304,4194304] 0 2023-12-16T20:11:40.768 INFO:tasks.workunit.client.1.smithi141.stdout:1/667: link da/d36/d4b/d4d/d89/d6c/l9f da/d36/d4b/d4d/d89/d6c/le0 0 2023-12-16T20:11:40.768 INFO:tasks.workunit.client.1.smithi141.stdout:1/668: write da/d36/d4b/d4d/d89/d61/f65 [4132556,28900] 0 2023-12-16T20:11:40.768 INFO:tasks.workunit.client.1.smithi141.stdout:1/669: write da/d1a/d1d/d22/f9b [378357,102941] 0 2023-12-16T20:11:40.771 INFO:tasks.workunit.client.1.smithi141.stdout:6/661: symlink d1/d12/d20/d85/dd1/ld4 0 2023-12-16T20:11:40.780 INFO:tasks.workunit.client.1.smithi141.stdout:3/713: link d0/d1c/d2c/d72/d74/ce5 d0/d1c/d40/d3f/d52/d5d/d95/cea 0 2023-12-16T20:11:40.781 INFO:tasks.workunit.client.1.smithi141.stdout:7/622: sync 2023-12-16T20:11:40.783 INFO:tasks.workunit.client.1.smithi141.stdout:0/597: sync 2023-12-16T20:11:40.783 INFO:tasks.workunit.client.1.smithi141.stdout:0/598: write d4/d49/d4b/f66 [3156561,8256] 0 2023-12-16T20:11:40.783 INFO:tasks.workunit.client.1.smithi141.stdout:0/599: dread - d4/d7/fb3 zero size 2023-12-16T20:11:40.785 INFO:tasks.workunit.client.1.smithi141.stdout:5/557: rename d0/fe to d0/d14/d75/fbf 0 2023-12-16T20:11:40.785 INFO:tasks.workunit.client.1.smithi141.stdout:5/558: fsync d0/d9/d16/d2a/d35/d4c/f8d 0 2023-12-16T20:11:40.785 INFO:tasks.workunit.client.1.smithi141.stdout:5/559: fsync d0/fb4 0 2023-12-16T20:11:40.786 INFO:tasks.workunit.client.1.smithi141.stdout:4/566: sync 2023-12-16T20:11:40.786 INFO:tasks.workunit.client.1.smithi141.stdout:6/662: dread d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:40.788 INFO:tasks.workunit.client.1.smithi141.stdout:4/567: unlink d1a/d2a/d3b/d69/la7 0 2023-12-16T20:11:40.788 INFO:tasks.workunit.client.1.smithi141.stdout:4/568: stat d1a/d3c/d9b 0 2023-12-16T20:11:40.789 INFO:tasks.workunit.client.1.smithi141.stdout:5/560: dread d0/f2b [0,4194304] 0 2023-12-16T20:11:40.789 INFO:tasks.workunit.client.1.smithi141.stdout:4/569: mknod d1a/d4e/d63/cce 0 2023-12-16T20:11:40.789 INFO:tasks.workunit.client.1.smithi141.stdout:4/570: write d1a/d2a/f31 [960804,35826] 0 2023-12-16T20:11:40.790 INFO:tasks.workunit.client.1.smithi141.stdout:1/670: rename da/df to da/d36/d4b/d4d/dd7/de1 0 2023-12-16T20:11:40.791 INFO:tasks.workunit.client.1.smithi141.stdout:1/671: rename da/d1a/f45 to da/d36/d4b/d4d/d80/dca/fe2 0 2023-12-16T20:11:40.796 INFO:tasks.workunit.client.1.smithi141.stdout:6/663: write d1/d3/d4b/d60/db8/f6c [9452269,7503] 0 2023-12-16T20:11:40.797 INFO:tasks.workunit.client.1.smithi141.stdout:6/664: stat d1/d3/fa0 0 2023-12-16T20:11:40.798 INFO:tasks.workunit.client.1.smithi141.stdout:6/665: mkdir d1/dd/de/d8a/dd5 0 2023-12-16T20:11:40.798 INFO:tasks.workunit.client.1.smithi141.stdout:6/666: chown d1/d12 2752340 1 2023-12-16T20:11:40.799 INFO:tasks.workunit.client.1.smithi141.stdout:6/667: write d1/d12/d22/d25/d38/f3e [3032161,86330] 0 2023-12-16T20:11:40.812 INFO:tasks.workunit.client.1.smithi141.stdout:6/668: write d1/d12/d22/f53 [1417871,54061] 0 2023-12-16T20:11:40.813 INFO:tasks.workunit.client.1.smithi141.stdout:7/623: dread d5/d1d/d1e/f52 [0,4194304] 0 2023-12-16T20:11:40.813 INFO:tasks.workunit.client.1.smithi141.stdout:7/624: creat d5/fd0 x:0 0 0 2023-12-16T20:11:40.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/561: dread d0/d9/d16/d2a/d35/f3f [0,4194304] 0 2023-12-16T20:11:40.815 INFO:tasks.workunit.client.1.smithi141.stdout:7/625: creat d5/d2a/d45/fd1 x:0 0 0 2023-12-16T20:11:40.816 INFO:tasks.workunit.client.1.smithi141.stdout:7/626: mknod d5/d1d/d1e/d71/cd2 0 2023-12-16T20:11:40.817 INFO:tasks.workunit.client.1.smithi141.stdout:2/471: dwrite d6/da/d33/d54/d73/f89 [0,4194304] 0 2023-12-16T20:11:40.821 INFO:tasks.workunit.client.1.smithi141.stdout:2/472: mkdir d6/d32/da1 0 2023-12-16T20:11:40.823 INFO:tasks.workunit.client.1.smithi141.stdout:5/562: dread d0/d9/f89 [4194304,4194304] 0 2023-12-16T20:11:40.823 INFO:tasks.workunit.client.1.smithi141.stdout:5/563: fsync d0/d9/d16/d2a/d4f/f8f 0 2023-12-16T20:11:40.826 INFO:tasks.workunit.client.1.smithi141.stdout:8/617: dwrite d14/d19/d1b/d24/f31 [0,4194304] 0 2023-12-16T20:11:40.827 INFO:tasks.workunit.client.1.smithi141.stdout:5/564: rename d0/d14/d75/l73 to d0/d9/lc0 0 2023-12-16T20:11:40.828 INFO:tasks.workunit.client.1.smithi141.stdout:4/571: dwrite f14 [4194304,4194304] 0 2023-12-16T20:11:40.831 INFO:tasks.workunit.client.1.smithi141.stdout:1/672: dwrite da/fac [0,4194304] 0 2023-12-16T20:11:40.833 INFO:tasks.workunit.client.1.smithi141.stdout:5/565: mknod d0/d25/d30/d8a/da0/cc1 0 2023-12-16T20:11:40.833 INFO:tasks.workunit.client.1.smithi141.stdout:5/566: fsync d0/f2b 0 2023-12-16T20:11:40.833 INFO:tasks.workunit.client.1.smithi141.stdout:5/567: fsync d0/fb4 0 2023-12-16T20:11:40.833 INFO:tasks.workunit.client.1.smithi141.stdout:5/568: chown d0/d25/fa4 2 1 2023-12-16T20:11:40.843 INFO:tasks.workunit.client.1.smithi141.stdout:5/569: unlink d0/d14/d2c/d4a/f55 0 2023-12-16T20:11:40.843 INFO:tasks.workunit.client.1.smithi141.stdout:5/570: chown d0/d9/d16/d2a/d35/d4c/dab 103 1 2023-12-16T20:11:40.845 INFO:tasks.workunit.client.1.smithi141.stdout:6/669: truncate d1/d12/d20/d44/f72 232571 0 2023-12-16T20:11:40.849 INFO:tasks.workunit.client.1.smithi141.stdout:6/670: rename d1/d77/d9e/cb4 to d1/d3/d4b/d60/cd6 0 2023-12-16T20:11:40.849 INFO:tasks.workunit.client.1.smithi141.stdout:6/671: chown d1/d12/f33 40025 1 2023-12-16T20:11:40.859 INFO:tasks.workunit.client.1.smithi141.stdout:2/473: dwrite d6/d12/d1f/d46/d5a/f76 [0,4194304] 0 2023-12-16T20:11:40.871 INFO:tasks.workunit.client.1.smithi141.stdout:2/474: dread d6/d12/d15/f44 [0,4194304] 0 2023-12-16T20:11:40.872 INFO:tasks.workunit.client.1.smithi141.stdout:8/618: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:40.872 INFO:tasks.workunit.client.1.smithi141.stdout:1/673: dwrite da/d36/d4b/d4d/f56 [0,4194304] 0 2023-12-16T20:11:40.872 INFO:tasks.workunit.client.1.smithi141.stdout:5/571: dwrite d0/d25/f96 [0,4194304] 0 2023-12-16T20:11:40.872 INFO:tasks.workunit.client.1.smithi141.stdout:6/672: dwrite d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:40.872 INFO:tasks.workunit.client.1.smithi141.stdout:4/572: dwrite d1a/d2a/d3b/f7f [0,4194304] 0 2023-12-16T20:11:40.873 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: Standby manager daemon smithi038.gdlrfj started 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/key"}]: dispatch 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:11:40.874 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:40 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3554999806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:11:40.875 INFO:tasks.workunit.client.1.smithi141.stdout:2/475: unlink d6/d12/d1f/d46/f84 0 2023-12-16T20:11:40.880 INFO:tasks.workunit.client.1.smithi141.stdout:5/572: rmdir d0/d9/d16/d2a/d35/d4c/dab 0 2023-12-16T20:11:40.880 INFO:tasks.workunit.client.1.smithi141.stdout:5/573: creat d0/d9/d16/d2a/d4f/fc2 x:0 0 0 2023-12-16T20:11:40.886 INFO:tasks.workunit.client.1.smithi141.stdout:6/673: link d1/d12/d22/d25/dc3/lcb d1/d12/d20/d3a/ld7 0 2023-12-16T20:11:40.886 INFO:tasks.workunit.client.1.smithi141.stdout:6/674: fdatasync d1/d12/d20/d44/d4a/f79 0 2023-12-16T20:11:40.893 INFO:tasks.workunit.client.1.smithi141.stdout:2/476: write d6/da/d33/d54/d7c/f97 [47134,95027] 0 2023-12-16T20:11:40.896 INFO:tasks.workunit.client.1.smithi141.stdout:1/674: dwrite da/d7a/fa5 [0,4194304] 0 2023-12-16T20:11:40.896 INFO:tasks.workunit.client.1.smithi141.stdout:1/675: write da/fbd [4210916,70071] 0 2023-12-16T20:11:40.898 INFO:tasks.workunit.client.1.smithi141.stdout:8/619: dwrite d14/d19/d95/dae/fc2 [0,4194304] 0 2023-12-16T20:11:40.898 INFO:tasks.workunit.client.1.smithi141.stdout:8/620: write d14/d19/f1f [3755241,113720] 0 2023-12-16T20:11:40.898 INFO:tasks.workunit.client.1.smithi141.stdout:8/621: write d14/d35/f66 [1933506,8876] 0 2023-12-16T20:11:40.899 INFO:tasks.workunit.client.1.smithi141.stdout:5/574: truncate d0/d43/f6e 2810103 0 2023-12-16T20:11:40.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/573: rmdir d1a/d59/d89/daf 0 2023-12-16T20:11:40.904 INFO:tasks.workunit.client.1.smithi141.stdout:1/676: rename da/d1a/d1d/d22/f30 to da/d36/d4b/d4d/d89/d6c/fe3 0 2023-12-16T20:11:40.909 INFO:tasks.workunit.client.1.smithi141.stdout:2/477: write d6/d32/d52/d53/fa0 [84787,34330] 0 2023-12-16T20:11:40.910 INFO:tasks.workunit.client.1.smithi141.stdout:4/574: mkdir d1a/d3c/d9b/da1/dcf 0 2023-12-16T20:11:40.912 INFO:tasks.workunit.client.1.smithi141.stdout:1/677: rmdir da/d36/d4b/d4d/d89 39 2023-12-16T20:11:40.912 INFO:tasks.workunit.client.1.smithi141.stdout:1/678: fdatasync da/d1a/d1d/fd8 0 2023-12-16T20:11:40.912 INFO:tasks.workunit.client.1.smithi141.stdout:6/675: dwrite d1/d12/d22/f64 [0,4194304] 0 2023-12-16T20:11:40.912 INFO:tasks.workunit.client.1.smithi141.stdout:6/676: readlink d1/dd/d2f/l57 0 2023-12-16T20:11:40.913 INFO:tasks.workunit.client.1.smithi141.stdout:2/478: creat d6/d32/d52/fa2 x:0 0 0 2023-12-16T20:11:40.915 INFO:tasks.workunit.client.1.smithi141.stdout:4/575: creat d1a/d2a/fd0 x:0 0 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:6/677: symlink d1/d12/d22/d25/dd0/ld8 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:6/678: readlink d1/dd/d2f/d48/la3 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:6/679: getdents d1/d3/d4b/d60/db8/d69/dd2 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:1/679: dread da/d36/d4b/d4d/dd7/de1/f27 [0,4194304] 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:1/680: stat da/d36/d4b/d4d/d80/d94 0 2023-12-16T20:11:40.917 INFO:tasks.workunit.client.1.smithi141.stdout:1/681: write da/d36/d4b/d4d/dd7/de1/f78 [721699,108641] 0 2023-12-16T20:11:40.918 INFO:tasks.workunit.client.1.smithi141.stdout:2/479: symlink d6/d3a/d47/d58/d8c/la3 0 2023-12-16T20:11:40.918 INFO:tasks.workunit.client.1.smithi141.stdout:2/480: write d6/da/d33/f81 [893717,26338] 0 2023-12-16T20:11:40.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/682: mknod da/d36/d4b/d4d/d89/d6c/ce4 0 2023-12-16T20:11:40.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/683: chown da/d36/la0 37611 1 2023-12-16T20:11:40.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/684: write da/d36/d4b/d4d/d89/f82 [485027,121810] 0 2023-12-16T20:11:40.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/685: read da/d36/d4b/d4d/d80/f93 [147336,123387] 0 2023-12-16T20:11:40.923 INFO:tasks.workunit.client.0.smithi038.stdout:8/871: sync 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:0/959: sync 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:4/931: sync 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:4/932: truncate d13/d17/d2e/d32/f105 851424 0 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:4/933: dread - d13/d17/d4b/da4/d34/d123/f120 zero size 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:6/900: sync 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:1/994: sync 2023-12-16T20:11:40.924 INFO:tasks.workunit.client.1.smithi141.stdout:2/481: link d6/d32/f64 d6/d32/d7a/d5f/d92/fa4 0 2023-12-16T20:11:40.927 INFO:tasks.workunit.client.1.smithi141.stdout:4/576: getdents d1a/d59 0 2023-12-16T20:11:40.927 INFO:tasks.workunit.client.0.smithi038.stdout:4/934: dread d13/d17/d2e/d32/d7c/fa8 [0,4194304] 0 2023-12-16T20:11:40.927 INFO:tasks.workunit.client.0.smithi038.stdout:4/935: chown d13/d17/l2a 97503927 1 2023-12-16T20:11:40.929 INFO:tasks.workunit.client.1.smithi141.stdout:2/482: truncate d6/d12/d1f/d46/f63 12225478 0 2023-12-16T20:11:40.932 INFO:tasks.workunit.client.1.smithi141.stdout:4/577: unlink d1a/d2a/fd0 0 2023-12-16T20:11:40.932 INFO:tasks.workunit.client.1.smithi141.stdout:4/578: chown d1a/d54/f6a 946418 1 2023-12-16T20:11:40.933 INFO:tasks.workunit.client.1.smithi141.stdout:5/575: dwrite d0/d14/d98/fa1 [0,4194304] 0 2023-12-16T20:11:40.934 INFO:tasks.workunit.client.1.smithi141.stdout:8/622: dwrite d14/d19/d95/dae/db4/d5b/f5d [0,4194304] 0 2023-12-16T20:11:40.935 INFO:tasks.workunit.client.1.smithi141.stdout:2/483: symlink d6/d12/d1f/d46/la5 0 2023-12-16T20:11:40.938 INFO:tasks.workunit.client.1.smithi141.stdout:4/579: mkdir d1a/d4e/d63/dd1 0 2023-12-16T20:11:40.941 INFO:tasks.workunit.client.0.smithi038.stdout:0/960: write db/fec [2347221,88857] 0 2023-12-16T20:11:40.941 INFO:tasks.workunit.client.0.smithi038.stdout:0/961: write db/f10 [5173942,115543] 0 2023-12-16T20:11:40.941 INFO:tasks.workunit.client.0.smithi038.stdout:0/962: creat db/d16/d19/d4e/d106/dce/f13e x:0 0 0 2023-12-16T20:11:40.942 INFO:tasks.workunit.client.1.smithi141.stdout:6/680: dwrite d1/dd/de/d8a/fc2 [0,4194304] 0 2023-12-16T20:11:40.947 INFO:tasks.workunit.client.0.smithi038.stdout:0/963: creat db/d16/d19/d27/f13f x:0 0 0 2023-12-16T20:11:40.947 INFO:tasks.workunit.client.0.smithi038.stdout:0/964: chown db/d16/d19/d4e/d106/d65/d90/da7 53 1 2023-12-16T20:11:40.947 INFO:tasks.workunit.client.0.smithi038.stdout:0/965: fdatasync db/d16/d1c/f32 0 2023-12-16T20:11:40.948 INFO:tasks.workunit.client.1.smithi141.stdout:9/551: sync 2023-12-16T20:11:40.948 INFO:tasks.workunit.client.1.smithi141.stdout:2/484: dread d6/d32/f4e [0,4194304] 0 2023-12-16T20:11:40.951 INFO:tasks.workunit.client.0.smithi038.stdout:0/966: creat db/d16/d19/d4e/d12c/f140 x:0 0 0 2023-12-16T20:11:40.954 INFO:tasks.workunit.client.1.smithi141.stdout:4/580: creat d1a/d3c/fd2 x:0 0 0 2023-12-16T20:11:40.955 INFO:tasks.workunit.client.0.smithi038.stdout:4/936: dwrite d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/f65 [0,4194304] 0 2023-12-16T20:11:40.955 INFO:tasks.workunit.client.1.smithi141.stdout:1/686: dwrite da/d67/f68 [0,4194304] 0 2023-12-16T20:11:40.956 INFO:tasks.workunit.client.1.smithi141.stdout:2/485: dread d6/d32/f4e [0,4194304] 0 2023-12-16T20:11:40.956 INFO:tasks.workunit.client.1.smithi141.stdout:1/687: write da/d1a/d1d/d22/f9b [1019710,98711] 0 2023-12-16T20:11:40.958 INFO:tasks.workunit.client.1.smithi141.stdout:1/688: dread da/d36/f8d [0,4194304] 0 2023-12-16T20:11:40.958 INFO:tasks.workunit.client.1.smithi141.stdout:1/689: truncate da/d1a/d31/d81/db6/fc0 659821 0 2023-12-16T20:11:40.963 INFO:tasks.workunit.client.0.smithi038.stdout:0/967: dread db/d16/d19/d4e/d106/d65/f6a [0,4194304] 0 2023-12-16T20:11:40.965 INFO:tasks.workunit.client.0.smithi038.stdout:0/968: getdents db/d16/d19/d27/d56 0 2023-12-16T20:11:40.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/969: truncate db/d16/d70/f6c 1211240 0 2023-12-16T20:11:40.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/970: read f6 [190819,74631] 0 2023-12-16T20:11:40.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/971: read - db/d16/d19/d4e/d106/dce/f130 zero size 2023-12-16T20:11:40.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/972: chown db/d16/d1c/d5d/d64/f118 349683978 1 2023-12-16T20:11:40.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/973: readlink db/d16/da6/l103 0 2023-12-16T20:11:40.971 INFO:tasks.workunit.client.0.smithi038.stdout:0/974: link db/d16/d19/d4e/l52 db/d16/d19/d4e/d89/l141 0 2023-12-16T20:11:40.973 INFO:tasks.workunit.client.1.smithi141.stdout:6/681: getdents d1/d3/d4b/d60/db8 0 2023-12-16T20:11:40.977 INFO:tasks.workunit.client.0.smithi038.stdout:0/975: unlink db/d16/da6/l103 0 2023-12-16T20:11:40.978 INFO:tasks.workunit.client.1.smithi141.stdout:4/581: dwrite f19 [0,4194304] 0 2023-12-16T20:11:40.978 INFO:tasks.workunit.client.1.smithi141.stdout:4/582: readlink d1a/d2a/d3b/l57 0 2023-12-16T20:11:40.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/583: write d1a/d3c/d9b/fb6 [532014,100043] 0 2023-12-16T20:11:40.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/584: creat d1a/d3c/fd3 x:0 0 0 2023-12-16T20:11:40.979 INFO:tasks.workunit.client.1.smithi141.stdout:4/585: chown d1a/d59 0 1 2023-12-16T20:11:40.980 INFO:tasks.workunit.client.1.smithi141.stdout:2/486: dwrite d6/d32/d7a/d5f/d92/fa4 [0,4194304] 0 2023-12-16T20:11:40.980 INFO:tasks.workunit.client.1.smithi141.stdout:8/623: mkdir d14/dc4 0 2023-12-16T20:11:40.980 INFO:tasks.workunit.client.1.smithi141.stdout:2/487: write d6/da/d1b/d5b/f6d [955731,115314] 0 2023-12-16T20:11:40.980 INFO:tasks.workunit.client.1.smithi141.stdout:8/624: readlink d14/d35/l40 0 2023-12-16T20:11:40.983 INFO:tasks.workunit.client.1.smithi141.stdout:6/682: mknod d1/d12/d22/d25/cd9 0 2023-12-16T20:11:40.985 INFO:tasks.workunit.client.1.smithi141.stdout:5/576: rename d0/d9/d16/d72/d7f to d0/d9/d16/d2a/d35/d4c/dc3 0 2023-12-16T20:11:40.986 INFO:tasks.workunit.client.1.smithi141.stdout:5/577: fsync d0/d25/d30/f6c 0 2023-12-16T20:11:40.988 INFO:tasks.workunit.client.1.smithi141.stdout:4/586: link d1a/d59/l61 d1a/d3c/d9b/da1/dcf/ld4 0 2023-12-16T20:11:40.993 INFO:tasks.workunit.client.1.smithi141.stdout:8/625: creat d14/d71/fc5 x:0 0 0 2023-12-16T20:11:40.993 INFO:tasks.workunit.client.1.smithi141.stdout:6/683: creat d1/d5e/da9/fda x:0 0 0 2023-12-16T20:11:40.993 INFO:tasks.workunit.client.1.smithi141.stdout:5/578: symlink d0/d9/d16/d2a/d35/d91/lc4 0 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: Standby manager daemon smithi038.gdlrfj started 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/key"}]: dispatch 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.38:0/2403185079' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:11:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:40 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3554999806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:11:40.996 INFO:tasks.workunit.client.1.smithi141.stdout:9/552: rename d1/d10/d14/d20/db3/f56 to d1/d26/fc1 0 2023-12-16T20:11:40.996 INFO:tasks.workunit.client.1.smithi141.stdout:9/553: write d1/d10/d27/f4b [3921558,70443] 0 2023-12-16T20:11:40.996 INFO:tasks.workunit.client.1.smithi141.stdout:9/554: read d1/d10/d14/d20/da/f41 [3293259,36896] 0 2023-12-16T20:11:40.999 INFO:tasks.workunit.client.1.smithi141.stdout:6/684: creat d1/d12/d20/d85/dd1/d47/fdb x:0 0 0 2023-12-16T20:11:41.003 INFO:tasks.workunit.client.1.smithi141.stdout:8/626: creat d14/d19/d1b/d24/d4b/d8f/fc6 x:0 0 0 2023-12-16T20:11:41.005 INFO:tasks.workunit.client.1.smithi141.stdout:5/579: write d0/f2b [1067968,127161] 0 2023-12-16T20:11:41.005 INFO:tasks.workunit.client.1.smithi141.stdout:5/580: creat d0/d14/d2c/fc5 x:0 0 0 2023-12-16T20:11:41.007 INFO:tasks.workunit.client.1.smithi141.stdout:9/555: write d1/d10/d14/d20/db3/f40 [5568123,100069] 0 2023-12-16T20:11:41.007 INFO:tasks.workunit.client.1.smithi141.stdout:1/690: rename da/d36/d4b/d4d/d89/d6c/l72 to da/d1a/db0/le5 0 2023-12-16T20:11:41.008 INFO:tasks.workunit.client.0.smithi038.stdout:0/976: dwrite db/d16/d70/f55 [4194304,4194304] 0 2023-12-16T20:11:41.009 INFO:tasks.workunit.client.1.smithi141.stdout:6/685: creat d1/dd/de/fdc x:0 0 0 2023-12-16T20:11:41.009 INFO:tasks.workunit.client.1.smithi141.stdout:6/686: fsync d1/d12/d20/d3a/f6d 0 2023-12-16T20:11:41.009 INFO:tasks.workunit.client.1.smithi141.stdout:9/556: dread d1/d10/d33/f34 [0,4194304] 0 2023-12-16T20:11:41.010 INFO:tasks.workunit.client.1.smithi141.stdout:9/557: readlink d1/d10/d33/lb5 0 2023-12-16T20:11:41.011 INFO:tasks.workunit.client.1.smithi141.stdout:8/627: unlink d14/d19/d1b/c27 0 2023-12-16T20:11:41.011 INFO:tasks.workunit.client.1.smithi141.stdout:8/628: chown cb 135161486 1 2023-12-16T20:11:41.013 INFO:tasks.workunit.client.0.smithi038.stdout:0/977: mknod db/d16/db5/de6/c142 0 2023-12-16T20:11:41.016 INFO:tasks.workunit.client.1.smithi141.stdout:5/581: mkdir d0/d9/d16/d72/dc6 0 2023-12-16T20:11:41.017 INFO:tasks.workunit.client.1.smithi141.stdout:2/488: dwrite d6/da/d33/d54/d7c/f97 [0,4194304] 0 2023-12-16T20:11:41.017 INFO:tasks.workunit.client.1.smithi141.stdout:5/582: chown d0/d9/d16/d2a/d35/d4c/f8d 73345790 1 2023-12-16T20:11:41.018 INFO:tasks.workunit.client.1.smithi141.stdout:6/687: symlink d1/d3/d4b/d60/db8/ldd 0 2023-12-16T20:11:41.020 INFO:tasks.workunit.client.1.smithi141.stdout:9/558: creat d1/d10/d33/fc2 x:0 0 0 2023-12-16T20:11:41.020 INFO:tasks.workunit.client.1.smithi141.stdout:9/559: fsync d1/d26/d4a/f99 0 2023-12-16T20:11:41.020 INFO:tasks.workunit.client.1.smithi141.stdout:1/691: write da/fb8 [549343,104149] 0 2023-12-16T20:11:41.020 INFO:tasks.workunit.client.1.smithi141.stdout:1/692: chown da/d1a/db0/lba 1300061 1 2023-12-16T20:11:41.021 INFO:tasks.workunit.client.1.smithi141.stdout:4/587: dwrite d1a/d4e/f56 [0,4194304] 0 2023-12-16T20:11:41.021 INFO:tasks.workunit.client.1.smithi141.stdout:4/588: dread - d1a/d54/d87/da8/f7d zero size 2023-12-16T20:11:41.021 INFO:tasks.workunit.client.1.smithi141.stdout:8/629: creat d14/d19/d95/dae/db4/d58/d8b/fc7 x:0 0 0 2023-12-16T20:11:41.024 INFO:tasks.workunit.client.1.smithi141.stdout:2/489: unlink d6/da/d1b/d5b/f6d 0 2023-12-16T20:11:41.027 INFO:tasks.workunit.client.1.smithi141.stdout:5/583: rename d0/d25/d30/d67/c24 to d0/d9/d16/d2a/d35/d5e/cc7 0 2023-12-16T20:11:41.027 INFO:tasks.workunit.client.1.smithi141.stdout:5/584: fdatasync d0/d25/d30/d67/f1d 0 2023-12-16T20:11:41.027 INFO:tasks.workunit.client.1.smithi141.stdout:6/688: symlink d1/d3/d4f/lde 0 2023-12-16T20:11:41.027 INFO:tasks.workunit.client.1.smithi141.stdout:6/689: write d1/d12/d20/d85/dd1/d47/fc1 [706674,83005] 0 2023-12-16T20:11:41.029 INFO:tasks.workunit.client.1.smithi141.stdout:9/560: unlink d1/d10/d33/d47/f5f 0 2023-12-16T20:11:41.029 INFO:tasks.workunit.client.1.smithi141.stdout:9/561: fsync d1/d10/d33/d47/d83/fa5 0 2023-12-16T20:11:41.030 INFO:tasks.workunit.client.1.smithi141.stdout:9/562: chown d1/d26/fad 23146 1 2023-12-16T20:11:41.030 INFO:tasks.workunit.client.1.smithi141.stdout:9/563: dread - d1/d10/d33/d47/fbc zero size 2023-12-16T20:11:41.030 INFO:tasks.workunit.client.1.smithi141.stdout:9/564: readlink d1/l2d 0 2023-12-16T20:11:41.030 INFO:tasks.workunit.client.1.smithi141.stdout:9/565: dread - d1/d26/d4a/f99 zero size 2023-12-16T20:11:41.031 INFO:tasks.workunit.client.1.smithi141.stdout:1/693: symlink da/d36/d4b/db2/le6 0 2023-12-16T20:11:41.034 INFO:tasks.workunit.client.1.smithi141.stdout:4/589: creat d1a/d2a/dc3/fd5 x:0 0 0 2023-12-16T20:11:41.036 INFO:tasks.workunit.client.1.smithi141.stdout:9/566: dread d1/d10/d33/d47/f7f [0,4194304] 0 2023-12-16T20:11:41.036 INFO:tasks.workunit.client.1.smithi141.stdout:9/567: creat d1/d10/d14/d20/da/d3f/fc3 x:0 0 0 2023-12-16T20:11:41.037 INFO:tasks.workunit.client.1.smithi141.stdout:5/585: rename d0/d14/l29 to d0/d25/d30/d8a/da0/lc8 0 2023-12-16T20:11:41.040 INFO:tasks.workunit.client.0.smithi038.stdout:8/872: link f16 d17/d1b/d25/db7/d82/da9/d50/d96/dba/f118 0 2023-12-16T20:11:41.040 INFO:tasks.workunit.client.0.smithi038.stdout:8/873: fdatasync f13 0 2023-12-16T20:11:41.041 INFO:tasks.workunit.client.1.smithi141.stdout:4/590: mknod d1a/d59/d89/d8a/cd6 0 2023-12-16T20:11:41.041 INFO:tasks.workunit.client.1.smithi141.stdout:8/630: mkdir d14/d19/d1b/d24/dc8 0 2023-12-16T20:11:41.041 INFO:tasks.workunit.client.1.smithi141.stdout:8/631: chown d14/d19/d1b/d24/da3/faa 1613067 1 2023-12-16T20:11:41.043 INFO:tasks.workunit.client.0.smithi038.stdout:6/901: unlink d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/f11a 0 2023-12-16T20:11:41.043 INFO:tasks.workunit.client.1.smithi141.stdout:6/690: dread d1/d12/d20/d85/dd1/d47/fc1 [0,4194304] 0 2023-12-16T20:11:41.044 INFO:tasks.workunit.client.1.smithi141.stdout:9/568: unlink d1/d10/d33/d47/fbc 0 2023-12-16T20:11:41.044 INFO:tasks.workunit.client.1.smithi141.stdout:5/586: symlink d0/d9/d16/d2a/d35/d4c/lc9 0 2023-12-16T20:11:41.045 INFO:tasks.workunit.client.1.smithi141.stdout:5/587: dread - d0/d9/d16/fac zero size 2023-12-16T20:11:41.045 INFO:tasks.workunit.client.0.smithi038.stdout:1/995: link d15/d1e/d3b/d5a/l10d d15/d22/d52/d7f/l158 0 2023-12-16T20:11:41.045 INFO:tasks.workunit.client.0.smithi038.stdout:1/996: chown d15/d1e/d3b/d48/d37/dde/d75 22 1 2023-12-16T20:11:41.047 INFO:tasks.workunit.client.1.smithi141.stdout:4/591: link d1a/d2a/f78 d1a/d2a/d3b/d69/fd7 0 2023-12-16T20:11:41.047 INFO:tasks.workunit.client.1.smithi141.stdout:4/592: chown d1a/d3c/d9b/fb6 1429 1 2023-12-16T20:11:41.047 INFO:tasks.workunit.client.0.smithi038.stdout:4/937: symlink d13/d1f/d98/l135 0 2023-12-16T20:11:41.047 INFO:tasks.workunit.client.0.smithi038.stdout:1/997: read d15/d4a/ded/f134 [472358,111601] 0 2023-12-16T20:11:41.048 INFO:tasks.workunit.client.1.smithi141.stdout:8/632: rename d14/d19/d1b/f8a to d14/d19/d95/dae/db4/d58/fc9 0 2023-12-16T20:11:41.050 INFO:tasks.workunit.client.1.smithi141.stdout:6/691: mkdir d1/d12/d20/d44/ddf 0 2023-12-16T20:11:41.050 INFO:tasks.workunit.client.1.smithi141.stdout:6/692: truncate d1/dd/d2f/f30 5526146 0 2023-12-16T20:11:41.050 INFO:tasks.workunit.client.0.smithi038.stdout:6/902: truncate d1/d4/f1c 4836933 0 2023-12-16T20:11:41.051 INFO:tasks.workunit.client.1.smithi141.stdout:9/569: mkdir d1/d10/d33/d47/d8d/dc4 0 2023-12-16T20:11:41.051 INFO:tasks.workunit.client.1.smithi141.stdout:9/570: chown d1/d10/d14/d20/da/c93 15030 1 2023-12-16T20:11:41.051 INFO:tasks.workunit.client.1.smithi141.stdout:9/571: readlink d1/d26/l49 0 2023-12-16T20:11:41.052 INFO:tasks.workunit.client.1.smithi141.stdout:8/633: rename d14/d19/d95/dae/db4/d5b/l74 to d14/d19/d95/dae/db4/d5b/lca 0 2023-12-16T20:11:41.052 INFO:tasks.workunit.client.1.smithi141.stdout:8/634: readlink d14/d19/d1b/d24/d4b/d8c/lb3 0 2023-12-16T20:11:41.052 INFO:tasks.workunit.client.1.smithi141.stdout:8/635: fsync d14/d19/d1b/d24/fa0 0 2023-12-16T20:11:41.053 INFO:tasks.workunit.client.1.smithi141.stdout:8/636: write d14/d19/d1b/d24/d4b/f80 [559509,41352] 0 2023-12-16T20:11:41.053 INFO:tasks.workunit.client.1.smithi141.stdout:6/693: mkdir d1/d12/d22/d25/de0 0 2023-12-16T20:11:41.053 INFO:tasks.workunit.client.1.smithi141.stdout:6/694: fsync d1/d12/d20/d44/d4a/f79 0 2023-12-16T20:11:41.053 INFO:tasks.workunit.client.1.smithi141.stdout:6/695: fdatasync d1/d3/fa0 0 2023-12-16T20:11:41.054 INFO:tasks.workunit.client.1.smithi141.stdout:6/696: read - d1/d3/fa8 zero size 2023-12-16T20:11:41.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/998: mknod d15/d1e/d3b/d117/d7d/daa/c159 0 2023-12-16T20:11:41.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/999: dread - d15/d1e/d3b/d117/d7d/f9b zero size 2023-12-16T20:11:41.054 INFO:tasks.workunit.client.1.smithi141.stdout:9/572: rmdir d1/d10/d14/d20/db3 39 2023-12-16T20:11:41.056 INFO:tasks.workunit.client.1.smithi141.stdout:9/573: rmdir d1/d26/d4a/d73 39 2023-12-16T20:11:41.059 INFO:tasks.workunit.client.1.smithi141.stdout:5/588: write d0/d25/d30/d67/f58 [874467,67122] 0 2023-12-16T20:11:41.059 INFO:tasks.workunit.client.1.smithi141.stdout:5/589: fdatasync d0/d9/d16/fa5 0 2023-12-16T20:11:41.059 INFO:tasks.workunit.client.0.smithi038.stdout:6/903: creat d1/d4/d1d/d8e/f122 x:0 0 0 2023-12-16T20:11:41.060 INFO:tasks.workunit.client.1.smithi141.stdout:9/574: creat d1/d26/d4a/d73/fc5 x:0 0 0 2023-12-16T20:11:41.060 INFO:tasks.workunit.client.1.smithi141.stdout:2/490: dwrite d6/d32/d7a/d5f/d92/fa4 [0,4194304] 0 2023-12-16T20:11:41.063 INFO:tasks.workunit.client.1.smithi141.stdout:5/590: dread d0/d14/f70 [0,4194304] 0 2023-12-16T20:11:41.066 INFO:tasks.workunit.client.1.smithi141.stdout:2/491: rmdir d6/d32/d7a/d7e 0 2023-12-16T20:11:41.066 INFO:tasks.workunit.client.1.smithi141.stdout:2/492: write d6/d32/d52/d53/f8d [831849,59383] 0 2023-12-16T20:11:41.066 INFO:tasks.workunit.client.1.smithi141.stdout:7/627: sync 2023-12-16T20:11:41.066 INFO:tasks.workunit.client.1.smithi141.stdout:0/600: sync 2023-12-16T20:11:41.067 INFO:tasks.workunit.client.1.smithi141.stdout:3/714: sync 2023-12-16T20:11:41.070 INFO:tasks.workunit.client.1.smithi141.stdout:2/493: unlink d6/d12/d1f/d46/c8f 0 2023-12-16T20:11:41.070 INFO:tasks.workunit.client.1.smithi141.stdout:2/494: getdents d6/d32/da1 0 2023-12-16T20:11:41.071 INFO:tasks.workunit.client.1.smithi141.stdout:7/628: mknod d5/d1d/d1e/d71/cd3 0 2023-12-16T20:11:41.072 INFO:tasks.workunit.client.1.smithi141.stdout:7/629: write d5/d2a/f7e [418043,120776] 0 2023-12-16T20:11:41.074 INFO:tasks.workunit.client.1.smithi141.stdout:0/601: creat d4/d49/d73/d3b/d78/d7f/fcf x:0 0 0 2023-12-16T20:11:41.077 INFO:tasks.workunit.client.1.smithi141.stdout:2/495: link d6/da/d33/d54/d7c/f97 d6/d12/d1f/fa6 0 2023-12-16T20:11:41.078 INFO:tasks.workunit.client.1.smithi141.stdout:0/602: chown d4/d7/lb 2921116 1 2023-12-16T20:11:41.080 INFO:tasks.workunit.client.1.smithi141.stdout:2/496: creat d6/d12/d15/fa7 x:0 0 0 2023-12-16T20:11:41.081 INFO:tasks.workunit.client.1.smithi141.stdout:2/497: creat d6/da/d33/fa8 x:0 0 0 2023-12-16T20:11:41.081 INFO:tasks.workunit.client.1.smithi141.stdout:2/498: creat d6/d12/d1f/fa9 x:0 0 0 2023-12-16T20:11:41.081 INFO:tasks.workunit.client.1.smithi141.stdout:2/499: creat d6/da/d1b/d5b/faa x:0 0 0 2023-12-16T20:11:41.081 INFO:tasks.workunit.client.1.smithi141.stdout:2/500: creat d6/da/d68/fab x:0 0 0 2023-12-16T20:11:41.092 INFO:tasks.workunit.client.1.smithi141.stdout:7/630: write d5/d2a/f34 [3501470,96019] 0 2023-12-16T20:11:41.092 INFO:tasks.workunit.client.1.smithi141.stdout:7/631: truncate d5/d1d/d1e/d71/f91 5085611 0 2023-12-16T20:11:41.092 INFO:tasks.workunit.client.1.smithi141.stdout:7/632: write d5/f11 [374730,76486] 0 2023-12-16T20:11:41.098 INFO:tasks.workunit.client.1.smithi141.stdout:0/603: dread d4/d7/fd [4194304,4194304] 0 2023-12-16T20:11:41.100 INFO:tasks.workunit.client.1.smithi141.stdout:0/604: symlink d4/d49/db9/dcd/ld0 0 2023-12-16T20:11:41.102 INFO:tasks.workunit.client.0.smithi038.stdout:4/938: dwrite d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/f85 [0,4194304] 0 2023-12-16T20:11:41.107 INFO:tasks.workunit.client.1.smithi141.stdout:0/605: dread d4/d7/fd [4194304,4194304] 0 2023-12-16T20:11:41.107 INFO:tasks.workunit.client.1.smithi141.stdout:3/715: dwrite d0/f6 [0,4194304] 0 2023-12-16T20:11:41.107 INFO:tasks.workunit.client.1.smithi141.stdout:3/716: chown d0/d1c/d6a/d8f/fe1 1317 1 2023-12-16T20:11:41.107 INFO:tasks.workunit.client.0.smithi038.stdout:4/939: mkdir d13/d1f/d35/ddf/d136 0 2023-12-16T20:11:41.113 INFO:tasks.workunit.client.0.smithi038.stdout:4/940: mknod d13/d17/d4b/da4/d34/d123/df6/dfc/c137 0 2023-12-16T20:11:41.113 INFO:tasks.workunit.client.0.smithi038.stdout:4/941: creat d13/d69/def/f138 x:0 0 0 2023-12-16T20:11:41.114 INFO:tasks.workunit.client.1.smithi141.stdout:5/591: dwrite d0/d43/f7e [0,4194304] 0 2023-12-16T20:11:41.114 INFO:tasks.workunit.client.1.smithi141.stdout:5/592: fdatasync d0/d9/d16/d2a/d35/d4c/f9a 0 2023-12-16T20:11:41.114 INFO:tasks.workunit.client.1.smithi141.stdout:3/717: link d0/f8 d0/d1c/feb 0 2023-12-16T20:11:41.114 INFO:tasks.workunit.client.1.smithi141.stdout:9/575: dwrite d1/d10/d14/d20/da/f41 [0,4194304] 0 2023-12-16T20:11:41.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/576: getdents d1/d10/d33/d47/d8d/dc4 0 2023-12-16T20:11:41.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/577: fsync d1/d10/d27/d36/f50 0 2023-12-16T20:11:41.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/578: chown d1/d10/d33/d6a 6 1 2023-12-16T20:11:41.115 INFO:tasks.workunit.client.1.smithi141.stdout:2/501: dwrite d6/da/d33/d54/d73/f89 [0,4194304] 0 2023-12-16T20:11:41.116 INFO:tasks.workunit.client.0.smithi038.stdout:8/874: rename d17/f40 to d17/d1b/d57/f119 0 2023-12-16T20:11:41.116 INFO:tasks.workunit.client.1.smithi141.stdout:3/718: creat d0/d1c/d40/d3f/d52/fec x:0 0 0 2023-12-16T20:11:41.116 INFO:tasks.workunit.client.1.smithi141.stdout:6/697: dwrite d1/f9c [0,4194304] 0 2023-12-16T20:11:41.116 INFO:tasks.workunit.client.1.smithi141.stdout:6/698: stat d1/d12/d20/d85/dd1/d47 0 2023-12-16T20:11:41.117 INFO:tasks.workunit.client.1.smithi141.stdout:7/633: dwrite d5/d2a/f41 [0,4194304] 0 2023-12-16T20:11:41.117 INFO:tasks.workunit.client.1.smithi141.stdout:7/634: chown d5/d16/d30/d4e 1 1 2023-12-16T20:11:41.117 INFO:tasks.workunit.client.1.smithi141.stdout:7/635: chown d5/d16/d30/d4e/d6e 76552 1 2023-12-16T20:11:41.118 INFO:tasks.workunit.client.0.smithi038.stdout:4/942: creat d13/d1f/d98/f139 x:0 0 0 2023-12-16T20:11:41.119 INFO:tasks.workunit.client.1.smithi141.stdout:9/579: mknod d1/d26/d3c/d9b/cc6 0 2023-12-16T20:11:41.120 INFO:tasks.workunit.client.0.smithi038.stdout:8/875: dread d17/d1b/d66/d73/d54/d69/f7e [0,4194304] 0 2023-12-16T20:11:41.121 INFO:tasks.workunit.client.0.smithi038.stdout:4/943: creat d13/d1f/db7/f13a x:0 0 0 2023-12-16T20:11:41.121 INFO:tasks.workunit.client.0.smithi038.stdout:4/944: write d13/d17/d2e/d32/d7c/fa8 [870858,128539] 0 2023-12-16T20:11:41.122 INFO:tasks.workunit.client.1.smithi141.stdout:2/502: truncate d6/da/d33/d54/d73/f79 247307 0 2023-12-16T20:11:41.123 INFO:tasks.workunit.client.1.smithi141.stdout:3/719: rmdir d0/d1c/d2c/d72/d74/d8b/da3 39 2023-12-16T20:11:41.125 INFO:tasks.workunit.client.1.smithi141.stdout:6/699: link d1/l90 d1/d12/le1 0 2023-12-16T20:11:41.130 INFO:tasks.workunit.client.1.smithi141.stdout:7/636: mkdir d5/d1d/d89/d9b/dd4 0 2023-12-16T20:11:41.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/876: rename d17/d1b/d25/db7/d82 to d17/d1b/d66/d73/d55/d11a 0 2023-12-16T20:11:41.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/877: getdents d17/d34/ddb/d114 0 2023-12-16T20:11:41.133 INFO:tasks.workunit.client.0.smithi038.stdout:4/945: rename d13/d17/d4b/da4/d34/d123/d84/d88/cd5 to d13/c13b 0 2023-12-16T20:11:41.135 INFO:tasks.workunit.client.1.smithi141.stdout:3/720: write d0/d1c/d40/f81 [1776821,25284] 0 2023-12-16T20:11:41.135 INFO:tasks.workunit.client.1.smithi141.stdout:2/503: creat d6/d3a/d47/d58/d66/d6c/d98/fac x:0 0 0 2023-12-16T20:11:41.136 INFO:tasks.workunit.client.0.smithi038.stdout:8/878: creat d17/d1b/d66/d73/d55/d11a/f11b x:0 0 0 2023-12-16T20:11:41.136 INFO:tasks.workunit.client.1.smithi141.stdout:7/637: mkdir d5/d16/d1a/d40/dab/dd5 0 2023-12-16T20:11:41.137 INFO:tasks.workunit.client.1.smithi141.stdout:6/700: dread d1/d12/d20/d44/fb1 [0,4194304] 0 2023-12-16T20:11:41.138 INFO:tasks.workunit.client.1.smithi141.stdout:7/638: getdents d5/d1d 0 2023-12-16T20:11:41.139 INFO:tasks.workunit.client.0.smithi038.stdout:4/946: rename d13/d17/d4b/da4/d34/d123/d84/d88/dc3/f11f to d13/d17/d4b/da4/d9d/db5/f13c 0 2023-12-16T20:11:41.139 INFO:tasks.workunit.client.1.smithi141.stdout:6/701: mknod d1/d12/d20/d44/ce2 0 2023-12-16T20:11:41.139 INFO:tasks.workunit.client.1.smithi141.stdout:6/702: stat d1/dd/d2f 0 2023-12-16T20:11:41.140 INFO:tasks.workunit.client.1.smithi141.stdout:3/721: dread d0/f41 [0,4194304] 0 2023-12-16T20:11:41.140 INFO:tasks.workunit.client.0.smithi038.stdout:8/879: mkdir d17/d1b/d66/d73/d55/d11a/da9/d50/d96/d11c 0 2023-12-16T20:11:41.141 INFO:tasks.workunit.client.0.smithi038.stdout:8/880: chown d17/d34/f84 0 1 2023-12-16T20:11:41.141 INFO:tasks.workunit.client.1.smithi141.stdout:0/606: dwrite d4/d5c/f87 [4194304,4194304] 0 2023-12-16T20:11:41.141 INFO:tasks.workunit.client.1.smithi141.stdout:6/703: unlink d1/d12/d22/d25/dd0/ld8 0 2023-12-16T20:11:41.142 INFO:tasks.workunit.client.0.smithi038.stdout:4/947: creat d13/d17/d4b/d7d/f13d x:0 0 0 2023-12-16T20:11:41.142 INFO:tasks.workunit.client.1.smithi141.stdout:7/639: link d5/d2a/f60 d5/d16/d30/fd6 0 2023-12-16T20:11:41.143 INFO:tasks.workunit.client.0.smithi038.stdout:8/881: mkdir d17/d11d 0 2023-12-16T20:11:41.143 INFO:tasks.workunit.client.1.smithi141.stdout:3/722: creat d0/d1c/d40/d3f/d52/d5a/fed x:0 0 0 2023-12-16T20:11:41.145 INFO:tasks.workunit.client.1.smithi141.stdout:6/704: symlink d1/d12/d22/d25/de0/le3 0 2023-12-16T20:11:41.145 INFO:tasks.workunit.client.1.smithi141.stdout:6/705: truncate d1/d12/d22/f88 1432402 0 2023-12-16T20:11:41.146 INFO:tasks.workunit.client.0.smithi038.stdout:4/948: mknod d13/d69/d7a/c13e 0 2023-12-16T20:11:41.146 INFO:tasks.workunit.client.0.smithi038.stdout:4/949: dread - d13/d17/d4b/da4/d34/d123/d84/d88/d125/f12c zero size 2023-12-16T20:11:41.147 INFO:tasks.workunit.client.1.smithi141.stdout:3/723: link d0/l4 d0/d1c/d2c/lee 0 2023-12-16T20:11:41.151 INFO:tasks.workunit.client.0.smithi038.stdout:4/950: link d13/d17/d4b/c9f d13/d17/d4b/da4/d34/d123/c13f 0 2023-12-16T20:11:41.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/951: chown d13/d17/d4b/d7d/f13d 5 1 2023-12-16T20:11:41.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/952: fdatasync d13/d17/d4b/da4/d34/d123/d84/d88/dc3/fe2 0 2023-12-16T20:11:41.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/953: mknod d13/d17/d4b/da4/d34/d123/c140 0 2023-12-16T20:11:41.152 INFO:tasks.workunit.client.1.smithi141.stdout:6/706: rename d1/dd/de/c28 to d1/dbd/ce4 0 2023-12-16T20:11:41.153 INFO:tasks.workunit.client.1.smithi141.stdout:6/707: write d1/d3/fa8 [258174,83576] 0 2023-12-16T20:11:41.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/724: mkdir d0/d1c/de8/def 0 2023-12-16T20:11:41.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/725: fdatasync d0/d1c/d2c/d72/d74/fbf 0 2023-12-16T20:11:41.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/726: creat d0/d1c/d2c/d72/d74/d8b/da3/ff0 x:0 0 0 2023-12-16T20:11:41.153 INFO:tasks.workunit.client.1.smithi141.stdout:3/727: dread - d0/d1c/d40/d3f/d52/d63/fb3 zero size 2023-12-16T20:11:41.155 INFO:tasks.workunit.client.0.smithi038.stdout:4/954: creat d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/dc8/dda/f141 x:0 0 0 2023-12-16T20:11:41.156 INFO:tasks.workunit.client.1.smithi141.stdout:0/607: dread d4/d49/d8f/fac [0,4194304] 0 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.1.smithi141.stdout:9/580: dwrite d1/d10/d33/d47/d83/f8f [4194304,4194304] 0 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.1.smithi141.stdout:9/581: chown d1/d10/d14/d20/c1f 202 1 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.1.smithi141.stdout:5/593: dwrite d0/d9/f15 [4194304,4194304] 0 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.1.smithi141.stdout:5/594: dread - d0/d25/d30/f6c zero size 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.1.smithi141.stdout:5/595: write d0/d9/d16/d2a/d4f/fc2 [727939,57667] 0 2023-12-16T20:11:41.158 INFO:tasks.workunit.client.0.smithi038.stdout:8/882: read d17/d1b/d66/d73/d55/d11a/d9b/fb3 [829933,58294] 0 2023-12-16T20:11:41.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/608: link d4/d49/d73/d3b/l64 d4/d5c/daf/ld1 0 2023-12-16T20:11:41.161 INFO:tasks.workunit.client.1.smithi141.stdout:7/640: dwrite d5/d16/d30/d4e/f82 [0,4194304] 0 2023-12-16T20:11:41.161 INFO:tasks.workunit.client.0.smithi038.stdout:4/955: rename d13/d17/d4b/da4/d34/d123/d84/d88/dc3/l12d to d13/d17/d4b/da4/d34/d123/d84/l142 0 2023-12-16T20:11:41.162 INFO:tasks.workunit.client.0.smithi038.stdout:4/956: chown d13/d17/d4b/d7d 105152774 1 2023-12-16T20:11:41.162 INFO:tasks.workunit.client.0.smithi038.stdout:4/957: write d13/d69/d7a/da5/f103 [852276,74015] 0 2023-12-16T20:11:41.162 INFO:tasks.workunit.client.0.smithi038.stdout:4/958: write d13/d17/d4b/da4/d34/d123/df6/dfc/f116 [1881,28987] 0 2023-12-16T20:11:41.162 INFO:tasks.workunit.client.0.smithi038.stdout:8/883: rmdir d17/d5a 39 2023-12-16T20:11:41.162 INFO:tasks.workunit.client.0.smithi038.stdout:8/884: write d17/d1b/d66/d73/d55/d11a/fef [270125,121109] 0 2023-12-16T20:11:41.163 INFO:tasks.workunit.client.1.smithi141.stdout:9/582: symlink d1/d10/d14/d20/da/lc7 0 2023-12-16T20:11:41.163 INFO:tasks.workunit.client.0.smithi038.stdout:4/959: rmdir d13/d17/d4b/da4/d34/d123/d84 39 2023-12-16T20:11:41.163 INFO:tasks.workunit.client.0.smithi038.stdout:4/960: write d13/d69/d7a/da5/f113 [1351973,46554] 0 2023-12-16T20:11:41.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/596: symlink d0/d25/d30/d8a/da0/lca 0 2023-12-16T20:11:41.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/597: chown d0/d9/d16/d2a/d4f/lb6 9 1 2023-12-16T20:11:41.168 INFO:tasks.workunit.client.0.smithi038.stdout:4/961: rename d13/d17/d4b/f43 to d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/f143 0 2023-12-16T20:11:41.168 INFO:tasks.workunit.client.0.smithi038.stdout:4/962: write d13/f91 [4028276,120624] 0 2023-12-16T20:11:41.168 INFO:tasks.workunit.client.0.smithi038.stdout:8/885: truncate d17/d5a/f7f 2025571 0 2023-12-16T20:11:41.168 INFO:tasks.workunit.client.0.smithi038.stdout:8/886: write d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fff [188276,98041] 0 2023-12-16T20:11:41.169 INFO:tasks.workunit.client.1.smithi141.stdout:7/641: mkdir d5/d16/d1a/dd7 0 2023-12-16T20:11:41.169 INFO:tasks.workunit.client.0.smithi038.stdout:4/963: creat d13/d69/def/d114/f144 x:0 0 0 2023-12-16T20:11:41.170 INFO:tasks.workunit.client.1.smithi141.stdout:0/609: symlink d4/d49/d4b/da3/ld2 0 2023-12-16T20:11:41.170 INFO:tasks.workunit.client.0.smithi038.stdout:8/887: mknod d17/d1b/d66/d73/d55/c11e 0 2023-12-16T20:11:41.171 INFO:tasks.workunit.client.0.smithi038.stdout:8/888: creat d17/d1b/d66/d73/d55/d11a/da9/f11f x:0 0 0 2023-12-16T20:11:41.173 INFO:tasks.workunit.client.1.smithi141.stdout:9/583: link d1/d26/fad d1/d10/d33/fc8 0 2023-12-16T20:11:41.174 INFO:tasks.workunit.client.0.smithi038.stdout:8/889: unlink d17/d1b/fae 0 2023-12-16T20:11:41.175 INFO:tasks.workunit.client.1.smithi141.stdout:5/598: creat d0/d9/d16/d2a/d35/d5e/d95/fcb x:0 0 0 2023-12-16T20:11:41.179 INFO:tasks.workunit.client.1.smithi141.stdout:7/642: rename d5/d16/f56 to d5/d1d/d89/fd8 0 2023-12-16T20:11:41.179 INFO:tasks.workunit.client.1.smithi141.stdout:7/643: write d5/d16/d46/f5d [4370639,98395] 0 2023-12-16T20:11:41.179 INFO:tasks.workunit.client.1.smithi141.stdout:6/708: dwrite d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:41.181 INFO:tasks.workunit.client.1.smithi141.stdout:3/728: dwrite d0/d1c/d40/d3f/d52/f7b [0,4194304] 0 2023-12-16T20:11:41.182 INFO:tasks.workunit.client.1.smithi141.stdout:3/729: write d0/d1c/d40/d3c/fcc [1026851,963] 0 2023-12-16T20:11:41.183 INFO:tasks.workunit.client.1.smithi141.stdout:3/730: dread - d0/d1c/d6a/d76/da2/fc3 zero size 2023-12-16T20:11:41.183 INFO:tasks.workunit.client.1.smithi141.stdout:3/731: stat d0/d1c/d6a/f9d 0 2023-12-16T20:11:41.184 INFO:tasks.workunit.client.1.smithi141.stdout:9/584: rmdir d1/d26/d3c/da6 0 2023-12-16T20:11:41.184 INFO:tasks.workunit.client.1.smithi141.stdout:9/585: truncate d1/d10/d14/d20/d84/fb2 276484 0 2023-12-16T20:11:41.187 INFO:tasks.workunit.client.1.smithi141.stdout:0/610: dread d4/f31 [0,4194304] 0 2023-12-16T20:11:41.190 INFO:tasks.workunit.client.1.smithi141.stdout:7/644: truncate d5/d16/d1a/d40/f58 7869284 0 2023-12-16T20:11:41.190 INFO:tasks.workunit.client.1.smithi141.stdout:7/645: creat d5/d2a/d45/fd9 x:0 0 0 2023-12-16T20:11:41.190 INFO:tasks.workunit.client.1.smithi141.stdout:7/646: dread - d5/d16/d30/d36/fc1 zero size 2023-12-16T20:11:41.190 INFO:tasks.workunit.client.1.smithi141.stdout:7/647: truncate d5/d1d/d1e/d71/d96/fad 1034025 0 2023-12-16T20:11:41.192 INFO:tasks.workunit.client.1.smithi141.stdout:9/586: mknod d1/d10/d14/d20/d90/cc9 0 2023-12-16T20:11:41.192 INFO:tasks.workunit.client.1.smithi141.stdout:9/587: stat d1/d26/d4a/d73/fa2 0 2023-12-16T20:11:41.193 INFO:tasks.workunit.client.1.smithi141.stdout:0/611: stat d4/d49/d73/d3b/d78/d7f/d80/lbc 0 2023-12-16T20:11:41.205 INFO:tasks.workunit.client.1.smithi141.stdout:7/648: dread d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:41.207 INFO:tasks.workunit.client.1.smithi141.stdout:7/649: symlink d5/d1d/d89/d9b/lda 0 2023-12-16T20:11:41.209 INFO:tasks.workunit.client.1.smithi141.stdout:7/650: rename d5/d16/d1a/f76 to d5/d1d/d1e/d71/d96/fdb 0 2023-12-16T20:11:41.210 INFO:tasks.workunit.client.1.smithi141.stdout:7/651: chown d5/d16/d30/d4e/d6e/la2 12239 1 2023-12-16T20:11:41.210 INFO:tasks.workunit.client.1.smithi141.stdout:7/652: dread - d5/d1d/d1e/d71/d96/fdb zero size 2023-12-16T20:11:41.210 INFO:tasks.workunit.client.1.smithi141.stdout:7/653: fdatasync d5/d1d/d1e/d71/f8e 0 2023-12-16T20:11:41.262 INFO:tasks.workunit.client.0.smithi038.stdout:4/964: dwrite d13/d17/d4b/da4/d34/fcb [0,4194304] 0 2023-12-16T20:11:41.264 INFO:tasks.workunit.client.0.smithi038.stdout:8/890: dwrite d17/d1b/d66/d73/d55/d11a/da9/d50/d96/dba/f118 [8388608,4194304] 0 2023-12-16T20:11:41.264 INFO:tasks.workunit.client.0.smithi038.stdout:8/891: fsync d17/d1b/d66/d8e/f9a 0 2023-12-16T20:11:41.265 INFO:tasks.workunit.client.0.smithi038.stdout:4/965: rename d13/d17/d2e/d32/d4e/f59 to d13/d17/d4b/da4/d34/d123/f145 0 2023-12-16T20:11:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:8/892: creat d17/d1b/d66/dfa/f120 x:0 0 0 2023-12-16T20:11:41.268 INFO:tasks.workunit.client.0.smithi038.stdout:4/966: creat d13/d69/d7a/d11c/f146 x:0 0 0 2023-12-16T20:11:41.268 INFO:tasks.workunit.client.0.smithi038.stdout:4/967: readlink d13/d17/d4b/da4/d34/d123/l10a 0 2023-12-16T20:11:41.269 INFO:tasks.workunit.client.1.smithi141.stdout:3/732: write d0/d1c/d2c/d72/d74/fbf [7007322,278] 0 2023-12-16T20:11:41.270 INFO:tasks.workunit.client.0.smithi038.stdout:8/893: creat d17/d1b/d66/d8e/d97/f121 x:0 0 0 2023-12-16T20:11:41.271 INFO:tasks.workunit.client.1.smithi141.stdout:6/709: dwrite d1/d12/d20/d89/d95/f75 [4194304,4194304] 0 2023-12-16T20:11:41.271 INFO:tasks.workunit.client.0.smithi038.stdout:8/894: mknod d17/d1b/d66/d73/d55/d11a/da9/d50/ddd/c122 0 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/733: mkdir d0/d1c/d2c/d72/d74/d8b/df1 0 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/734: readlink d0/l9 0 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:3/735: chown d0/d1c/d40/d3c/cb8 48 1 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:5/599: dwrite d0/d14/f23 [0,4194304] 0 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:5/600: write d0/d9/d16/d2a/d35/d4c/fb7 [121384,67903] 0 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:5/601: chown d0/d9/d16/d2a/d35/d5e/cc7 1446 1 2023-12-16T20:11:41.273 INFO:tasks.workunit.client.1.smithi141.stdout:5/602: write d0/d9/f15 [1701625,11458] 0 2023-12-16T20:11:41.284 INFO:tasks.workunit.client.1.smithi141.stdout:3/736: getdents d0/d1c/d40/d85/d4c 0 2023-12-16T20:11:41.284 INFO:tasks.workunit.client.0.smithi038.stdout:4/968: dread d13/d1f/d35/f117 [0,4194304] 0 2023-12-16T20:11:41.285 INFO:tasks.workunit.client.0.smithi038.stdout:4/969: mkdir d13/d1f/d35/ddf/d147 0 2023-12-16T20:11:41.285 INFO:tasks.workunit.client.0.smithi038.stdout:4/970: dread - d13/d69/def/f138 zero size 2023-12-16T20:11:41.286 INFO:tasks.workunit.client.1.smithi141.stdout:9/588: dwrite d1/d10/d14/d20/da/d3f/dab/fbe [0,4194304] 0 2023-12-16T20:11:41.289 INFO:tasks.workunit.client.1.smithi141.stdout:3/737: rename d0/d1c/d40/d3f/d52/f75 to d0/d1c/d40/d3c/dce/ff2 0 2023-12-16T20:11:41.290 INFO:tasks.workunit.client.0.smithi038.stdout:4/971: write d13/d17/d4b/da4/fd3 [322997,20129] 0 2023-12-16T20:11:41.295 INFO:tasks.workunit.client.1.smithi141.stdout:3/738: creat d0/d1c/d6a/d76/de3/ff3 x:0 0 0 2023-12-16T20:11:41.295 INFO:tasks.workunit.client.1.smithi141.stdout:3/739: write d0/d1c/d40/d3f/d52/d5a/f71 [5023404,17512] 0 2023-12-16T20:11:41.295 INFO:tasks.workunit.client.1.smithi141.stdout:0/612: dwrite d4/d49/d73/d3b/f67 [0,4194304] 0 2023-12-16T20:11:41.295 INFO:tasks.workunit.client.1.smithi141.stdout:0/613: creat d4/d49/da1/fd3 x:0 0 0 2023-12-16T20:11:41.296 INFO:tasks.workunit.client.1.smithi141.stdout:5/603: write d0/d14/d2c/fb2 [207488,83673] 0 2023-12-16T20:11:41.310 INFO:tasks.workunit.client.1.smithi141.stdout:5/604: creat d0/d14/d75/fcc x:0 0 0 2023-12-16T20:11:41.310 INFO:tasks.workunit.client.1.smithi141.stdout:5/605: write d0/f2b [1662367,39779] 0 2023-12-16T20:11:41.313 INFO:tasks.workunit.client.1.smithi141.stdout:5/606: mknod d0/d9/d16/d2a/d35/d4c/ccd 0 2023-12-16T20:11:41.316 INFO:tasks.workunit.client.1.smithi141.stdout:6/710: dwrite d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:41.317 INFO:tasks.workunit.client.1.smithi141.stdout:6/711: mkdir d1/d12/d20/d85/de5 0 2023-12-16T20:11:41.319 INFO:tasks.workunit.client.0.smithi038.stdout:8/895: dwrite d17/f89 [0,4194304] 0 2023-12-16T20:11:41.320 INFO:tasks.workunit.client.0.smithi038.stdout:8/896: chown d17/d1b/d25/fc3 4136390 1 2023-12-16T20:11:41.321 INFO:tasks.workunit.client.0.smithi038.stdout:8/897: symlink d17/d1b/d66/d73/d54/l123 0 2023-12-16T20:11:41.327 INFO:tasks.workunit.client.0.smithi038.stdout:4/972: dwrite d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d6e/d101/f104 [0,4194304] 0 2023-12-16T20:11:41.332 INFO:tasks.workunit.client.1.smithi141.stdout:0/614: dwrite d4/d49/db9/fc5 [0,4194304] 0 2023-12-16T20:11:41.332 INFO:tasks.workunit.client.1.smithi141.stdout:6/712: dread d1/fa [0,4194304] 0 2023-12-16T20:11:41.336 INFO:tasks.workunit.client.1.smithi141.stdout:6/713: mkdir d1/dd/d2f/de6 0 2023-12-16T20:11:41.338 INFO:tasks.workunit.client.1.smithi141.stdout:3/740: dwrite d0/d1c/d2c/fa6 [0,4194304] 0 2023-12-16T20:11:41.338 INFO:tasks.workunit.client.1.smithi141.stdout:3/741: readlink d0/d1c/d6a/ld3 0 2023-12-16T20:11:41.344 INFO:tasks.workunit.client.0.smithi038.stdout:8/898: dwrite d17/d1b/d66/d73/d55/d11a/da9/d50/d96/dba/fec [0,4194304] 0 2023-12-16T20:11:41.346 INFO:tasks.workunit.client.1.smithi141.stdout:1/694: sync 2023-12-16T20:11:41.347 INFO:tasks.workunit.client.1.smithi141.stdout:5/607: dwrite d0/d14/d2c/d4a/f51 [4194304,4194304] 0 2023-12-16T20:11:41.347 INFO:tasks.workunit.client.1.smithi141.stdout:5/608: write d0/d9/d16/d2a/d35/d4c/f8d [249215,43858] 0 2023-12-16T20:11:41.347 INFO:tasks.workunit.client.1.smithi141.stdout:5/609: write d0/d14/d75/fcc [381704,107952] 0 2023-12-16T20:11:41.348 INFO:tasks.workunit.client.0.smithi038.stdout:6/904: sync 2023-12-16T20:11:41.348 INFO:tasks.workunit.client.0.smithi038.stdout:0/978: sync 2023-12-16T20:11:41.348 INFO:tasks.workunit.client.1.smithi141.stdout:1/695: symlink da/d1a/dd1/le7 0 2023-12-16T20:11:41.350 INFO:tasks.workunit.client.0.smithi038.stdout:6/905: rmdir d1/d4/d1d/d61/da4/d114 0 2023-12-16T20:11:41.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/979: mkdir db/d16/d70/dd2/d13c/d143 0 2023-12-16T20:11:41.354 INFO:tasks.workunit.client.1.smithi141.stdout:5/610: mkdir d0/d25/dce 0 2023-12-16T20:11:41.354 INFO:tasks.workunit.client.1.smithi141.stdout:1/696: creat da/d36/d4b/db2/fe8 x:0 0 0 2023-12-16T20:11:41.354 INFO:tasks.workunit.client.1.smithi141.stdout:1/697: stat da/d1a/db0/dd3 0 2023-12-16T20:11:41.354 INFO:tasks.workunit.client.1.smithi141.stdout:5/611: unlink d0/d9/d16/d2a/d35/d5e/d95/fcb 0 2023-12-16T20:11:41.355 INFO:tasks.workunit.client.1.smithi141.stdout:1/698: mkdir da/d1a/d1d/d33/de9 0 2023-12-16T20:11:41.355 INFO:tasks.workunit.client.1.smithi141.stdout:5/612: symlink d0/d25/dce/lcf 0 2023-12-16T20:11:41.356 INFO:tasks.workunit.client.1.smithi141.stdout:1/699: symlink da/d36/d4b/d4d/d89/d6c/lea 0 2023-12-16T20:11:41.356 INFO:tasks.workunit.client.1.smithi141.stdout:1/700: write da/d1a/f51 [3050156,126574] 0 2023-12-16T20:11:41.358 INFO:tasks.workunit.client.0.smithi038.stdout:8/899: dread d17/d1b/d66/d73/d54/d69/f1a [4194304,4194304] 0 2023-12-16T20:11:41.358 INFO:tasks.workunit.client.0.smithi038.stdout:8/900: fsync d17/d1b/d66/d73/d54/fd1 0 2023-12-16T20:11:41.358 INFO:tasks.workunit.client.0.smithi038.stdout:8/901: truncate d17/d1b/d66/d73/dc8/f102 75302 0 2023-12-16T20:11:41.359 INFO:tasks.workunit.client.1.smithi141.stdout:5/613: unlink d0/d94/db3/cb5 0 2023-12-16T20:11:41.360 INFO:tasks.workunit.client.1.smithi141.stdout:5/614: mknod d0/d25/d30/d67/cd0 0 2023-12-16T20:11:41.360 INFO:tasks.workunit.client.1.smithi141.stdout:5/615: stat d0/d9/d16/fa5 0 2023-12-16T20:11:41.362 INFO:tasks.workunit.client.1.smithi141.stdout:3/742: dwrite d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:41.362 INFO:tasks.workunit.client.1.smithi141.stdout:3/743: write d0/d1c/d40/d3c/fba [909203,102807] 0 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:3/744: chown d0/d1c/feb 193 1 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:3/745: creat d0/d1c/d2c/d72/d74/dda/ff4 x:0 0 0 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:0/615: dwrite d4/d49/d73/d3b/f7a [0,4194304] 0 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:0/616: truncate d4/d49/d73/f96 161895 0 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:5/616: dread d0/d25/d30/d67/f71 [0,4194304] 0 2023-12-16T20:11:41.363 INFO:tasks.workunit.client.1.smithi141.stdout:5/617: chown d0/d25/d30/d8a/da0 3 1 2023-12-16T20:11:41.364 INFO:tasks.workunit.client.1.smithi141.stdout:3/746: truncate d0/d1c/feb 780841 0 2023-12-16T20:11:41.367 INFO:tasks.workunit.client.0.smithi038.stdout:6/906: write d1/d5b/d7d/d9d/dc8/de7/f41 [1998673,77855] 0 2023-12-16T20:11:41.367 INFO:tasks.workunit.client.0.smithi038.stdout:8/902: dread d17/d1b/d66/d73/d55/d11a/daa/f10f [0,4194304] 0 2023-12-16T20:11:41.367 INFO:tasks.workunit.client.0.smithi038.stdout:8/903: chown d17/d1b/d66/d73/d55/d11a/fef 80 1 2023-12-16T20:11:41.367 INFO:tasks.workunit.client.0.smithi038.stdout:8/904: chown d17/d1b/d66/d73/fbf 834142 1 2023-12-16T20:11:41.368 INFO:tasks.workunit.client.1.smithi141.stdout:5/618: mkdir d0/d25/dce/dd1 0 2023-12-16T20:11:41.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/907: rename d1/d5b/d7d/d9d/dc8/de7/d2f/l3e to d1/d5b/d7d/d9d/dc8/de7/d2f/d85/l123 0 2023-12-16T20:11:41.370 INFO:tasks.workunit.client.1.smithi141.stdout:3/747: dread d0/d1c/d40/d3c/fba [0,4194304] 0 2023-12-16T20:11:41.371 INFO:tasks.workunit.client.1.smithi141.stdout:3/748: stat d0/d1c/d2c/d72/la0 0 2023-12-16T20:11:41.371 INFO:tasks.workunit.client.0.smithi038.stdout:0/980: write db/d16/d1c/f62 [1498084,37768] 0 2023-12-16T20:11:41.371 INFO:tasks.workunit.client.0.smithi038.stdout:8/905: symlink d17/d1b/d66/d73/d55/d11a/da9/d50/d96/dba/l124 0 2023-12-16T20:11:41.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/619: rename d0/d43 to d0/dd2 0 2023-12-16T20:11:41.373 INFO:tasks.workunit.client.1.smithi141.stdout:0/617: dread d4/f35 [0,4194304] 0 2023-12-16T20:11:41.374 INFO:tasks.workunit.client.0.smithi038.stdout:0/981: creat db/d16/d19/d4e/dac/f144 x:0 0 0 2023-12-16T20:11:41.374 INFO:tasks.workunit.client.0.smithi038.stdout:0/982: chown db/d16/d70/dd2/d13c 8185415 1 2023-12-16T20:11:41.374 INFO:tasks.workunit.client.0.smithi038.stdout:0/983: fdatasync db/d16/d19/f98 0 2023-12-16T20:11:41.376 INFO:tasks.workunit.client.0.smithi038.stdout:0/984: truncate db/d16/d70/f55 5136138 0 2023-12-16T20:11:41.376 INFO:tasks.workunit.client.0.smithi038.stdout:0/985: write db/d16/d70/dd2/ffa [418952,123081] 0 2023-12-16T20:11:41.377 INFO:tasks.workunit.client.1.smithi141.stdout:3/749: creat d0/d1c/d40/ff5 x:0 0 0 2023-12-16T20:11:41.381 INFO:tasks.workunit.client.0.smithi038.stdout:6/908: dread d1/d16/d23/f57 [0,4194304] 0 2023-12-16T20:11:41.382 INFO:tasks.workunit.client.1.smithi141.stdout:3/750: dread d0/d1c/d40/f81 [0,4194304] 0 2023-12-16T20:11:41.382 INFO:tasks.workunit.client.1.smithi141.stdout:3/751: read - d0/d1c/d2c/d72/d74/d8b/fb4 zero size 2023-12-16T20:11:41.382 INFO:tasks.workunit.client.1.smithi141.stdout:3/752: fsync d0/f37 0 2023-12-16T20:11:41.382 INFO:tasks.workunit.client.1.smithi141.stdout:3/753: dread - d0/d1c/d6a/f9d zero size 2023-12-16T20:11:41.383 INFO:tasks.workunit.client.1.smithi141.stdout:3/754: mkdir d0/d1c/d40/d3f/d52/d63/df6 0 2023-12-16T20:11:41.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/986: dread db/d16/d19/d4e/d106/d65/de8/fcd [0,4194304] 0 2023-12-16T20:11:41.386 INFO:tasks.workunit.client.1.smithi141.stdout:3/755: unlink d0/d1c/d40/d3c/f4a 0 2023-12-16T20:11:41.386 INFO:tasks.workunit.client.1.smithi141.stdout:3/756: creat d0/d1c/d40/d3f/d52/d5d/ff7 x:0 0 0 2023-12-16T20:11:41.386 INFO:tasks.workunit.client.1.smithi141.stdout:3/757: dread - d0/d1c/d40/d3f/d52/d5d/fd6 zero size 2023-12-16T20:11:41.389 INFO:tasks.workunit.client.1.smithi141.stdout:3/758: rename d0/d1c/d2c/d72/d74/d8b to d0/d1c/d6a/d8f/df8 0 2023-12-16T20:11:41.392 INFO:tasks.workunit.client.1.smithi141.stdout:0/618: dwrite d4/d49/d73/d8a/f91 [0,4194304] 0 2023-12-16T20:11:41.392 INFO:tasks.workunit.client.1.smithi141.stdout:0/619: readlink d4/d5c/l65 0 2023-12-16T20:11:41.392 INFO:tasks.workunit.client.0.smithi038.stdout:8/906: dwrite d17/d1b/d66/d8e/d97/fb9 [0,4194304] 0 2023-12-16T20:11:41.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/909: read d1/d5b/d7d/d9d/dc8/de7/f69 [2516524,6237] 0 2023-12-16T20:11:41.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/910: creat d1/d4/d1d/d8e/f124 x:0 0 0 2023-12-16T20:11:41.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/911: chown d1/f71 36 1 2023-12-16T20:11:41.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/912: chown d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/ld4 1874 1 2023-12-16T20:11:41.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/907: dread d17/d1b/d66/d73/d55/d11a/da9/d50/ddd/df9/f7c [0,4194304] 0 2023-12-16T20:11:41.408 INFO:tasks.workunit.client.0.smithi038.stdout:8/908: getdents d17/d1b/d66/d73/d55/d11a/da9/d50/ddd 0 2023-12-16T20:11:41.411 INFO:tasks.workunit.client.1.smithi141.stdout:3/759: rename d0/d1c/d6a/d8f to d0/d1c/d40/d3f/d52/d5a/df9 0 2023-12-16T20:11:41.412 INFO:tasks.workunit.client.0.smithi038.stdout:6/913: dwrite d1/f19 [4194304,4194304] 0 2023-12-16T20:11:41.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/987: dwrite db/d16/d1c/d5d/f8d [4194304,4194304] 0 2023-12-16T20:11:41.412 INFO:tasks.workunit.client.1.smithi141.stdout:0/620: truncate d4/d49/d73/d3b/f67 1239278 0 2023-12-16T20:11:41.414 INFO:tasks.workunit.client.0.smithi038.stdout:6/914: rename d1/d5b/d7d/d9d/dc8/de7/d2f/l3c to d1/d5b/l125 0 2023-12-16T20:11:41.414 INFO:tasks.workunit.client.1.smithi141.stdout:0/621: rmdir d4/d49/d73/d3b/d78/d7f/d80/d83 39 2023-12-16T20:11:41.416 INFO:tasks.workunit.client.1.smithi141.stdout:0/622: mkdir d4/d49/da1/dd4 0 2023-12-16T20:11:41.416 INFO:tasks.workunit.client.1.smithi141.stdout:0/623: creat d4/d5c/fd5 x:0 0 0 2023-12-16T20:11:41.418 INFO:tasks.workunit.client.0.smithi038.stdout:0/988: dread db/d16/d19/d4e/d106/d65/de8/f7a [0,4194304] 0 2023-12-16T20:11:41.421 INFO:tasks.workunit.client.1.smithi141.stdout:0/624: mknod d4/d49/d73/cd6 0 2023-12-16T20:11:41.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/909: dread f10 [0,4194304] 0 2023-12-16T20:11:41.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/910: fsync d17/d1b/d66/d73/d55/d11a/da9/d50/f6e 0 2023-12-16T20:11:41.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/911: fdatasync d17/d1b/d66/d73/d54/d69/f1a 0 2023-12-16T20:11:41.424 INFO:tasks.workunit.client.1.smithi141.stdout:0/625: symlink d4/d49/d73/d3b/d78/d7f/d80/ld7 0 2023-12-16T20:11:41.424 INFO:tasks.workunit.client.0.smithi038.stdout:8/912: creat d17/d1b/d25/db7/f125 x:0 0 0 2023-12-16T20:11:41.424 INFO:tasks.workunit.client.0.smithi038.stdout:8/913: write d17/d34/f112 [216922,22494] 0 2023-12-16T20:11:41.425 INFO:tasks.workunit.client.0.smithi038.stdout:8/914: symlink d17/d5a/l126 0 2023-12-16T20:11:41.426 INFO:tasks.workunit.client.1.smithi141.stdout:0/626: mknod d4/d49/d73/d8a/da4/dcc/cd8 0 2023-12-16T20:11:41.432 INFO:tasks.workunit.client.0.smithi038.stdout:0/989: dread db/d16/d19/d4e/d106/d65/de8/fcf [0,4194304] 0 2023-12-16T20:11:41.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/990: mknod db/d16/db5/de6/d112/c145 0 2023-12-16T20:11:41.439 INFO:tasks.workunit.client.0.smithi038.stdout:6/915: dwrite d1/d4/d1d/d61/da4/f106 [0,4194304] 0 2023-12-16T20:11:41.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/991: dread db/db6/fdb [0,4194304] 0 2023-12-16T20:11:41.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/992: chown db/d16 208047 1 2023-12-16T20:11:41.441 INFO:tasks.workunit.client.0.smithi038.stdout:0/993: getdents db/d16/d19/d27/d78/dd5 0 2023-12-16T20:11:41.442 INFO:tasks.workunit.client.0.smithi038.stdout:0/994: write db/f88 [629385,121363] 0 2023-12-16T20:11:41.442 INFO:tasks.workunit.client.0.smithi038.stdout:0/995: read - db/d16/d19/d4e/d106/d65/de8/f137 zero size 2023-12-16T20:11:41.443 INFO:tasks.workunit.client.0.smithi038.stdout:0/996: link db/d16/d19/d4e/d106/d65/de8/f59 db/d16/d70/d7c/f146 0 2023-12-16T20:11:41.444 INFO:tasks.workunit.client.1.smithi141.stdout:0/627: dwrite d4/d49/d4b/f53 [0,4194304] 0 2023-12-16T20:11:41.458 INFO:tasks.workunit.client.0.smithi038.stdout:6/916: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fde [0,4194304] 0 2023-12-16T20:11:41.460 INFO:tasks.workunit.client.0.smithi038.stdout:6/917: dread d1/d5b/d7d/dc6/fda [0,4194304] 0 2023-12-16T20:11:41.461 INFO:tasks.workunit.client.0.smithi038.stdout:6/918: dread d1/d5b/d7d/d9d/dc8/de7/f79 [0,4194304] 0 2023-12-16T20:11:41.484 INFO:tasks.workunit.client.1.smithi141.stdout:4/593: sync 2023-12-16T20:11:41.484 INFO:tasks.workunit.client.1.smithi141.stdout:8/637: sync 2023-12-16T20:11:41.484 INFO:tasks.workunit.client.1.smithi141.stdout:4/594: stat d1a/d2a/c5b 0 2023-12-16T20:11:41.486 INFO:tasks.workunit.client.1.smithi141.stdout:8/638: symlink d14/lcb 0 2023-12-16T20:11:41.486 INFO:tasks.workunit.client.1.smithi141.stdout:8/639: fdatasync d14/d19/d95/dae/db4/fac 0 2023-12-16T20:11:41.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/997: dwrite db/d16/d19/d27/d56/def/f113 [0,4194304] 0 2023-12-16T20:11:41.492 INFO:tasks.workunit.client.0.smithi038.stdout:6/919: dwrite d1/d5b/d7d/d9d/dc8/de7/f41 [0,4194304] 0 2023-12-16T20:11:41.492 INFO:tasks.workunit.client.0.smithi038.stdout:6/920: write d1/d4/d1d/d8e/dbf/fef [4459544,15481] 0 2023-12-16T20:11:41.493 INFO:tasks.workunit.client.0.smithi038.stdout:6/921: mkdir d1/d126 0 2023-12-16T20:11:41.495 INFO:tasks.workunit.client.0.smithi038.stdout:0/998: truncate db/d16/d1c/f62 3930136 0 2023-12-16T20:11:41.495 INFO:tasks.workunit.client.0.smithi038.stdout:6/922: rename d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2/f11e to d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/dc9/f127 0 2023-12-16T20:11:41.497 INFO:tasks.workunit.client.0.smithi038.stdout:6/923: creat d1/d5b/d7d/f128 x:0 0 0 2023-12-16T20:11:41.497 INFO:tasks.workunit.client.0.smithi038.stdout:6/924: write d1/f22 [1674524,118927] 0 2023-12-16T20:11:41.497 INFO:tasks.workunit.client.0.smithi038.stdout:0/999: creat db/d16/d19/d4e/d106/d65/de8/d77/d95/d9e/df9/f147 x:0 0 0 2023-12-16T20:11:41.510 INFO:tasks.workunit.client.1.smithi141.stdout:4/595: dwrite d1a/d54/f6a [0,4194304] 0 2023-12-16T20:11:41.510 INFO:tasks.workunit.client.0.smithi038.stdout:6/925: read d1/d5b/d7d/d9d/f46 [6453690,24388] 0 2023-12-16T20:11:41.511 INFO:tasks.workunit.client.0.smithi038.stdout:6/926: rmdir d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3 39 2023-12-16T20:11:41.511 INFO:tasks.workunit.client.0.smithi038.stdout:6/927: read d1/f39 [2394813,60317] 0 2023-12-16T20:11:41.511 INFO:tasks.workunit.client.0.smithi038.stdout:6/928: stat d1/d16/f44 0 2023-12-16T20:11:41.511 INFO:tasks.workunit.client.0.smithi038.stdout:6/929: chown d1/d4/d1d/c9b 23 1 2023-12-16T20:11:41.511 INFO:tasks.workunit.client.1.smithi141.stdout:4/596: creat d1a/d3c/d9b/da1/da6/fd8 x:0 0 0 2023-12-16T20:11:41.512 INFO:tasks.workunit.client.1.smithi141.stdout:4/597: read - d1a/d2a/f6b zero size 2023-12-16T20:11:41.512 INFO:tasks.workunit.client.1.smithi141.stdout:4/598: write d1a/d59/d89/d8a/fc0 [260153,10404] 0 2023-12-16T20:11:41.512 INFO:tasks.workunit.client.1.smithi141.stdout:4/599: chown c11 1170238 1 2023-12-16T20:11:41.512 INFO:tasks.workunit.client.1.smithi141.stdout:4/600: truncate d1a/d3c/d9b/fac 856293 0 2023-12-16T20:11:41.517 INFO:tasks.workunit.client.1.smithi141.stdout:8/640: dwrite d14/d19/d1b/d24/f49 [0,4194304] 0 2023-12-16T20:11:41.517 INFO:tasks.workunit.client.1.smithi141.stdout:8/641: chown d14/d19/d95/dae/db4/d5b/f7e 1339 1 2023-12-16T20:11:41.517 INFO:tasks.workunit.client.0.smithi038.stdout:6/930: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f43 [2504991,16392] 0 2023-12-16T20:11:41.517 INFO:tasks.workunit.client.0.smithi038.stdout:6/931: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fb0 [825092,54923] 0 2023-12-16T20:11:41.519 INFO:tasks.workunit.client.0.smithi038.stdout:6/932: dread d1/d4/d1d/d61/da4/fd9 [0,4194304] 0 2023-12-16T20:11:41.520 INFO:tasks.workunit.client.1.smithi141.stdout:8/642: dread d14/f79 [0,4194304] 0 2023-12-16T20:11:41.522 INFO:tasks.workunit.client.0.smithi038.stdout:6/933: rename d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/df2 to d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/d129 0 2023-12-16T20:11:41.523 INFO:tasks.workunit.client.1.smithi141.stdout:8/643: write d14/f79 [441294,122076] 0 2023-12-16T20:11:41.524 INFO:tasks.workunit.client.1.smithi141.stdout:8/644: truncate d14/d19/f1c 3075827 0 2023-12-16T20:11:41.525 INFO:tasks.workunit.client.1.smithi141.stdout:8/645: chown d14/d19/d95/dae/db4/f5a 214333894 1 2023-12-16T20:11:41.525 INFO:tasks.workunit.client.1.smithi141.stdout:8/646: chown d14/d19/fa8 223 1 2023-12-16T20:11:41.526 INFO:tasks.workunit.client.1.smithi141.stdout:8/647: unlink d14/d19/d95/dae/db4/fac 0 2023-12-16T20:11:41.527 INFO:tasks.workunit.client.1.smithi141.stdout:8/648: dread d14/d19/d95/dae/db4/d5b/f7b [0,4194304] 0 2023-12-16T20:11:41.527 INFO:tasks.workunit.client.1.smithi141.stdout:8/649: write d14/d35/f66 [3261405,112814] 0 2023-12-16T20:11:41.528 INFO:tasks.workunit.client.1.smithi141.stdout:8/650: mkdir d14/d35/dcc 0 2023-12-16T20:11:41.528 INFO:tasks.workunit.client.1.smithi141.stdout:8/651: write d14/d19/d1b/d24/d4b/fb6 [648701,103931] 0 2023-12-16T20:11:41.537 INFO:tasks.workunit.client.1.smithi141.stdout:8/652: dread d14/d19/d1b/f1a [0,4194304] 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/934: dwrite d1/d4/d1d/d8e/dbf/d115/f120 [0,4194304] 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/935: creat d1/d5b/d7d/d9d/f12a x:0 0 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/936: write d1/fa8 [621338,76727] 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/937: readlink d1/d16/d23/l87 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/938: write d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fb0 [1028881,105784] 0 2023-12-16T20:11:41.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/939: fdatasync d1/d4/d1d/d61/da4/fd9 0 2023-12-16T20:11:41.547 INFO:tasks.workunit.client.1.smithi141.stdout:8/653: dread d14/d19/d95/dae/fc2 [0,4194304] 0 2023-12-16T20:11:41.548 INFO:tasks.workunit.client.1.smithi141.stdout:8/654: creat d14/d71/d81/fcd x:0 0 0 2023-12-16T20:11:41.548 INFO:tasks.workunit.client.1.smithi141.stdout:8/655: chown d14/d19/d1b/d24/d4b/l65 15 1 2023-12-16T20:11:41.565 INFO:tasks.workunit.client.1.smithi141.stdout:8/656: dwrite d14/f64 [0,4194304] 0 2023-12-16T20:11:41.565 INFO:tasks.workunit.client.1.smithi141.stdout:8/657: mkdir d14/d19/dce 0 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:7/654: sync 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:2/504: sync 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:2/505: chown d6/da/d1b/f5d 60602059 1 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:7/655: chown d5/d1d/c26 8 1 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:7/656: fdatasync d5/d1d/f7c 0 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:2/506: truncate d6/d3a/d47/d58/d66/d6c/d98/fac 703374 0 2023-12-16T20:11:41.569 INFO:tasks.workunit.client.1.smithi141.stdout:2/507: write d6/f1d [1905798,101774] 0 2023-12-16T20:11:41.570 INFO:tasks.workunit.client.1.smithi141.stdout:7/657: write d5/d16/d1a/f25 [382724,9877] 0 2023-12-16T20:11:41.570 INFO:tasks.workunit.client.1.smithi141.stdout:7/658: fsync d5/d2a/f34 0 2023-12-16T20:11:41.573 INFO:tasks.workunit.client.1.smithi141.stdout:7/659: creat d5/d16/fdc x:0 0 0 2023-12-16T20:11:41.577 INFO:tasks.workunit.client.1.smithi141.stdout:8/658: dread d14/d19/f1c [0,4194304] 0 2023-12-16T20:11:41.579 INFO:tasks.workunit.client.1.smithi141.stdout:8/659: dread d14/d35/fbb [0,4194304] 0 2023-12-16T20:11:41.580 INFO:tasks.workunit.client.1.smithi141.stdout:8/660: dread d14/d19/d1b/f48 [0,4194304] 0 2023-12-16T20:11:41.580 INFO:tasks.workunit.client.1.smithi141.stdout:8/661: chown d14/d19/d1b/d24/d4b/d8f/fc6 141318 1 2023-12-16T20:11:41.580 INFO:tasks.workunit.client.1.smithi141.stdout:8/662: chown d14/d19/d1b/d24 14654 1 2023-12-16T20:11:41.580 INFO:tasks.workunit.client.1.smithi141.stdout:8/663: write d14/f23 [1190049,13527] 0 2023-12-16T20:11:41.580 INFO:tasks.workunit.client.1.smithi141.stdout:8/664: chown ff 317957459 1 2023-12-16T20:11:41.581 INFO:tasks.workunit.client.1.smithi141.stdout:8/665: rename d14/f98 to d14/d19/d95/dab/fcf 0 2023-12-16T20:11:41.583 INFO:tasks.workunit.client.1.smithi141.stdout:2/508: dwrite d6/d32/d52/d53/f74 [0,4194304] 0 2023-12-16T20:11:41.584 INFO:tasks.workunit.client.1.smithi141.stdout:2/509: chown d6/da/d1b/f5d 107773 1 2023-12-16T20:11:41.584 INFO:tasks.workunit.client.1.smithi141.stdout:2/510: read - d6/d12/d1f/d46/f6b zero size 2023-12-16T20:11:41.584 INFO:tasks.workunit.client.1.smithi141.stdout:2/511: truncate d6/d12/d1f/d46/f9a 236523 0 2023-12-16T20:11:41.584 INFO:tasks.workunit.client.1.smithi141.stdout:8/666: unlink d14/d19/f2e 0 2023-12-16T20:11:41.584 INFO:tasks.workunit.client.1.smithi141.stdout:7/660: dread d5/d16/d46/f5d [0,4194304] 0 2023-12-16T20:11:41.585 INFO:tasks.workunit.client.0.smithi038.stdout:4/973: sync 2023-12-16T20:11:41.585 INFO:tasks.workunit.client.0.smithi038.stdout:4/974: mknod d13/d17/d4b/da4/d34/d123/db2/c148 0 2023-12-16T20:11:41.585 INFO:tasks.workunit.client.1.smithi141.stdout:2/512: mkdir d6/d32/d7a/dad 0 2023-12-16T20:11:41.589 INFO:tasks.workunit.client.0.smithi038.stdout:4/975: creat d13/d17/d4b/da4/d9d/db5/d107/f149 x:0 0 0 2023-12-16T20:11:41.590 INFO:tasks.workunit.client.0.smithi038.stdout:4/976: rename d13/d17/d2e/d32/d4e/la2 to d13/d17/d4b/da4/d34/d123/db2/l14a 0 2023-12-16T20:11:41.590 INFO:tasks.workunit.client.0.smithi038.stdout:4/977: stat d13/d69/d7a/d11d/l5f 0 2023-12-16T20:11:41.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/978: symlink d13/d17/d4b/d7d/d90/l14b 0 2023-12-16T20:11:41.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/979: creat d13/d17/d4b/d7d/d90/f14c x:0 0 0 2023-12-16T20:11:41.591 INFO:tasks.workunit.client.1.smithi141.stdout:7/661: rename d5/d2a/fc9 to d5/d16/d46/d61/fdd 0 2023-12-16T20:11:41.591 INFO:tasks.workunit.client.1.smithi141.stdout:2/513: creat d6/da/fae x:0 0 0 2023-12-16T20:11:41.591 INFO:tasks.workunit.client.1.smithi141.stdout:2/514: dread - d6/da/fae zero size 2023-12-16T20:11:41.592 INFO:tasks.workunit.client.1.smithi141.stdout:7/662: creat d5/d16/d30/d4e/fde x:0 0 0 2023-12-16T20:11:41.593 INFO:tasks.workunit.client.0.smithi038.stdout:4/980: rename d13/d17/d4b/da4/d34/d123/f120 to d13/d17/d4b/d7d/dc0/d10f/f14d 0 2023-12-16T20:11:41.594 INFO:tasks.workunit.client.1.smithi141.stdout:7/663: mkdir d5/d1d/d1e/d71/ddf 0 2023-12-16T20:11:41.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/981: rename d13/d17/d2e/l51 to d13/d17/d4b/da4/d11b/l14e 0 2023-12-16T20:11:41.596 INFO:tasks.workunit.client.1.smithi141.stdout:2/515: link d6/d32/d7a/d5f/d92/f9f d6/d12/d15/faf 0 2023-12-16T20:11:41.601 INFO:tasks.workunit.client.1.smithi141.stdout:8/667: dwrite d14/d19/d1b/d3d/f3e [0,4194304] 0 2023-12-16T20:11:41.604 INFO:tasks.workunit.client.0.smithi038.stdout:4/982: dread d13/d69/d7a/d11d/f53 [0,4194304] 0 2023-12-16T20:11:41.605 INFO:tasks.workunit.client.1.smithi141.stdout:8/668: link d14/d19/d95/dae/db4/d5b/l60 d14/d71/ld0 0 2023-12-16T20:11:41.605 INFO:tasks.workunit.client.1.smithi141.stdout:8/669: chown d14/d19/d1b/d3d 69336482 1 2023-12-16T20:11:41.606 INFO:tasks.workunit.client.1.smithi141.stdout:8/670: symlink d14/d19/d1b/ld1 0 2023-12-16T20:11:41.606 INFO:tasks.workunit.client.1.smithi141.stdout:2/516: write d6/d32/f4e [2778576,88402] 0 2023-12-16T20:11:41.609 INFO:tasks.workunit.client.1.smithi141.stdout:8/671: mkdir d14/d19/dd2 0 2023-12-16T20:11:41.615 INFO:tasks.workunit.client.1.smithi141.stdout:8/672: getdents d14/d19/d1b/d24/d4b/d8f 0 2023-12-16T20:11:41.615 INFO:tasks.workunit.client.1.smithi141.stdout:8/673: read d14/d19/d1b/d3d/f77 [1453747,85673] 0 2023-12-16T20:11:41.620 INFO:tasks.workunit.client.0.smithi038.stdout:4/983: dwrite d13/d1f/d98/fd0 [0,4194304] 0 2023-12-16T20:11:41.631 INFO:tasks.workunit.client.1.smithi141.stdout:2/517: dwrite d6/da/d33/d54/d73/f89 [0,4194304] 0 2023-12-16T20:11:41.631 INFO:tasks.workunit.client.1.smithi141.stdout:9/589: sync 2023-12-16T20:11:41.633 INFO:tasks.workunit.client.0.smithi038.stdout:4/984: write d13/d17/d4b/da4/d34/d123/d84/d88/f12b [3388609,58725] 0 2023-12-16T20:11:41.633 INFO:tasks.workunit.client.1.smithi141.stdout:2/518: link d6/d12/d1f/d46/la5 d6/da/d33/d54/d7c/lb0 0 2023-12-16T20:11:41.634 INFO:tasks.workunit.client.1.smithi141.stdout:8/674: dwrite d14/d19/d1b/d24/d4b/f97 [0,4194304] 0 2023-12-16T20:11:41.634 INFO:tasks.workunit.client.1.smithi141.stdout:8/675: truncate d14/d19/d1b/f3f 1046448 0 2023-12-16T20:11:41.637 INFO:tasks.workunit.client.1.smithi141.stdout:8/676: mknod d14/d19/d1b/d24/d4b/d8f/cd3 0 2023-12-16T20:11:41.638 INFO:tasks.workunit.client.1.smithi141.stdout:8/677: mkdir d14/d19/d95/dae/db4/d69/dd4 0 2023-12-16T20:11:41.640 INFO:tasks.workunit.client.1.smithi141.stdout:8/678: truncate d14/d19/f1c 412381 0 2023-12-16T20:11:41.644 INFO:tasks.workunit.client.1.smithi141.stdout:2/519: dread d6/d32/d7a/d5f/d92/f9f [0,4194304] 0 2023-12-16T20:11:41.647 INFO:tasks.workunit.client.1.smithi141.stdout:2/520: rename d6/da/d33/f4b to d6/da/fb1 0 2023-12-16T20:11:41.650 INFO:tasks.workunit.client.1.smithi141.stdout:8/679: dread d14/d35/f61 [0,4194304] 0 2023-12-16T20:11:41.650 INFO:tasks.workunit.client.1.smithi141.stdout:8/680: chown d14/l44 43913211 1 2023-12-16T20:11:41.651 INFO:tasks.workunit.client.1.smithi141.stdout:8/681: mknod d14/d19/d1b/d24/d4b/d8c/cd5 0 2023-12-16T20:11:41.657 INFO:tasks.workunit.client.0.smithi038.stdout:4/985: dwrite d13/d17/d4b/da4/d34/d123/f145 [0,4194304] 0 2023-12-16T20:11:41.657 INFO:tasks.workunit.client.0.smithi038.stdout:4/986: write d13/d17/d4b/da4/d34/d123/d84/de3/ffe [86235,57711] 0 2023-12-16T20:11:41.659 INFO:tasks.workunit.client.0.smithi038.stdout:4/987: link d13/f48 d13/f14f 0 2023-12-16T20:11:41.659 INFO:tasks.workunit.client.1.smithi141.stdout:8/682: dread d14/d19/d1b/f1a [0,4194304] 0 2023-12-16T20:11:41.661 INFO:tasks.workunit.client.0.smithi038.stdout:4/988: creat d13/d17/d4b/da4/d34/d123/d84/f150 x:0 0 0 2023-12-16T20:11:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:4/989: unlink d13/f14f 0 2023-12-16T20:11:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:4/990: write d13/d17/d4b/da4/d34/ff2 [307190,60737] 0 2023-12-16T20:11:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:4/991: mknod d13/d1f/d35/ddf/d136/c151 0 2023-12-16T20:11:41.664 INFO:tasks.workunit.client.0.smithi038.stdout:4/992: creat d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/d78/dc8/f152 x:0 0 0 2023-12-16T20:11:41.666 INFO:tasks.workunit.client.0.smithi038.stdout:4/993: getdents d13/d69/d7a 0 2023-12-16T20:11:41.667 INFO:tasks.workunit.client.0.smithi038.stdout:4/994: symlink d13/d1f/db7/db9/l153 0 2023-12-16T20:11:41.668 INFO:tasks.workunit.client.1.smithi141.stdout:8/683: write d14/d19/d1b/d24/d4b/fa9 [531788,4174] 0 2023-12-16T20:11:41.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/684: creat d14/d19/d95/dae/db4/d5b/fd6 x:0 0 0 2023-12-16T20:11:41.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/685: chown d14/d19/d1b/d24/fbd 722123 1 2023-12-16T20:11:41.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/686: stat d14/d71/d81/fcd 0 2023-12-16T20:11:41.673 INFO:tasks.workunit.client.1.smithi141.stdout:2/521: dwrite d6/d12/d15/f4c [0,4194304] 0 2023-12-16T20:11:41.673 INFO:tasks.workunit.client.1.smithi141.stdout:8/687: creat d14/d19/d95/dae/db4/d69/dd4/fd7 x:0 0 0 2023-12-16T20:11:41.673 INFO:tasks.workunit.client.1.smithi141.stdout:2/522: chown d6/da/d1b/d5b/d6a/l6e 1703 1 2023-12-16T20:11:41.673 INFO:tasks.workunit.client.1.smithi141.stdout:2/523: truncate d6/d12/d1f/fa9 525350 0 2023-12-16T20:11:41.675 INFO:tasks.workunit.client.1.smithi141.stdout:2/524: mknod d6/d32/d7a/dad/cb2 0 2023-12-16T20:11:41.675 INFO:tasks.workunit.client.1.smithi141.stdout:2/525: readlink d6/l8 0 2023-12-16T20:11:41.678 INFO:tasks.workunit.client.1.smithi141.stdout:8/688: rename ff to d14/d19/d1b/d24/fd8 0 2023-12-16T20:11:41.678 INFO:tasks.workunit.client.1.smithi141.stdout:8/689: creat d14/d19/d95/dae/db4/d69/dd4/fd9 x:0 0 0 2023-12-16T20:11:41.678 INFO:tasks.workunit.client.1.smithi141.stdout:8/690: fdatasync d14/d71/d81/f75 0 2023-12-16T20:11:41.682 INFO:tasks.workunit.client.1.smithi141.stdout:8/691: rename d14/d19/d95/dae/db4/d58/fb8 to d14/d19/dce/fda 0 2023-12-16T20:11:41.683 INFO:tasks.workunit.client.1.smithi141.stdout:8/692: mknod d14/d19/d95/dae/db4/d58/cdb 0 2023-12-16T20:11:41.683 INFO:tasks.workunit.client.1.smithi141.stdout:8/693: read d14/d19/d1b/d24/fd8 [2433792,28685] 0 2023-12-16T20:11:41.688 INFO:tasks.workunit.client.1.smithi141.stdout:2/526: dwrite d6/d3a/d47/d58/f71 [0,4194304] 0 2023-12-16T20:11:41.688 INFO:tasks.workunit.client.1.smithi141.stdout:2/527: stat d6/da/d33/d54/d73/d80/f9b 0 2023-12-16T20:11:41.696 INFO:tasks.workunit.client.1.smithi141.stdout:2/528: write d6/d3a/d47/d58/d66/f7b [3262087,73037] 0 2023-12-16T20:11:41.698 INFO:tasks.workunit.client.1.smithi141.stdout:2/529: creat d6/d32/d7a/d5f/fb3 x:0 0 0 2023-12-16T20:11:41.698 INFO:tasks.workunit.client.1.smithi141.stdout:2/530: dread - d6/d32/d52/fa2 zero size 2023-12-16T20:11:41.699 INFO:tasks.workunit.client.1.smithi141.stdout:8/694: dwrite d14/f36 [0,4194304] 0 2023-12-16T20:11:41.699 INFO:tasks.workunit.client.1.smithi141.stdout:2/531: symlink d6/d12/d1f/d46/lb4 0 2023-12-16T20:11:41.701 INFO:tasks.workunit.client.1.smithi141.stdout:2/532: mknod d6/d3a/d47/d58/d66/d6c/d98/cb5 0 2023-12-16T20:11:41.701 INFO:tasks.workunit.client.1.smithi141.stdout:2/533: dread - d6/d32/d52/fa2 zero size 2023-12-16T20:11:41.702 INFO:tasks.workunit.client.1.smithi141.stdout:8/695: getdents d14/d19/d95/dae/db4 0 2023-12-16T20:11:41.704 INFO:tasks.workunit.client.1.smithi141.stdout:2/534: rmdir d6/d32/d7a/dad 39 2023-12-16T20:11:41.704 INFO:tasks.workunit.client.1.smithi141.stdout:2/535: creat d6/d12/d1f/d46/d5a/fb6 x:0 0 0 2023-12-16T20:11:41.704 INFO:tasks.workunit.client.1.smithi141.stdout:2/536: creat d6/d12/d1f/d46/d5a/fb7 x:0 0 0 2023-12-16T20:11:41.705 INFO:tasks.workunit.client.1.smithi141.stdout:8/696: creat d14/d19/d1b/d24/dc8/fdc x:0 0 0 2023-12-16T20:11:41.705 INFO:tasks.workunit.client.1.smithi141.stdout:8/697: chown d14/d19/d1b/d3d/d5e/dbe/dc3 1 1 2023-12-16T20:11:41.709 INFO:tasks.workunit.client.1.smithi141.stdout:8/698: symlink d14/d19/d95/dae/db4/d58/ldd 0 2023-12-16T20:11:41.710 INFO:tasks.workunit.client.1.smithi141.stdout:8/699: fsync d14/d35/f70 0 2023-12-16T20:11:41.710 INFO:tasks.workunit.client.1.smithi141.stdout:8/700: write d14/d19/d1b/d24/f55 [1497326,53064] 0 2023-12-16T20:11:41.718 INFO:tasks.workunit.client.1.smithi141.stdout:8/701: write d14/f36 [2295512,93788] 0 2023-12-16T20:11:41.719 INFO:tasks.workunit.client.1.smithi141.stdout:8/702: write d14/d19/d1b/f3f [471044,24078] 0 2023-12-16T20:11:41.720 INFO:tasks.workunit.client.1.smithi141.stdout:8/703: symlink d14/d19/d95/dae/db4/lde 0 2023-12-16T20:11:41.720 INFO:tasks.workunit.client.1.smithi141.stdout:8/704: write d14/f64 [5124745,40874] 0 2023-12-16T20:11:41.721 INFO:tasks.workunit.client.1.smithi141.stdout:2/537: dwrite d6/d12/d1f/d46/d5a/fb6 [0,4194304] 0 2023-12-16T20:11:41.730 INFO:tasks.workunit.client.1.smithi141.stdout:2/538: symlink d6/da/d1b/d5b/d6a/d85/lb8 0 2023-12-16T20:11:41.731 INFO:tasks.workunit.client.1.smithi141.stdout:6/714: sync 2023-12-16T20:11:41.734 INFO:tasks.workunit.client.1.smithi141.stdout:6/715: rename d1/d12/d20/d44/ce2 to d1/ce7 0 2023-12-16T20:11:41.734 INFO:tasks.workunit.client.1.smithi141.stdout:6/716: chown d1/d12/d22/d25/fbb 1281 1 2023-12-16T20:11:41.740 INFO:tasks.workunit.client.1.smithi141.stdout:8/705: dwrite d14/d19/d95/dae/db4/d5b/f5d [4194304,4194304] 0 2023-12-16T20:11:41.740 INFO:tasks.workunit.client.1.smithi141.stdout:8/706: chown d14/d19/d95/dae/db4/d69/dd4/fd7 102 1 2023-12-16T20:11:41.740 INFO:tasks.workunit.client.1.smithi141.stdout:8/707: fsync d14/d19/dce/fda 0 2023-12-16T20:11:41.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/539: dread d6/d12/d1f/d46/f48 [0,4194304] 0 2023-12-16T20:11:41.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/540: write d6/d3a/d47/d58/f72 [215692,36105] 0 2023-12-16T20:11:41.749 INFO:tasks.workunit.client.1.smithi141.stdout:6/717: dread d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:41.751 INFO:tasks.workunit.client.1.smithi141.stdout:6/718: mkdir d1/d12/d20/d85/de5/de8 0 2023-12-16T20:11:41.751 INFO:tasks.workunit.client.1.smithi141.stdout:6/719: chown d1/d12/d22/d25/d38/c61 126388180 1 2023-12-16T20:11:41.752 INFO:tasks.workunit.client.1.smithi141.stdout:8/708: dread d14/d19/d95/dab/fcf [4194304,4194304] 0 2023-12-16T20:11:41.752 INFO:tasks.workunit.client.1.smithi141.stdout:8/709: write d14/d19/d1b/f3a [2746936,117705] 0 2023-12-16T20:11:41.753 INFO:tasks.workunit.client.1.smithi141.stdout:6/720: mkdir d1/d12/d22/d25/de0/de9 0 2023-12-16T20:11:41.755 INFO:tasks.workunit.client.1.smithi141.stdout:6/721: getdents d1/d12/d20/d85 0 2023-12-16T20:11:41.756 INFO:tasks.workunit.client.1.smithi141.stdout:8/710: dread d14/d19/f78 [0,4194304] 0 2023-12-16T20:11:41.756 INFO:tasks.workunit.client.0.smithi038.stdout:8/915: sync 2023-12-16T20:11:41.756 INFO:tasks.workunit.client.0.smithi038.stdout:8/916: truncate d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fde 128987 0 2023-12-16T20:11:41.757 INFO:tasks.workunit.client.1.smithi141.stdout:6/722: getdents d1/d12/d20 0 2023-12-16T20:11:41.757 INFO:tasks.workunit.client.1.smithi141.stdout:6/723: fsync d1/d5e/da9/fda 0 2023-12-16T20:11:41.757 INFO:tasks.workunit.client.0.smithi038.stdout:8/917: symlink d17/d1b/d66/d73/d55/d11a/da9/d50/d7d/dd7/l127 0 2023-12-16T20:11:41.758 INFO:tasks.workunit.client.1.smithi141.stdout:8/711: mkdir d14/d19/dd2/ddf 0 2023-12-16T20:11:41.758 INFO:tasks.workunit.client.1.smithi141.stdout:8/712: chown d14/d19/d1b/d3d/l3b 1 1 2023-12-16T20:11:41.758 INFO:tasks.workunit.client.0.smithi038.stdout:8/918: symlink d17/d1b/l128 0 2023-12-16T20:11:41.758 INFO:tasks.workunit.client.1.smithi141.stdout:6/724: mkdir d1/d12/d22/d25/de0/de9/dea 0 2023-12-16T20:11:41.759 INFO:tasks.workunit.client.1.smithi141.stdout:2/541: dwrite d6/d32/d7a/f99 [0,4194304] 0 2023-12-16T20:11:41.760 INFO:tasks.workunit.client.0.smithi038.stdout:8/919: rename d17/d1b/d66/d73/d54/l123 to d17/d1b/d66/d73/d54/d69/l129 0 2023-12-16T20:11:41.760 INFO:tasks.workunit.client.1.smithi141.stdout:6/725: symlink d1/d5e/leb 0 2023-12-16T20:11:41.760 INFO:tasks.workunit.client.0.smithi038.stdout:8/920: truncate d17/d1b/d66/d73/d55/d11a/da9/d50/d96/dba/f118 6371854 0 2023-12-16T20:11:41.761 INFO:tasks.workunit.client.0.smithi038.stdout:8/921: chown d17/l1c 11 1 2023-12-16T20:11:41.761 INFO:tasks.workunit.client.0.smithi038.stdout:8/922: fdatasync d17/d1b/d66/d73/d55/d11a/f11b 0 2023-12-16T20:11:41.762 INFO:tasks.workunit.client.0.smithi038.stdout:8/923: dread - d17/d1b/d66/d73/d55/d11a/fee zero size 2023-12-16T20:11:41.762 INFO:tasks.workunit.client.0.smithi038.stdout:8/924: write d17/d1b/d57/f65 [324629,329] 0 2023-12-16T20:11:41.765 INFO:tasks.workunit.client.0.smithi038.stdout:8/925: creat d17/d1b/d66/d73/d55/d11a/da9/f12a x:0 0 0 2023-12-16T20:11:41.766 INFO:tasks.workunit.client.0.smithi038.stdout:8/926: symlink d17/d1b/d66/d73/d55/d11a/da9/d59/l12b 0 2023-12-16T20:11:41.767 INFO:tasks.workunit.client.1.smithi141.stdout:2/542: rename d6/d12/d1f/d46/l93 to d6/d12/d1f/lb9 0 2023-12-16T20:11:41.767 INFO:tasks.workunit.client.0.smithi038.stdout:8/927: mknod d17/d1b/d66/d73/d55/da5/da6/c12c 0 2023-12-16T20:11:41.768 INFO:tasks.workunit.client.1.smithi141.stdout:6/726: getdents d1/d12/d22/d25/dc3 0 2023-12-16T20:11:41.769 INFO:tasks.workunit.client.0.smithi038.stdout:8/928: mknod d17/d1b/d66/d73/d55/d11a/da9/d50/c12d 0 2023-12-16T20:11:41.770 INFO:tasks.workunit.client.1.smithi141.stdout:6/727: mkdir d1/d3/d4b/dec 0 2023-12-16T20:11:41.772 INFO:tasks.workunit.client.1.smithi141.stdout:6/728: symlink d1/d12/d20/d44/d4a/led 0 2023-12-16T20:11:41.772 INFO:tasks.workunit.client.1.smithi141.stdout:6/729: write d1/d12/d20/d44/d4a/f79 [190083,115798] 0 2023-12-16T20:11:41.772 INFO:tasks.workunit.client.1.smithi141.stdout:6/730: read - d1/d77/d9e/fc9 zero size 2023-12-16T20:11:41.772 INFO:tasks.workunit.client.0.smithi038.stdout:8/929: rename d17/d1b/d66/d73/d55/da5/da6/c12c to d17/d1b/d66/d73/d54/d69/c12e 0 2023-12-16T20:11:41.773 INFO:tasks.workunit.client.1.smithi141.stdout:6/731: link d1/d12/f33 d1/d12/d20/d44/ddf/fee 0 2023-12-16T20:11:41.774 INFO:tasks.workunit.client.0.smithi038.stdout:8/930: write d17/d1b/d66/d73/d55/d11a/daa/ff7 [201805,57733] 0 2023-12-16T20:11:41.775 INFO:tasks.workunit.client.1.smithi141.stdout:6/732: rename d1/d3/d4b/d60/db8/d69/dd2 to d1/d3/d4b/d60/def 0 2023-12-16T20:11:41.775 INFO:tasks.workunit.client.1.smithi141.stdout:6/733: truncate d1/dd/de/fdc 550943 0 2023-12-16T20:11:41.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/760: sync 2023-12-16T20:11:41.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/761: write d0/d1c/d40/d3f/d52/d5d/fe0 [375617,33244] 0 2023-12-16T20:11:41.776 INFO:tasks.workunit.client.1.smithi141.stdout:1/701: sync 2023-12-16T20:11:41.776 INFO:tasks.workunit.client.1.smithi141.stdout:5/620: sync 2023-12-16T20:11:41.776 INFO:tasks.workunit.client.1.smithi141.stdout:5/621: readlink d0/d14/d2c/d90/l9c 0 2023-12-16T20:11:41.776 INFO:tasks.workunit.client.1.smithi141.stdout:2/543: dread d6/da/d33/d54/d7c/f97 [0,4194304] 0 2023-12-16T20:11:41.777 INFO:tasks.workunit.client.0.smithi038.stdout:8/931: unlink d17/d1b/d66/d73/d55/da5/fb4 0 2023-12-16T20:11:41.778 INFO:tasks.workunit.client.1.smithi141.stdout:8/713: dwrite d14/d19/d95/dae/db4/d5b/f89 [0,4194304] 0 2023-12-16T20:11:41.778 INFO:tasks.workunit.client.1.smithi141.stdout:3/762: creat d0/d1c/d2c/ffa x:0 0 0 2023-12-16T20:11:41.778 INFO:tasks.workunit.client.1.smithi141.stdout:1/702: creat da/d36/d4b/d7c/feb x:0 0 0 2023-12-16T20:11:41.780 INFO:tasks.workunit.client.0.smithi038.stdout:8/932: mkdir d17/d1b/d66/d73/d55/d11a/da9/d50/d7d/d12f 0 2023-12-16T20:11:41.785 INFO:tasks.workunit.client.1.smithi141.stdout:3/763: link d0/d1c/d40/ld7 d0/d1c/d40/d3f/d52/d63/lfb 0 2023-12-16T20:11:41.785 INFO:tasks.workunit.client.1.smithi141.stdout:3/764: readlink d0/d1c/d2c/d72/la0 0 2023-12-16T20:11:41.786 INFO:tasks.workunit.client.1.smithi141.stdout:3/765: fsync d0/d1c/d2c/f87 0 2023-12-16T20:11:41.787 INFO:tasks.workunit.client.1.smithi141.stdout:1/703: unlink da/d1a/d1d/c2e 0 2023-12-16T20:11:41.787 INFO:tasks.workunit.client.1.smithi141.stdout:8/714: symlink d14/d19/d95/dae/db4/le0 0 2023-12-16T20:11:41.795 INFO:tasks.workunit.client.1.smithi141.stdout:3/766: truncate d0/d1c/d40/f43 741526 0 2023-12-16T20:11:41.796 INFO:tasks.workunit.client.1.smithi141.stdout:3/767: write d0/d1c/d40/d3f/d52/d63/fb3 [317112,128922] 0 2023-12-16T20:11:41.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/715: creat d14/d35/dcc/fe1 x:0 0 0 2023-12-16T20:11:41.797 INFO:tasks.workunit.client.1.smithi141.stdout:3/768: mknod d0/d1c/d40/d3f/cfc 0 2023-12-16T20:11:41.798 INFO:tasks.workunit.client.1.smithi141.stdout:8/716: symlink d14/d71/le2 0 2023-12-16T20:11:41.798 INFO:tasks.workunit.client.1.smithi141.stdout:3/769: mkdir d0/d1c/d40/d3f/d52/d5a/df9/df8/dfd 0 2023-12-16T20:11:41.799 INFO:tasks.workunit.client.1.smithi141.stdout:3/770: read - d0/d1c/d40/d3f/d52/fec zero size 2023-12-16T20:11:41.799 INFO:tasks.workunit.client.1.smithi141.stdout:8/717: mknod d14/d19/d95/ce3 0 2023-12-16T20:11:41.800 INFO:tasks.workunit.client.1.smithi141.stdout:1/704: dread da/fac [0,4194304] 0 2023-12-16T20:11:41.800 INFO:tasks.workunit.client.1.smithi141.stdout:3/771: symlink d0/d1c/d40/d3f/d52/d63/lfe 0 2023-12-16T20:11:41.801 INFO:tasks.workunit.client.1.smithi141.stdout:1/705: creat da/d36/d4b/d4d/d89/d61/fec x:0 0 0 2023-12-16T20:11:41.801 INFO:tasks.workunit.client.1.smithi141.stdout:1/706: chown da/d1a/d1d/d33/d7f/fbe 146033445 1 2023-12-16T20:11:41.802 INFO:tasks.workunit.client.1.smithi141.stdout:3/772: creat d0/d1c/d2c/d72/d74/fff x:0 0 0 2023-12-16T20:11:41.802 INFO:tasks.workunit.client.1.smithi141.stdout:3/773: dread - d0/d1c/d6a/d76/da2/fc3 zero size 2023-12-16T20:11:41.802 INFO:tasks.workunit.client.1.smithi141.stdout:1/707: symlink da/d1a/d1d/d22/led 0 2023-12-16T20:11:41.803 INFO:tasks.workunit.client.1.smithi141.stdout:3/774: symlink d0/d1c/d40/d3f/d52/d63/l100 0 2023-12-16T20:11:41.804 INFO:tasks.workunit.client.1.smithi141.stdout:3/775: chown d0/d1c/da9/fd1 25 1 2023-12-16T20:11:41.804 INFO:tasks.workunit.client.1.smithi141.stdout:3/776: fdatasync d0/d1c/d40/f1b 0 2023-12-16T20:11:41.804 INFO:tasks.workunit.client.1.smithi141.stdout:8/718: dread d14/d19/d1b/d24/d4b/fb6 [0,4194304] 0 2023-12-16T20:11:41.804 INFO:tasks.workunit.client.0.smithi038.stdout:8/933: dwrite f16 [4194304,4194304] 0 2023-12-16T20:11:41.805 INFO:tasks.workunit.client.1.smithi141.stdout:5/622: dwrite d0/d14/d2c/d4a/f51 [0,4194304] 0 2023-12-16T20:11:41.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/719: rmdir d14/d19/dd2/ddf 0 2023-12-16T20:11:41.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/720: stat d14/d19/d95/dae/db4/d58 0 2023-12-16T20:11:41.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/721: write d14/f36 [3286943,70455] 0 2023-12-16T20:11:41.806 INFO:tasks.workunit.client.1.smithi141.stdout:5/623: rename d0/dd2/f7e to d0/d25/fd3 0 2023-12-16T20:11:41.806 INFO:tasks.workunit.client.1.smithi141.stdout:5/624: creat d0/d25/d30/d67/fd4 x:0 0 0 2023-12-16T20:11:41.807 INFO:tasks.workunit.client.1.smithi141.stdout:5/625: write d0/d9/d16/d2a/d35/d4c/f9a [385530,11492] 0 2023-12-16T20:11:41.807 INFO:tasks.workunit.client.0.smithi038.stdout:8/934: rename d17/d1b/d66/d73/d55/d11a/da9/d59/ce0 to d17/d1b/d66/d73/d4e/c130 0 2023-12-16T20:11:41.807 INFO:tasks.workunit.client.0.smithi038.stdout:8/935: dread - d17/d1b/d66/d73/dc8/f110 zero size 2023-12-16T20:11:41.808 INFO:tasks.workunit.client.1.smithi141.stdout:2/544: rmdir d6 39 2023-12-16T20:11:41.811 INFO:tasks.workunit.client.1.smithi141.stdout:8/722: truncate d14/d19/d1b/d24/f31 2601231 0 2023-12-16T20:11:41.812 INFO:tasks.workunit.client.1.smithi141.stdout:8/723: chown d14/d19/d1b/lb1 1012888 1 2023-12-16T20:11:41.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/626: rename d0/d25/f7b to d0/d25/dce/dd1/fd5 0 2023-12-16T20:11:41.817 INFO:tasks.workunit.client.1.smithi141.stdout:8/724: mkdir d14/d19/d95/dae/db4/d58/d8b/de4 0 2023-12-16T20:11:41.817 INFO:tasks.workunit.client.0.smithi038.stdout:6/940: sync 2023-12-16T20:11:41.817 INFO:tasks.workunit.client.0.smithi038.stdout:4/995: sync 2023-12-16T20:11:41.818 INFO:tasks.workunit.client.1.smithi141.stdout:6/734: getdents d1/d3/d4b/d60 0 2023-12-16T20:11:41.819 INFO:tasks.workunit.client.0.smithi038.stdout:6/941: mknod d1/d5b/d7d/dc6/c12b 0 2023-12-16T20:11:41.819 INFO:tasks.workunit.client.0.smithi038.stdout:6/942: readlink d1/d4/lcf 0 2023-12-16T20:11:41.819 INFO:tasks.workunit.client.0.smithi038.stdout:6/943: fsync d1/f39 0 2023-12-16T20:11:41.820 INFO:tasks.workunit.client.0.smithi038.stdout:6/944: write d1/d5b/d7d/d9d/dc8/de7/f79 [218666,29573] 0 2023-12-16T20:11:41.820 INFO:tasks.workunit.client.1.smithi141.stdout:5/627: rmdir d0/d25/dce/dd1 39 2023-12-16T20:11:41.820 INFO:tasks.workunit.client.1.smithi141.stdout:5/628: truncate d0/d9/d16/d2a/d35/d4c/f8d 545210 0 2023-12-16T20:11:41.823 INFO:tasks.workunit.client.0.smithi038.stdout:6/945: truncate d1/d5b/d7d/d9d/dc8/de7/f7a 98925 0 2023-12-16T20:11:41.825 INFO:tasks.workunit.client.1.smithi141.stdout:8/725: rename d14/d35/l40 to d14/d19/d1b/d24/le5 0 2023-12-16T20:11:41.825 INFO:tasks.workunit.client.1.smithi141.stdout:8/726: readlink d14/d35/l84 0 2023-12-16T20:11:41.828 INFO:tasks.workunit.client.1.smithi141.stdout:8/727: unlink d14/c39 0 2023-12-16T20:11:41.830 INFO:tasks.workunit.client.1.smithi141.stdout:8/728: unlink d14/d19/f1c 0 2023-12-16T20:11:41.832 INFO:tasks.workunit.client.1.smithi141.stdout:6/735: read d1/d12/d22/f64 [1004148,32230] 0 2023-12-16T20:11:41.833 INFO:tasks.workunit.client.1.smithi141.stdout:8/729: creat d14/d19/d1b/d3d/d5e/fe6 x:0 0 0 2023-12-16T20:11:41.834 INFO:tasks.workunit.client.1.smithi141.stdout:8/730: creat d14/d19/d95/fe7 x:0 0 0 2023-12-16T20:11:41.840 INFO:tasks.workunit.client.1.smithi141.stdout:0/628: sync 2023-12-16T20:11:41.840 INFO:tasks.workunit.client.1.smithi141.stdout:9/590: sync 2023-12-16T20:11:41.840 INFO:tasks.workunit.client.1.smithi141.stdout:4/601: sync 2023-12-16T20:11:41.840 INFO:tasks.workunit.client.1.smithi141.stdout:7/664: sync 2023-12-16T20:11:41.841 INFO:tasks.workunit.client.1.smithi141.stdout:9/591: truncate d1/d10/f6c 4109344 0 2023-12-16T20:11:41.842 INFO:tasks.workunit.client.1.smithi141.stdout:0/629: creat d4/d49/d73/fd9 x:0 0 0 2023-12-16T20:11:41.843 INFO:tasks.workunit.client.1.smithi141.stdout:3/777: dwrite d0/d1c/d40/d3f/d52/d5a/df9/fe1 [0,4194304] 0 2023-12-16T20:11:41.843 INFO:tasks.workunit.client.1.smithi141.stdout:3/778: creat d0/f101 x:0 0 0 2023-12-16T20:11:41.844 INFO:tasks.workunit.client.1.smithi141.stdout:7/665: unlink d5/fd0 0 2023-12-16T20:11:41.844 INFO:tasks.workunit.client.0.smithi038.stdout:6/946: dwrite d1/d4/d1d/f11c [0,4194304] 0 2023-12-16T20:11:41.844 INFO:tasks.workunit.client.0.smithi038.stdout:6/947: write d1/d16/d23/fb8 [14612,8759] 0 2023-12-16T20:11:41.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/602: link f15 d1a/d4e/d63/dd1/fd9 0 2023-12-16T20:11:41.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/603: chown d1a/d2a/d3b/d69/l85 32825519 1 2023-12-16T20:11:41.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/604: chown d1a/d54/d87/da8/l74 3159 1 2023-12-16T20:11:41.847 INFO:tasks.workunit.client.0.smithi038.stdout:6/948: getdents d1/d5b/d7d/d9d/dc8/de7 0 2023-12-16T20:11:41.848 INFO:tasks.workunit.client.1.smithi141.stdout:3/779: mknod d0/d1c/da9/c102 0 2023-12-16T20:11:41.848 INFO:tasks.workunit.client.1.smithi141.stdout:7/666: getdents d5/d1d/d89/d9b 0 2023-12-16T20:11:41.849 INFO:tasks.workunit.client.1.smithi141.stdout:8/731: dread d14/d35/f66 [0,4194304] 0 2023-12-16T20:11:41.850 INFO:tasks.workunit.client.1.smithi141.stdout:8/732: read d14/f23 [172515,128481] 0 2023-12-16T20:11:41.850 INFO:tasks.workunit.client.0.smithi038.stdout:6/949: mknod d1/d5b/d7d/d9d/dc8/de7/c12c 0 2023-12-16T20:11:41.851 INFO:tasks.workunit.client.1.smithi141.stdout:2/545: dwrite d6/da/d4a/d5e/f88 [0,4194304] 0 2023-12-16T20:11:41.851 INFO:tasks.workunit.client.1.smithi141.stdout:1/708: dwrite da/d36/d4b/d4d/d80/d94/fc4 [0,4194304] 0 2023-12-16T20:11:41.851 INFO:tasks.workunit.client.1.smithi141.stdout:7/667: link d5/d2a/d45/d5a/l69 d5/d16/d1a/le0 0 2023-12-16T20:11:41.855 INFO:tasks.workunit.client.1.smithi141.stdout:9/592: dread d1/d10/d14/f25 [0,4194304] 0 2023-12-16T20:11:41.855 INFO:tasks.workunit.client.1.smithi141.stdout:9/593: chown d1/d10/fb6 0 1 2023-12-16T20:11:41.855 INFO:tasks.workunit.client.0.smithi038.stdout:6/950: dread d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f8d [0,4194304] 0 2023-12-16T20:11:41.857 INFO:tasks.workunit.client.0.smithi038.stdout:4/996: dwrite d13/d69/d7a/fcd [0,4194304] 0 2023-12-16T20:11:41.858 INFO:tasks.workunit.client.0.smithi038.stdout:8/936: dwrite d17/d1b/d66/d73/d55/d11a/daa/f10f [4194304,4194304] 0 2023-12-16T20:11:41.859 INFO:tasks.workunit.client.1.smithi141.stdout:1/709: chown da/c14 3693706 1 2023-12-16T20:11:41.860 INFO:tasks.workunit.client.1.smithi141.stdout:8/733: rename d14/d19/d1b/d24/d4b/d8f/fc6 to d14/fe8 0 2023-12-16T20:11:41.862 INFO:tasks.workunit.client.1.smithi141.stdout:3/780: write d0/d1c/d40/d3f/d52/f7b [3179059,49370] 0 2023-12-16T20:11:41.862 INFO:tasks.workunit.client.1.smithi141.stdout:3/781: write d0/d1c/d40/f43 [1442318,16623] 0 2023-12-16T20:11:41.862 INFO:tasks.workunit.client.1.smithi141.stdout:3/782: chown d0/d1c/d40/d85/lb6 1161 1 2023-12-16T20:11:41.863 INFO:tasks.workunit.client.0.smithi038.stdout:8/937: getdents d17/d5a 0 2023-12-16T20:11:41.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/594: mkdir d1/d10/d14/d20/d90/dca 0 2023-12-16T20:11:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:8/938: symlink d17/d1b/d66/d73/d4e/l131 0 2023-12-16T20:11:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:6/951: truncate d1/d16/d23/fb8 3087406 0 2023-12-16T20:11:41.870 INFO:tasks.workunit.client.0.smithi038.stdout:6/952: write d1/d4/d1d/d61/da4/fc2 [336402,23851] 0 2023-12-16T20:11:41.872 INFO:tasks.workunit.client.0.smithi038.stdout:6/953: mkdir d1/d16/d23/d104/d12d 0 2023-12-16T20:11:41.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/668: rename d5/d1d/c81 to d5/d1d/d89/ce1 0 2023-12-16T20:11:41.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/669: fdatasync d5/d2a/f34 0 2023-12-16T20:11:41.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/670: truncate d5/d16/d30/d4e/f72 484992 0 2023-12-16T20:11:41.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/671: write d5/d1d/d1e/d71/fc6 [980654,20373] 0 2023-12-16T20:11:41.874 INFO:tasks.workunit.client.1.smithi141.stdout:7/672: creat d5/d1d/d1e/d71/fe2 x:0 0 0 2023-12-16T20:11:41.874 INFO:tasks.workunit.client.1.smithi141.stdout:7/673: chown d5/d16/d46/f5d 1947 1 2023-12-16T20:11:41.874 INFO:tasks.workunit.client.1.smithi141.stdout:7/674: write d5/d1d/d89/fa6 [1589033,98911] 0 2023-12-16T20:11:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:4/997: write d13/d17/d4b/da4/d34/d123/d84/d88/dc3/de9/f65 [3816959,35090] 0 2023-12-16T20:11:41.879 INFO:tasks.workunit.client.0.smithi038.stdout:4/998: creat d13/f154 x:0 0 0 2023-12-16T20:11:41.882 INFO:tasks.workunit.client.1.smithi141.stdout:7/675: truncate d5/d2a/fa9 1450587 0 2023-12-16T20:11:41.888 INFO:tasks.workunit.client.1.smithi141.stdout:3/783: dread d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:41.890 INFO:tasks.workunit.client.1.smithi141.stdout:4/605: dwrite d1a/d2a/f37 [0,4194304] 0 2023-12-16T20:11:41.890 INFO:tasks.workunit.client.1.smithi141.stdout:4/606: truncate d1a/d2a/f31 1165673 0 2023-12-16T20:11:41.892 INFO:tasks.workunit.client.1.smithi141.stdout:4/607: creat d1a/d2a/d3b/dcd/fda x:0 0 0 2023-12-16T20:11:41.892 INFO:tasks.workunit.client.1.smithi141.stdout:4/608: truncate d1a/d3c/fd3 902525 0 2023-12-16T20:11:41.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:41 smithi038 ceph-mon[80659]: pgmap v9: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 281 MiB/s rd, 363 MiB/s wr, 507 op/s 2023-12-16T20:11:41.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:41 smithi038 ceph-mon[80659]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:41.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:41 smithi038 ceph-mon[80659]: mgrmap e25: smithi141.cycgjd(active, since 12s), standbys: smithi038.gdlrfj 2023-12-16T20:11:41.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:41 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:11:41.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/609: dread d1a/d2a/f76 [0,4194304] 0 2023-12-16T20:11:41.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/610: readlink d1a/d54/l60 0 2023-12-16T20:11:41.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/611: write d1a/d2a/f31 [1526307,6439] 0 2023-12-16T20:11:41.896 INFO:tasks.workunit.client.1.smithi141.stdout:4/612: creat d1a/d3c/d9b/da1/fdb x:0 0 0 2023-12-16T20:11:41.899 INFO:tasks.workunit.client.1.smithi141.stdout:4/613: creat d1a/d4e/d63/dd1/fdc x:0 0 0 2023-12-16T20:11:41.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/954: dwrite d1/d4/d1d/d67/d73/f98 [0,4194304] 0 2023-12-16T20:11:41.899 INFO:tasks.workunit.client.0.smithi038.stdout:6/955: read - d1/d5b/d7d/d9d/f12a zero size 2023-12-16T20:11:41.899 INFO:tasks.workunit.client.0.smithi038.stdout:4/999: read d13/d17/d4b/da4/d34/d123/f145 [819244,122237] 0 2023-12-16T20:11:41.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/614: mknod d1a/d4e/d63/daa/cdd 0 2023-12-16T20:11:41.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/615: creat d1a/d59/d89/d8a/fde x:0 0 0 2023-12-16T20:11:41.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/616: creat d1a/d4e/d63/fdf x:0 0 0 2023-12-16T20:11:41.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/617: write d1a/d54/d87/da8/f99 [1320213,53988] 0 2023-12-16T20:11:41.900 INFO:tasks.workunit.client.1.smithi141.stdout:4/618: truncate d1a/f29 440154 0 2023-12-16T20:11:41.903 INFO:tasks.workunit.client.1.smithi141.stdout:4/619: rmdir d1a/d3c/d9b/da1/dcf 39 2023-12-16T20:11:41.905 INFO:tasks.workunit.client.0.smithi038.stdout:6/956: rmdir d1/d5b/d7d/d9d 39 2023-12-16T20:11:41.906 INFO:tasks.workunit.client.1.smithi141.stdout:4/620: rename d1a/d54/f98 to d1a/d3c/d9b/fe0 0 2023-12-16T20:11:41.906 INFO:tasks.workunit.client.1.smithi141.stdout:4/621: dread - d1a/d54/d87/da8/da9/fb3 zero size 2023-12-16T20:11:41.906 INFO:tasks.workunit.client.1.smithi141.stdout:4/622: chown d1a/d54/d87/lbc 821052 1 2023-12-16T20:11:41.906 INFO:tasks.workunit.client.1.smithi141.stdout:4/623: write d1a/d3c/fd2 [1045989,110564] 0 2023-12-16T20:11:41.906 INFO:tasks.workunit.client.1.smithi141.stdout:4/624: chown d1a/d59/d89/d8a/fde 2 1 2023-12-16T20:11:41.907 INFO:tasks.workunit.client.0.smithi038.stdout:6/957: creat d1/d5b/d7d/d9d/dc8/de7/db1/dbe/f12e x:0 0 0 2023-12-16T20:11:41.908 INFO:tasks.workunit.client.0.smithi038.stdout:6/958: creat d1/d4/d1d/d8e/dea/f12f x:0 0 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:0/630: dwrite d4/d7/f1e [0,4194304] 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:0/631: chown d4/d7/l29 440657064 1 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:0/632: read d4/d49/d73/d3b/f79 [271704,101780] 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:4/625: link d1a/d2a/d3b/d69/f80 d1a/d54/d87/fe1 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:1/710: dwrite da/d36/d4b/d4d/d80/d94/fa8 [0,4194304] 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:8/734: dwrite d14/d19/d1b/d3d/f96 [4194304,4194304] 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:8/735: readlink d14/d19/d1b/d24/le5 0 2023-12-16T20:11:41.909 INFO:tasks.workunit.client.1.smithi141.stdout:8/736: chown d14/d19/d1b/d24/dc8/fdc 956102 1 2023-12-16T20:11:41.910 INFO:tasks.workunit.client.1.smithi141.stdout:2/546: dwrite d6/da/d1b/f27 [0,4194304] 0 2023-12-16T20:11:41.910 INFO:tasks.workunit.client.0.smithi038.stdout:6/959: link d1/d16/c1f d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/c130 0 2023-12-16T20:11:41.910 INFO:tasks.workunit.client.0.smithi038.stdout:6/960: stat d1/d16/d23/fb7 0 2023-12-16T20:11:41.910 INFO:tasks.workunit.client.0.smithi038.stdout:8/939: dwrite d17/d1b/d66/d73/d55/d11a/da9/f107 [4194304,4194304] 0 2023-12-16T20:11:41.911 INFO:tasks.workunit.client.1.smithi141.stdout:0/633: link d4/c37 d4/d5c/daf/cda 0 2023-12-16T20:11:41.912 INFO:tasks.workunit.client.1.smithi141.stdout:0/634: write d4/d49/d73/d3b/d78/d7f/f90 [1890548,2067] 0 2023-12-16T20:11:41.912 INFO:tasks.workunit.client.1.smithi141.stdout:0/635: chown d4/d49/d73/d8a/l9e 28 1 2023-12-16T20:11:41.915 INFO:tasks.workunit.client.0.smithi038.stdout:6/961: link d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/fcd d1/d5b/d7d/d9d/dc8/de7/db1/f131 0 2023-12-16T20:11:41.917 INFO:tasks.workunit.client.1.smithi141.stdout:1/711: dread da/d36/d4b/d4d/d89/f2a [0,4194304] 0 2023-12-16T20:11:41.918 INFO:tasks.workunit.client.1.smithi141.stdout:8/737: rename d14/d19/d95/dae/db4/d58/fa5 to d14/d71/d81/fe9 0 2023-12-16T20:11:41.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/626: symlink d1a/d54/le2 0 2023-12-16T20:11:41.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/627: chown d1a/d3c/d9b/da1/da6/fd8 1377 1 2023-12-16T20:11:41.921 INFO:tasks.workunit.client.0.smithi038.stdout:6/962: mkdir d1/d5b/d7d/d9d/dc8/de7/db1/d132 0 2023-12-16T20:11:41.921 INFO:tasks.workunit.client.1.smithi141.stdout:2/547: dread d6/d12/d1f/d46/d5a/f76 [0,4194304] 0 2023-12-16T20:11:41.921 INFO:tasks.workunit.client.1.smithi141.stdout:4/628: write d1a/d2a/d3b/d69/fd7 [4300005,104173] 0 2023-12-16T20:11:41.922 INFO:tasks.workunit.client.1.smithi141.stdout:4/629: stat d1a/f20 0 2023-12-16T20:11:41.922 INFO:tasks.workunit.client.1.smithi141.stdout:1/712: creat da/d36/d4b/d4d/dd7/de1/fee x:0 0 0 2023-12-16T20:11:41.923 INFO:tasks.workunit.client.1.smithi141.stdout:8/738: mkdir d14/d19/d95/dae/db4/d5b/dea 0 2023-12-16T20:11:41.923 INFO:tasks.workunit.client.1.smithi141.stdout:8/739: chown d14/d19/d95/dae/db4/f5a 32 1 2023-12-16T20:11:41.923 INFO:tasks.workunit.client.1.smithi141.stdout:0/636: write d4/d7/f50 [2070838,395] 0 2023-12-16T20:11:41.924 INFO:tasks.workunit.client.0.smithi038.stdout:6/963: mkdir d1/d5b/d7d/df4/d133 0 2023-12-16T20:11:41.927 INFO:tasks.workunit.client.1.smithi141.stdout:8/740: mkdir d14/d19/d95/dae/db4/d5b/dea/deb 0 2023-12-16T20:11:41.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/741: truncate d14/d19/d1b/d3d/f77 2822828 0 2023-12-16T20:11:41.931 INFO:tasks.workunit.client.1.smithi141.stdout:8/742: write d14/d19/d1b/d24/d4b/d8c/fa6 [774084,123919] 0 2023-12-16T20:11:41.933 INFO:tasks.workunit.client.1.smithi141.stdout:8/743: rename d14/d19/d95/dab/fb5 to d14/d19/d95/fec 0 2023-12-16T20:11:41.933 INFO:tasks.workunit.client.0.smithi038.stdout:8/940: dwrite d17/d1b/d66/d73/d55/d11a/da9/d50/ddd/df9/ff3 [0,4194304] 0 2023-12-16T20:11:41.934 INFO:tasks.workunit.client.1.smithi141.stdout:2/548: write d6/d32/d7a/f51 [3061731,120719] 0 2023-12-16T20:11:41.936 INFO:tasks.workunit.client.0.smithi038.stdout:8/941: unlink d17/d1b/d57/d90/f105 0 2023-12-16T20:11:41.936 INFO:tasks.workunit.client.0.smithi038.stdout:6/964: dread d1/d4/d1d/d67/d73/f98 [0,4194304] 0 2023-12-16T20:11:41.936 INFO:tasks.workunit.client.0.smithi038.stdout:6/965: chown d1/d4/d1d/c9b 21729711 1 2023-12-16T20:11:41.936 INFO:tasks.workunit.client.0.smithi038.stdout:6/966: fdatasync d1/d5b/d7d/d9d/dc8/de7/db1/dbe/db3/fb5 0 2023-12-16T20:11:41.937 INFO:tasks.workunit.client.0.smithi038.stdout:6/967: creat d1/d4/d1d/d8e/dbf/f134 x:0 0 0 2023-12-16T20:11:41.937 INFO:tasks.workunit.client.0.smithi038.stdout:6/968: chown d1/d126 834318 1 2023-12-16T20:11:41.937 INFO:tasks.workunit.client.0.smithi038.stdout:6/969: write d1/d5b/d7d/d9d/dc8/de7/db1/fb9 [4994641,1146] 0 2023-12-16T20:11:41.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/713: dread da/d36/f66 [0,4194304] 0 2023-12-16T20:11:41.940 INFO:tasks.workunit.client.1.smithi141.stdout:4/630: dwrite d1a/d3c/d9b/fe0 [0,4194304] 0 2023-12-16T20:11:41.940 INFO:tasks.workunit.client.1.smithi141.stdout:4/631: truncate d1a/d2a/f37 4562231 0 2023-12-16T20:11:41.943 INFO:tasks.workunit.client.1.smithi141.stdout:2/549: creat d6/d32/d52/fba x:0 0 0 2023-12-16T20:11:41.948 INFO:tasks.workunit.client.1.smithi141.stdout:8/744: dread d14/f43 [0,4194304] 0 2023-12-16T20:11:41.948 INFO:tasks.workunit.client.1.smithi141.stdout:8/745: creat d14/d19/d95/dae/db4/d58/fed x:0 0 0 2023-12-16T20:11:41.952 INFO:tasks.workunit.client.1.smithi141.stdout:8/746: truncate d14/d19/d1b/d24/d4b/f97 3784002 0 2023-12-16T20:11:41.952 INFO:tasks.workunit.client.1.smithi141.stdout:8/747: write d14/d71/d81/f75 [177973,48743] 0 2023-12-16T20:11:41.954 INFO:tasks.workunit.client.1.smithi141.stdout:8/748: mknod d14/d19/d95/dae/db4/d5b/dea/deb/cee 0 2023-12-16T20:11:41.956 INFO:tasks.workunit.client.1.smithi141.stdout:8/749: mknod d14/d19/d1b/cef 0 2023-12-16T20:11:41.956 INFO:tasks.workunit.client.1.smithi141.stdout:8/750: chown d14/l6f 111 1 2023-12-16T20:11:41.956 INFO:tasks.workunit.client.1.smithi141.stdout:8/751: truncate d14/d19/d1b/d24/d4b/fa9 4439860 0 2023-12-16T20:11:41.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/752: creat d14/d19/d1b/d24/ff0 x:0 0 0 2023-12-16T20:11:41.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/753: write d14/d19/d1b/f1a [4447257,84416] 0 2023-12-16T20:11:41.959 INFO:tasks.workunit.client.1.smithi141.stdout:2/550: write d6/da/d1b/f30 [747884,38005] 0 2023-12-16T20:11:41.959 INFO:tasks.workunit.client.1.smithi141.stdout:2/551: dread - d6/da/d1b/d5b/d6a/d85/f9c zero size 2023-12-16T20:11:41.960 INFO:tasks.workunit.client.1.smithi141.stdout:8/754: write d14/d35/fbb [501404,87472] 0 2023-12-16T20:11:41.961 INFO:tasks.workunit.client.1.smithi141.stdout:2/552: truncate d6/d32/d52/d53/f8d 835310 0 2023-12-16T20:11:41.961 INFO:tasks.workunit.client.1.smithi141.stdout:4/632: dread d1a/d54/f6a [0,4194304] 0 2023-12-16T20:11:41.961 INFO:tasks.workunit.client.1.smithi141.stdout:4/633: creat d1a/d4e/d63/dd1/fe3 x:0 0 0 2023-12-16T20:11:41.962 INFO:tasks.workunit.client.1.smithi141.stdout:2/553: mknod d6/d3a/d47/d58/d66/cbb 0 2023-12-16T20:11:41.962 INFO:tasks.workunit.client.1.smithi141.stdout:2/554: write d6/d12/d1f/d46/d5a/fb7 [341439,648] 0 2023-12-16T20:11:41.962 INFO:tasks.workunit.client.1.smithi141.stdout:2/555: stat d6/d32/d7a/dad 0 2023-12-16T20:11:41.964 INFO:tasks.workunit.client.1.smithi141.stdout:1/714: dwrite da/d1a/f51 [0,4194304] 0 2023-12-16T20:11:41.965 INFO:tasks.workunit.client.0.smithi038.stdout:8/942: dwrite d17/d1b/d66/d73/d55/d11a/da9/f4c [4194304,4194304] 0 2023-12-16T20:11:41.970 INFO:tasks.workunit.client.0.smithi038.stdout:8/943: rename d17/d1b/d66/d73/d54/d69/c44 to d17/d1b/d66/d73/d55/d11a/da9/d59/d108/c132 0 2023-12-16T20:11:41.970 INFO:tasks.workunit.client.0.smithi038.stdout:8/944: symlink d17/d1b/d66/d73/d55/da5/da6/l133 0 2023-12-16T20:11:41.970 INFO:tasks.workunit.client.0.smithi038.stdout:8/945: write d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fff [551376,68002] 0 2023-12-16T20:11:41.970 INFO:tasks.workunit.client.0.smithi038.stdout:8/946: stat d17/d1b/d66/d73/d55/d11a/da9/d50/d96 0 2023-12-16T20:11:41.973 INFO:tasks.workunit.client.1.smithi141.stdout:8/755: dread d14/d19/d1b/d24/fbd [0,4194304] 0 2023-12-16T20:11:41.977 INFO:tasks.workunit.client.1.smithi141.stdout:8/756: dread d14/d71/d81/f75 [0,4194304] 0 2023-12-16T20:11:41.986 INFO:tasks.workunit.client.1.smithi141.stdout:1/715: creat da/d36/d4b/d4d/dd7/fef x:0 0 0 2023-12-16T20:11:41.986 INFO:tasks.workunit.client.1.smithi141.stdout:1/716: creat da/d1a/d1d/ff0 x:0 0 0 2023-12-16T20:11:41.986 INFO:tasks.workunit.client.1.smithi141.stdout:1/717: truncate da/d1a/d1d/fd8 629490 0 2023-12-16T20:11:41.986 INFO:tasks.workunit.client.1.smithi141.stdout:1/718: chown da/d36/c38 1041898 1 2023-12-16T20:11:41.986 INFO:tasks.workunit.client.1.smithi141.stdout:1/719: truncate da/d36/f8d 654098 0 2023-12-16T20:11:41.987 INFO:tasks.workunit.client.1.smithi141.stdout:8/757: unlink d14/d19/d1b/d3d/f37 0 2023-12-16T20:11:41.989 INFO:tasks.workunit.client.1.smithi141.stdout:1/720: mknod da/d36/d4b/d4d/d80/d94/cf1 0 2023-12-16T20:11:41.990 INFO:tasks.workunit.client.1.smithi141.stdout:8/758: truncate d14/d19/f78 26748 0 2023-12-16T20:11:41.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:41 smithi141 ceph-mon[88165]: pgmap v9: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 281 MiB/s rd, 363 MiB/s wr, 507 op/s 2023-12-16T20:11:41.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:41 smithi141 ceph-mon[88165]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:11:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:41 smithi141 ceph-mon[88165]: mgrmap e25: smithi141.cycgjd(active, since 12s), standbys: smithi038.gdlrfj 2023-12-16T20:11:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:41 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:11:42.026 INFO:tasks.workunit.client.0.smithi038.stdout:8/947: unlink d17/d1b/d66/d73/d55/d11a/da9/d59/d108/c132 0 2023-12-16T20:11:42.028 INFO:tasks.workunit.client.1.smithi141.stdout:2/556: dwrite d6/f1d [0,4194304] 0 2023-12-16T20:11:42.030 INFO:tasks.workunit.client.1.smithi141.stdout:2/557: mknod d6/da/d33/d54/d73/cbc 0 2023-12-16T20:11:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/948: rename d17/d1b/d66/f72 to d17/d1b/d57/d90/f134 0 2023-12-16T20:11:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/949: chown d17/d1b/d66/d73/d55/d11a/l10e 171 1 2023-12-16T20:11:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/950: dread - d17/f101 zero size 2023-12-16T20:11:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/951: truncate d17/d34/f92 425225 0 2023-12-16T20:11:42.032 INFO:tasks.workunit.client.0.smithi038.stdout:8/952: mknod d17/d1b/d66/d73/d55/d11a/da9/d50/dc4/c135 0 2023-12-16T20:11:42.032 INFO:tasks.workunit.client.0.smithi038.stdout:8/953: fsync d17/f38 0 2023-12-16T20:11:42.035 INFO:tasks.workunit.client.1.smithi141.stdout:2/558: read d6/da/d33/d54/d73/f79 [68806,94082] 0 2023-12-16T20:11:42.045 INFO:tasks.workunit.client.1.smithi141.stdout:8/759: dwrite d14/d19/d95/dae/db4/d69/dd4/fd7 [0,4194304] 0 2023-12-16T20:11:42.046 INFO:tasks.workunit.client.1.smithi141.stdout:8/760: fsync d14/d19/dce/fda 0 2023-12-16T20:11:42.046 INFO:tasks.workunit.client.1.smithi141.stdout:1/721: dwrite da/f79 [0,4194304] 0 2023-12-16T20:11:42.046 INFO:tasks.workunit.client.1.smithi141.stdout:1/722: dread - da/d1a/d31/d81/fa9 zero size 2023-12-16T20:11:42.046 INFO:tasks.workunit.client.1.smithi141.stdout:1/723: chown da/d7a/fa5 11 1 2023-12-16T20:11:42.048 INFO:tasks.workunit.client.1.smithi141.stdout:2/559: read d6/d3a/d47/f65 [1986395,38335] 0 2023-12-16T20:11:42.048 INFO:tasks.workunit.client.1.smithi141.stdout:2/560: write d6/d12/d1f/fa9 [569830,51149] 0 2023-12-16T20:11:42.051 INFO:tasks.workunit.client.1.smithi141.stdout:2/561: symlink d6/d32/d7a/dad/lbd 0 2023-12-16T20:11:42.052 INFO:tasks.workunit.client.1.smithi141.stdout:8/761: rmdir d14/d19/d95/dae/db4/d58/d8b 39 2023-12-16T20:11:42.053 INFO:tasks.workunit.client.1.smithi141.stdout:8/762: creat d14/d19/ff1 x:0 0 0 2023-12-16T20:11:42.053 INFO:tasks.workunit.client.0.smithi038.stdout:8/954: unlink d17/d34/f92 0 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/955: rmdir d17/d1b/d66/d73/d55/d11a/da9 39 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/956: stat d17/d1b/d66/d73/d55/d11a/da9/d50/d96/lfb 0 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/957: fdatasync f10 0 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/958: creat d17/d1b/d66/d73/f136 x:0 0 0 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/959: fsync d17/d1b/d57/d90/ffd 0 2023-12-16T20:11:42.057 INFO:tasks.workunit.client.0.smithi038.stdout:8/960: truncate d17/d1b/d66/d8e/d97/fe9 585779 0 2023-12-16T20:11:42.123 INFO:tasks.workunit.client.1.smithi141.stdout:2/562: dwrite d6/d32/d7a/d5f/fb3 [0,4194304] 0 2023-12-16T20:11:42.124 INFO:tasks.workunit.client.1.smithi141.stdout:1/724: dread da/d67/f26 [0,4194304] 0 2023-12-16T20:11:42.127 INFO:tasks.workunit.client.1.smithi141.stdout:1/725: dread da/d67/f8e [0,4194304] 0 2023-12-16T20:11:42.127 INFO:tasks.workunit.client.1.smithi141.stdout:8/763: dread d14/d19/d95/dae/db4/f9b [0,4194304] 0 2023-12-16T20:11:42.127 INFO:tasks.workunit.client.1.smithi141.stdout:2/563: creat d6/da/d4a/fbe x:0 0 0 2023-12-16T20:11:42.127 INFO:tasks.workunit.client.1.smithi141.stdout:2/564: fdatasync d6/d3a/d47/d58/f72 0 2023-12-16T20:11:42.127 INFO:tasks.workunit.client.1.smithi141.stdout:2/565: rename d6/da/d1b to d6/da/d1b/d5b/d6a/d85/dbf 22 2023-12-16T20:11:42.128 INFO:tasks.workunit.client.1.smithi141.stdout:1/726: creat da/d1a/db0/ff2 x:0 0 0 2023-12-16T20:11:42.130 INFO:tasks.workunit.client.1.smithi141.stdout:1/727: mknod da/d36/d4b/d4d/d80/d94/d9d/cf3 0 2023-12-16T20:11:42.132 INFO:tasks.workunit.client.1.smithi141.stdout:1/728: unlink da/d36/d4b/d4d/dd7/de1/fee 0 2023-12-16T20:11:42.132 INFO:tasks.workunit.client.1.smithi141.stdout:1/729: write da/d1a/db0/ff2 [764089,67691] 0 2023-12-16T20:11:42.140 INFO:tasks.workunit.client.1.smithi141.stdout:8/764: dread d14/d19/d95/dae/db4/d5b/f7e [0,4194304] 0 2023-12-16T20:11:42.141 INFO:tasks.workunit.client.1.smithi141.stdout:2/566: write d6/d12/f29 [3447889,59896] 0 2023-12-16T20:11:42.141 INFO:tasks.workunit.client.0.smithi038.stdout:8/961: dwrite d17/d1b/d66/d73/dc8/f110 [0,4194304] 0 2023-12-16T20:11:42.143 INFO:tasks.workunit.client.1.smithi141.stdout:8/765: mknod d14/d19/d95/dab/cf2 0 2023-12-16T20:11:42.143 INFO:tasks.workunit.client.1.smithi141.stdout:8/766: rename d14/d19/d95/dae/db4/d5b to d14/d19/d95/dae/db4/d5b/df3 22 2023-12-16T20:11:42.143 INFO:tasks.workunit.client.1.smithi141.stdout:8/767: creat d14/d19/d95/dae/db4/d69/dd4/ff4 x:0 0 0 2023-12-16T20:11:42.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/962: mkdir d17/d1b/d66/d73/d55/d11a/da9/d59/d137 0 2023-12-16T20:11:42.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/963: chown d17/d1b/d66/d73/d55/d11a/da9/d50/c12d 18 1 2023-12-16T20:11:42.146 INFO:tasks.workunit.client.1.smithi141.stdout:8/768: symlink d14/d19/d1b/lf5 0 2023-12-16T20:11:42.148 INFO:tasks.workunit.client.1.smithi141.stdout:8/769: creat d14/d19/d95/dae/db4/d69/ff6 x:0 0 0 2023-12-16T20:11:42.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/964: getdents d17/d1b/d66/d73/dc8 0 2023-12-16T20:11:42.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/965: write d17/d1b/d66/d73/d55/d11a/fa4 [876102,46326] 0 2023-12-16T20:11:42.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/966: stat d17/d1b/d66/d73/dc8/lce 0 2023-12-16T20:11:42.150 INFO:tasks.workunit.client.0.smithi038.stdout:8/967: mknod d17/d34/c138 0 2023-12-16T20:11:42.151 INFO:tasks.workunit.client.0.smithi038.stdout:8/968: chown d17/d1b/d25/db7/c39 116 1 2023-12-16T20:11:42.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/969: write d17/d1b/d57/d90/f134 [1042658,111926] 0 2023-12-16T20:11:42.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/970: chown d17/d1b/d66/d73/d55/c70 0 1 2023-12-16T20:11:42.160 INFO:tasks.workunit.client.1.smithi141.stdout:2/567: dwrite d6/d32/d52/fa2 [0,4194304] 0 2023-12-16T20:11:42.161 INFO:tasks.workunit.client.1.smithi141.stdout:6/736: sync 2023-12-16T20:11:42.161 INFO:tasks.workunit.client.1.smithi141.stdout:9/595: sync 2023-12-16T20:11:42.161 INFO:tasks.workunit.client.1.smithi141.stdout:6/737: write d1/d12/d22/d25/d38/f3e [1597699,60555] 0 2023-12-16T20:11:42.161 INFO:tasks.workunit.client.1.smithi141.stdout:5/629: sync 2023-12-16T20:11:42.163 INFO:tasks.workunit.client.1.smithi141.stdout:1/730: dwrite da/d67/f2f [0,4194304] 0 2023-12-16T20:11:42.164 INFO:tasks.workunit.client.1.smithi141.stdout:2/568: creat d6/d12/d1f/fc0 x:0 0 0 2023-12-16T20:11:42.166 INFO:tasks.workunit.client.1.smithi141.stdout:6/738: symlink d1/d3/d4b/d60/db8/d69/lf0 0 2023-12-16T20:11:42.166 INFO:tasks.workunit.client.1.smithi141.stdout:6/739: write d1/d3/d4b/d60/f99 [269956,79488] 0 2023-12-16T20:11:42.169 INFO:tasks.workunit.client.1.smithi141.stdout:1/731: rename da/d36/d4b/d7c/fd5 to da/d1a/d1d/d33/ff4 0 2023-12-16T20:11:42.171 INFO:tasks.workunit.client.1.smithi141.stdout:6/740: dread d1/d77/d9e/fb2 [0,4194304] 0 2023-12-16T20:11:42.171 INFO:tasks.workunit.client.1.smithi141.stdout:1/732: mknod da/d1a/d1d/d33/d7f/cf5 0 2023-12-16T20:11:42.172 INFO:tasks.workunit.client.1.smithi141.stdout:1/733: read - da/d36/d4b/db2/fe8 zero size 2023-12-16T20:11:42.172 INFO:tasks.workunit.client.1.smithi141.stdout:1/734: write da/d36/d4b/d4d/d89/f82 [492522,124125] 0 2023-12-16T20:11:42.173 INFO:tasks.workunit.client.1.smithi141.stdout:6/741: unlink d1/d12/d20/d85/dd1/d47/l56 0 2023-12-16T20:11:42.176 INFO:tasks.workunit.client.1.smithi141.stdout:1/735: mkdir da/d1a/db0/dd3/df6 0 2023-12-16T20:11:42.176 INFO:tasks.workunit.client.1.smithi141.stdout:1/736: write da/d1a/d31/f7e [1781763,17526] 0 2023-12-16T20:11:42.176 INFO:tasks.workunit.client.1.smithi141.stdout:6/742: creat d1/d12/d20/ff1 x:0 0 0 2023-12-16T20:11:42.177 INFO:tasks.workunit.client.0.smithi038.stdout:8/971: dwrite f16 [4194304,4194304] 0 2023-12-16T20:11:42.178 INFO:tasks.workunit.client.1.smithi141.stdout:8/770: dwrite d14/d19/d95/dae/db4/d5b/f7e [0,4194304] 0 2023-12-16T20:11:42.178 INFO:tasks.workunit.client.1.smithi141.stdout:1/737: creat da/d36/d4b/ff7 x:0 0 0 2023-12-16T20:11:42.179 INFO:tasks.workunit.client.0.smithi038.stdout:8/972: creat d17/d11d/f139 x:0 0 0 2023-12-16T20:11:42.180 INFO:tasks.workunit.client.1.smithi141.stdout:6/743: creat d1/d12/d20/d89/d95/ff2 x:0 0 0 2023-12-16T20:11:42.180 INFO:tasks.workunit.client.1.smithi141.stdout:6/744: chown d1/d12/d22 213 1 2023-12-16T20:11:42.185 INFO:tasks.workunit.client.1.smithi141.stdout:5/630: dread d0/d14/f23 [0,4194304] 0 2023-12-16T20:11:42.185 INFO:tasks.workunit.client.1.smithi141.stdout:5/631: fsync d0/d9/f8e 0 2023-12-16T20:11:42.187 INFO:tasks.workunit.client.1.smithi141.stdout:9/596: dwrite d1/d10/d14/d20/da/d3f/f68 [0,4194304] 0 2023-12-16T20:11:42.188 INFO:tasks.workunit.client.1.smithi141.stdout:2/569: dwrite d6/da/d1b/d5b/faa [0,4194304] 0 2023-12-16T20:11:42.188 INFO:tasks.workunit.client.1.smithi141.stdout:2/570: dread - d6/d12/d15/fa7 zero size 2023-12-16T20:11:42.191 INFO:tasks.workunit.client.1.smithi141.stdout:6/745: mknod d1/d12/d20/cf3 0 2023-12-16T20:11:42.195 INFO:tasks.workunit.client.1.smithi141.stdout:5/632: getdents d0/dd2 0 2023-12-16T20:11:42.196 INFO:tasks.workunit.client.1.smithi141.stdout:2/571: creat d6/d32/d7a/fc1 x:0 0 0 2023-12-16T20:11:42.196 INFO:tasks.workunit.client.1.smithi141.stdout:1/738: getdents da/d36/d4b/d4d/d80/d94 0 2023-12-16T20:11:42.197 INFO:tasks.workunit.client.1.smithi141.stdout:1/739: chown da/d36/d4b/d4d/d89/d6c/le0 386538430 1 2023-12-16T20:11:42.197 INFO:tasks.workunit.client.1.smithi141.stdout:1/740: dread - da/d1a/d1d/d33/ff4 zero size 2023-12-16T20:11:42.197 INFO:tasks.workunit.client.1.smithi141.stdout:1/741: dread - da/d36/d4b/d4d/d80/dca/fe2 zero size 2023-12-16T20:11:42.199 INFO:tasks.workunit.client.1.smithi141.stdout:6/746: rename d1/d3/l49 to d1/dd/d2f/d48/lf4 0 2023-12-16T20:11:42.199 INFO:tasks.workunit.client.1.smithi141.stdout:6/747: fsync d1/d12/d22/d25/d38/fcd 0 2023-12-16T20:11:42.199 INFO:tasks.workunit.client.1.smithi141.stdout:6/748: chown d1/d12/d20/d89/d95/dca 33686889 1 2023-12-16T20:11:42.202 INFO:tasks.workunit.client.1.smithi141.stdout:6/749: creat d1/dbd/ff5 x:0 0 0 2023-12-16T20:11:42.202 INFO:tasks.workunit.client.1.smithi141.stdout:6/750: read d1/d12/d20/d44/f5b [333541,76872] 0 2023-12-16T20:11:42.206 INFO:tasks.workunit.client.1.smithi141.stdout:6/751: dread d1/d77/d9e/fb6 [0,4194304] 0 2023-12-16T20:11:42.210 INFO:tasks.workunit.client.1.smithi141.stdout:6/752: rename d1/d3/d4b/d60/db8/l92 to d1/d77/lf6 0 2023-12-16T20:11:42.210 INFO:tasks.workunit.client.1.smithi141.stdout:6/753: fdatasync d1/dd/f1e 0 2023-12-16T20:11:42.211 INFO:tasks.workunit.client.1.smithi141.stdout:2/572: dread d6/d32/d7a/f99 [0,4194304] 0 2023-12-16T20:11:42.213 INFO:tasks.workunit.client.1.smithi141.stdout:6/754: mkdir d1/dd/d2f/df7 0 2023-12-16T20:11:42.214 INFO:tasks.workunit.client.1.smithi141.stdout:1/742: dread da/fb8 [0,4194304] 0 2023-12-16T20:11:42.214 INFO:tasks.workunit.client.1.smithi141.stdout:1/743: chown da/d36/d4b/d4d/d80/ccf 98447 1 2023-12-16T20:11:42.216 INFO:tasks.workunit.client.1.smithi141.stdout:2/573: creat d6/fc2 x:0 0 0 2023-12-16T20:11:42.216 INFO:tasks.workunit.client.1.smithi141.stdout:2/574: creat d6/d32/d52/fc3 x:0 0 0 2023-12-16T20:11:42.216 INFO:tasks.workunit.client.1.smithi141.stdout:8/771: dwrite d14/d19/d1b/d24/da3/faa [0,4194304] 0 2023-12-16T20:11:42.216 INFO:tasks.workunit.client.1.smithi141.stdout:8/772: getdents d14/d19/d1b/d3d/d5e/dbe/dc3 0 2023-12-16T20:11:42.216 INFO:tasks.workunit.client.1.smithi141.stdout:8/773: stat d14/d19/d95/dae/db4/d58/d8b/de4 0 2023-12-16T20:11:42.217 INFO:tasks.workunit.client.0.smithi038.stdout:8/973: dwrite d17/d1b/d25/fc3 [0,4194304] 0 2023-12-16T20:11:42.221 INFO:tasks.workunit.client.1.smithi141.stdout:3/784: sync 2023-12-16T20:11:42.227 INFO:tasks.workunit.client.0.smithi038.stdout:8/974: mkdir d17/d1b/d66/d8e/d97/d13a 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.0.smithi038.stdout:8/975: dread - d17/d1b/d66/dfa/f120 zero size 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/597: dwrite d1/d26/f2f [0,4194304] 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:4/634: sync 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:4/635: fsync d1a/d3c/d9b/fb6 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:7/676: sync 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:9/598: write d1/d10/d27/f4b [9365488,16984] 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:0/637: sync 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:3/785: creat d0/d1c/d2c/d72/f103 x:0 0 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:3/786: creat d0/d1c/d2c/d72/d74/dda/f104 x:0 0 0 2023-12-16T20:11:42.228 INFO:tasks.workunit.client.1.smithi141.stdout:5/633: dwrite d0/d25/d30/d67/f1d [0,4194304] 0 2023-12-16T20:11:42.229 INFO:tasks.workunit.client.1.smithi141.stdout:5/634: stat d0/d14/f23 0 2023-12-16T20:11:42.229 INFO:tasks.workunit.client.1.smithi141.stdout:4/636: rename d1a/d54/d87/da8/f99 to d1a/d3c/d9b/da1/fe4 0 2023-12-16T20:11:42.229 INFO:tasks.workunit.client.1.smithi141.stdout:2/575: dread d6/d12/d1f/d46/f63 [4194304,4194304] 0 2023-12-16T20:11:42.232 INFO:tasks.workunit.client.1.smithi141.stdout:0/638: mkdir d4/d7/db0/ddb 0 2023-12-16T20:11:42.237 INFO:tasks.workunit.client.1.smithi141.stdout:1/744: dwrite da/f79 [4194304,4194304] 0 2023-12-16T20:11:42.238 INFO:tasks.workunit.client.1.smithi141.stdout:1/745: readlink da/d1a/d1d/lc7 0 2023-12-16T20:11:42.239 INFO:tasks.workunit.client.1.smithi141.stdout:4/637: mknod d1a/d3c/d9b/da1/ce5 0 2023-12-16T20:11:42.239 INFO:tasks.workunit.client.1.smithi141.stdout:5/635: dread d0/d9/d16/d2a/d35/d4c/dc3/faf [0,4194304] 0 2023-12-16T20:11:42.239 INFO:tasks.workunit.client.1.smithi141.stdout:5/636: dread - d0/d25/d30/d8a/fb1 zero size 2023-12-16T20:11:42.239 INFO:tasks.workunit.client.1.smithi141.stdout:5/637: fsync d0/d9/d16/d2a/d35/d5e/f6b 0 2023-12-16T20:11:42.239 INFO:tasks.workunit.client.1.smithi141.stdout:5/638: write d0/d14/f70 [826295,51528] 0 2023-12-16T20:11:42.240 INFO:tasks.workunit.client.1.smithi141.stdout:5/639: fdatasync d0/d25/d30/f97 0 2023-12-16T20:11:42.240 INFO:tasks.workunit.client.1.smithi141.stdout:5/640: creat d0/d9/d16/d2a/d35/d5e/d95/fd6 x:0 0 0 2023-12-16T20:11:42.240 INFO:tasks.workunit.client.0.smithi038.stdout:8/976: write d17/d1b/f22 [7996937,95022] 0 2023-12-16T20:11:42.244 INFO:tasks.workunit.client.1.smithi141.stdout:0/639: mknod d4/d49/da1/dd4/cdc 0 2023-12-16T20:11:42.244 INFO:tasks.workunit.client.1.smithi141.stdout:0/640: fsync d4/d49/d73/d3b/d78/fa5 0 2023-12-16T20:11:42.246 INFO:tasks.workunit.client.1.smithi141.stdout:4/638: mknod d1a/d3c/d9b/da1/ce6 0 2023-12-16T20:11:42.246 INFO:tasks.workunit.client.1.smithi141.stdout:4/639: dread - d1a/fab zero size 2023-12-16T20:11:42.246 INFO:tasks.workunit.client.1.smithi141.stdout:4/640: write d1a/d3c/d9b/fac [1576229,17716] 0 2023-12-16T20:11:42.246 INFO:tasks.workunit.client.1.smithi141.stdout:4/641: fsync d1a/d54/d87/fe1 0 2023-12-16T20:11:42.249 INFO:tasks.workunit.client.1.smithi141.stdout:7/677: rename d5/d1d to d5/d16/de3 0 2023-12-16T20:11:42.250 INFO:tasks.workunit.client.1.smithi141.stdout:2/576: write d6/d32/d52/d53/fa0 [2801964,31928] 0 2023-12-16T20:11:42.251 INFO:tasks.workunit.client.1.smithi141.stdout:0/641: unlink d4/f16 0 2023-12-16T20:11:42.251 INFO:tasks.workunit.client.1.smithi141.stdout:4/642: symlink d1a/d2a/dc3/le7 0 2023-12-16T20:11:42.252 INFO:tasks.workunit.client.1.smithi141.stdout:4/643: chown d1a/d3c/fd3 1590 1 2023-12-16T20:11:42.252 INFO:tasks.workunit.client.1.smithi141.stdout:4/644: creat d1a/d2a/d3b/dcd/fe8 x:0 0 0 2023-12-16T20:11:42.252 INFO:tasks.workunit.client.1.smithi141.stdout:1/746: write da/d1a/f95 [2568012,102456] 0 2023-12-16T20:11:42.254 INFO:tasks.workunit.client.1.smithi141.stdout:5/641: write d0/d9/d16/d2a/d35/d4c/dc3/faf [4058982,57776] 0 2023-12-16T20:11:42.256 INFO:tasks.workunit.client.1.smithi141.stdout:3/787: dwrite d0/d1c/d40/d3f/d52/d5a/fb1 [0,4194304] 0 2023-12-16T20:11:42.258 INFO:tasks.workunit.client.1.smithi141.stdout:7/678: symlink d5/d16/de3/d89/le4 0 2023-12-16T20:11:42.258 INFO:tasks.workunit.client.1.smithi141.stdout:9/599: dwrite d1/d26/d4a/f94 [0,4194304] 0 2023-12-16T20:11:42.258 INFO:tasks.workunit.client.1.smithi141.stdout:6/755: dwrite d1/d12/d22/d25/d38/faf [0,4194304] 0 2023-12-16T20:11:42.260 INFO:tasks.workunit.client.1.smithi141.stdout:0/642: mkdir d4/d49/d73/d3b/d78/d7f/d80/d83/ddd 0 2023-12-16T20:11:42.261 INFO:tasks.workunit.client.0.smithi038.stdout:8/977: dwrite d17/d1b/d66/d73/f136 [0,4194304] 0 2023-12-16T20:11:42.261 INFO:tasks.workunit.client.0.smithi038.stdout:8/978: fsync d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fde 0 2023-12-16T20:11:42.263 INFO:tasks.workunit.client.1.smithi141.stdout:4/645: symlink d1a/d3c/le9 0 2023-12-16T20:11:42.263 INFO:tasks.workunit.client.1.smithi141.stdout:4/646: fdatasync d1a/d54/d87/da8/da9/fb3 0 2023-12-16T20:11:42.263 INFO:tasks.workunit.client.1.smithi141.stdout:4/647: creat d1a/d2a/dc3/fea x:0 0 0 2023-12-16T20:11:42.264 INFO:tasks.workunit.client.1.smithi141.stdout:5/642: mkdir d0/d9/d16/d72/dd7 0 2023-12-16T20:11:42.264 INFO:tasks.workunit.client.1.smithi141.stdout:5/643: write d0/d9/d16/d2a/d35/d4c/f9a [1373788,26639] 0 2023-12-16T20:11:42.264 INFO:tasks.workunit.client.1.smithi141.stdout:5/644: chown d0/d14/d2c 1 1 2023-12-16T20:11:42.269 INFO:tasks.workunit.client.1.smithi141.stdout:3/788: mknod d0/d1c/d40/d3f/d52/d5a/df9/df8/de9/c105 0 2023-12-16T20:11:42.269 INFO:tasks.workunit.client.0.smithi038.stdout:6/970: sync 2023-12-16T20:11:42.269 INFO:tasks.workunit.client.0.smithi038.stdout:8/979: truncate d17/d1b/d66/d73/d55/d11a/da9/d50/d96/dba/f118 338498 0 2023-12-16T20:11:42.269 INFO:tasks.workunit.client.0.smithi038.stdout:8/980: truncate d17/d1b/d66/d73/fbf 1710973 0 2023-12-16T20:11:42.270 INFO:tasks.workunit.client.0.smithi038.stdout:6/971: mknod d1/d5b/d7d/d9d/c135 0 2023-12-16T20:11:42.272 INFO:tasks.workunit.client.0.smithi038.stdout:8/981: symlink d17/d1b/d66/d73/d55/d11a/da9/d59/d108/l13b 0 2023-12-16T20:11:42.272 INFO:tasks.workunit.client.0.smithi038.stdout:8/982: write d17/d1b/d25/db7/f125 [792937,85196] 0 2023-12-16T20:11:42.272 INFO:tasks.workunit.client.0.smithi038.stdout:8/983: write d17/d1b/d66/d73/d55/d11a/d9b/fc0 [940072,792] 0 2023-12-16T20:11:42.272 INFO:tasks.workunit.client.1.smithi141.stdout:9/600: truncate d1/d10/d14/f31 2654713 0 2023-12-16T20:11:42.273 INFO:tasks.workunit.client.1.smithi141.stdout:2/577: mkdir d6/dc4 0 2023-12-16T20:11:42.275 INFO:tasks.workunit.client.0.smithi038.stdout:8/984: creat d17/d5a/f13c x:0 0 0 2023-12-16T20:11:42.275 INFO:tasks.workunit.client.1.smithi141.stdout:6/756: symlink d1/d12/d20/d85/de5/lf8 0 2023-12-16T20:11:42.276 INFO:tasks.workunit.client.0.smithi038.stdout:8/985: dread d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fde [0,4194304] 0 2023-12-16T20:11:42.277 INFO:tasks.workunit.client.1.smithi141.stdout:2/578: write d6/d12/d1f/d46/d5a/f76 [676678,23275] 0 2023-12-16T20:11:42.278 INFO:tasks.workunit.client.0.smithi038.stdout:8/986: mknod d17/d1b/d66/d73/d55/d11a/c13d 0 2023-12-16T20:11:42.278 INFO:tasks.workunit.client.0.smithi038.stdout:8/987: read - d17/d1b/d66/dfa/f120 zero size 2023-12-16T20:11:42.278 INFO:tasks.workunit.client.1.smithi141.stdout:5/645: rename d0/d9/d16/d2a/d35/d91/lc4 to d0/d9/d16/d2a/ld8 0 2023-12-16T20:11:42.278 INFO:tasks.workunit.client.1.smithi141.stdout:3/789: mknod d0/d1c/d40/d3c/c106 0 2023-12-16T20:11:42.279 INFO:tasks.workunit.client.1.smithi141.stdout:9/601: rmdir d1/d10/d27 39 2023-12-16T20:11:42.280 INFO:tasks.workunit.client.0.smithi038.stdout:8/988: creat d17/d1b/d66/d73/d55/d11a/da9/f13e x:0 0 0 2023-12-16T20:11:42.280 INFO:tasks.workunit.client.0.smithi038.stdout:8/989: symlink d17/d11d/l13f 0 2023-12-16T20:11:42.283 INFO:tasks.workunit.client.1.smithi141.stdout:5/646: symlink d0/d9/d16/d2a/d4f/ld9 0 2023-12-16T20:11:42.284 INFO:tasks.workunit.client.1.smithi141.stdout:3/790: symlink d0/d1c/d40/d3c/dce/l107 0 2023-12-16T20:11:42.285 INFO:tasks.workunit.client.1.smithi141.stdout:6/757: mkdir d1/d12/d22/d25/dc3/dc6/df9 0 2023-12-16T20:11:42.285 INFO:tasks.workunit.client.1.smithi141.stdout:6/758: readlink d1/dd/d2f/l57 0 2023-12-16T20:11:42.285 INFO:tasks.workunit.client.1.smithi141.stdout:6/759: creat d1/d12/d22/ffa x:0 0 0 2023-12-16T20:11:42.287 INFO:tasks.workunit.client.1.smithi141.stdout:2/579: getdents d6/d12/d1f 0 2023-12-16T20:11:42.288 INFO:tasks.workunit.client.1.smithi141.stdout:5/647: rmdir d0/d94 39 2023-12-16T20:11:42.288 INFO:tasks.workunit.client.1.smithi141.stdout:2/580: chown d6/da/d4a/c5c 1 1 2023-12-16T20:11:42.288 INFO:tasks.workunit.client.1.smithi141.stdout:2/581: stat d6/d3a/d47/d58/d66/d6c/d98/fac 0 2023-12-16T20:11:42.288 INFO:tasks.workunit.client.1.smithi141.stdout:2/582: chown d6/da/fae 8 1 2023-12-16T20:11:42.288 INFO:tasks.workunit.client.1.smithi141.stdout:7/679: dwrite d5/f13 [0,4194304] 0 2023-12-16T20:11:42.289 INFO:tasks.workunit.client.1.smithi141.stdout:3/791: truncate d0/d1c/d6a/f7f 1678322 0 2023-12-16T20:11:42.294 INFO:tasks.workunit.client.1.smithi141.stdout:3/792: mknod d0/d1c/d40/d3f/d52/d5a/df9/df8/c108 0 2023-12-16T20:11:42.295 INFO:tasks.workunit.client.1.smithi141.stdout:5/648: getdents d0 0 2023-12-16T20:11:42.296 INFO:tasks.workunit.client.1.smithi141.stdout:3/793: mkdir d0/d1c/d40/d3f/d52/d5d/d109 0 2023-12-16T20:11:42.303 INFO:tasks.workunit.client.1.smithi141.stdout:9/602: dwrite d1/d10/d14/d20/d84/fb2 [0,4194304] 0 2023-12-16T20:11:42.303 INFO:tasks.workunit.client.1.smithi141.stdout:0/643: dwrite d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:42.303 INFO:tasks.workunit.client.1.smithi141.stdout:0/644: truncate d4/d5c/fd5 664725 0 2023-12-16T20:11:42.304 INFO:tasks.workunit.client.1.smithi141.stdout:3/794: creat d0/d1c/d40/d3f/d52/d5d/d95/f10a x:0 0 0 2023-12-16T20:11:42.304 INFO:tasks.workunit.client.1.smithi141.stdout:3/795: fdatasync d0/d1c/d40/d85/f53 0 2023-12-16T20:11:42.304 INFO:tasks.workunit.client.1.smithi141.stdout:2/583: dread d6/d12/d15/f44 [0,4194304] 0 2023-12-16T20:11:42.304 INFO:tasks.workunit.client.1.smithi141.stdout:2/584: readlink d6/da/d33/d54/d7c/lb0 0 2023-12-16T20:11:42.305 INFO:tasks.workunit.client.1.smithi141.stdout:4/648: dwrite d1a/d2a/d3b/d69/f84 [0,4194304] 0 2023-12-16T20:11:42.305 INFO:tasks.workunit.client.1.smithi141.stdout:4/649: dread - d1a/d3c/d9b/da1/da6/fd8 zero size 2023-12-16T20:11:42.310 INFO:tasks.workunit.client.0.smithi038.stdout:8/990: getdents d17/d11d 0 2023-12-16T20:11:42.312 INFO:tasks.workunit.client.0.smithi038.stdout:8/991: symlink d17/d1b/d66/d8e/d97/d13a/l140 0 2023-12-16T20:11:42.314 INFO:tasks.workunit.client.1.smithi141.stdout:9/603: write d1/d10/d14/d20/da/d3f/dab/fbe [1188746,29397] 0 2023-12-16T20:11:42.314 INFO:tasks.workunit.client.0.smithi038.stdout:8/992: link d17/d1b/d25/f6b d17/d1b/d66/d73/d55/d11a/d9b/f141 0 2023-12-16T20:11:42.315 INFO:tasks.workunit.client.0.smithi038.stdout:8/993: dread - d17/d1b/d66/d73/d4e/fbe zero size 2023-12-16T20:11:42.316 INFO:tasks.workunit.client.1.smithi141.stdout:4/650: unlink d1a/d2a/d3b/f7f 0 2023-12-16T20:11:42.316 INFO:tasks.workunit.client.0.smithi038.stdout:8/994: mkdir d17/d34/d142 0 2023-12-16T20:11:42.317 INFO:tasks.workunit.client.1.smithi141.stdout:6/760: dwrite d1/d77/d9e/fc9 [0,4194304] 0 2023-12-16T20:11:42.318 INFO:tasks.workunit.client.1.smithi141.stdout:5/649: dwrite d0/d14/f70 [0,4194304] 0 2023-12-16T20:11:42.319 INFO:tasks.workunit.client.0.smithi038.stdout:8/995: creat d17/d1b/d66/d73/d55/d11a/da9/d50/ddd/f143 x:0 0 0 2023-12-16T20:11:42.319 INFO:tasks.workunit.client.1.smithi141.stdout:2/585: write d6/d32/d52/d53/f8d [119942,63650] 0 2023-12-16T20:11:42.321 INFO:tasks.workunit.client.1.smithi141.stdout:9/604: creat d1/d10/d33/d47/d8d/dc4/fcb x:0 0 0 2023-12-16T20:11:42.322 INFO:tasks.workunit.client.1.smithi141.stdout:3/796: dread d0/d1c/d40/d85/d4c/f8a [0,4194304] 0 2023-12-16T20:11:42.322 INFO:tasks.workunit.client.0.smithi038.stdout:8/996: getdents d17/d1b/d53 0 2023-12-16T20:11:42.323 INFO:tasks.workunit.client.1.smithi141.stdout:4/651: symlink d1a/d2a/dc2/leb 0 2023-12-16T20:11:42.326 INFO:tasks.workunit.client.1.smithi141.stdout:6/761: mkdir d1/d12/d20/d85/dfb 0 2023-12-16T20:11:42.329 INFO:tasks.workunit.client.1.smithi141.stdout:5/650: mkdir d0/d9/d16/d2a/d35/dbe/dda 0 2023-12-16T20:11:42.330 INFO:tasks.workunit.client.1.smithi141.stdout:2/586: creat d6/d32/d7a/d5f/d92/fc5 x:0 0 0 2023-12-16T20:11:42.332 INFO:tasks.workunit.client.1.smithi141.stdout:9/605: mknod d1/d10/d14/ccc 0 2023-12-16T20:11:42.332 INFO:tasks.workunit.client.1.smithi141.stdout:0/645: dwrite d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 [0,4194304] 0 2023-12-16T20:11:42.334 INFO:tasks.workunit.client.1.smithi141.stdout:3/797: write d0/d1c/d40/f1b [2612921,28649] 0 2023-12-16T20:11:42.338 INFO:tasks.workunit.client.1.smithi141.stdout:5/651: rmdir d0/d9/d16/d2a/d35/d4c/dc3 39 2023-12-16T20:11:42.343 INFO:tasks.workunit.client.0.smithi038.stdout:8/997: dwrite d17/d1b/d66/dfa/f120 [0,4194304] 0 2023-12-16T20:11:42.344 INFO:tasks.workunit.client.0.smithi038.stdout:8/998: truncate d17/d1b/d66/d73/d55/d11a/d9b/feb 508484 0 2023-12-16T20:11:42.344 INFO:tasks.workunit.client.1.smithi141.stdout:0/646: creat d4/d74/dc1/dbe/fde x:0 0 0 2023-12-16T20:11:42.345 INFO:tasks.workunit.client.1.smithi141.stdout:2/587: write d6/d32/d52/d53/f74 [897257,2570] 0 2023-12-16T20:11:42.345 INFO:tasks.workunit.client.1.smithi141.stdout:2/588: fsync d6/d32/d7a/d5f/fb3 0 2023-12-16T20:11:42.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/652: rmdir d1a/d3c/d9b/da1/da6 39 2023-12-16T20:11:42.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/653: fsync d1a/d54/d87/fe1 0 2023-12-16T20:11:42.345 INFO:tasks.workunit.client.1.smithi141.stdout:4/654: fsync d1a/d2a/d3b/f45 0 2023-12-16T20:11:42.347 INFO:tasks.workunit.client.1.smithi141.stdout:6/762: mknod d1/d12/d22/d25/cfc 0 2023-12-16T20:11:42.349 INFO:tasks.workunit.client.1.smithi141.stdout:5/652: mknod d0/d14/d75/cdb 0 2023-12-16T20:11:42.352 INFO:tasks.workunit.client.1.smithi141.stdout:0/647: mknod d4/d49/d73/cdf 0 2023-12-16T20:11:42.352 INFO:tasks.workunit.client.1.smithi141.stdout:0/648: write d4/d49/d4b/f9d [15045,125721] 0 2023-12-16T20:11:42.352 INFO:tasks.workunit.client.1.smithi141.stdout:0/649: chown d4/lb1 1651829 1 2023-12-16T20:11:42.355 INFO:tasks.workunit.client.1.smithi141.stdout:2/589: link d6/da/d4a/fbe d6/d3a/d47/d58/d66/fc6 0 2023-12-16T20:11:42.358 INFO:tasks.workunit.client.1.smithi141.stdout:5/653: mknod d0/d25/cdc 0 2023-12-16T20:11:42.358 INFO:tasks.workunit.client.1.smithi141.stdout:5/654: truncate d0/d14/f37 4280136 0 2023-12-16T20:11:42.359 INFO:tasks.workunit.client.1.smithi141.stdout:9/606: dwrite d1/d10/d14/d20/d3b/f46 [0,4194304] 0 2023-12-16T20:11:42.360 INFO:tasks.workunit.client.1.smithi141.stdout:3/798: dwrite d0/d1c/f6e [4194304,4194304] 0 2023-12-16T20:11:42.360 INFO:tasks.workunit.client.1.smithi141.stdout:3/799: chown d0/d1c/d40/d3f/d52/d5a/df9/fcf 2 1 2023-12-16T20:11:42.360 INFO:tasks.workunit.client.1.smithi141.stdout:3/800: truncate d0/d1c/d40/d3f/d52/d5d/d95/f10a 247333 0 2023-12-16T20:11:42.360 INFO:tasks.workunit.client.1.smithi141.stdout:3/801: fdatasync d0/d1c/d2c/d72/fc6 0 2023-12-16T20:11:42.360 INFO:tasks.workunit.client.1.smithi141.stdout:0/650: rename d4/d49/d73/cc3 to d4/d74/dc1/dbe/ce0 0 2023-12-16T20:11:42.361 INFO:tasks.workunit.client.1.smithi141.stdout:2/590: creat d6/da/d33/d54/d7c/fc7 x:0 0 0 2023-12-16T20:11:42.362 INFO:tasks.workunit.client.1.smithi141.stdout:2/591: read d6/d3a/d47/d58/f72 [517776,85571] 0 2023-12-16T20:11:42.363 INFO:tasks.workunit.client.1.smithi141.stdout:4/655: getdents d1a/d2a/d3b/dcd 0 2023-12-16T20:11:42.367 INFO:tasks.workunit.client.1.smithi141.stdout:3/802: mkdir d0/d1c/d40/d3f/d52/d5d/d10b 0 2023-12-16T20:11:42.369 INFO:tasks.workunit.client.1.smithi141.stdout:4/656: symlink d1a/d54/d87/da8/da9/lec 0 2023-12-16T20:11:42.371 INFO:tasks.workunit.client.0.smithi038.stdout:8/999: dwrite d17/d1b/d66/d73/d55/d11a/da9/d50/db1/fde [0,4194304] 0 2023-12-16T20:11:42.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/655: read d0/d14/d98/fa1 [1934174,71854] 0 2023-12-16T20:11:42.373 INFO:tasks.workunit.client.1.smithi141.stdout:5/656: readlink d0/d25/d30/d8a/da0/lca 0 2023-12-16T20:11:42.373 INFO:tasks.workunit.client.1.smithi141.stdout:5/657: creat d0/d25/fdd x:0 0 0 2023-12-16T20:11:42.385 INFO:tasks.workunit.client.1.smithi141.stdout:0/651: dwrite d4/d49/da1/fd3 [0,4194304] 0 2023-12-16T20:11:42.391 INFO:tasks.workunit.client.1.smithi141.stdout:0/652: creat d4/d49/d73/d8a/d9b/fe1 x:0 0 0 2023-12-16T20:11:42.392 INFO:tasks.workunit.client.1.smithi141.stdout:3/803: dwrite d0/d1c/d6a/d76/da2/fbe [0,4194304] 0 2023-12-16T20:11:42.392 INFO:tasks.workunit.client.1.smithi141.stdout:3/804: write d0/d1c/d2c/d72/f8e [419438,24348] 0 2023-12-16T20:11:42.392 INFO:tasks.workunit.client.1.smithi141.stdout:0/653: unlink d4/l36 0 2023-12-16T20:11:42.393 INFO:tasks.workunit.client.1.smithi141.stdout:2/592: dwrite d6/d3a/d47/d58/d66/f7b [4194304,4194304] 0 2023-12-16T20:11:42.394 INFO:tasks.workunit.client.1.smithi141.stdout:3/805: creat d0/d1c/d40/d3f/d52/d5a/df9/df8/f10c x:0 0 0 2023-12-16T20:11:42.397 INFO:tasks.workunit.client.1.smithi141.stdout:5/658: dwrite d0/d14/d2c/f33 [0,4194304] 0 2023-12-16T20:11:42.400 INFO:tasks.workunit.client.1.smithi141.stdout:2/593: creat d6/d32/fc8 x:0 0 0 2023-12-16T20:11:42.403 INFO:tasks.workunit.client.1.smithi141.stdout:5/659: mknod d0/d9/d16/d2a/cde 0 2023-12-16T20:11:42.403 INFO:tasks.workunit.client.1.smithi141.stdout:4/657: dwrite d1a/f32 [0,4194304] 0 2023-12-16T20:11:42.404 INFO:tasks.workunit.client.1.smithi141.stdout:2/594: mknod d6/d32/d7a/cc9 0 2023-12-16T20:11:42.405 INFO:tasks.workunit.client.1.smithi141.stdout:0/654: dread d4/d49/d4b/f66 [0,4194304] 0 2023-12-16T20:11:42.407 INFO:tasks.workunit.client.1.smithi141.stdout:4/658: symlink d1a/d3c/d9b/led 0 2023-12-16T20:11:42.409 INFO:tasks.workunit.client.1.smithi141.stdout:3/806: dwrite d0/f68 [0,4194304] 0 2023-12-16T20:11:42.410 INFO:tasks.workunit.client.1.smithi141.stdout:4/659: creat d1a/d2a/d3b/dcd/fee x:0 0 0 2023-12-16T20:11:42.412 INFO:tasks.workunit.client.1.smithi141.stdout:8/774: sync 2023-12-16T20:11:42.412 INFO:tasks.workunit.client.1.smithi141.stdout:8/775: dread - d14/d19/d1b/f90 zero size 2023-12-16T20:11:42.412 INFO:tasks.workunit.client.1.smithi141.stdout:8/776: fsync d14/d19/d95/dae/db4/f9b 0 2023-12-16T20:11:42.414 INFO:tasks.workunit.client.1.smithi141.stdout:4/660: mknod d1a/d2a/cef 0 2023-12-16T20:11:42.415 INFO:tasks.workunit.client.1.smithi141.stdout:8/777: truncate d14/d19/d1b/f1a 942781 0 2023-12-16T20:11:42.415 INFO:tasks.workunit.client.1.smithi141.stdout:8/778: readlink d14/d19/d95/dae/db4/d5b/lca 0 2023-12-16T20:11:42.416 INFO:tasks.workunit.client.1.smithi141.stdout:4/661: mkdir d1a/d2a/d3b/d69/df0 0 2023-12-16T20:11:42.418 INFO:tasks.workunit.client.1.smithi141.stdout:8/779: link d14/d19/d1b/d24/d4b/d8c/cd5 d14/d19/d1b/d24/dc8/cf7 0 2023-12-16T20:11:42.418 INFO:tasks.workunit.client.1.smithi141.stdout:4/662: read d1a/f9a [296296,81274] 0 2023-12-16T20:11:42.420 INFO:tasks.workunit.client.1.smithi141.stdout:4/663: mkdir d1a/d3c/d9b/da1/dcf/df1 0 2023-12-16T20:11:42.420 INFO:tasks.workunit.client.1.smithi141.stdout:4/664: fdatasync d1a/d2a/f6b 0 2023-12-16T20:11:42.424 INFO:tasks.workunit.client.1.smithi141.stdout:0/655: write d4/d49/d73/f46 [2016808,71420] 0 2023-12-16T20:11:42.424 INFO:tasks.workunit.client.1.smithi141.stdout:0/656: readlink d4/d49/d73/d3b/d78/l75 0 2023-12-16T20:11:42.435 INFO:tasks.workunit.client.1.smithi141.stdout:4/665: write d1a/f9c [2351436,83098] 0 2023-12-16T20:11:42.437 INFO:tasks.workunit.client.1.smithi141.stdout:4/666: getdents d1a/d4e/d63 0 2023-12-16T20:11:42.449 INFO:tasks.workunit.client.1.smithi141.stdout:3/807: dwrite d0/d1c/d40/d3f/d52/d5a/f6c [0,4194304] 0 2023-12-16T20:11:42.449 INFO:tasks.workunit.client.1.smithi141.stdout:3/808: readlink d0/d1c/d6a/ld3 0 2023-12-16T20:11:42.451 INFO:tasks.workunit.client.1.smithi141.stdout:0/657: dwrite d4/d49/d73/d3b/d78/d7f/f90 [0,4194304] 0 2023-12-16T20:11:42.451 INFO:tasks.workunit.client.1.smithi141.stdout:5/660: dwrite d0/d9/d16/fac [0,4194304] 0 2023-12-16T20:11:42.451 INFO:tasks.workunit.client.1.smithi141.stdout:5/661: truncate d0/d25/fa4 163288 0 2023-12-16T20:11:42.453 INFO:tasks.workunit.client.1.smithi141.stdout:8/780: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:42.454 INFO:tasks.workunit.client.0.smithi038.stdout:6/972: sync 2023-12-16T20:11:42.457 INFO:tasks.workunit.client.1.smithi141.stdout:4/667: dwrite d1a/d3c/d9b/da1/da6/fd8 [0,4194304] 0 2023-12-16T20:11:42.458 INFO:tasks.workunit.client.0.smithi038.stdout:6/973: link d1/d4/d1d/d8e/f122 d1/d5b/d7d/d9d/dc8/de7/d2f/d85/df5/f136 0 2023-12-16T20:11:42.458 INFO:tasks.workunit.client.1.smithi141.stdout:5/662: mknod d0/d9/d85/cdf 0 2023-12-16T20:11:42.459 INFO:tasks.workunit.client.0.smithi038.stdout:6/974: getdents d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2 0 2023-12-16T20:11:42.460 INFO:tasks.workunit.client.1.smithi141.stdout:8/781: symlink d14/d35/lf8 0 2023-12-16T20:11:42.460 INFO:tasks.workunit.client.0.smithi038.stdout:6/975: creat d1/d5b/d7d/df4/d117/f137 x:0 0 0 2023-12-16T20:11:42.461 INFO:tasks.workunit.client.1.smithi141.stdout:8/782: fdatasync d14/d19/d1b/d24/d4b/fb6 0 2023-12-16T20:11:42.463 INFO:tasks.workunit.client.1.smithi141.stdout:0/658: dread d4/d49/d73/d3b/d78/d7f/d80/d83/f89 [4194304,4194304] 0 2023-12-16T20:11:42.465 INFO:tasks.workunit.client.0.smithi038.stdout:6/976: read d1/d5b/d7d/d9d/dc8/de7/db1/dbe/d94/ff3 [1538353,101885] 0 2023-12-16T20:11:42.471 INFO:tasks.workunit.client.1.smithi141.stdout:3/809: dwrite d0/d1c/d2c/fa6 [0,4194304] 0 2023-12-16T20:11:42.472 INFO:tasks.workunit.client.1.smithi141.stdout:3/810: getdents d0/d1c/d40/d3f/dc1 0 2023-12-16T20:11:42.472 INFO:tasks.workunit.client.1.smithi141.stdout:4/668: mknod d1a/d3c/d9b/cf2 0 2023-12-16T20:11:42.474 INFO:tasks.workunit.client.1.smithi141.stdout:5/663: mknod d0/ce0 0 2023-12-16T20:11:42.476 INFO:tasks.workunit.client.1.smithi141.stdout:3/811: rmdir d0/d1c/d40/d85/d4c 39 2023-12-16T20:11:42.482 INFO:tasks.workunit.client.1.smithi141.stdout:3/812: rename d0/d1c/d40/d3f/d52/d5a to d0/d1c/d2c/d10d 0 2023-12-16T20:11:42.483 INFO:tasks.workunit.client.1.smithi141.stdout:1/747: sync 2023-12-16T20:11:42.483 INFO:tasks.workunit.client.1.smithi141.stdout:1/748: chown da/d1a/fa3 94 1 2023-12-16T20:11:42.483 INFO:tasks.workunit.client.1.smithi141.stdout:7/680: sync 2023-12-16T20:11:42.483 INFO:tasks.workunit.client.1.smithi141.stdout:0/659: dwrite d4/d49/d73/d8a/f91 [0,4194304] 0 2023-12-16T20:11:42.483 INFO:tasks.workunit.client.1.smithi141.stdout:1/749: write da/d1a/d31/d81/db6/fc0 [1612007,115651] 0 2023-12-16T20:11:42.485 INFO:tasks.workunit.client.1.smithi141.stdout:3/813: rename d0/f37 to d0/d1c/d40/d3f/d52/d5d/f10e 0 2023-12-16T20:11:42.485 INFO:tasks.workunit.client.1.smithi141.stdout:3/814: creat d0/d1c/d6a/d76/f10f x:0 0 0 2023-12-16T20:11:42.485 INFO:tasks.workunit.client.1.smithi141.stdout:8/783: dwrite d14/d19/d1b/d24/f49 [4194304,4194304] 0 2023-12-16T20:11:42.485 INFO:tasks.workunit.client.1.smithi141.stdout:8/784: readlink d14/d19/d95/dae/db4/d5b/lca 0 2023-12-16T20:11:42.486 INFO:tasks.workunit.client.1.smithi141.stdout:8/785: dread - d14/d19/d95/dae/db4/d5b/fd6 zero size 2023-12-16T20:11:42.487 INFO:tasks.workunit.client.1.smithi141.stdout:0/660: rmdir d4/d49/d73/d8a/da4/dcc 39 2023-12-16T20:11:42.489 INFO:tasks.workunit.client.1.smithi141.stdout:7/681: mknod d5/d16/d30/d36/d8c/ce5 0 2023-12-16T20:11:42.489 INFO:tasks.workunit.client.1.smithi141.stdout:3/815: mkdir d0/d1c/d2c/dc0/d110 0 2023-12-16T20:11:42.494 INFO:tasks.workunit.client.1.smithi141.stdout:3/816: symlink d0/d1c/d2c/d72/d74/l111 0 2023-12-16T20:11:42.495 INFO:tasks.workunit.client.1.smithi141.stdout:5/664: dread d0/d9/d16/f21 [0,4194304] 0 2023-12-16T20:11:42.495 INFO:tasks.workunit.client.1.smithi141.stdout:5/665: stat d0/d9/d16/d2a/d35/c5c 0 2023-12-16T20:11:42.495 INFO:tasks.workunit.client.1.smithi141.stdout:5/666: mknod d0/d9/d16/d2a/d35/dbe/ce1 0 2023-12-16T20:11:42.495 INFO:tasks.workunit.client.1.smithi141.stdout:5/667: fsync d0/d25/f2e 0 2023-12-16T20:11:42.497 INFO:tasks.workunit.client.1.smithi141.stdout:5/668: mknod d0/d9/d99/ce2 0 2023-12-16T20:11:42.497 INFO:tasks.workunit.client.1.smithi141.stdout:5/669: creat d0/d25/d30/fe3 x:0 0 0 2023-12-16T20:11:42.497 INFO:tasks.workunit.client.1.smithi141.stdout:5/670: fdatasync d0/d14/d98/fa1 0 2023-12-16T20:11:42.498 INFO:tasks.workunit.client.1.smithi141.stdout:5/671: dread - d0/d9/d16/d2a/d35/d5e/d95/fd6 zero size 2023-12-16T20:11:42.500 INFO:tasks.workunit.client.1.smithi141.stdout:5/672: creat d0/d9/d16/d72/dd7/fe4 x:0 0 0 2023-12-16T20:11:42.500 INFO:tasks.workunit.client.1.smithi141.stdout:5/673: chown d0/d9/d16/d2a/d35/ca6 17843466 1 2023-12-16T20:11:42.500 INFO:tasks.workunit.client.1.smithi141.stdout:5/674: write d0/d14/fa7 [782316,10230] 0 2023-12-16T20:11:42.502 INFO:tasks.workunit.client.1.smithi141.stdout:4/669: dwrite d1a/d54/f6a [0,4194304] 0 2023-12-16T20:11:42.503 INFO:tasks.workunit.client.1.smithi141.stdout:5/675: rename d0/d9/d16/d2a/d35/ca6 to d0/d14/d75/ce5 0 2023-12-16T20:11:42.517 INFO:tasks.workunit.client.1.smithi141.stdout:3/817: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:42.519 INFO:tasks.workunit.client.1.smithi141.stdout:3/818: mkdir d0/d1c/d40/d112 0 2023-12-16T20:11:42.520 INFO:tasks.workunit.client.1.smithi141.stdout:3/819: readlink d0/l32 0 2023-12-16T20:11:42.520 INFO:tasks.workunit.client.1.smithi141.stdout:3/820: dread - d0/d1c/d40/d3f/d52/d5d/fd6 zero size 2023-12-16T20:11:42.530 INFO:tasks.workunit.client.1.smithi141.stdout:8/786: dwrite d14/d19/dce/fda [0,4194304] 0 2023-12-16T20:11:42.532 INFO:tasks.workunit.client.1.smithi141.stdout:8/787: dread d14/d71/d81/f75 [0,4194304] 0 2023-12-16T20:11:42.532 INFO:tasks.workunit.client.1.smithi141.stdout:8/788: fdatasync d14/d19/d1b/d24/f28 0 2023-12-16T20:11:42.534 INFO:tasks.workunit.client.1.smithi141.stdout:8/789: rename d14/d19/d1b/d3d/d5e/c9c to d14/d19/d95/dae/db4/d58/d8b/de4/cf9 0 2023-12-16T20:11:42.534 INFO:tasks.workunit.client.1.smithi141.stdout:8/790: stat d14/d35/f70 0 2023-12-16T20:11:42.534 INFO:tasks.workunit.client.1.smithi141.stdout:8/791: fdatasync d14/d19/d1b/d3d/f96 0 2023-12-16T20:11:42.534 INFO:tasks.workunit.client.1.smithi141.stdout:8/792: mkdir d14/d35/dfa 0 2023-12-16T20:11:42.535 INFO:tasks.workunit.client.1.smithi141.stdout:8/793: symlink d14/d19/d1b/d24/dc8/lfb 0 2023-12-16T20:11:42.536 INFO:tasks.workunit.client.1.smithi141.stdout:8/794: rename d14/d71/d81/fcd to d14/d71/d81/ffc 0 2023-12-16T20:11:42.536 INFO:tasks.workunit.client.1.smithi141.stdout:8/795: write d14/d19/d1b/d24/f31 [3076669,69992] 0 2023-12-16T20:11:42.538 INFO:tasks.workunit.client.1.smithi141.stdout:8/796: truncate d14/f15 667879 0 2023-12-16T20:11:42.538 INFO:tasks.workunit.client.1.smithi141.stdout:0/661: dwrite d4/d49/d73/d3b/f7a [0,4194304] 0 2023-12-16T20:11:42.541 INFO:tasks.workunit.client.1.smithi141.stdout:8/797: rename d14/d35/dcc to d14/d19/d95/dab/dfd 0 2023-12-16T20:11:42.541 INFO:tasks.workunit.client.1.smithi141.stdout:1/750: dwrite da/d36/d4b/d4d/d80/f93 [0,4194304] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:5/676: dwrite d0/d9/d16/d2a/fa8 [4194304,4194304] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:3/821: dwrite d0/f68 [0,4194304] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:5/677: creat d0/d25/d30/d67/fe6 x:0 0 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:4/670: dwrite d1a/d2a/f6c [0,4194304] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:7/682: dwrite d5/d16/de3/d1e/d71/d96/fad [0,4194304] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:7/683: stat d5/d2a/d45/d5a/fc5 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:7/684: write d5/fa8 [375464,84158] 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:7/685: fsync d5/d16/d30/d36/f4b 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:1/751: truncate da/fac 1689606 0 2023-12-16T20:11:42.543 INFO:tasks.workunit.client.1.smithi141.stdout:1/752: dread - da/d36/f96 zero size 2023-12-16T20:11:42.550 INFO:tasks.workunit.client.1.smithi141.stdout:3/822: mknod d0/d1c/d40/d3f/d52/d5d/d10b/c113 0 2023-12-16T20:11:42.555 INFO:tasks.workunit.client.1.smithi141.stdout:4/671: read d1a/f29 [85827,27566] 0 2023-12-16T20:11:42.558 INFO:tasks.workunit.client.1.smithi141.stdout:5/678: write d0/d9/d16/d2a/fa8 [4413968,98934] 0 2023-12-16T20:11:42.558 INFO:tasks.workunit.client.1.smithi141.stdout:5/679: write d0/d25/d30/d8a/fb1 [357330,10141] 0 2023-12-16T20:11:42.560 INFO:tasks.workunit.client.1.smithi141.stdout:8/798: dread d14/f64 [0,4194304] 0 2023-12-16T20:11:42.560 INFO:tasks.workunit.client.1.smithi141.stdout:8/799: truncate d14/d19/d1b/f48 1182617 0 2023-12-16T20:11:42.562 INFO:tasks.workunit.client.1.smithi141.stdout:7/686: mkdir d5/d16/d1a/dd7/de6 0 2023-12-16T20:11:42.562 INFO:tasks.workunit.client.1.smithi141.stdout:7/687: write d5/d2a/f2d [353581,74114] 0 2023-12-16T20:11:42.564 INFO:tasks.workunit.client.1.smithi141.stdout:1/753: mkdir da/d1a/d1d/d33/dcd/df8 0 2023-12-16T20:11:42.568 INFO:tasks.workunit.client.1.smithi141.stdout:0/662: dwrite d4/d49/f71 [0,4194304] 0 2023-12-16T20:11:42.568 INFO:tasks.workunit.client.1.smithi141.stdout:0/663: write d4/d74/dc1/dbe/fde [626080,5219] 0 2023-12-16T20:11:42.569 INFO:tasks.workunit.client.1.smithi141.stdout:3/823: rename d0/d1c/d40/d3f/d52/d63/l100 to d0/d1c/d40/d3f/d52/d5d/d95/l114 0 2023-12-16T20:11:42.573 INFO:tasks.workunit.client.1.smithi141.stdout:4/672: mkdir d1a/d54/d87/dbf/df3 0 2023-12-16T20:11:42.574 INFO:tasks.workunit.client.1.smithi141.stdout:5/680: mknod d0/d9/d16/d2a/d35/d5e/ce7 0 2023-12-16T20:11:42.582 INFO:tasks.workunit.client.1.smithi141.stdout:0/664: creat d4/d49/d4b/da3/fe2 x:0 0 0 2023-12-16T20:11:42.585 INFO:tasks.workunit.client.1.smithi141.stdout:1/754: mknod da/cf9 0 2023-12-16T20:11:42.585 INFO:tasks.workunit.client.1.smithi141.stdout:5/681: dread d0/d14/d2c/d4a/f51 [0,4194304] 0 2023-12-16T20:11:42.585 INFO:tasks.workunit.client.1.smithi141.stdout:5/682: fdatasync d0/d14/d2c/d4a/f4d 0 2023-12-16T20:11:42.585 INFO:tasks.workunit.client.1.smithi141.stdout:0/665: creat d4/d5c/daf/fe3 x:0 0 0 2023-12-16T20:11:42.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/683: mknod d0/d25/d30/d67/ce8 0 2023-12-16T20:11:42.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/684: fsync d0/d25/fd3 0 2023-12-16T20:11:42.588 INFO:tasks.workunit.client.1.smithi141.stdout:5/685: truncate d0/d9/f8e 896665 0 2023-12-16T20:11:42.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/595: sync 2023-12-16T20:11:42.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/596: chown d6/da/d1b/f5d 4 1 2023-12-16T20:11:42.590 INFO:tasks.workunit.client.1.smithi141.stdout:9/607: sync 2023-12-16T20:11:42.590 INFO:tasks.workunit.client.1.smithi141.stdout:6/763: sync 2023-12-16T20:11:42.591 INFO:tasks.workunit.client.1.smithi141.stdout:9/608: fdatasync d1/d26/f4d 0 2023-12-16T20:11:42.591 INFO:tasks.workunit.client.1.smithi141.stdout:6/764: dread - d1/dd/fb5 zero size 2023-12-16T20:11:42.593 INFO:tasks.workunit.client.1.smithi141.stdout:8/800: dwrite d14/d19/d95/dae/db4/d5b/f5d [4194304,4194304] 0 2023-12-16T20:11:42.594 INFO:tasks.workunit.client.1.smithi141.stdout:8/801: mkdir d14/d19/d95/dae/db4/d69/dfe 0 2023-12-16T20:11:42.595 INFO:tasks.workunit.client.1.smithi141.stdout:8/802: chown d14/d19/d1b/d24 2626204 1 2023-12-16T20:11:42.596 INFO:tasks.workunit.client.1.smithi141.stdout:0/666: dread d4/d74/dc1/dbe/fde [0,4194304] 0 2023-12-16T20:11:42.596 INFO:tasks.workunit.client.1.smithi141.stdout:1/755: getdents da/d1a/d1d/d33/dcd 0 2023-12-16T20:11:42.597 INFO:tasks.workunit.client.1.smithi141.stdout:4/673: dread d1a/f1f [0,4194304] 0 2023-12-16T20:11:42.599 INFO:tasks.workunit.client.1.smithi141.stdout:1/756: link da/d1a/f73 da/d1a/d31/ffa 0 2023-12-16T20:11:42.601 INFO:tasks.workunit.client.1.smithi141.stdout:0/667: getdents d4/d49/db9 0 2023-12-16T20:11:42.607 INFO:tasks.workunit.client.1.smithi141.stdout:4/674: dread d1a/f25 [0,4194304] 0 2023-12-16T20:11:42.607 INFO:tasks.workunit.client.1.smithi141.stdout:4/675: chown d1a/d2a/l4f 11758897 1 2023-12-16T20:11:42.607 INFO:tasks.workunit.client.1.smithi141.stdout:4/676: creat d1a/d3c/ff4 x:0 0 0 2023-12-16T20:11:42.609 INFO:tasks.workunit.client.1.smithi141.stdout:4/677: rename d1a/d2a/f76 to d1a/d2a/d3b/ff5 0 2023-12-16T20:11:42.609 INFO:tasks.workunit.client.1.smithi141.stdout:4/678: chown d1a/d59/d89/d8a/fcc 3 1 2023-12-16T20:11:42.609 INFO:tasks.workunit.client.1.smithi141.stdout:4/679: read - d1a/d2a/dc3/fea zero size 2023-12-16T20:11:42.610 INFO:tasks.workunit.client.1.smithi141.stdout:4/680: mkdir d1a/d4e/d63/daa/db9/df6 0 2023-12-16T20:11:42.611 INFO:tasks.workunit.client.1.smithi141.stdout:4/681: rename d1a/d4e/d63/daa/lc8 to d1a/d2a/d3b/lf7 0 2023-12-16T20:11:42.644 INFO:tasks.workunit.client.1.smithi141.stdout:3/824: dwrite d0/d1c/d40/d3c/fcc [0,4194304] 0 2023-12-16T20:11:42.644 INFO:tasks.workunit.client.1.smithi141.stdout:7/688: dwrite d5/d16/d46/d61/fbb [0,4194304] 0 2023-12-16T20:11:42.651 INFO:tasks.workunit.client.1.smithi141.stdout:7/689: mkdir d5/d16/d1a/de7 0 2023-12-16T20:11:42.657 INFO:tasks.workunit.client.1.smithi141.stdout:6/765: read d1/d77/d9e/fc9 [3746270,86909] 0 2023-12-16T20:11:42.658 INFO:tasks.workunit.client.1.smithi141.stdout:1/757: dread da/d36/d4b/d4d/d80/d94/fa8 [0,4194304] 0 2023-12-16T20:11:42.658 INFO:tasks.workunit.client.1.smithi141.stdout:6/766: mkdir d1/d12/d20/d85/dd1/d47/dfd 0 2023-12-16T20:11:42.662 INFO:tasks.workunit.client.1.smithi141.stdout:6/767: truncate d1/dd/de/fdc 417560 0 2023-12-16T20:11:42.662 INFO:tasks.workunit.client.1.smithi141.stdout:6/768: write d1/d3/d4b/d60/f9b [1345014,39461] 0 2023-12-16T20:11:42.666 INFO:tasks.workunit.client.1.smithi141.stdout:2/597: dwrite d6/d3a/d47/d58/f87 [0,4194304] 0 2023-12-16T20:11:42.666 INFO:tasks.workunit.client.1.smithi141.stdout:2/598: truncate d6/d12/d1f/d46/d5a/fb7 722554 0 2023-12-16T20:11:42.667 INFO:tasks.workunit.client.1.smithi141.stdout:6/769: rename d1/d3/d4b/d60/db8/d69/lf0 to d1/d12/d22/d25/de0/lfe 0 2023-12-16T20:11:42.667 INFO:tasks.workunit.client.1.smithi141.stdout:6/770: chown d1/d12/d20/c42 7 1 2023-12-16T20:11:42.668 INFO:tasks.workunit.client.1.smithi141.stdout:0/668: write d4/d49/f71 [1622701,81489] 0 2023-12-16T20:11:42.668 INFO:tasks.workunit.client.1.smithi141.stdout:0/669: truncate d4/d49/d4b/f66 5002247 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/599: unlink d6/fc2 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/600: write d6/da/d1b/d5b/d6a/d85/f9c [734706,102666] 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/601: write d6/d32/d7a/d5f/d92/fa4 [4703110,116082] 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/602: fdatasync d6/d32/f4e 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:2/603: chown d6/da/d1b/d5b/faa 15467 1 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:1/758: read da/f2c [2012551,62815] 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:6/771: truncate d1/d3/d4b/f66 4420512 0 2023-12-16T20:11:42.670 INFO:tasks.workunit.client.1.smithi141.stdout:6/772: write d1/d12/d20/d44/f5b [447116,22] 0 2023-12-16T20:11:42.671 INFO:tasks.workunit.client.1.smithi141.stdout:6/773: write d1/d3/d4b/d60/db8/f6c [7786941,18325] 0 2023-12-16T20:11:42.671 INFO:tasks.workunit.client.1.smithi141.stdout:8/803: dwrite d14/d19/d1b/d24/d4b/f5c [0,4194304] 0 2023-12-16T20:11:42.671 INFO:tasks.workunit.client.1.smithi141.stdout:5/686: dwrite d0/d25/f93 [0,4194304] 0 2023-12-16T20:11:42.671 INFO:tasks.workunit.client.1.smithi141.stdout:5/687: truncate d0/d14/f70 4681971 0 2023-12-16T20:11:42.672 INFO:tasks.workunit.client.1.smithi141.stdout:7/690: dwrite d5/d16/d30/d4e/fde [0,4194304] 0 2023-12-16T20:11:42.672 INFO:tasks.workunit.client.1.smithi141.stdout:7/691: fsync d5/d16/d30/d4e/d6e/f88 0 2023-12-16T20:11:42.672 INFO:tasks.workunit.client.1.smithi141.stdout:0/670: symlink d4/d49/d73/d8a/da4/dcc/le4 0 2023-12-16T20:11:42.674 INFO:tasks.workunit.client.1.smithi141.stdout:1/759: symlink da/d1a/d1d/d33/dcd/lfb 0 2023-12-16T20:11:42.675 INFO:tasks.workunit.client.1.smithi141.stdout:6/774: mkdir d1/d3/d4f/dff 0 2023-12-16T20:11:42.678 INFO:tasks.workunit.client.1.smithi141.stdout:0/671: dread d4/d49/f52 [0,4194304] 0 2023-12-16T20:11:42.680 INFO:tasks.workunit.client.1.smithi141.stdout:8/804: link d14/d19/d1b/d24/d4b/l4d d14/d19/d95/dae/db4/d5b/lff 0 2023-12-16T20:11:42.683 INFO:tasks.workunit.client.1.smithi141.stdout:2/604: dread d6/da/f49 [0,4194304] 0 2023-12-16T20:11:42.684 INFO:tasks.workunit.client.1.smithi141.stdout:5/688: creat d0/dd2/fe9 x:0 0 0 2023-12-16T20:11:42.689 INFO:tasks.workunit.client.0.smithi038.stdout:6/977: sync 2023-12-16T20:11:42.689 INFO:tasks.workunit.client.0.smithi038.stdout:6/978: fsync d1/d4/f8 0 2023-12-16T20:11:42.689 INFO:tasks.workunit.client.0.smithi038.stdout:6/979: chown d1/d5b/d7d/d9d/led 0 1 2023-12-16T20:11:42.691 INFO:tasks.workunit.client.0.smithi038.stdout:6/980: truncate d1/d5b/f63 911752 0 2023-12-16T20:11:42.701 INFO:tasks.workunit.client.1.smithi141.stdout:0/672: dwrite d4/d5c/f98 [0,4194304] 0 2023-12-16T20:11:42.702 INFO:tasks.workunit.client.1.smithi141.stdout:1/760: rename da/d1a/d1d/d8f to da/d36/d4b/d4d/d80/d94/d9d/dfc 0 2023-12-16T20:11:42.704 INFO:tasks.workunit.client.1.smithi141.stdout:8/805: creat d14/d19/d95/dae/db4/d5b/dea/f100 x:0 0 0 2023-12-16T20:11:42.705 INFO:tasks.workunit.client.1.smithi141.stdout:2/605: mknod d6/dc4/cca 0 2023-12-16T20:11:42.707 INFO:tasks.workunit.client.1.smithi141.stdout:5/689: creat d0/d94/db3/fea x:0 0 0 2023-12-16T20:11:42.708 INFO:tasks.workunit.client.1.smithi141.stdout:5/690: write d0/d14/d75/fbf [1351176,24609] 0 2023-12-16T20:11:42.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/761: dread da/d36/d4b/d4d/d80/d94/fc4 [0,4194304] 0 2023-12-16T20:11:42.714 INFO:tasks.workunit.client.1.smithi141.stdout:1/762: write da/d1a/d1d/d22/f69 [4678500,112834] 0 2023-12-16T20:11:42.714 INFO:tasks.workunit.client.1.smithi141.stdout:6/775: rename d1/d12/d20/d89/d95/dca to d1/d12/d22/d25/dd0/d100 0 2023-12-16T20:11:42.715 INFO:tasks.workunit.client.1.smithi141.stdout:6/776: readlink d1/d12/d20/d85/dd1/d47/lc0 0 2023-12-16T20:11:42.715 INFO:tasks.workunit.client.1.smithi141.stdout:8/806: symlink d14/d19/d1b/d24/da3/l101 0 2023-12-16T20:11:42.715 INFO:tasks.workunit.client.1.smithi141.stdout:8/807: write d14/d19/d95/dae/db4/d58/fc1 [858599,74292] 0 2023-12-16T20:11:42.716 INFO:tasks.workunit.client.0.smithi038.stdout:6/981: dwrite d1/d4/f9c [0,4194304] 0 2023-12-16T20:11:42.717 INFO:tasks.workunit.client.1.smithi141.stdout:2/606: dread d6/da/d1b/f30 [0,4194304] 0 2023-12-16T20:11:42.718 INFO:tasks.workunit.client.0.smithi038.stdout:6/982: dread d1/d4/d1d/d8e/d91/ffb [0,4194304] 0 2023-12-16T20:11:42.718 INFO:tasks.workunit.client.0.smithi038.stdout:6/983: dread - d1/d5b/d7d/d9d/f12a zero size 2023-12-16T20:11:42.718 INFO:tasks.workunit.client.1.smithi141.stdout:1/763: dread da/d36/f8d [0,4194304] 0 2023-12-16T20:11:42.718 INFO:tasks.workunit.client.1.smithi141.stdout:6/777: unlink d1/d3/d4f/lde 0 2023-12-16T20:11:42.719 INFO:tasks.workunit.client.0.smithi038.stdout:6/984: truncate d1/d5b/d7d/d9d/dc8/de7/f79 1632286 0 2023-12-16T20:11:42.720 INFO:tasks.workunit.client.0.smithi038.stdout:6/985: chown d1/d16/d23/d5f/fd0 253565 1 2023-12-16T20:11:42.720 INFO:tasks.workunit.client.1.smithi141.stdout:8/808: creat d14/d19/d95/dae/db4/d5b/dea/deb/f102 x:0 0 0 2023-12-16T20:11:42.720 INFO:tasks.workunit.client.1.smithi141.stdout:8/809: dread - d14/d71/d81/fe9 zero size 2023-12-16T20:11:42.721 INFO:tasks.workunit.client.0.smithi038.stdout:6/986: creat d1/d16/d23/f138 x:0 0 0 2023-12-16T20:11:42.721 INFO:tasks.workunit.client.1.smithi141.stdout:2/607: mknod d6/d32/d52/ccb 0 2023-12-16T20:11:42.723 INFO:tasks.workunit.client.1.smithi141.stdout:0/673: dwrite d4/f33 [4194304,4194304] 0 2023-12-16T20:11:42.724 INFO:tasks.workunit.client.1.smithi141.stdout:1/764: rename da/d1a/d1d/d22/l3d to da/d36/d4b/d4d/d80/lfd 0 2023-12-16T20:11:42.724 INFO:tasks.workunit.client.1.smithi141.stdout:1/765: fdatasync da/d7a/fa5 0 2023-12-16T20:11:42.725 INFO:tasks.workunit.client.1.smithi141.stdout:0/674: symlink d4/d49/db9/dcd/le5 0 2023-12-16T20:11:42.728 INFO:tasks.workunit.client.1.smithi141.stdout:6/778: rename d1/d12/d20/d44/fb1 to d1/d3/d4b/d60/def/f101 0 2023-12-16T20:11:42.728 INFO:tasks.workunit.client.1.smithi141.stdout:6/779: write d1/dd/d2f/fb3 [562893,95537] 0 2023-12-16T20:11:42.729 INFO:tasks.workunit.client.1.smithi141.stdout:8/810: rename d14/d19/d1b/d24/d4b/d8f/cd3 to d14/d19/d95/dae/db4/d5b/dea/c103 0 2023-12-16T20:11:42.730 INFO:tasks.workunit.client.1.smithi141.stdout:6/780: creat d1/d12/d20/d3a/f102 x:0 0 0 2023-12-16T20:11:42.731 INFO:tasks.workunit.client.1.smithi141.stdout:6/781: chown d1/d3/d4b/d60/c8f 141 1 2023-12-16T20:11:42.731 INFO:tasks.workunit.client.1.smithi141.stdout:8/811: unlink d14/d19/d95/dae/db4/d5b/f89 0 2023-12-16T20:11:42.734 INFO:tasks.workunit.client.1.smithi141.stdout:6/782: link d1/d3/d4b/d60/db8/f6c d1/d12/d20/d44/f103 0 2023-12-16T20:11:42.735 INFO:tasks.workunit.client.1.smithi141.stdout:8/812: unlink d14/d19/d95/dae/db4/d69/fba 0 2023-12-16T20:11:42.737 INFO:tasks.workunit.client.1.smithi141.stdout:0/675: dread d4/d5c/f68 [0,4194304] 0 2023-12-16T20:11:42.738 INFO:tasks.workunit.client.1.smithi141.stdout:8/813: mknod d14/d19/d1b/d24/da3/c104 0 2023-12-16T20:11:42.740 INFO:tasks.workunit.client.1.smithi141.stdout:0/676: unlink d4/d49/d4b/c6a 0 2023-12-16T20:11:42.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/783: dread d1/d12/d22/f88 [0,4194304] 0 2023-12-16T20:11:42.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/784: truncate d1/d12/d22/d25/d38/fc7 646945 0 2023-12-16T20:11:42.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/785: chown d1/d12/d20/d85/dd1 0 1 2023-12-16T20:11:42.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/786: fdatasync d1/d12/d20/d44/f6b 0 2023-12-16T20:11:42.741 INFO:tasks.workunit.client.1.smithi141.stdout:6/787: write d1/d12/d22/d25/d38/fcd [351526,100225] 0 2023-12-16T20:11:42.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/608: dwrite d6/d32/d7a/d5f/d92/f9f [0,4194304] 0 2023-12-16T20:11:42.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/609: creat d6/d32/d7a/fcc x:0 0 0 2023-12-16T20:11:42.747 INFO:tasks.workunit.client.1.smithi141.stdout:1/766: dwrite da/d1a/f95 [0,4194304] 0 2023-12-16T20:11:42.747 INFO:tasks.workunit.client.1.smithi141.stdout:1/767: fsync da/d67/f26 0 2023-12-16T20:11:42.747 INFO:tasks.workunit.client.1.smithi141.stdout:1/768: write da/d36/d4b/d7c/feb [447083,84586] 0 2023-12-16T20:11:42.748 INFO:tasks.workunit.client.1.smithi141.stdout:2/610: mknod d6/da/d33/ccd 0 2023-12-16T20:11:42.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/814: write d14/d19/d95/fec [1858693,35291] 0 2023-12-16T20:11:42.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/815: write d14/d19/d95/dae/db4/d5b/dea/f100 [582693,47328] 0 2023-12-16T20:11:42.751 INFO:tasks.workunit.client.1.smithi141.stdout:8/816: write d14/d19/d95/dae/db4/d69/f88 [23091,25771] 0 2023-12-16T20:11:42.753 INFO:tasks.workunit.client.1.smithi141.stdout:8/817: mkdir d14/d19/d95/dae/db4/d58/d105 0 2023-12-16T20:11:42.753 INFO:tasks.workunit.client.1.smithi141.stdout:8/818: read - d14/d19/d95/dae/db4/d58/fc9 zero size 2023-12-16T20:11:42.753 INFO:tasks.workunit.client.1.smithi141.stdout:8/819: fsync d14/d19/d1b/d3d/f3e 0 2023-12-16T20:11:42.754 INFO:tasks.workunit.client.1.smithi141.stdout:6/788: write d1/d12/d20/d3a/f6d [1050877,48241] 0 2023-12-16T20:11:42.755 INFO:tasks.workunit.client.1.smithi141.stdout:8/820: symlink d14/d19/d95/dae/db4/d58/d105/l106 0 2023-12-16T20:11:42.758 INFO:tasks.workunit.client.1.smithi141.stdout:6/789: symlink d1/dd/d2f/d48/l104 0 2023-12-16T20:11:42.758 INFO:tasks.workunit.client.1.smithi141.stdout:6/790: write d1/d12/d20/d89/d95/ff2 [382828,120218] 0 2023-12-16T20:11:42.761 INFO:tasks.workunit.client.1.smithi141.stdout:6/791: creat d1/dd/d2f/de6/f105 x:0 0 0 2023-12-16T20:11:42.761 INFO:tasks.workunit.client.1.smithi141.stdout:6/792: readlink d1/d3/l98 0 2023-12-16T20:11:42.763 INFO:tasks.workunit.client.1.smithi141.stdout:0/677: dwrite d4/d49/d73/d3b/f7a [4194304,4194304] 0 2023-12-16T20:11:42.763 INFO:tasks.workunit.client.1.smithi141.stdout:0/678: truncate d4/d49/d73/d3b/d78/fbb 447660 0 2023-12-16T20:11:42.766 INFO:tasks.workunit.client.1.smithi141.stdout:0/679: mknod d4/d49/d4b/da3/ce6 0 2023-12-16T20:11:42.773 INFO:tasks.workunit.client.1.smithi141.stdout:6/793: dread d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:42.773 INFO:tasks.workunit.client.1.smithi141.stdout:1/769: dwrite da/d36/d4b/d4d/d89/f97 [0,4194304] 0 2023-12-16T20:11:42.773 INFO:tasks.workunit.client.1.smithi141.stdout:6/794: stat d1/d77/lf6 0 2023-12-16T20:11:42.773 INFO:tasks.workunit.client.1.smithi141.stdout:6/795: stat d1/d12/d20/ff1 0 2023-12-16T20:11:42.774 INFO:tasks.workunit.client.1.smithi141.stdout:1/770: link da/d7a/fa5 da/d76/ffe 0 2023-12-16T20:11:42.774 INFO:tasks.workunit.client.1.smithi141.stdout:1/771: fdatasync da/d1a/d1d/d22/f69 0 2023-12-16T20:11:42.775 INFO:tasks.workunit.client.1.smithi141.stdout:6/796: mknod d1/d12/d20/d85/de5/de8/c106 0 2023-12-16T20:11:42.776 INFO:tasks.workunit.client.1.smithi141.stdout:6/797: symlink d1/d12/d22/d25/dc3/dc6/df9/l107 0 2023-12-16T20:11:42.776 INFO:tasks.workunit.client.1.smithi141.stdout:6/798: getdents d1/d12/d20/d85/dfb 0 2023-12-16T20:11:42.776 INFO:tasks.workunit.client.1.smithi141.stdout:0/680: write d4/d5c/f98 [1353924,89452] 0 2023-12-16T20:11:42.779 INFO:tasks.workunit.client.1.smithi141.stdout:6/799: dread d1/d12/d22/d25/fa7 [0,4194304] 0 2023-12-16T20:11:42.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/821: dwrite d14/d19/d1b/d24/f31 [0,4194304] 0 2023-12-16T20:11:42.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/822: chown d14/d19/dce/fda 173484463 1 2023-12-16T20:11:42.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/823: write d14/d35/fbb [1569907,23302] 0 2023-12-16T20:11:42.806 INFO:tasks.workunit.client.1.smithi141.stdout:1/772: dwrite da/d1a/d31/fd0 [0,4194304] 0 2023-12-16T20:11:42.808 INFO:tasks.workunit.client.1.smithi141.stdout:1/773: dread da/d36/f8d [0,4194304] 0 2023-12-16T20:11:42.808 INFO:tasks.workunit.client.1.smithi141.stdout:1/774: chown da/d67/lb5 0 1 2023-12-16T20:11:42.808 INFO:tasks.workunit.client.1.smithi141.stdout:1/775: fsync da/d67/f5e 0 2023-12-16T20:11:42.819 INFO:tasks.workunit.client.1.smithi141.stdout:1/776: write da/d36/d4b/d4d/d89/f37 [169142,70168] 0 2023-12-16T20:11:42.837 INFO:tasks.workunit.client.1.smithi141.stdout:2/611: dwrite d6/d12/f29 [0,4194304] 0 2023-12-16T20:11:42.837 INFO:tasks.workunit.client.1.smithi141.stdout:2/612: chown d6/d3a/l2a 221425052 1 2023-12-16T20:11:42.837 INFO:tasks.workunit.client.1.smithi141.stdout:2/613: fsync d6/da/d1b/f27 0 2023-12-16T20:11:42.838 INFO:tasks.workunit.client.1.smithi141.stdout:6/800: dwrite d1/dd/de/f6f [0,4194304] 0 2023-12-16T20:11:42.839 INFO:tasks.workunit.client.1.smithi141.stdout:6/801: chown d1/d12/d22/d25/d38/fc7 511121 1 2023-12-16T20:11:42.840 INFO:tasks.workunit.client.1.smithi141.stdout:1/777: rmdir da/d1a/d1d/d33/de9 0 2023-12-16T20:11:42.840 INFO:tasks.workunit.client.1.smithi141.stdout:1/778: chown da/d36/d4b/d4d/d89/f82 199 1 2023-12-16T20:11:42.842 INFO:tasks.workunit.client.1.smithi141.stdout:6/802: dread d1/d3/d4b/f66 [0,4194304] 0 2023-12-16T20:11:42.842 INFO:tasks.workunit.client.1.smithi141.stdout:6/803: fsync d1/d3/d4b/f66 0 2023-12-16T20:11:42.846 INFO:tasks.workunit.client.1.smithi141.stdout:2/614: mknod d6/d3a/cce 0 2023-12-16T20:11:42.846 INFO:tasks.workunit.client.1.smithi141.stdout:2/615: readlink d6/d12/d1f/l40 0 2023-12-16T20:11:42.846 INFO:tasks.workunit.client.1.smithi141.stdout:2/616: chown d6/d32/d52/ccb 353612 1 2023-12-16T20:11:42.847 INFO:tasks.workunit.client.1.smithi141.stdout:8/824: getdents d14/d19/d95/dae/db4/d58/d105 0 2023-12-16T20:11:42.847 INFO:tasks.workunit.client.1.smithi141.stdout:8/825: truncate d14/d19/d95/fe7 669700 0 2023-12-16T20:11:42.849 INFO:tasks.workunit.client.1.smithi141.stdout:8/826: write d14/d19/d1b/f48 [21783,103176] 0 2023-12-16T20:11:42.851 INFO:tasks.workunit.client.1.smithi141.stdout:1/779: rename da/d36/d4b/d4d/d80/d94/lb3 to da/d36/d4b/d7c/lff 0 2023-12-16T20:11:42.852 INFO:tasks.workunit.client.1.smithi141.stdout:1/780: dread - da/d1a/d31/d81/f83 zero size 2023-12-16T20:11:42.859 INFO:tasks.workunit.client.0.smithi038.stdout:6/987: sync 2023-12-16T20:11:42.860 INFO:tasks.workunit.client.1.smithi141.stdout:2/617: dwrite d6/d12/d1f/d46/f9a [0,4194304] 0 2023-12-16T20:11:42.860 INFO:tasks.workunit.client.1.smithi141.stdout:2/618: chown d6/d12/d1f/fa9 84966427 1 2023-12-16T20:11:42.860 INFO:tasks.workunit.client.1.smithi141.stdout:2/619: readlink d6/da/l3f 0 2023-12-16T20:11:42.861 INFO:tasks.workunit.client.0.smithi038.stdout:6/988: creat d1/d5b/d7d/d9d/dc8/f139 x:0 0 0 2023-12-16T20:11:42.862 INFO:tasks.workunit.client.0.smithi038.stdout:6/989: mknod d1/d16/d23/d5f/c13a 0 2023-12-16T20:11:42.863 INFO:tasks.workunit.client.0.smithi038.stdout:6/990: write d1/d5b/d7d/d9d/dc8/de7/d2f/d85/da2/da5/fd3 [559525,5588] 0 2023-12-16T20:11:42.864 INFO:tasks.workunit.client.0.smithi038.stdout:6/991: symlink d1/d4/l13b 0 2023-12-16T20:11:42.864 INFO:tasks.workunit.client.0.smithi038.stdout:6/992: chown d1/d16/c4a 1160608 1 2023-12-16T20:11:42.865 INFO:tasks.workunit.client.0.smithi038.stdout:6/993: symlink d1/d4/d1d/d61/da4/l13c 0 2023-12-16T20:11:42.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/994: dwrite d1/d5b/d7d/d9d/dc8/de7/db1/dbe/ff1 [0,4194304] 0 2023-12-16T20:11:42.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/995: write d1/d5b/d7d/d9d/dc8/f139 [351180,57486] 0 2023-12-16T20:11:42.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/996: stat d1/d5b/d7d/d9d/fe0 0 2023-12-16T20:11:42.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/997: chown d1/d16/d23/f10a 87365 1 2023-12-16T20:11:42.882 INFO:tasks.workunit.client.0.smithi038.stdout:6/998: dread - d1/d16/feb zero size 2023-12-16T20:11:42.884 INFO:tasks.workunit.client.0.smithi038.stdout:6/999: rmdir d1/d5b/d7d/d9d/dc8/de7 39 2023-12-16T20:11:42.888 INFO:tasks.workunit.client.0.smithi038.stderr:+ rm -rf -- ./tmp.d6soZLuafT 2023-12-16T20:11:42.896 INFO:tasks.workunit.client.1.smithi141.stdout:8/827: getdents d14/d19/dce 0 2023-12-16T20:11:42.903 INFO:tasks.workunit.client.1.smithi141.stdout:6/804: getdents d1/d12/d22 0 2023-12-16T20:11:42.920 INFO:tasks.workunit.client.1.smithi141.stdout:3/825: sync 2023-12-16T20:11:42.920 INFO:tasks.workunit.client.1.smithi141.stdout:9/609: sync 2023-12-16T20:11:42.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/682: sync 2023-12-16T20:11:42.920 INFO:tasks.workunit.client.1.smithi141.stdout:4/683: dread - d1a/d2a/d3b/f82 zero size 2023-12-16T20:11:42.922 INFO:tasks.workunit.client.1.smithi141.stdout:7/692: sync 2023-12-16T20:11:42.950 INFO:tasks.workunit.client.1.smithi141.stdout:7/693: dwrite d5/f8d [0,4194304] 0 2023-12-16T20:11:42.950 INFO:tasks.workunit.client.1.smithi141.stdout:7/694: chown d5/d16/de3/d89/lcf 2787 1 2023-12-16T20:11:42.952 INFO:tasks.workunit.client.1.smithi141.stdout:9/610: dwrite d1/d10/d14/d20/d90/f9f [0,4194304] 0 2023-12-16T20:11:42.952 INFO:tasks.workunit.client.1.smithi141.stdout:9/611: dread - d1/d10/d14/d20/d3b/f6b zero size 2023-12-16T20:11:42.952 INFO:tasks.workunit.client.1.smithi141.stdout:9/612: write d1/d10/d33/fc8 [332343,128997] 0 2023-12-16T20:11:42.953 INFO:tasks.workunit.client.1.smithi141.stdout:3/826: dwrite d0/d1c/d40/f43 [0,4194304] 0 2023-12-16T20:11:42.973 INFO:tasks.workunit.client.1.smithi141.stdout:8/828: rmdir d14/d19/d95/dab/dfd 39 2023-12-16T20:11:42.976 INFO:tasks.workunit.client.1.smithi141.stdout:1/781: getdents da/d36/d4b/d4d/dd7/de1 0 2023-12-16T20:11:42.979 INFO:tasks.workunit.client.1.smithi141.stdout:6/805: mkdir d1/d12/d22/d25/d38/d108 0 2023-12-16T20:11:42.979 INFO:tasks.workunit.client.1.smithi141.stdout:6/806: readlink d1/d3/d4f/l68 0 2023-12-16T20:11:42.984 INFO:tasks.workunit.client.1.smithi141.stdout:7/695: rmdir d5/d16/d1a 39 2023-12-16T20:11:42.991 INFO:tasks.workunit.client.1.smithi141.stdout:8/829: dwrite d14/d19/d95/dae/db4/d5b/fd6 [0,4194304] 0 2023-12-16T20:11:42.991 INFO:tasks.workunit.client.1.smithi141.stdout:8/830: creat d14/d19/d95/dae/db4/d69/f107 x:0 0 0 2023-12-16T20:11:42.991 INFO:tasks.workunit.client.1.smithi141.stdout:8/831: fdatasync d14/d19/f78 0 2023-12-16T20:11:42.991 INFO:tasks.workunit.client.1.smithi141.stdout:9/613: mkdir d1/d10/d14/d20/da/d3f/dab/dcd 0 2023-12-16T20:11:42.993 INFO:tasks.workunit.client.1.smithi141.stdout:3/827: rmdir d0/d1c/d2c/d10d 39 2023-12-16T20:11:42.993 INFO:tasks.workunit.client.1.smithi141.stdout:3/828: chown d0/d1c/d40/d85/d4c/f55 57921 1 2023-12-16T20:11:42.993 INFO:tasks.workunit.client.1.smithi141.stdout:3/829: chown d0/l4 122196 1 2023-12-16T20:11:42.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/691: sync 2023-12-16T20:11:42.997 INFO:tasks.workunit.client.1.smithi141.stdout:6/807: creat d1/d3/f109 x:0 0 0 2023-12-16T20:11:42.997 INFO:tasks.workunit.client.1.smithi141.stdout:7/696: unlink d5/d16/d30/l73 0 2023-12-16T20:11:43.004 INFO:tasks.workunit.client.1.smithi141.stdout:8/832: mkdir d14/d19/d95/dae/db4/d108 0 2023-12-16T20:11:43.006 INFO:tasks.workunit.client.1.smithi141.stdout:9/614: unlink d1/d10/d14/d20/f54 0 2023-12-16T20:11:43.007 INFO:tasks.workunit.client.1.smithi141.stdout:7/697: write d5/d16/d1a/f7f [1036303,121214] 0 2023-12-16T20:11:43.007 INFO:tasks.workunit.client.1.smithi141.stdout:3/830: mkdir d0/d1c/d40/d3f/dc1/d115 0 2023-12-16T20:11:43.009 INFO:tasks.workunit.client.1.smithi141.stdout:5/692: rename d0/d9/d16/fa5 to d0/d94/feb 0 2023-12-16T20:11:43.013 INFO:tasks.workunit.client.1.smithi141.stdout:7/698: getdents d5/d16/d1a/dd7 0 2023-12-16T20:11:43.015 INFO:tasks.workunit.client.1.smithi141.stdout:3/831: symlink d0/d1c/da9/l116 0 2023-12-16T20:11:43.016 INFO:tasks.workunit.client.1.smithi141.stdout:6/808: getdents d1/dd/d2f/de6 0 2023-12-16T20:11:43.016 INFO:tasks.workunit.client.1.smithi141.stdout:6/809: read d1/d12/d20/d3a/f6d [1586966,122530] 0 2023-12-16T20:11:43.018 INFO:tasks.workunit.client.1.smithi141.stdout:9/615: mkdir d1/dce 0 2023-12-16T20:11:43.019 INFO:tasks.workunit.client.1.smithi141.stdout:7/699: getdents d5/d16/de3/d89 0 2023-12-16T20:11:43.019 INFO:tasks.workunit.client.1.smithi141.stdout:5/693: dread d0/d14/d2c/d4a/f4d [0,4194304] 0 2023-12-16T20:11:43.019 INFO:tasks.workunit.client.1.smithi141.stdout:7/700: write d5/d2a/f7e [1194998,88319] 0 2023-12-16T20:11:43.020 INFO:tasks.workunit.client.1.smithi141.stdout:8/833: dwrite d14/d19/d95/dae/db4/d69/ff6 [0,4194304] 0 2023-12-16T20:11:43.022 INFO:tasks.workunit.client.1.smithi141.stdout:3/832: rename d0/d1c/d2c/f87 to d0/d1c/d40/d3c/f117 0 2023-12-16T20:11:43.023 INFO:tasks.workunit.client.1.smithi141.stdout:6/810: creat d1/d12/d22/d25/d38/f10a x:0 0 0 2023-12-16T20:11:43.023 INFO:tasks.workunit.client.1.smithi141.stdout:6/811: chown d1/d12/d20/d89/d95/ff2 2843545 1 2023-12-16T20:11:43.024 INFO:tasks.workunit.client.1.smithi141.stdout:6/812: dread - d1/d3/fa0 zero size 2023-12-16T20:11:43.026 INFO:tasks.workunit.client.1.smithi141.stdout:9/616: unlink d1/d10/d14/d20/db3/l65 0 2023-12-16T20:11:43.029 INFO:tasks.workunit.client.1.smithi141.stdout:5/694: link d0/d25/d30/d67/f71 d0/d9/d16/d72/dc6/fec 0 2023-12-16T20:11:43.032 INFO:tasks.workunit.client.1.smithi141.stdout:7/701: read d5/d2a/f3e [2267648,22534] 0 2023-12-16T20:11:43.034 INFO:tasks.workunit.client.1.smithi141.stdout:3/833: mknod d0/d1c/d40/d3f/c118 0 2023-12-16T20:11:43.036 INFO:tasks.workunit.client.1.smithi141.stdout:6/813: rmdir d1/d12/d20/d85/de5 39 2023-12-16T20:11:43.045 INFO:tasks.workunit.client.1.smithi141.stdout:2/620: rmdir d6 39 2023-12-16T20:11:43.045 INFO:tasks.workunit.client.1.smithi141.stdout:2/621: readlink d6/da/d33/d54/d7c/lb0 0 2023-12-16T20:11:43.047 INFO:tasks.workunit.client.1.smithi141.stdout:3/834: mknod d0/d1c/de8/def/c119 0 2023-12-16T20:11:43.050 INFO:tasks.workunit.client.1.smithi141.stdout:6/814: symlink d1/d3/d4b/d60/db8/l10b 0 2023-12-16T20:11:43.052 INFO:tasks.workunit.client.1.smithi141.stdout:4/684: creat d1a/d54/ff8 x:0 0 0 2023-12-16T20:11:43.052 INFO:tasks.workunit.client.1.smithi141.stdout:4/685: read - d1a/d2a/d3b/f82 zero size 2023-12-16T20:11:43.052 INFO:tasks.workunit.client.1.smithi141.stdout:4/686: readlink d1a/l58 0 2023-12-16T20:11:43.052 INFO:tasks.workunit.client.1.smithi141.stdout:4/687: truncate d1a/d2a/d3b/dcd/fda 322102 0 2023-12-16T20:11:43.052 INFO:tasks.workunit.client.1.smithi141.stdout:4/688: chown d1a/d54/d87/da8 44609 1 2023-12-16T20:11:43.054 INFO:tasks.workunit.client.1.smithi141.stdout:0/681: sync 2023-12-16T20:11:43.054 INFO:tasks.workunit.client.1.smithi141.stdout:4/689: link d1a/d3c/c79 d1a/d2a/d3b/dcd/cf9 0 2023-12-16T20:11:43.054 INFO:tasks.workunit.client.1.smithi141.stdout:9/617: dwrite d1/d10/f6c [0,4194304] 0 2023-12-16T20:11:43.056 INFO:tasks.workunit.client.1.smithi141.stdout:8/834: dwrite d14/d19/d95/dae/fc2 [0,4194304] 0 2023-12-16T20:11:43.056 INFO:tasks.workunit.client.1.smithi141.stdout:7/702: dwrite d5/d16/de3/d1e/d71/fc6 [0,4194304] 0 2023-12-16T20:11:43.057 INFO:tasks.workunit.client.1.smithi141.stdout:0/682: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/le7 0 2023-12-16T20:11:43.059 INFO:tasks.workunit.client.1.smithi141.stdout:4/690: symlink d1a/d4e/d63/lfa 0 2023-12-16T20:11:43.063 INFO:tasks.workunit.client.1.smithi141.stdout:8/835: rmdir d14/d35 39 2023-12-16T20:11:43.063 INFO:tasks.workunit.client.1.smithi141.stdout:8/836: chown d14/d35/f67 18 1 2023-12-16T20:11:43.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/618: read d1/d10/d14/d20/da/f32 [4116987,111291] 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:9/619: fdatasync d1/d10/d14/d20/da/f32 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:9/620: fsync d1/d10/d14/d20/d3b/f5c 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:8/837: write d14/d19/d95/fe7 [227328,33675] 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/683: mkdir d4/d49/db9/dcd/de8 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/684: fsync d4/d49/d73/d3b/d78/fc2 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/685: write d4/d49/f71 [1773766,45516] 0 2023-12-16T20:11:43.070 INFO:tasks.workunit.client.1.smithi141.stdout:0/686: creat d4/d49/d4b/da3/fe9 x:0 0 0 2023-12-16T20:11:43.071 INFO:tasks.workunit.client.1.smithi141.stdout:6/815: dwrite d1/dd/d2f/de6/f105 [0,4194304] 0 2023-12-16T20:11:43.071 INFO:tasks.workunit.client.1.smithi141.stdout:6/816: readlink d1/lc5 0 2023-12-16T20:11:43.071 INFO:tasks.workunit.client.1.smithi141.stdout:3/835: dwrite d0/d1c/d2c/d72/d74/dda/ff4 [0,4194304] 0 2023-12-16T20:11:43.072 INFO:tasks.workunit.client.1.smithi141.stdout:4/691: creat d1a/d54/d87/dbf/ffb x:0 0 0 2023-12-16T20:11:43.072 INFO:tasks.workunit.client.1.smithi141.stdout:4/692: getdents d1a/d3c/d9b/da1/dcf/df1 0 2023-12-16T20:11:43.072 INFO:tasks.workunit.client.1.smithi141.stdout:4/693: creat d1a/d4e/d63/dd1/ffc x:0 0 0 2023-12-16T20:11:43.073 INFO:tasks.workunit.client.1.smithi141.stdout:7/703: getdents d5/d2a/d45/d5a 0 2023-12-16T20:11:43.076 INFO:tasks.workunit.client.1.smithi141.stdout:9/621: creat d1/d26/d4a/d73/d76/fcf x:0 0 0 2023-12-16T20:11:43.079 INFO:tasks.workunit.client.1.smithi141.stdout:8/838: mkdir d14/d19/d95/dae/db4/d5b/dea/deb/d109 0 2023-12-16T20:11:43.085 INFO:tasks.workunit.client.1.smithi141.stdout:0/687: rename d4/d74/dc1/dbe/cbf to d4/d49/d73/d8a/da4/dcc/cea 0 2023-12-16T20:11:43.089 INFO:tasks.workunit.client.1.smithi141.stdout:8/839: write d14/d19/d95/dae/db4/f9b [80927,43814] 0 2023-12-16T20:11:43.089 INFO:tasks.workunit.client.1.smithi141.stdout:6/817: mkdir d1/d12/d20/d85/de5/de8/d10c 0 2023-12-16T20:11:43.089 INFO:tasks.workunit.client.1.smithi141.stdout:6/818: dread - d1/d12/d20/d3a/f102 zero size 2023-12-16T20:11:43.089 INFO:tasks.workunit.client.1.smithi141.stdout:6/819: chown d1/d3/d4b/d60/c8f 118 1 2023-12-16T20:11:43.089 INFO:tasks.workunit.client.1.smithi141.stdout:6/820: write d1/d12/d20/d89/d95/ff2 [1116302,119999] 0 2023-12-16T20:11:43.094 INFO:tasks.workunit.client.1.smithi141.stdout:4/694: rename f1 to d1a/d4e/d63/dd1/ffd 0 2023-12-16T20:11:43.095 INFO:tasks.workunit.client.1.smithi141.stdout:3/836: dwrite d0/d1c/d40/f27 [0,4194304] 0 2023-12-16T20:11:43.099 INFO:tasks.workunit.client.1.smithi141.stdout:2/622: creat d6/d3a/fcf x:0 0 0 2023-12-16T20:11:43.101 INFO:tasks.workunit.client.1.smithi141.stdout:4/695: unlink d1a/f9a 0 2023-12-16T20:11:43.102 INFO:tasks.workunit.client.1.smithi141.stdout:0/688: write d4/d49/d73/d3b/d78/fc2 [84123,108282] 0 2023-12-16T20:11:43.104 INFO:tasks.workunit.client.1.smithi141.stdout:3/837: symlink d0/d1c/d6a/d76/l11a 0 2023-12-16T20:11:43.107 INFO:tasks.workunit.client.1.smithi141.stdout:6/821: rename d1/d12/d20/d85/dd1 to d1/d12/d10d 0 2023-12-16T20:11:43.109 INFO:tasks.workunit.client.1.smithi141.stdout:3/838: mkdir d0/d1c/d40/d3f/d52/d5d/d11b 0 2023-12-16T20:11:43.110 INFO:tasks.workunit.client.1.smithi141.stdout:9/622: dwrite d1/d26/fad [0,4194304] 0 2023-12-16T20:11:43.113 INFO:tasks.workunit.client.1.smithi141.stdout:4/696: dread d1a/f9c [0,4194304] 0 2023-12-16T20:11:43.114 INFO:tasks.workunit.client.1.smithi141.stdout:4/697: chown d1a/d3c/d9b/fb6 0 1 2023-12-16T20:11:43.114 INFO:tasks.workunit.client.1.smithi141.stdout:0/689: read d4/d74/dc1/fa0 [3777197,63534] 0 2023-12-16T20:11:43.114 INFO:tasks.workunit.client.1.smithi141.stdout:8/840: dwrite d14/d71/d81/fe9 [0,4194304] 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:6/822: getdents d1/d3/d4f 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:6/823: fsync d1/d3/d4b/d60/def/f101 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:0/690: write d4/d49/d4b/da3/fe2 [520249,129585] 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:6/824: write d1/d12/d20/d3a/f102 [590314,70522] 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:6/825: fdatasync d1/d77/d9e/fb2 0 2023-12-16T20:11:43.115 INFO:tasks.workunit.client.1.smithi141.stdout:6/826: read d1/d12/d22/f64 [1259017,73360] 0 2023-12-16T20:11:43.116 INFO:tasks.workunit.client.1.smithi141.stdout:4/698: truncate d1a/d2a/d3b/d69/fd7 3345330 0 2023-12-16T20:11:43.116 INFO:tasks.workunit.client.1.smithi141.stdout:4/699: creat d1a/d2a/dc3/ffe x:0 0 0 2023-12-16T20:11:43.121 INFO:tasks.workunit.client.1.smithi141.stdout:2/623: dwrite d6/da/d1b/d5b/faa [0,4194304] 0 2023-12-16T20:11:43.122 INFO:tasks.workunit.client.1.smithi141.stdout:6/827: creat d1/d12/d22/d25/de0/f10e x:0 0 0 2023-12-16T20:11:43.124 INFO:tasks.workunit.client.1.smithi141.stdout:8/841: symlink d14/l10a 0 2023-12-16T20:11:43.125 INFO:tasks.workunit.client.1.smithi141.stdout:8/842: creat d14/d19/d95/dae/db4/d5b/f10b x:0 0 0 2023-12-16T20:11:43.125 INFO:tasks.workunit.client.1.smithi141.stdout:8/843: creat d14/d19/d1b/d3d/d5e/f10c x:0 0 0 2023-12-16T20:11:43.126 INFO:tasks.workunit.client.1.smithi141.stdout:3/839: dread d0/f68 [0,4194304] 0 2023-12-16T20:11:43.126 INFO:tasks.workunit.client.1.smithi141.stdout:6/828: stat d1/d12/d20/d44/l9d 0 2023-12-16T20:11:43.126 INFO:tasks.workunit.client.1.smithi141.stdout:3/840: write d0/d1c/fa1 [1006223,122469] 0 2023-12-16T20:11:43.126 INFO:tasks.workunit.client.1.smithi141.stdout:6/829: truncate d1/dd/d2f/d48/fba 121610 0 2023-12-16T20:11:43.128 INFO:tasks.workunit.client.1.smithi141.stdout:9/623: dread d1/d10/d14/d20/f86 [0,4194304] 0 2023-12-16T20:11:43.134 INFO:tasks.workunit.client.1.smithi141.stdout:6/830: unlink d1/d12/d20/d44/d4a/led 0 2023-12-16T20:11:43.134 INFO:tasks.workunit.client.1.smithi141.stdout:0/691: dread d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:43.137 INFO:tasks.workunit.client.1.smithi141.stdout:1/782: symlink da/d36/d4b/d4d/d80/l100 0 2023-12-16T20:11:43.137 INFO:tasks.workunit.client.1.smithi141.stdout:1/783: stat da/d36/d4b/d4d/d89/ca4 0 2023-12-16T20:11:43.142 INFO:tasks.workunit.client.1.smithi141.stdout:9/624: creat d1/d10/d33/d6a/fd0 x:0 0 0 2023-12-16T20:11:43.142 INFO:tasks.workunit.client.1.smithi141.stdout:2/624: read d6/d32/f57 [3518072,57662] 0 2023-12-16T20:11:43.143 INFO:tasks.workunit.client.1.smithi141.stdout:4/700: dwrite d1a/d54/d87/da8/f94 [0,4194304] 0 2023-12-16T20:11:43.143 INFO:tasks.workunit.client.1.smithi141.stdout:6/831: link d1/d12/d20/d44/lbf d1/dd/d2f/d48/l10f 0 2023-12-16T20:11:43.144 INFO:tasks.workunit.client.1.smithi141.stdout:1/784: creat da/d1a/d1d/d22/f101 x:0 0 0 2023-12-16T20:11:43.146 INFO:tasks.workunit.client.1.smithi141.stdout:9/625: rename d1/d10/d14/d20/d90/cc9 to d1/d10/d14/d20/d90/cd1 0 2023-12-16T20:11:43.146 INFO:tasks.workunit.client.1.smithi141.stdout:9/626: chown d1/d10/d33/d47/f5b 50391 1 2023-12-16T20:11:43.147 INFO:tasks.workunit.client.1.smithi141.stdout:2/625: rename d6/da/d33/d54/d7c/c8a to d6/d3a/d47/d58/d66/d6c/d98/cd0 0 2023-12-16T20:11:43.149 INFO:tasks.workunit.client.1.smithi141.stdout:4/701: symlink d1a/d2a/dc2/lff 0 2023-12-16T20:11:43.149 INFO:tasks.workunit.client.1.smithi141.stdout:4/702: dread - d1a/d54/d87/da8/f97 zero size 2023-12-16T20:11:43.150 INFO:tasks.workunit.client.1.smithi141.stdout:6/832: creat d1/d12/f110 x:0 0 0 2023-12-16T20:11:43.151 INFO:tasks.workunit.client.1.smithi141.stdout:9/627: creat d1/fd2 x:0 0 0 2023-12-16T20:11:43.153 INFO:tasks.workunit.client.1.smithi141.stdout:1/785: rename da/d1a/f51 to da/d36/d4b/d4d/d89/d61/f102 0 2023-12-16T20:11:43.154 INFO:tasks.workunit.client.1.smithi141.stdout:3/841: dwrite d0/d1c/f6e [4194304,4194304] 0 2023-12-16T20:11:43.154 INFO:tasks.workunit.client.1.smithi141.stdout:6/833: dread d1/d12/d20/d3a/f102 [0,4194304] 0 2023-12-16T20:11:43.155 INFO:tasks.workunit.client.1.smithi141.stdout:9/628: getdents d1/d26/d3c/d9b 0 2023-12-16T20:11:43.155 INFO:tasks.workunit.client.1.smithi141.stdout:8/844: dwrite d14/d19/d95/dae/db4/d69/dd4/fd9 [0,4194304] 0 2023-12-16T20:11:43.156 INFO:tasks.workunit.client.1.smithi141.stdout:1/786: unlink da/d36/f66 0 2023-12-16T20:11:43.159 INFO:tasks.workunit.client.1.smithi141.stdout:3/842: mkdir d0/d1c/d2c/d72/d74/dda/d11c 0 2023-12-16T20:11:43.159 INFO:tasks.workunit.client.1.smithi141.stdout:3/843: dread - d0/d1c/d2c/d10d/df9/df8/da3/ff0 zero size 2023-12-16T20:11:43.160 INFO:tasks.workunit.client.1.smithi141.stdout:6/834: creat d1/d12/d20/d89/f111 x:0 0 0 2023-12-16T20:11:43.162 INFO:tasks.workunit.client.1.smithi141.stdout:9/629: unlink d1/d10/d14/d20/d84/l85 0 2023-12-16T20:11:43.164 INFO:tasks.workunit.client.1.smithi141.stdout:2/626: dwrite d6/d32/f64 [4194304,4194304] 0 2023-12-16T20:11:43.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/787: rename da/d36/d4b/d4d/d89/d6c/l9f to da/d1a/dd1/l103 0 2023-12-16T20:11:43.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/788: write da/d1a/d1d/fd8 [1512186,27338] 0 2023-12-16T20:11:43.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/789: fdatasync da/d1a/d1d/f5d 0 2023-12-16T20:11:43.167 INFO:tasks.workunit.client.1.smithi141.stdout:1/790: creat da/d36/d4b/db2/f104 x:0 0 0 2023-12-16T20:11:43.169 INFO:tasks.workunit.client.1.smithi141.stdout:3/844: truncate d0/d1c/d40/f43 3752864 0 2023-12-16T20:11:43.170 INFO:tasks.workunit.client.1.smithi141.stdout:6/835: creat d1/f112 x:0 0 0 2023-12-16T20:11:43.172 INFO:tasks.workunit.client.1.smithi141.stdout:9/630: mkdir d1/d10/d14/d20/da/d3f/dab/dcd/dd3 0 2023-12-16T20:11:43.172 INFO:tasks.workunit.client.1.smithi141.stdout:9/631: fdatasync d1/d10/d33/f34 0 2023-12-16T20:11:43.172 INFO:tasks.workunit.client.1.smithi141.stdout:9/632: creat d1/d10/d33/d47/d8d/dc4/fd4 x:0 0 0 2023-12-16T20:11:43.173 INFO:tasks.workunit.client.1.smithi141.stdout:2/627: dread d6/d3a/d47/d58/d66/f7b [0,4194304] 0 2023-12-16T20:11:43.173 INFO:tasks.workunit.client.1.smithi141.stdout:2/628: truncate d6/f9e 292638 0 2023-12-16T20:11:43.173 INFO:tasks.workunit.client.1.smithi141.stdout:2/629: truncate d6/da/d1b/f27 4591536 0 2023-12-16T20:11:43.176 INFO:tasks.workunit.client.1.smithi141.stdout:8/845: symlink d14/d19/d1b/d24/dc8/l10d 0 2023-12-16T20:11:43.181 INFO:tasks.workunit.client.1.smithi141.stdout:3/845: mknod d0/d1c/d40/d3c/dce/c11d 0 2023-12-16T20:11:43.187 INFO:tasks.workunit.client.1.smithi141.stdout:9/633: rename d1/d10/d33/d47/l80 to d1/d26/d3c/d9b/ld5 0 2023-12-16T20:11:43.189 INFO:tasks.workunit.client.1.smithi141.stdout:8/846: unlink d14/l6f 0 2023-12-16T20:11:43.189 INFO:tasks.workunit.client.1.smithi141.stdout:1/791: dwrite da/d36/d4b/d4d/d80/d94/fc4 [0,4194304] 0 2023-12-16T20:11:43.191 INFO:tasks.workunit.client.1.smithi141.stdout:3/846: rmdir d0/d1c/d2c/dc0/d110 0 2023-12-16T20:11:43.193 INFO:tasks.workunit.client.1.smithi141.stdout:9/634: mkdir d1/d10/d14/d20/dd6 0 2023-12-16T20:11:43.196 INFO:tasks.workunit.client.1.smithi141.stdout:2/630: mkdir d6/dd1 0 2023-12-16T20:11:43.197 INFO:tasks.workunit.client.1.smithi141.stdout:2/631: truncate d6/d3a/d47/d58/d66/d6c/d98/fac 845845 0 2023-12-16T20:11:43.197 INFO:tasks.workunit.client.1.smithi141.stdout:6/836: dwrite d1/d3/f109 [0,4194304] 0 2023-12-16T20:11:43.197 INFO:tasks.workunit.client.1.smithi141.stdout:6/837: chown d1/d5e/da9/fda 47166782 1 2023-12-16T20:11:43.198 INFO:tasks.workunit.client.1.smithi141.stdout:3/847: mknod d0/d1c/d40/d3f/d52/c11e 0 2023-12-16T20:11:43.198 INFO:tasks.workunit.client.1.smithi141.stdout:3/848: dread - d0/d1c/d2c/d10d/fed zero size 2023-12-16T20:11:43.201 INFO:tasks.workunit.client.1.smithi141.stdout:8/847: dread d14/d19/d1b/d3d/f96 [4194304,4194304] 0 2023-12-16T20:11:43.204 INFO:tasks.workunit.client.1.smithi141.stdout:6/838: mknod d1/d3/d4b/c113 0 2023-12-16T20:11:43.205 INFO:tasks.workunit.client.1.smithi141.stdout:8/848: write d14/d19/d1b/f1a [422696,105524] 0 2023-12-16T20:11:43.205 INFO:tasks.workunit.client.1.smithi141.stdout:1/792: getdents da/d36/d4b 0 2023-12-16T20:11:43.208 INFO:tasks.workunit.client.1.smithi141.stdout:2/632: dread d6/d3a/d47/d58/f71 [0,4194304] 0 2023-12-16T20:11:43.208 INFO:tasks.workunit.client.1.smithi141.stdout:2/633: write d6/da/d33/d54/f7f [135463,65171] 0 2023-12-16T20:11:43.208 INFO:tasks.workunit.client.1.smithi141.stdout:6/839: mknod d1/d3/d4b/dec/c114 0 2023-12-16T20:11:43.211 INFO:tasks.workunit.client.1.smithi141.stdout:2/634: rmdir d6/da 39 2023-12-16T20:11:43.215 INFO:tasks.workunit.client.1.smithi141.stdout:2/635: rename d6/d3a/d47/d58/d66/fc6 to d6/d12/d1f/d46/d5a/fd2 0 2023-12-16T20:11:43.216 INFO:tasks.workunit.client.1.smithi141.stdout:9/635: dwrite d1/d10/d14/d20/da/d3f/fc3 [0,4194304] 0 2023-12-16T20:11:43.221 INFO:tasks.workunit.client.1.smithi141.stdout:8/849: dread d14/d19/d1b/d3d/f3e [0,4194304] 0 2023-12-16T20:11:43.222 INFO:tasks.workunit.client.1.smithi141.stdout:8/850: readlink d14/d19/d1b/d24/da3/l101 0 2023-12-16T20:11:43.224 INFO:tasks.workunit.client.1.smithi141.stdout:8/851: truncate d14/d35/f66 3094726 0 2023-12-16T20:11:43.226 INFO:tasks.workunit.client.1.smithi141.stdout:8/852: symlink d14/d19/d1b/l10e 0 2023-12-16T20:11:43.231 INFO:tasks.workunit.client.1.smithi141.stdout:8/853: unlink d14/d19/d1b/d24/c54 0 2023-12-16T20:11:43.231 INFO:tasks.workunit.client.1.smithi141.stdout:2/636: dread d6/d12/d1f/fa6 [0,4194304] 0 2023-12-16T20:11:43.231 INFO:tasks.workunit.client.1.smithi141.stdout:2/637: dread - d6/d32/d52/fba zero size 2023-12-16T20:11:43.234 INFO:tasks.workunit.client.1.smithi141.stdout:2/638: mknod d6/d12/d1f/d46/d5a/cd3 0 2023-12-16T20:11:43.236 INFO:tasks.workunit.client.1.smithi141.stdout:8/854: mknod d14/d19/d1b/d24/d4b/d8c/c10f 0 2023-12-16T20:11:43.236 INFO:tasks.workunit.client.1.smithi141.stdout:8/855: read d14/f79 [74208,59957] 0 2023-12-16T20:11:43.236 INFO:tasks.workunit.client.1.smithi141.stdout:8/856: dread - d14/d19/d95/dae/db4/d58/d8b/fc7 zero size 2023-12-16T20:11:43.236 INFO:tasks.workunit.client.1.smithi141.stdout:8/857: fsync d14/d19/d95/dae/db4/f6d 0 2023-12-16T20:11:43.236 INFO:tasks.workunit.client.1.smithi141.stdout:8/858: chown d14/d19/d1b/d24/d4b/d8c/c10f 5294784 1 2023-12-16T20:11:43.237 INFO:tasks.workunit.client.1.smithi141.stdout:2/639: mknod d6/d32/d7a/d5f/d92/cd4 0 2023-12-16T20:11:43.237 INFO:tasks.workunit.client.1.smithi141.stdout:2/640: write d6/d3a/d47/d58/d66/d6c/d98/fac [1222734,47513] 0 2023-12-16T20:11:43.237 INFO:tasks.workunit.client.1.smithi141.stdout:2/641: write d6/d32/d52/d53/f74 [1944637,49847] 0 2023-12-16T20:11:43.242 INFO:tasks.workunit.client.1.smithi141.stdout:6/840: dwrite d1/d12/d20/d44/f103 [4194304,4194304] 0 2023-12-16T20:11:43.242 INFO:tasks.workunit.client.1.smithi141.stdout:4/703: dwrite d1a/f29 [0,4194304] 0 2023-12-16T20:11:43.243 INFO:tasks.workunit.client.1.smithi141.stdout:4/704: stat d1a 0 2023-12-16T20:11:43.244 INFO:tasks.workunit.client.1.smithi141.stdout:6/841: dread d1/d12/d20/d44/d4a/f79 [0,4194304] 0 2023-12-16T20:11:43.244 INFO:tasks.workunit.client.1.smithi141.stdout:6/842: stat d1/dbd/ff5 0 2023-12-16T20:11:43.244 INFO:tasks.workunit.client.1.smithi141.stdout:9/636: dwrite d1/d26/d4a/d73/f92 [0,4194304] 0 2023-12-16T20:11:43.252 INFO:tasks.workunit.client.1.smithi141.stdout:2/642: dwrite d6/da/fb1 [4194304,4194304] 0 2023-12-16T20:11:43.252 INFO:tasks.workunit.client.1.smithi141.stdout:2/643: chown d6/da/d33/d54/d73/f89 106072 1 2023-12-16T20:11:43.252 INFO:tasks.workunit.client.1.smithi141.stdout:2/644: fdatasync d6/d12/d1f/d46/f9a 0 2023-12-16T20:11:43.253 INFO:tasks.workunit.client.1.smithi141.stdout:6/843: unlink d1/d12/d22/ffa 0 2023-12-16T20:11:43.253 INFO:tasks.workunit.client.1.smithi141.stdout:6/844: fdatasync d1/d12/d20/d3a/f6d 0 2023-12-16T20:11:43.257 INFO:tasks.workunit.client.1.smithi141.stdout:9/637: creat d1/d10/d14/d20/da/d3f/d66/fd7 x:0 0 0 2023-12-16T20:11:43.259 INFO:tasks.workunit.client.1.smithi141.stdout:8/859: rename d14/d19/d95/dae to d14/d19/d95/dab/dfd/d110 0 2023-12-16T20:11:43.261 INFO:tasks.workunit.client.1.smithi141.stdout:6/845: dread d1/d3/d4b/d60/def/f101 [0,4194304] 0 2023-12-16T20:11:43.262 INFO:tasks.workunit.client.1.smithi141.stdout:2/645: write d6/d32/d7a/d5f/fb3 [2045295,35050] 0 2023-12-16T20:11:43.267 INFO:tasks.workunit.client.1.smithi141.stdout:9/638: mknod d1/d26/da1/cd8 0 2023-12-16T20:11:43.267 INFO:tasks.workunit.client.1.smithi141.stdout:9/639: chown d1/d10/d27/fa9 7 1 2023-12-16T20:11:43.267 INFO:tasks.workunit.client.1.smithi141.stdout:9/640: write d1/d10/d33/fc2 [261187,3556] 0 2023-12-16T20:11:43.269 INFO:tasks.workunit.client.1.smithi141.stdout:6/846: creat d1/d3/d4b/d60/db8/f115 x:0 0 0 2023-12-16T20:11:43.272 INFO:tasks.workunit.client.1.smithi141.stdout:6/847: dread d1/d3/d4b/d60/f99 [0,4194304] 0 2023-12-16T20:11:43.272 INFO:tasks.workunit.client.1.smithi141.stdout:6/848: creat d1/dd/de/d8a/f116 x:0 0 0 2023-12-16T20:11:43.274 INFO:tasks.workunit.client.1.smithi141.stdout:9/641: mkdir d1/d10/d14/d20/da/d3f/dab/dcd/dd9 0 2023-12-16T20:11:43.276 INFO:tasks.workunit.client.1.smithi141.stdout:2/646: read d6/da/d33/d54/d73/f89 [349903,103374] 0 2023-12-16T20:11:43.277 INFO:tasks.workunit.client.1.smithi141.stdout:2/647: write d6/d3a/d47/d58/f72 [674130,52431] 0 2023-12-16T20:11:43.277 INFO:tasks.workunit.client.1.smithi141.stdout:2/648: chown d6/d12/d15/c7d 10170895 1 2023-12-16T20:11:43.277 INFO:tasks.workunit.client.1.smithi141.stdout:4/705: rename d1a/d59/d89/d8a/fde to d1a/f100 0 2023-12-16T20:11:43.277 INFO:tasks.workunit.client.1.smithi141.stdout:4/706: truncate d1a/d2a/f6b 47476 0 2023-12-16T20:11:43.279 INFO:tasks.workunit.client.1.smithi141.stdout:8/860: unlink d14/d35/f66 0 2023-12-16T20:11:43.282 INFO:tasks.workunit.client.1.smithi141.stdout:6/849: symlink d1/d3/d4b/d60/db8/l117 0 2023-12-16T20:11:43.284 INFO:tasks.workunit.client.1.smithi141.stdout:2/649: mkdir d6/d3a/dd5 0 2023-12-16T20:11:43.287 INFO:tasks.workunit.client.1.smithi141.stdout:4/707: creat d1a/d2a/d3b/f101 x:0 0 0 2023-12-16T20:11:43.292 INFO:tasks.workunit.client.1.smithi141.stdout:9/642: dwrite d1/d10/d27/d36/f7a [0,4194304] 0 2023-12-16T20:11:43.292 INFO:tasks.workunit.client.1.smithi141.stdout:9/643: dread - d1/d26/fbb zero size 2023-12-16T20:11:43.294 INFO:tasks.workunit.client.1.smithi141.stdout:6/850: mknod d1/d12/d20/c118 0 2023-12-16T20:11:43.296 INFO:tasks.workunit.client.1.smithi141.stdout:2/650: creat d6/d12/fd6 x:0 0 0 2023-12-16T20:11:43.298 INFO:tasks.workunit.client.1.smithi141.stdout:8/861: link d14/d19/d1b/f48 d14/d19/d95/dab/dfd/d110/db4/d108/f111 0 2023-12-16T20:11:43.303 INFO:tasks.workunit.client.1.smithi141.stdout:6/851: dread d1/d12/d20/d44/f6b [0,4194304] 0 2023-12-16T20:11:43.306 INFO:tasks.workunit.client.1.smithi141.stdout:2/651: write d6/da/fb1 [6612897,12633] 0 2023-12-16T20:11:43.307 INFO:tasks.workunit.client.1.smithi141.stdout:6/852: fsync d1/d12/d22/d25/f7e 0 2023-12-16T20:11:43.307 INFO:tasks.workunit.client.1.smithi141.stdout:6/853: chown d1/dd/c74 25 1 2023-12-16T20:11:43.309 INFO:tasks.workunit.client.1.smithi141.stdout:2/652: creat d6/da/d1b/d5b/d6a/d85/fd7 x:0 0 0 2023-12-16T20:11:43.309 INFO:tasks.workunit.client.1.smithi141.stdout:2/653: chown d6/da/d1b/d5b/d6a/d85/f9c 12 1 2023-12-16T20:11:43.310 INFO:tasks.workunit.client.1.smithi141.stdout:8/862: unlink d14/d19/d1b/d24/fbd 0 2023-12-16T20:11:43.311 INFO:tasks.workunit.client.1.smithi141.stdout:2/654: mkdir d6/d12/dd8 0 2023-12-16T20:11:43.312 INFO:tasks.workunit.client.1.smithi141.stdout:4/708: dwrite d1a/d3c/f5d [0,4194304] 0 2023-12-16T20:11:43.312 INFO:tasks.workunit.client.1.smithi141.stdout:4/709: stat d1a/d3c/d9b/da1/dcf 0 2023-12-16T20:11:43.313 INFO:tasks.workunit.client.1.smithi141.stdout:2/655: stat d6/da/d4a/c5c 0 2023-12-16T20:11:43.317 INFO:tasks.workunit.client.1.smithi141.stdout:4/710: mknod d1a/d2a/d3b/c102 0 2023-12-16T20:11:43.318 INFO:tasks.workunit.client.1.smithi141.stdout:4/711: write f9 [3482583,119412] 0 2023-12-16T20:11:43.318 INFO:tasks.workunit.client.1.smithi141.stdout:4/712: chown d1a/d54/d87/da8/f94 33 1 2023-12-16T20:11:43.319 INFO:tasks.workunit.client.1.smithi141.stdout:2/656: symlink d6/d32/d7a/d5f/d92/ld9 0 2023-12-16T20:11:43.319 INFO:tasks.workunit.client.1.smithi141.stdout:2/657: stat d6/da/d1b/d5b/d6a/d85/f9c 0 2023-12-16T20:11:43.322 INFO:tasks.workunit.client.1.smithi141.stdout:9/644: dwrite d1/d26/fad [0,4194304] 0 2023-12-16T20:11:43.322 INFO:tasks.workunit.client.1.smithi141.stdout:9/645: write d1/d10/d14/d20/da/d3f/dab/fbe [3485971,40990] 0 2023-12-16T20:11:43.322 INFO:tasks.workunit.client.1.smithi141.stdout:8/863: dread d14/d19/d1b/d24/f49 [4194304,4194304] 0 2023-12-16T20:11:43.323 INFO:tasks.workunit.client.1.smithi141.stdout:2/658: symlink d6/da/d33/d54/lda 0 2023-12-16T20:11:43.326 INFO:tasks.workunit.client.1.smithi141.stdout:2/659: truncate d6/da/d1b/f27 1481589 0 2023-12-16T20:11:43.332 INFO:tasks.workunit.client.1.smithi141.stdout:2/660: write d6/d12/d1f/fa6 [1215064,60230] 0 2023-12-16T20:11:43.333 INFO:tasks.workunit.client.1.smithi141.stdout:2/661: creat d6/da/d1b/d5b/d6a/d85/fdb x:0 0 0 2023-12-16T20:11:43.333 INFO:tasks.workunit.client.1.smithi141.stdout:2/662: readlink d6/d3a/d47/d58/d8c/la3 0 2023-12-16T20:11:43.333 INFO:tasks.workunit.client.1.smithi141.stdout:2/663: fdatasync d6/da/d1b/d5b/d6a/d85/fd7 0 2023-12-16T20:11:43.338 INFO:tasks.workunit.client.1.smithi141.stdout:4/713: dwrite d1a/d4e/fc4 [0,4194304] 0 2023-12-16T20:11:43.341 INFO:tasks.workunit.client.1.smithi141.stdout:7/704: sync 2023-12-16T20:11:43.341 INFO:tasks.workunit.client.1.smithi141.stdout:5/695: sync 2023-12-16T20:11:43.341 INFO:tasks.workunit.client.1.smithi141.stdout:5/696: chown d0/d25/fd3 114678271 1 2023-12-16T20:11:43.342 INFO:tasks.workunit.client.1.smithi141.stdout:7/705: mknod d5/d16/d30/d36/d8c/ce8 0 2023-12-16T20:11:43.343 INFO:tasks.workunit.client.1.smithi141.stdout:5/697: mknod d0/d9/d16/d72/ced 0 2023-12-16T20:11:43.344 INFO:tasks.workunit.client.1.smithi141.stdout:9/646: dwrite d1/d26/f91 [0,4194304] 0 2023-12-16T20:11:43.345 INFO:tasks.workunit.client.1.smithi141.stdout:7/706: symlink d5/d16/d1a/de7/le9 0 2023-12-16T20:11:43.345 INFO:tasks.workunit.client.1.smithi141.stdout:7/707: chown d5/d16/d46/l4d 3539050 1 2023-12-16T20:11:43.347 INFO:tasks.workunit.client.1.smithi141.stdout:5/698: mkdir d0/d9/d16/d2a/d35/d5e/dee 0 2023-12-16T20:11:43.347 INFO:tasks.workunit.client.1.smithi141.stdout:5/699: write d0/d9/d16/d2a/d35/d5e/d95/fd6 [334163,128927] 0 2023-12-16T20:11:43.348 INFO:tasks.workunit.client.1.smithi141.stdout:2/664: dwrite d6/d12/d1f/d46/f9a [4194304,4194304] 0 2023-12-16T20:11:43.350 INFO:tasks.workunit.client.1.smithi141.stdout:7/708: unlink d5/d16/d46/d61/f99 0 2023-12-16T20:11:43.350 INFO:tasks.workunit.client.1.smithi141.stdout:7/709: chown d5/d16/l33 1 1 2023-12-16T20:11:43.353 INFO:tasks.workunit.client.1.smithi141.stdout:4/714: dread d1a/d2a/f37 [0,4194304] 0 2023-12-16T20:11:43.356 INFO:tasks.workunit.client.1.smithi141.stdout:4/715: rmdir d1a/d59/d89/d8a 39 2023-12-16T20:11:43.358 INFO:tasks.workunit.client.1.smithi141.stdout:4/716: creat d1a/d2a/dc2/f103 x:0 0 0 2023-12-16T20:11:43.359 INFO:tasks.workunit.client.1.smithi141.stdout:7/710: write d5/d16/d46/f90 [5730693,96974] 0 2023-12-16T20:11:43.360 INFO:tasks.workunit.client.1.smithi141.stdout:4/717: symlink d1a/d3c/d9b/da1/l104 0 2023-12-16T20:11:43.361 INFO:tasks.workunit.client.1.smithi141.stdout:4/718: write d1a/f9c [3664890,55867] 0 2023-12-16T20:11:43.364 INFO:tasks.workunit.client.1.smithi141.stdout:5/700: write d0/d9/d16/d2a/fa2 [120271,105962] 0 2023-12-16T20:11:43.364 INFO:tasks.workunit.client.1.smithi141.stdout:2/665: read d6/d12/f29 [927322,60239] 0 2023-12-16T20:11:43.367 INFO:tasks.workunit.client.1.smithi141.stdout:5/701: creat d0/d9/d16/d72/dc6/fef x:0 0 0 2023-12-16T20:11:43.369 INFO:tasks.workunit.client.1.smithi141.stdout:7/711: dread d5/f13 [0,4194304] 0 2023-12-16T20:11:43.370 INFO:tasks.workunit.client.1.smithi141.stdout:7/712: dread - d5/d16/d30/d4e/d6e/f88 zero size 2023-12-16T20:11:43.370 INFO:tasks.workunit.client.1.smithi141.stdout:7/713: getdents d5/d16/d1a/dd7/de6 0 2023-12-16T20:11:43.370 INFO:tasks.workunit.client.1.smithi141.stdout:2/666: creat d6/d3a/d47/d58/d66/d6c/d98/fdc x:0 0 0 2023-12-16T20:11:43.370 INFO:tasks.workunit.client.1.smithi141.stdout:9/647: dwrite d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:43.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/702: mknod d0/d9/d16/d72/dd7/cf0 0 2023-12-16T20:11:43.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/703: write d0/d9/f34 [1334447,61056] 0 2023-12-16T20:11:43.372 INFO:tasks.workunit.client.1.smithi141.stdout:7/714: truncate d5/d2a/f2d 2642831 0 2023-12-16T20:11:43.374 INFO:tasks.workunit.client.1.smithi141.stdout:2/667: link d6/d3a/d47/d58/l61 d6/da/ldd 0 2023-12-16T20:11:43.374 INFO:tasks.workunit.client.1.smithi141.stdout:2/668: stat d6/d3a/d47/d58/f71 0 2023-12-16T20:11:43.374 INFO:tasks.workunit.client.1.smithi141.stdout:2/669: read - d6/da/fae zero size 2023-12-16T20:11:43.376 INFO:tasks.workunit.client.1.smithi141.stdout:9/648: unlink d1/d10/d14/d20/l59 0 2023-12-16T20:11:43.378 INFO:tasks.workunit.client.1.smithi141.stdout:7/715: symlink d5/d2a/d45/d5a/lea 0 2023-12-16T20:11:43.383 INFO:tasks.workunit.client.1.smithi141.stdout:2/670: dread d6/f1d [0,4194304] 0 2023-12-16T20:11:43.387 INFO:tasks.workunit.client.1.smithi141.stdout:9/649: creat d1/d10/d14/d20/da/d3f/dab/dcd/fda x:0 0 0 2023-12-16T20:11:43.388 INFO:tasks.workunit.client.1.smithi141.stdout:7/716: mkdir d5/d16/de3/deb 0 2023-12-16T20:11:43.388 INFO:tasks.workunit.client.1.smithi141.stdout:7/717: chown d5/d16/d30/d4e 1627631 1 2023-12-16T20:11:43.389 INFO:tasks.workunit.client.1.smithi141.stdout:2/671: getdents d6/da/d1b/d5b/d6a 0 2023-12-16T20:11:43.389 INFO:tasks.workunit.client.1.smithi141.stdout:2/672: dread d6/f9e [0,4194304] 0 2023-12-16T20:11:43.394 INFO:tasks.workunit.client.1.smithi141.stdout:7/718: rmdir d5/d16/d1a/d40 39 2023-12-16T20:11:43.394 INFO:tasks.workunit.client.1.smithi141.stdout:7/719: read - d5/d16/d30/d4e/d6e/f88 zero size 2023-12-16T20:11:43.402 INFO:tasks.workunit.client.1.smithi141.stdout:9/650: dread d1/d26/f2f [0,4194304] 0 2023-12-16T20:11:43.407 INFO:tasks.workunit.client.1.smithi141.stdout:4/719: dwrite d1a/f20 [0,4194304] 0 2023-12-16T20:11:43.409 INFO:tasks.workunit.client.1.smithi141.stdout:4/720: mknod d1a/d54/d87/da8/da9/c105 0 2023-12-16T20:11:43.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/720: dwrite d5/d16/de3/d1e/d71/fc6 [4194304,4194304] 0 2023-12-16T20:11:43.419 INFO:tasks.workunit.client.1.smithi141.stdout:5/704: dwrite d0/d9/d16/d2a/d35/d4c/fb7 [0,4194304] 0 2023-12-16T20:11:43.419 INFO:tasks.workunit.client.1.smithi141.stdout:5/705: readlink d0/l7 0 2023-12-16T20:11:43.419 INFO:tasks.workunit.client.1.smithi141.stdout:5/706: dread - d0/d14/d2c/fc5 zero size 2023-12-16T20:11:43.420 INFO:tasks.workunit.client.1.smithi141.stdout:2/673: dwrite d6/da/d33/d54/d73/d80/f9b [0,4194304] 0 2023-12-16T20:11:43.423 INFO:tasks.workunit.client.1.smithi141.stdout:5/707: creat d0/ff1 x:0 0 0 2023-12-16T20:11:43.423 INFO:tasks.workunit.client.1.smithi141.stdout:5/708: read d0/d14/d98/fa1 [1794447,28311] 0 2023-12-16T20:11:43.423 INFO:tasks.workunit.client.1.smithi141.stdout:5/709: chown d0/d9/d16/d72/f92 796145 1 2023-12-16T20:11:43.423 INFO:tasks.workunit.client.1.smithi141.stdout:5/710: fdatasync d0/d25/f96 0 2023-12-16T20:11:43.423 INFO:tasks.workunit.client.1.smithi141.stdout:5/711: fsync d0/d25/fdd 0 2023-12-16T20:11:43.424 INFO:tasks.workunit.client.1.smithi141.stdout:4/721: read d1a/d54/f6a [3669947,38401] 0 2023-12-16T20:11:43.426 INFO:tasks.workunit.client.1.smithi141.stdout:5/712: mknod d0/d14/d2c/d90/cf2 0 2023-12-16T20:11:43.427 INFO:tasks.workunit.client.1.smithi141.stdout:7/721: write d5/f8d [2781250,20105] 0 2023-12-16T20:11:43.428 INFO:tasks.workunit.client.1.smithi141.stdout:4/722: creat d1a/d3c/d9b/da1/dcf/f106 x:0 0 0 2023-12-16T20:11:43.430 INFO:tasks.workunit.client.1.smithi141.stdout:9/651: dwrite d1/d10/d33/d47/d83/f8f [4194304,4194304] 0 2023-12-16T20:11:43.436 INFO:tasks.workunit.client.1.smithi141.stdout:7/722: rename d5/fc to d5/d16/d30/d4e/fec 0 2023-12-16T20:11:43.436 INFO:tasks.workunit.client.1.smithi141.stdout:7/723: write d5/d16/de3/d1e/d71/fe2 [795948,116700] 0 2023-12-16T20:11:43.436 INFO:tasks.workunit.client.1.smithi141.stdout:2/674: dwrite d6/da/d68/fab [0,4194304] 0 2023-12-16T20:11:43.437 INFO:tasks.workunit.client.1.smithi141.stdout:4/723: creat d1a/d4e/d63/daa/db9/df6/f107 x:0 0 0 2023-12-16T20:11:43.439 INFO:tasks.workunit.client.1.smithi141.stdout:9/652: write d1/d26/d4a/d73/f5e [1020575,55102] 0 2023-12-16T20:11:43.441 INFO:tasks.workunit.client.1.smithi141.stdout:7/724: truncate d5/d2a/fa9 1415080 0 2023-12-16T20:11:43.445 INFO:tasks.workunit.client.1.smithi141.stdout:2/675: symlink d6/da/d4a/lde 0 2023-12-16T20:11:43.453 INFO:tasks.workunit.client.1.smithi141.stdout:7/725: write d5/d16/de3/d1e/d71/f8e [363122,42549] 0 2023-12-16T20:11:43.455 INFO:tasks.workunit.client.1.smithi141.stdout:2/676: rename d6/d3a/d47/d58/d66/d6c to d6/d32/d7a/ddf 0 2023-12-16T20:11:43.458 INFO:tasks.workunit.client.1.smithi141.stdout:4/724: dwrite d1a/d2a/f37 [4194304,4194304] 0 2023-12-16T20:11:43.458 INFO:tasks.workunit.client.1.smithi141.stdout:4/725: truncate d1a/d3c/d9b/da1/fdb 271644 0 2023-12-16T20:11:43.458 INFO:tasks.workunit.client.1.smithi141.stdout:4/726: dread - d1a/d4e/d63/daa/db9/df6/f107 zero size 2023-12-16T20:11:43.461 INFO:tasks.workunit.client.1.smithi141.stdout:7/726: dread d5/d16/d30/f57 [0,4194304] 0 2023-12-16T20:11:43.461 INFO:tasks.workunit.client.1.smithi141.stdout:7/727: chown d5/d16/de3/d1e/d71 12798166 1 2023-12-16T20:11:43.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/727: link d1a/d3c/c5c d1a/d3c/d9b/da1/dcf/c108 0 2023-12-16T20:11:43.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/728: read - d1a/d4e/d63/dd1/fdc zero size 2023-12-16T20:11:43.462 INFO:tasks.workunit.client.1.smithi141.stdout:4/729: readlink d1a/l58 0 2023-12-16T20:11:43.464 INFO:tasks.workunit.client.1.smithi141.stdout:9/653: dwrite d1/d10/d33/d47/d8d/dc4/fcb [0,4194304] 0 2023-12-16T20:11:43.465 INFO:tasks.workunit.client.1.smithi141.stdout:7/728: link d5/d2a/f3d d5/d16/d1a/d40/dab/dd5/fed 0 2023-12-16T20:11:43.466 INFO:tasks.workunit.client.1.smithi141.stdout:7/729: write d5/d16/d1a/d40/fcc [445241,16565] 0 2023-12-16T20:11:43.466 INFO:tasks.workunit.client.1.smithi141.stdout:9/654: dread d1/d26/d4a/f88 [0,4194304] 0 2023-12-16T20:11:43.466 INFO:tasks.workunit.client.1.smithi141.stdout:9/655: chown d1/d10/d14/d20/da/d3f/dab/fc0 731553 1 2023-12-16T20:11:43.466 INFO:tasks.workunit.client.1.smithi141.stdout:4/730: creat d1a/d54/f109 x:0 0 0 2023-12-16T20:11:43.470 INFO:tasks.workunit.client.1.smithi141.stdout:7/730: rmdir d5/d2a 39 2023-12-16T20:11:43.471 INFO:tasks.workunit.client.1.smithi141.stdout:9/656: mkdir d1/d10/d33/d47/d8d/dc4/ddb 0 2023-12-16T20:11:43.472 INFO:tasks.workunit.client.1.smithi141.stdout:4/731: rename d1a/d3c/c7a to d1a/d4e/d63/daa/c10a 0 2023-12-16T20:11:43.473 INFO:tasks.workunit.client.1.smithi141.stdout:7/731: truncate d5/d16/de3/d1e/d71/f8e 1379504 0 2023-12-16T20:11:43.474 INFO:tasks.workunit.client.1.smithi141.stdout:7/732: fsync d5/d16/d30/d4e/f62 0 2023-12-16T20:11:43.476 INFO:tasks.workunit.client.1.smithi141.stdout:9/657: truncate d1/d10/d33/d47/d83/fa5 3138404 0 2023-12-16T20:11:43.477 INFO:tasks.workunit.client.1.smithi141.stdout:4/732: rename d1a/d59/lb1 to d1a/d2a/d3b/d69/df0/l10b 0 2023-12-16T20:11:43.478 INFO:tasks.workunit.client.1.smithi141.stdout:9/658: symlink d1/d10/d14/d20/dd6/ldc 0 2023-12-16T20:11:43.483 INFO:tasks.workunit.client.1.smithi141.stdout:4/733: unlink d1a/l2d 0 2023-12-16T20:11:43.491 INFO:tasks.workunit.client.1.smithi141.stdout:9/659: read d1/d10/d27/f4b [8381585,116464] 0 2023-12-16T20:11:43.492 INFO:tasks.workunit.client.1.smithi141.stdout:4/734: write d1a/d2a/d3b/d69/f84 [392480,91182] 0 2023-12-16T20:11:43.496 INFO:tasks.workunit.client.1.smithi141.stdout:9/660: mkdir d1/d10/d33/d47/d83/ddd 0 2023-12-16T20:11:43.498 INFO:tasks.workunit.client.1.smithi141.stdout:4/735: creat d1a/d2a/d3b/db2/f10c x:0 0 0 2023-12-16T20:11:43.499 INFO:tasks.workunit.client.1.smithi141.stdout:9/661: mkdir d1/d26/d4a/dde 0 2023-12-16T20:11:43.500 INFO:tasks.workunit.client.1.smithi141.stdout:4/736: mknod d1a/d59/d89/d8a/c10d 0 2023-12-16T20:11:43.510 INFO:tasks.workunit.client.1.smithi141.stdout:4/737: write d1a/f20 [2351636,36660] 0 2023-12-16T20:11:43.510 INFO:tasks.workunit.client.1.smithi141.stdout:4/738: write d1a/d59/d89/d8a/fcc [120021,103116] 0 2023-12-16T20:11:43.516 INFO:tasks.workunit.client.1.smithi141.stdout:9/662: dwrite d1/d26/d4a/d73/f4e [0,4194304] 0 2023-12-16T20:11:43.521 INFO:tasks.workunit.client.1.smithi141.stdout:9/663: rename d1/d10/d14/d20/da/d3f/dab to d1/d10/d33/d47/d8d/ddf 0 2023-12-16T20:11:43.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/664: unlink d1/d10/d33/d47/d83/f8f 0 2023-12-16T20:11:43.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/665: chown d1/d10/d27/l2c 110 1 2023-12-16T20:11:43.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/666: chown d1/d10/d14/d20/d84/la0 7 1 2023-12-16T20:11:43.523 INFO:tasks.workunit.client.1.smithi141.stdout:4/739: read d1a/f32 [1089541,50027] 0 2023-12-16T20:11:43.523 INFO:tasks.workunit.client.1.smithi141.stdout:9/667: dread d1/d26/d4a/d73/fa2 [0,4194304] 0 2023-12-16T20:11:43.524 INFO:tasks.workunit.client.1.smithi141.stdout:9/668: dread d1/d10/d14/d20/da/f78 [0,4194304] 0 2023-12-16T20:11:43.524 INFO:tasks.workunit.client.1.smithi141.stdout:9/669: fsync d1/d10/fb6 0 2023-12-16T20:11:43.525 INFO:tasks.workunit.client.1.smithi141.stdout:4/740: unlink d1a/d59/d89/cc5 0 2023-12-16T20:11:43.525 INFO:tasks.workunit.client.1.smithi141.stdout:4/741: stat d1a/d4e/l7b 0 2023-12-16T20:11:43.526 INFO:tasks.workunit.client.1.smithi141.stdout:9/670: symlink d1/d10/d14/d20/d90/dca/le0 0 2023-12-16T20:11:43.528 INFO:tasks.workunit.client.1.smithi141.stdout:4/742: rmdir d1a/d59/d89/d8a 39 2023-12-16T20:11:43.530 INFO:tasks.workunit.client.1.smithi141.stdout:9/671: unlink d1/d10/d14/d20/c6f 0 2023-12-16T20:11:43.530 INFO:tasks.workunit.client.1.smithi141.stdout:9/672: creat d1/d10/d14/d20/d84/fe1 x:0 0 0 2023-12-16T20:11:43.530 INFO:tasks.workunit.client.1.smithi141.stdout:9/673: fsync d1/d10/d33/d47/f5b 0 2023-12-16T20:11:43.531 INFO:tasks.workunit.client.1.smithi141.stdout:4/743: mknod d1a/d4e/d63/daa/db9/c10e 0 2023-12-16T20:11:43.532 INFO:tasks.workunit.client.1.smithi141.stdout:4/744: read d1a/d59/d89/d8a/fc0 [21474,59298] 0 2023-12-16T20:11:43.533 INFO:tasks.workunit.client.1.smithi141.stdout:9/674: creat d1/d10/d33/d6a/fe2 x:0 0 0 2023-12-16T20:11:43.534 INFO:tasks.workunit.client.1.smithi141.stdout:4/745: creat d1a/d54/d87/da8/f10f x:0 0 0 2023-12-16T20:11:43.535 INFO:tasks.workunit.client.1.smithi141.stdout:9/675: truncate d1/d10/d33/d47/d8d/ddf/fbe 38309 0 2023-12-16T20:11:43.536 INFO:tasks.workunit.client.1.smithi141.stdout:9/676: creat d1/d10/d14/d20/da/d3f/fe3 x:0 0 0 2023-12-16T20:11:43.537 INFO:tasks.workunit.client.1.smithi141.stdout:9/677: rename d1/d10/d14/l9a to d1/d26/d4a/dde/le4 0 2023-12-16T20:11:43.538 INFO:tasks.workunit.client.1.smithi141.stdout:4/746: dread d1a/f9c [0,4194304] 0 2023-12-16T20:11:43.542 INFO:tasks.workunit.client.1.smithi141.stdout:4/747: unlink d1a/d2a/d3b/c102 0 2023-12-16T20:11:43.544 INFO:tasks.workunit.client.1.smithi141.stdout:9/678: rename d1/l7d to d1/d10/d14/d20/db3/le5 0 2023-12-16T20:11:43.545 INFO:tasks.workunit.client.1.smithi141.stdout:4/748: mkdir d1a/d3c/d9b/da1/dcf/d110 0 2023-12-16T20:11:43.546 INFO:tasks.workunit.client.1.smithi141.stdout:4/749: symlink d1a/d59/d89/l111 0 2023-12-16T20:11:43.547 INFO:tasks.workunit.client.1.smithi141.stdout:4/750: creat d1a/d59/f112 x:0 0 0 2023-12-16T20:11:43.551 INFO:tasks.workunit.client.1.smithi141.stdout:4/751: getdents d1a/d2a/d3b/d69 0 2023-12-16T20:11:43.551 INFO:tasks.workunit.client.1.smithi141.stdout:4/752: write f9 [4236522,24214] 0 2023-12-16T20:11:43.553 INFO:tasks.workunit.client.1.smithi141.stdout:9/679: dread d1/d10/d14/d20/db3/f62 [0,4194304] 0 2023-12-16T20:11:43.553 INFO:tasks.workunit.client.1.smithi141.stdout:4/753: mknod d1a/d54/d87/da8/da9/c113 0 2023-12-16T20:11:43.560 INFO:tasks.workunit.client.1.smithi141.stdout:4/754: write d1a/d2a/f78 [787557,29335] 0 2023-12-16T20:11:43.563 INFO:tasks.workunit.client.1.smithi141.stdout:4/755: link d1a/d2a/d3b/lf7 d1a/d54/d87/dbf/df3/l114 0 2023-12-16T20:11:43.565 INFO:tasks.workunit.client.1.smithi141.stdout:4/756: link d1a/d3c/c71 d1a/d3c/d9b/da1/da6/c115 0 2023-12-16T20:11:43.565 INFO:tasks.workunit.client.1.smithi141.stdout:4/757: write d1a/f32 [3507267,91671] 0 2023-12-16T20:11:43.565 INFO:tasks.workunit.client.1.smithi141.stdout:4/758: readlink d1a/d4e/l7b 0 2023-12-16T20:11:43.571 INFO:tasks.workunit.client.1.smithi141.stdout:9/680: dwrite d1/d10/d33/d47/d8d/ddf/fbe [0,4194304] 0 2023-12-16T20:11:43.574 INFO:tasks.workunit.client.1.smithi141.stdout:4/759: rmdir d1a/d3c/d9b/da1 39 2023-12-16T20:11:43.577 INFO:tasks.workunit.client.1.smithi141.stdout:4/760: symlink d1a/d4e/d63/l116 0 2023-12-16T20:11:43.577 INFO:tasks.workunit.client.1.smithi141.stdout:4/761: chown d1a/d4e/d63/fdf 6152 1 2023-12-16T20:11:43.595 INFO:tasks.workunit.client.1.smithi141.stdout:4/762: dwrite d1a/f25 [0,4194304] 0 2023-12-16T20:11:43.595 INFO:tasks.workunit.client.1.smithi141.stdout:4/763: truncate d1a/d54/d87/da8/da9/fbd 116367 0 2023-12-16T20:11:43.595 INFO:tasks.workunit.client.1.smithi141.stdout:9/681: dwrite d1/d10/d33/d47/d8d/ddf/fbf [0,4194304] 0 2023-12-16T20:11:43.597 INFO:tasks.workunit.client.1.smithi141.stdout:4/764: unlink d1a/d4e/d63/dd1/fe3 0 2023-12-16T20:11:43.597 INFO:tasks.workunit.client.1.smithi141.stdout:4/765: truncate d1a/d4e/d63/dd1/fdc 261942 0 2023-12-16T20:11:43.610 INFO:tasks.workunit.client.1.smithi141.stdout:9/682: write d1/d26/f91 [719247,65451] 0 2023-12-16T20:11:43.616 INFO:tasks.workunit.client.1.smithi141.stdout:3/849: sync 2023-12-16T20:11:43.617 INFO:tasks.workunit.client.1.smithi141.stdout:0/692: sync 2023-12-16T20:11:43.617 INFO:tasks.workunit.client.1.smithi141.stdout:1/793: sync 2023-12-16T20:11:43.617 INFO:tasks.workunit.client.1.smithi141.stdout:6/854: sync 2023-12-16T20:11:43.621 INFO:tasks.workunit.client.1.smithi141.stdout:0/693: symlink d4/d49/d73/d8a/d9b/leb 0 2023-12-16T20:11:43.621 INFO:tasks.workunit.client.1.smithi141.stdout:4/766: dwrite d1a/d2a/d3b/d69/fd7 [0,4194304] 0 2023-12-16T20:11:43.630 INFO:tasks.workunit.client.1.smithi141.stdout:3/850: rmdir d0/d1c 39 2023-12-16T20:11:43.633 INFO:tasks.workunit.client.1.smithi141.stdout:6/855: dread d1/d12/d20/d44/f103 [4194304,4194304] 0 2023-12-16T20:11:43.633 INFO:tasks.workunit.client.1.smithi141.stdout:9/683: dwrite d1/d10/d14/d20/d84/fb2 [0,4194304] 0 2023-12-16T20:11:43.636 INFO:tasks.workunit.client.1.smithi141.stdout:6/856: getdents d1/d5e/da9 0 2023-12-16T20:11:43.638 INFO:tasks.workunit.client.1.smithi141.stdout:0/694: dwrite d4/d49/d4b/da3/fe2 [0,4194304] 0 2023-12-16T20:11:43.638 INFO:tasks.workunit.client.1.smithi141.stdout:0/695: read - d4/d49/d73/fad zero size 2023-12-16T20:11:43.647 INFO:tasks.workunit.client.1.smithi141.stdout:4/767: dwrite d1a/d54/d87/da8/da9/fbd [0,4194304] 0 2023-12-16T20:11:43.652 INFO:tasks.workunit.client.1.smithi141.stdout:4/768: rmdir d1a/d3c/d9b 39 2023-12-16T20:11:43.654 INFO:tasks.workunit.client.1.smithi141.stdout:4/769: symlink d1a/d2a/d3b/d69/df0/l117 0 2023-12-16T20:11:43.656 INFO:tasks.workunit.client.1.smithi141.stdout:4/770: link d1a/d2a/f6b d1a/d2a/d3b/db2/f118 0 2023-12-16T20:11:43.657 INFO:tasks.workunit.client.1.smithi141.stdout:4/771: fsync d1a/d54/d87/da8/f7d 0 2023-12-16T20:11:43.658 INFO:tasks.workunit.client.1.smithi141.stdout:4/772: truncate f9 1094532 0 2023-12-16T20:11:43.669 INFO:tasks.workunit.client.1.smithi141.stdout:9/684: dwrite d1/d10/d27/fa9 [0,4194304] 0 2023-12-16T20:11:43.671 INFO:tasks.workunit.client.1.smithi141.stdout:9/685: mkdir d1/d10/d33/d47/d8d/ddf/de6 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:4/773: dwrite d1a/d54/d87/da8/da9/fb3 [0,4194304] 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:4/774: chown d1a/d54 699988907 1 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:4/775: readlink d1a/d2a/d3b/l90 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:4/776: readlink d1a/d3c/le9 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:3/851: dwrite d0/d1c/d40/f81 [0,4194304] 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:3/852: truncate d0/f9c 924017 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:6/857: dwrite d1/dd/d2f/f30 [0,4194304] 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:6/858: readlink d1/d3/d4f/l68 0 2023-12-16T20:11:43.678 INFO:tasks.workunit.client.1.smithi141.stdout:6/859: fdatasync d1/fa 0 2023-12-16T20:11:43.680 INFO:tasks.workunit.client.1.smithi141.stdout:0/696: dwrite d4/d49/d4b/f66 [0,4194304] 0 2023-12-16T20:11:43.684 INFO:tasks.workunit.client.1.smithi141.stdout:6/860: unlink d1/d5e/lad 0 2023-12-16T20:11:43.691 INFO:tasks.workunit.client.1.smithi141.stdout:0/697: mknod d4/d49/d8f/cec 0 2023-12-16T20:11:43.691 INFO:tasks.workunit.client.1.smithi141.stdout:0/698: read d4/f3e [3870131,8175] 0 2023-12-16T20:11:43.691 INFO:tasks.workunit.client.1.smithi141.stdout:0/699: fsync d4/d49/d73/d3b/f67 0 2023-12-16T20:11:43.692 INFO:tasks.workunit.client.1.smithi141.stdout:0/700: truncate d4/d49/d73/d3b/f7a 8218479 0 2023-12-16T20:11:43.694 INFO:tasks.workunit.client.1.smithi141.stdout:0/701: mkdir d4/d49/d73/d3b/ded 0 2023-12-16T20:11:43.696 INFO:tasks.workunit.client.1.smithi141.stdout:0/702: truncate d4/d49/d4b/f53 5115075 0 2023-12-16T20:11:43.696 INFO:tasks.workunit.client.1.smithi141.stdout:9/686: dwrite d1/d10/d14/d20/d3b/f5c [0,4194304] 0 2023-12-16T20:11:43.700 INFO:tasks.workunit.client.1.smithi141.stdout:9/687: rmdir d1/d26/da1 39 2023-12-16T20:11:43.700 INFO:tasks.workunit.client.1.smithi141.stdout:3/853: dread d0/d1c/d2c/d72/d74/fbf [0,4194304] 0 2023-12-16T20:11:43.700 INFO:tasks.workunit.client.1.smithi141.stdout:9/688: read d1/d10/f15 [141865,10312] 0 2023-12-16T20:11:43.701 INFO:tasks.workunit.client.1.smithi141.stdout:9/689: mkdir d1/d10/d14/d20/d90/dca/de7 0 2023-12-16T20:11:43.705 INFO:tasks.workunit.client.1.smithi141.stdout:6/861: dwrite d1/fc4 [0,4194304] 0 2023-12-16T20:11:43.705 INFO:tasks.workunit.client.1.smithi141.stdout:6/862: chown d1/d12/d20/d89/d95 65129321 1 2023-12-16T20:11:43.705 INFO:tasks.workunit.client.1.smithi141.stdout:4/777: dwrite d1a/d3c/d9b/da1/da6/fd8 [4194304,4194304] 0 2023-12-16T20:11:43.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/863: truncate d1/d12/d20/d44/f103 6891665 0 2023-12-16T20:11:43.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/864: write d1/d12/d20/d3a/f6d [2032031,44519] 0 2023-12-16T20:11:43.710 INFO:tasks.workunit.client.1.smithi141.stdout:3/854: write d0/d1c/d40/d85/f77 [1702860,77911] 0 2023-12-16T20:11:43.712 INFO:tasks.workunit.client.1.smithi141.stdout:4/778: creat d1a/d59/d89/f119 x:0 0 0 2023-12-16T20:11:43.712 INFO:tasks.workunit.client.1.smithi141.stdout:4/779: chown d1a/d4e/d63/dd1/fd9 150922970 1 2023-12-16T20:11:43.712 INFO:tasks.workunit.client.1.smithi141.stdout:4/780: write d1a/d2a/d3b/db2/f118 [477905,33179] 0 2023-12-16T20:11:43.713 INFO:tasks.workunit.client.1.smithi141.stdout:9/690: write d1/d26/fad [2058100,63753] 0 2023-12-16T20:11:43.714 INFO:tasks.workunit.client.1.smithi141.stdout:3/855: creat d0/f11f x:0 0 0 2023-12-16T20:11:43.715 INFO:tasks.workunit.client.1.smithi141.stdout:3/856: write d0/d1c/d6a/f9d [834735,75768] 0 2023-12-16T20:11:43.716 INFO:tasks.workunit.client.1.smithi141.stdout:8/864: sync 2023-12-16T20:11:43.716 INFO:tasks.workunit.client.1.smithi141.stdout:8/865: getdents d14/d19/d95/dab/dfd/d110/db4/d5b/dea/deb/d109 0 2023-12-16T20:11:43.716 INFO:tasks.workunit.client.1.smithi141.stdout:8/866: stat d14/d19/d95/dab/dfd/d110/db4/d5b/l6e 0 2023-12-16T20:11:43.717 INFO:tasks.workunit.client.1.smithi141.stdout:0/703: dwrite d4/d49/d73/f5b [0,4194304] 0 2023-12-16T20:11:43.718 INFO:tasks.workunit.client.1.smithi141.stdout:4/781: unlink d1a/d2a/c67 0 2023-12-16T20:11:43.718 INFO:tasks.workunit.client.1.smithi141.stdout:4/782: dread - d1a/d59/f9e zero size 2023-12-16T20:11:43.719 INFO:tasks.workunit.client.1.smithi141.stdout:4/783: write d1a/d2a/f4b [4328977,38637] 0 2023-12-16T20:11:43.720 INFO:tasks.workunit.client.1.smithi141.stdout:9/691: mknod d1/d10/d33/d6a/d72/ce8 0 2023-12-16T20:11:43.727 INFO:tasks.workunit.client.1.smithi141.stdout:8/867: rename d14/f16 to d14/d19/d95/dab/dfd/d110/f112 0 2023-12-16T20:11:43.731 INFO:tasks.workunit.client.1.smithi141.stdout:4/784: creat d1a/d54/d87/da8/da9/f11a x:0 0 0 2023-12-16T20:11:43.733 INFO:tasks.workunit.client.1.smithi141.stdout:9/692: rmdir d1/d10/d14/d20/d90/dca 39 2023-12-16T20:11:43.733 INFO:tasks.workunit.client.1.smithi141.stdout:6/865: dwrite d1/d12/d22/d25/de0/f10e [0,4194304] 0 2023-12-16T20:11:43.736 INFO:tasks.workunit.client.1.smithi141.stdout:9/693: mkdir d1/d10/d33/d47/d8d/ddf/de6/de9 0 2023-12-16T20:11:43.746 INFO:tasks.workunit.client.1.smithi141.stdout:8/868: write d14/d19/d95/dab/dfd/d110/db4/d5b/f7e [3417390,84356] 0 2023-12-16T20:11:43.747 INFO:tasks.workunit.client.1.smithi141.stdout:8/869: write d14/d19/d95/dab/dfd/d110/db4/f5a [1926053,50636] 0 2023-12-16T20:11:43.747 INFO:tasks.workunit.client.1.smithi141.stdout:9/694: mkdir d1/d10/d14/d20/da/d3f/dea 0 2023-12-16T20:11:43.747 INFO:tasks.workunit.client.1.smithi141.stdout:3/857: dwrite d0/d1c/d40/d3c/fba [0,4194304] 0 2023-12-16T20:11:43.752 INFO:tasks.workunit.client.1.smithi141.stdout:9/695: symlink d1/d10/d33/d47/d8d/leb 0 2023-12-16T20:11:43.753 INFO:tasks.workunit.client.1.smithi141.stdout:8/870: read d14/d35/f70 [2625648,21154] 0 2023-12-16T20:11:43.757 INFO:tasks.workunit.client.1.smithi141.stdout:0/704: dwrite d4/d49/d73/d3b/f7a [0,4194304] 0 2023-12-16T20:11:43.757 INFO:tasks.workunit.client.1.smithi141.stdout:0/705: write d4/d49/d73/d3b/d78/fa5 [1007241,129268] 0 2023-12-16T20:11:43.761 INFO:tasks.workunit.client.1.smithi141.stdout:3/858: read d0/f8 [295247,82336] 0 2023-12-16T20:11:43.762 INFO:tasks.workunit.client.1.smithi141.stdout:9/696: mkdir d1/d26/d4a/dde/dec 0 2023-12-16T20:11:43.762 INFO:tasks.workunit.client.1.smithi141.stdout:4/785: dwrite d1a/d59/d89/d8a/fc0 [0,4194304] 0 2023-12-16T20:11:43.764 INFO:tasks.workunit.client.1.smithi141.stdout:6/866: dwrite d1/d3/d4f/faa [0,4194304] 0 2023-12-16T20:11:43.765 INFO:tasks.workunit.client.1.smithi141.stdout:3/859: mknod d0/d1c/d40/d3c/c120 0 2023-12-16T20:11:43.765 INFO:tasks.workunit.client.1.smithi141.stdout:3/860: readlink d0/d1c/l3d 0 2023-12-16T20:11:43.767 INFO:tasks.workunit.client.1.smithi141.stdout:9/697: creat d1/d10/d33/d47/d83/ddd/fed x:0 0 0 2023-12-16T20:11:43.772 INFO:tasks.workunit.client.1.smithi141.stdout:8/871: rename d14/d19/d1b/d3d/d5e/fe6 to d14/d19/d95/dab/dfd/d110/db4/d5b/f113 0 2023-12-16T20:11:43.772 INFO:tasks.workunit.client.1.smithi141.stdout:8/872: chown d14/d19/d95/dab/dfd/d110/db4/d5b/dea 3 1 2023-12-16T20:11:43.774 INFO:tasks.workunit.client.1.smithi141.stdout:3/861: truncate d0/d1c/d40/f1b 2766352 0 2023-12-16T20:11:43.775 INFO:tasks.workunit.client.1.smithi141.stdout:3/862: fdatasync d0/d1c/d2c/d72/f103 0 2023-12-16T20:11:43.776 INFO:tasks.workunit.client.1.smithi141.stdout:3/863: symlink d0/d1c/d6a/d76/l121 0 2023-12-16T20:11:43.778 INFO:tasks.workunit.client.1.smithi141.stdout:3/864: symlink d0/d1c/d40/d85/d4c/l122 0 2023-12-16T20:11:43.778 INFO:tasks.workunit.client.1.smithi141.stdout:3/865: fsync d0/f101 0 2023-12-16T20:11:43.779 INFO:tasks.workunit.client.1.smithi141.stdout:9/698: read d1/d10/d14/d20/d84/fb2 [234019,52661] 0 2023-12-16T20:11:43.781 INFO:tasks.workunit.client.1.smithi141.stdout:9/699: symlink d1/d10/d33/d47/d8d/ddf/de6/de9/lee 0 2023-12-16T20:11:43.781 INFO:tasks.workunit.client.1.smithi141.stdout:9/700: stat d1/d10/d14/d20/d90/dca 0 2023-12-16T20:11:43.792 INFO:tasks.workunit.client.1.smithi141.stdout:8/873: dwrite d14/d35/f67 [0,4194304] 0 2023-12-16T20:11:43.792 INFO:tasks.workunit.client.1.smithi141.stdout:4/786: dwrite d1a/f1b [0,4194304] 0 2023-12-16T20:11:43.795 INFO:tasks.workunit.client.1.smithi141.stdout:9/701: dread d1/d26/d4a/d73/f92 [0,4194304] 0 2023-12-16T20:11:43.795 INFO:tasks.workunit.client.1.smithi141.stdout:9/702: truncate d1/d26/d4a/f99 901915 0 2023-12-16T20:11:43.795 INFO:tasks.workunit.client.1.smithi141.stdout:9/703: chown d1/d10/d14/d20/d84/fb2 84319 1 2023-12-16T20:11:43.796 INFO:tasks.workunit.client.1.smithi141.stdout:8/874: rename d14/d19/d1b/d24/da3/c104 to d14/d19/d1b/d24/d4b/c114 0 2023-12-16T20:11:43.796 INFO:tasks.workunit.client.1.smithi141.stdout:4/787: truncate d1a/d2a/d3b/ff5 3380752 0 2023-12-16T20:11:43.797 INFO:tasks.workunit.client.1.smithi141.stdout:8/875: creat d14/d19/d1b/d3d/d5e/dbe/dc3/f115 x:0 0 0 2023-12-16T20:11:43.799 INFO:tasks.workunit.client.1.smithi141.stdout:4/788: link d1a/d54/l81 d1a/d3c/d9b/da1/l11b 0 2023-12-16T20:11:43.799 INFO:tasks.workunit.client.1.smithi141.stdout:4/789: creat d1a/d4e/d63/daa/db9/df6/f11c x:0 0 0 2023-12-16T20:11:43.800 INFO:tasks.workunit.client.1.smithi141.stdout:5/713: sync 2023-12-16T20:11:43.801 INFO:tasks.workunit.client.1.smithi141.stdout:8/876: rmdir d14/d19/d95/dab/dfd/d110/db4/d5b/dea 39 2023-12-16T20:11:43.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/877: mknod d14/d19/d1b/d24/d4b/d8c/c116 0 2023-12-16T20:11:43.805 INFO:tasks.workunit.client.1.smithi141.stdout:8/878: creat d14/d19/f117 x:0 0 0 2023-12-16T20:11:43.806 INFO:tasks.workunit.client.1.smithi141.stdout:9/704: dread d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:43.806 INFO:tasks.workunit.client.1.smithi141.stdout:9/705: stat d1/d26/d4a/d73/f92 0 2023-12-16T20:11:43.807 INFO:tasks.workunit.client.1.smithi141.stdout:8/879: link d14/d19/d1b/d24/d4b/l65 d14/d19/d95/dab/dfd/d110/db4/d5b/l118 0 2023-12-16T20:11:43.807 INFO:tasks.workunit.client.1.smithi141.stdout:8/880: chown d14/d19/d95/dab/dfd/d110/db4/d69/l8e 747 1 2023-12-16T20:11:43.808 INFO:tasks.workunit.client.1.smithi141.stdout:9/706: stat d1/d10/d33/d6a/d72/l95 0 2023-12-16T20:11:43.810 INFO:tasks.workunit.client.1.smithi141.stdout:8/881: mkdir d14/d71/d81/d119 0 2023-12-16T20:11:43.810 INFO:tasks.workunit.client.1.smithi141.stdout:9/707: chown d1/l23 159 1 2023-12-16T20:11:43.812 INFO:tasks.workunit.client.1.smithi141.stdout:5/714: dread d0/d14/d2c/d4a/f51 [4194304,4194304] 0 2023-12-16T20:11:43.812 INFO:tasks.workunit.client.1.smithi141.stdout:8/882: rename d14/d19/dce/fda to d14/d19/d95/dab/dfd/d110/f11a 0 2023-12-16T20:11:43.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/708: unlink d1/d26/f91 0 2023-12-16T20:11:43.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/709: creat d1/d10/d14/d20/da/d3f/dea/fef x:0 0 0 2023-12-16T20:11:43.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/710: creat d1/d10/d33/d47/d83/ddd/ff0 x:0 0 0 2023-12-16T20:11:43.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/711: write d1/d10/f22 [4996729,1099] 0 2023-12-16T20:11:43.817 INFO:tasks.workunit.client.1.smithi141.stdout:9/712: fsync d1/d10/d27/fa9 0 2023-12-16T20:11:43.818 INFO:tasks.workunit.client.1.smithi141.stdout:9/713: link d1/d26/da1/cd8 d1/dce/cf1 0 2023-12-16T20:11:43.822 INFO:tasks.workunit.client.1.smithi141.stdout:4/790: dwrite d1a/d2a/d3b/f82 [0,4194304] 0 2023-12-16T20:11:43.822 INFO:tasks.workunit.client.1.smithi141.stdout:9/714: dread d1/d26/d4a/d73/f92 [0,4194304] 0 2023-12-16T20:11:43.825 INFO:tasks.workunit.client.1.smithi141.stdout:4/791: mknod d1a/d59/d89/d8a/c11d 0 2023-12-16T20:11:43.826 INFO:tasks.workunit.client.1.smithi141.stdout:9/715: symlink d1/d10/d14/d20/d3b/lf2 0 2023-12-16T20:11:43.826 INFO:tasks.workunit.client.1.smithi141.stdout:8/883: dread d14/d71/d81/fe9 [0,4194304] 0 2023-12-16T20:11:43.827 INFO:tasks.workunit.client.1.smithi141.stdout:4/792: creat d1a/d59/d89/d8a/f11e x:0 0 0 2023-12-16T20:11:43.827 INFO:tasks.workunit.client.1.smithi141.stdout:4/793: chown d1a/d54/d87/dbf 90780 1 2023-12-16T20:11:43.827 INFO:tasks.workunit.client.1.smithi141.stdout:5/715: dwrite d0/d9/f34 [0,4194304] 0 2023-12-16T20:11:43.828 INFO:tasks.workunit.client.1.smithi141.stdout:9/716: mknod d1/d10/d33/d47/d8d/ddf/de6/de9/cf3 0 2023-12-16T20:11:43.829 INFO:tasks.workunit.client.1.smithi141.stdout:4/794: mkdir d1a/d59/d89/d8a/d11f 0 2023-12-16T20:11:43.837 INFO:tasks.workunit.client.1.smithi141.stdout:5/716: truncate d0/d9/d16/f21 1682994 0 2023-12-16T20:11:43.840 INFO:tasks.workunit.client.1.smithi141.stdout:8/884: unlink d14/d19/d1b/d24/fd8 0 2023-12-16T20:11:43.841 INFO:tasks.workunit.client.1.smithi141.stdout:4/795: symlink d1a/d54/d87/dbf/l120 0 2023-12-16T20:11:43.844 INFO:tasks.workunit.client.1.smithi141.stdout:8/885: rename d14/l10a to d14/d19/d95/dab/dfd/d110/db4/d69/l11b 0 2023-12-16T20:11:43.844 INFO:tasks.workunit.client.1.smithi141.stdout:9/717: dwrite d1/d10/d33/d47/d8d/dc4/fd4 [0,4194304] 0 2023-12-16T20:11:43.845 INFO:tasks.workunit.client.1.smithi141.stdout:4/796: truncate d1a/d3c/fd2 1115739 0 2023-12-16T20:11:43.846 INFO:tasks.workunit.client.1.smithi141.stdout:5/717: getdents d0/d9/d16/d2a/d4f 0 2023-12-16T20:11:43.846 INFO:tasks.workunit.client.1.smithi141.stdout:5/718: readlink d0/d25/dce/lcf 0 2023-12-16T20:11:43.849 INFO:tasks.workunit.client.1.smithi141.stdout:8/886: symlink d14/d19/d95/dab/dfd/d110/db4/d108/l11c 0 2023-12-16T20:11:43.850 INFO:tasks.workunit.client.1.smithi141.stdout:5/719: dread d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:43.850 INFO:tasks.workunit.client.1.smithi141.stdout:5/720: readlink d0/d14/d75/l9f 0 2023-12-16T20:11:43.850 INFO:tasks.workunit.client.1.smithi141.stdout:5/721: read - d0/d25/fdd zero size 2023-12-16T20:11:43.851 INFO:tasks.workunit.client.1.smithi141.stdout:4/797: symlink d1a/d59/d89/d8a/d11f/l121 0 2023-12-16T20:11:43.852 INFO:tasks.workunit.client.1.smithi141.stdout:8/887: getdents d14/d19/d1b/d24/d4b/d8c 0 2023-12-16T20:11:43.852 INFO:tasks.workunit.client.1.smithi141.stdout:8/888: fdatasync d14/d35/f9f 0 2023-12-16T20:11:43.853 INFO:tasks.workunit.client.1.smithi141.stdout:5/722: mknod d0/d25/dce/cf3 0 2023-12-16T20:11:43.856 INFO:tasks.workunit.client.1.smithi141.stdout:9/718: rename d1/d10/d27/l28 to d1/d10/d33/d6a/d75/lf4 0 2023-12-16T20:11:43.856 INFO:tasks.workunit.client.1.smithi141.stdout:5/723: dread d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:43.856 INFO:tasks.workunit.client.1.smithi141.stdout:8/889: stat d14/d19/d1b/lf5 0 2023-12-16T20:11:43.858 INFO:tasks.workunit.client.1.smithi141.stdout:5/724: mknod d0/d14/d98/cf4 0 2023-12-16T20:11:43.860 INFO:tasks.workunit.client.1.smithi141.stdout:5/725: creat d0/d14/d2c/d90/ff5 x:0 0 0 2023-12-16T20:11:43.860 INFO:tasks.workunit.client.1.smithi141.stdout:5/726: stat d0/d14/d2c/d4a/f9b 0 2023-12-16T20:11:43.862 INFO:tasks.workunit.client.1.smithi141.stdout:5/727: unlink d0/d25/dce/cf3 0 2023-12-16T20:11:43.864 INFO:tasks.workunit.client.1.smithi141.stdout:5/728: rename d0/d25/fa4 to d0/d9/d16/d2a/d35/d91/ff6 0 2023-12-16T20:11:43.871 INFO:tasks.workunit.client.1.smithi141.stdout:9/719: write d1/d10/d33/f8b [53106,76839] 0 2023-12-16T20:11:43.877 INFO:tasks.workunit.client.1.smithi141.stdout:8/890: dwrite d14/d19/d95/dab/dfd/d110/f112 [8388608,4194304] 0 2023-12-16T20:11:43.877 INFO:tasks.workunit.client.1.smithi141.stdout:4/798: dwrite f15 [0,4194304] 0 2023-12-16T20:11:43.878 INFO:tasks.workunit.client.1.smithi141.stdout:4/799: mkdir d1a/d3c/d122 0 2023-12-16T20:11:43.879 INFO:tasks.workunit.client.1.smithi141.stdout:4/800: symlink d1a/d59/l123 0 2023-12-16T20:11:43.879 INFO:tasks.workunit.client.1.smithi141.stdout:4/801: write d1a/d2a/d3b/f82 [4471856,31042] 0 2023-12-16T20:11:43.888 INFO:tasks.workunit.client.1.smithi141.stdout:8/891: dread d14/d19/d95/dab/dfd/d110/db4/d5b/fd6 [0,4194304] 0 2023-12-16T20:11:43.888 INFO:tasks.workunit.client.1.smithi141.stdout:8/892: chown d14/d19/d95/dab/dfd/d110/db4/d58/d8b/de4 806447 1 2023-12-16T20:11:43.889 INFO:tasks.workunit.client.1.smithi141.stdout:8/893: symlink d14/d19/d95/dab/l11d 0 2023-12-16T20:11:43.892 INFO:tasks.workunit.client.1.smithi141.stdout:8/894: rename d14/d19/d95/dab/dfd/d110/db4/d69/dd4/fd7 to d14/dc4/f11e 0 2023-12-16T20:11:43.892 INFO:tasks.workunit.client.1.smithi141.stdout:4/802: dwrite d1a/d54/f109 [0,4194304] 0 2023-12-16T20:11:43.892 INFO:tasks.workunit.client.1.smithi141.stdout:4/803: chown d1a/d2a/d3b/d69/fd7 24 1 2023-12-16T20:11:43.894 INFO:tasks.workunit.client.1.smithi141.stdout:8/895: dread d14/d19/d95/dab/dfd/d110/db4/f9b [0,4194304] 0 2023-12-16T20:11:43.895 INFO:tasks.workunit.client.1.smithi141.stdout:4/804: link d1a/d4e/d63/fdf d1a/f124 0 2023-12-16T20:11:43.896 INFO:tasks.workunit.client.1.smithi141.stdout:4/805: mkdir d1a/d59/d89/d125 0 2023-12-16T20:11:43.896 INFO:tasks.workunit.client.1.smithi141.stdout:4/806: write d1a/d59/d89/d8a/f11e [523263,62462] 0 2023-12-16T20:11:43.903 INFO:tasks.workunit.client.1.smithi141.stdout:8/896: write d14/d19/f4e [1332553,75372] 0 2023-12-16T20:11:43.904 INFO:tasks.workunit.client.1.smithi141.stdout:4/807: write d1a/d4e/d63/dd1/fd9 [3083070,30783] 0 2023-12-16T20:11:43.904 INFO:tasks.workunit.client.1.smithi141.stdout:4/808: readlink d1a/d2a/d3b/d69/df0/l10b 0 2023-12-16T20:11:43.904 INFO:tasks.workunit.client.1.smithi141.stdout:8/897: creat d14/d19/d95/dab/dfd/d110/db4/d58/f11f x:0 0 0 2023-12-16T20:11:43.904 INFO:tasks.workunit.client.1.smithi141.stdout:8/898: creat d14/d19/d1b/d3d/d5e/f120 x:0 0 0 2023-12-16T20:11:43.905 INFO:tasks.workunit.client.1.smithi141.stdout:4/809: mkdir d1a/d2a/d3b/d69/df0/d126 0 2023-12-16T20:11:43.905 INFO:tasks.workunit.client.1.smithi141.stdout:4/810: creat d1a/d4e/d63/dd1/f127 x:0 0 0 2023-12-16T20:11:43.907 INFO:tasks.workunit.client.1.smithi141.stdout:4/811: mkdir d1a/d2a/d3b/dcd/d128 0 2023-12-16T20:11:43.908 INFO:tasks.workunit.client.1.smithi141.stdout:4/812: creat d1a/d2a/d3b/d69/df0/f129 x:0 0 0 2023-12-16T20:11:43.909 INFO:tasks.workunit.client.1.smithi141.stdout:4/813: readlink d1a/d59/l8e 0 2023-12-16T20:11:43.910 INFO:tasks.workunit.client.1.smithi141.stdout:2/677: sync 2023-12-16T20:11:43.910 INFO:tasks.workunit.client.1.smithi141.stdout:7/733: sync 2023-12-16T20:11:43.911 INFO:tasks.workunit.client.1.smithi141.stdout:7/734: mkdir d5/d16/de3/d1e/d71/ddf/dee 0 2023-12-16T20:11:43.913 INFO:tasks.workunit.client.1.smithi141.stdout:2/678: symlink d6/d12/d67/le0 0 2023-12-16T20:11:43.916 INFO:tasks.workunit.client.1.smithi141.stdout:2/679: rename d6/d32/d7a/cc9 to d6/d12/ce1 0 2023-12-16T20:11:43.917 INFO:tasks.workunit.client.1.smithi141.stdout:2/680: truncate d6/d32/d7a/d5f/d92/f9f 2123434 0 2023-12-16T20:11:43.917 INFO:tasks.workunit.client.1.smithi141.stdout:2/681: chown d6/d32/d52 4504276 1 2023-12-16T20:11:43.919 INFO:tasks.workunit.client.1.smithi141.stdout:8/899: dwrite d14/f15 [0,4194304] 0 2023-12-16T20:11:43.920 INFO:tasks.workunit.client.1.smithi141.stdout:2/682: dread d6/da/d33/d54/f7f [0,4194304] 0 2023-12-16T20:11:43.922 INFO:tasks.workunit.client.1.smithi141.stdout:2/683: creat d6/d3a/d47/d58/d66/fe2 x:0 0 0 2023-12-16T20:11:43.933 INFO:tasks.workunit.client.1.smithi141.stdout:4/814: dwrite d1a/d2a/d3b/f45 [0,4194304] 0 2023-12-16T20:11:43.936 INFO:tasks.workunit.client.1.smithi141.stdout:4/815: symlink d1a/d2a/d3b/d69/df0/l12a 0 2023-12-16T20:11:43.937 INFO:tasks.workunit.client.1.smithi141.stdout:4/816: mkdir d1a/d59/d89/d125/d12b 0 2023-12-16T20:11:43.938 INFO:tasks.workunit.client.1.smithi141.stdout:4/817: fsync d1a/d2a/f6c 0 2023-12-16T20:11:43.941 INFO:tasks.workunit.client.1.smithi141.stdout:8/900: dwrite d14/d19/d1b/d24/d4b/f5c [0,4194304] 0 2023-12-16T20:11:43.945 INFO:tasks.workunit.client.1.smithi141.stdout:2/684: dwrite d6/d32/f64 [0,4194304] 0 2023-12-16T20:11:43.949 INFO:tasks.workunit.client.1.smithi141.stdout:2/685: getdents d6 0 2023-12-16T20:11:43.950 INFO:tasks.workunit.client.1.smithi141.stdout:2/686: truncate d6/f7 8473241 0 2023-12-16T20:11:43.958 INFO:tasks.workunit.client.1.smithi141.stdout:8/901: dread d14/d19/d1b/d24/fa0 [0,4194304] 0 2023-12-16T20:11:43.960 INFO:tasks.workunit.client.1.smithi141.stdout:4/818: dwrite d1a/d2a/d3b/d69/fa0 [0,4194304] 0 2023-12-16T20:11:43.961 INFO:tasks.workunit.client.1.smithi141.stdout:2/687: dread d6/d12/d15/f44 [0,4194304] 0 2023-12-16T20:11:43.965 INFO:tasks.workunit.client.1.smithi141.stdout:4/819: truncate d1a/f25 3435248 0 2023-12-16T20:11:43.965 INFO:tasks.workunit.client.1.smithi141.stdout:2/688: truncate d6/d12/d1f/d46/f48 292705 0 2023-12-16T20:11:43.965 INFO:tasks.workunit.client.1.smithi141.stdout:2/689: stat d6/d32/d7a/d5f/d92 0 2023-12-16T20:11:43.965 INFO:tasks.workunit.client.1.smithi141.stdout:4/820: mkdir d1a/d3c/d9b/d12c 0 2023-12-16T20:11:43.967 INFO:tasks.workunit.client.1.smithi141.stdout:2/690: link d6/f17 d6/da/d4a/d5e/fe3 0 2023-12-16T20:11:43.969 INFO:tasks.workunit.client.1.smithi141.stdout:4/821: symlink d1a/d2a/d3b/dcd/l12d 0 2023-12-16T20:11:43.969 INFO:tasks.workunit.client.1.smithi141.stdout:4/822: chown d1a/d4e/d63/daa/cdd 2120201868 1 2023-12-16T20:11:43.969 INFO:tasks.workunit.client.1.smithi141.stdout:4/823: creat d1a/d2a/d3b/db2/f12e x:0 0 0 2023-12-16T20:11:43.972 INFO:tasks.workunit.client.1.smithi141.stdout:2/691: creat d6/d3a/d47/d58/d8c/fe4 x:0 0 0 2023-12-16T20:11:43.976 INFO:tasks.workunit.client.1.smithi141.stdout:2/692: dread d6/d3a/d47/d58/f71 [0,4194304] 0 2023-12-16T20:11:43.976 INFO:tasks.workunit.client.1.smithi141.stdout:8/902: dwrite d14/d19/d95/dab/dfd/d110/db4/d5b/f10b [0,4194304] 0 2023-12-16T20:11:43.979 INFO:tasks.workunit.client.1.smithi141.stdout:8/903: mknod d14/d19/d95/dab/c121 0 2023-12-16T20:11:43.980 INFO:tasks.workunit.client.1.smithi141.stdout:4/824: read d1a/d2a/d3b/d69/f95 [643262,7996] 0 2023-12-16T20:11:43.980 INFO:tasks.workunit.client.1.smithi141.stdout:4/825: creat d1a/d59/d89/f12f x:0 0 0 2023-12-16T20:11:43.981 INFO:tasks.workunit.client.1.smithi141.stdout:8/904: unlink d14/dc4/f11e 0 2023-12-16T20:11:43.985 INFO:tasks.workunit.client.1.smithi141.stdout:2/693: write d6/d3a/f2c [2810285,103024] 0 2023-12-16T20:11:43.987 INFO:tasks.workunit.client.1.smithi141.stdout:2/694: mknod d6/d12/d1f/d46/ce5 0 2023-12-16T20:11:43.994 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: pgmap v10: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 332 MiB/s wr, 463 op/s 2023-12-16T20:11:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:43 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:43.996 INFO:tasks.workunit.client.1.smithi141.stdout:4/826: dwrite d1a/f25 [0,4194304] 0 2023-12-16T20:11:43.998 INFO:tasks.workunit.client.1.smithi141.stdout:4/827: symlink d1a/d3c/d122/l130 0 2023-12-16T20:11:44.013 INFO:tasks.workunit.client.1.smithi141.stdout:4/828: dwrite d1a/d54/d87/dbf/ffb [0,4194304] 0 2023-12-16T20:11:44.013 INFO:tasks.workunit.client.1.smithi141.stdout:4/829: write d1a/fab [408840,69333] 0 2023-12-16T20:11:44.036 INFO:tasks.workunit.client.1.smithi141.stdout:1/794: sync 2023-12-16T20:11:44.036 INFO:tasks.workunit.client.1.smithi141.stdout:1/795: chown da/d36/d4b/d4d 1823 1 2023-12-16T20:11:44.036 INFO:tasks.workunit.client.1.smithi141.stdout:1/796: creat da/d1a/d1d/d22/f105 x:0 0 0 2023-12-16T20:11:44.037 INFO:tasks.workunit.client.1.smithi141.stdout:1/797: mknod da/d1a/d31/c106 0 2023-12-16T20:11:44.037 INFO:tasks.workunit.client.1.smithi141.stdout:1/798: stat da/d1a/f7b 0 2023-12-16T20:11:44.045 INFO:tasks.workunit.client.1.smithi141.stdout:1/799: write da/d67/f68 [1370829,116688] 0 2023-12-16T20:11:44.046 INFO:tasks.workunit.client.1.smithi141.stdout:1/800: readlink da/d36/d4b/d4d/d80/l100 0 2023-12-16T20:11:44.047 INFO:tasks.workunit.client.1.smithi141.stdout:1/801: creat da/d1a/f107 x:0 0 0 2023-12-16T20:11:44.047 INFO:tasks.workunit.client.1.smithi141.stdout:1/802: chown da/d1a/d1d/f5d 15864727 1 2023-12-16T20:11:44.048 INFO:tasks.workunit.client.1.smithi141.stdout:1/803: rmdir da/d1a/d1d/d33/dcd 39 2023-12-16T20:11:44.049 INFO:tasks.workunit.client.1.smithi141.stdout:1/804: mkdir da/d36/d4b/d4d/d80/dca/ddc/d108 0 2023-12-16T20:11:44.050 INFO:tasks.workunit.client.1.smithi141.stdout:1/805: symlink da/d1a/d1d/d33/l109 0 2023-12-16T20:11:44.050 INFO:tasks.workunit.client.1.smithi141.stdout:1/806: chown da/d1a/d1d/d33/ff4 1149 1 2023-12-16T20:11:44.051 INFO:tasks.workunit.client.1.smithi141.stdout:1/807: getdents da/d36/d4b/d4d/d80/dca 0 2023-12-16T20:11:44.070 INFO:tasks.workunit.client.1.smithi141.stdout:1/808: dwrite da/fc [0,4194304] 0 2023-12-16T20:11:44.072 INFO:tasks.workunit.client.1.smithi141.stdout:1/809: mknod da/d36/d4b/db2/c10a 0 2023-12-16T20:11:44.073 INFO:tasks.workunit.client.1.smithi141.stdout:1/810: mkdir da/d1a/dd1/d10b 0 2023-12-16T20:11:44.073 INFO:tasks.workunit.client.1.smithi141.stdout:1/811: write da/d36/d4b/d7c/feb [584896,12470] 0 2023-12-16T20:11:44.073 INFO:tasks.workunit.client.1.smithi141.stdout:1/812: chown da/d36/d4b/d4d/d89/d6c/fe3 17484 1 2023-12-16T20:11:44.076 INFO:tasks.workunit.client.1.smithi141.stdout:1/813: rename da/d36/d4b/d7c to da/d1a/d1d/d22/d10c 0 2023-12-16T20:11:44.078 INFO:tasks.workunit.client.1.smithi141.stdout:1/814: creat da/d36/d4b/d4d/d80/d94/d9d/f10d x:0 0 0 2023-12-16T20:11:44.078 INFO:tasks.workunit.client.1.smithi141.stdout:1/815: chown da/d7a 279510 1 2023-12-16T20:11:44.078 INFO:tasks.workunit.client.1.smithi141.stdout:1/816: mkdir da/d1a/d31/d81/d10e 0 2023-12-16T20:11:44.086 INFO:tasks.workunit.client.1.smithi141.stdout:1/817: dread da/d1a/d31/f49 [0,4194304] 0 2023-12-16T20:11:44.088 INFO:tasks.workunit.client.1.smithi141.stdout:1/818: rename f6 to da/d1a/db0/f10f 0 2023-12-16T20:11:44.090 INFO:tasks.workunit.client.1.smithi141.stdout:1/819: dread da/d1a/d1d/fd8 [0,4194304] 0 2023-12-16T20:11:44.090 INFO:tasks.workunit.client.1.smithi141.stdout:1/820: stat da/fb9 0 2023-12-16T20:11:44.106 INFO:tasks.workunit.client.1.smithi141.stdout:1/821: dwrite da/d36/d4b/d4d/d89/d6c/faf [4194304,4194304] 0 2023-12-16T20:11:44.108 INFO:tasks.workunit.client.1.smithi141.stdout:1/822: rmdir da/d36/d4b/d4d/d89 39 2023-12-16T20:11:44.110 INFO:tasks.workunit.client.1.smithi141.stdout:1/823: rename da/d36/d4b/db2/c10a to da/d36/d4b/d4d/d80/dca/ddc/c110 0 2023-12-16T20:11:44.110 INFO:tasks.workunit.client.1.smithi141.stdout:1/824: stat da/d36/d4b/d4d/cde 0 2023-12-16T20:11:44.111 INFO:tasks.workunit.client.1.smithi141.stdout:1/825: mkdir da/d36/d4b/d4d/dd7/de1/d111 0 2023-12-16T20:11:44.111 INFO:tasks.workunit.client.1.smithi141.stdout:1/826: dread - da/d1a/d1d/ff0 zero size 2023-12-16T20:11:44.112 INFO:tasks.workunit.client.1.smithi141.stdout:1/827: mkdir da/d36/d112 0 2023-12-16T20:11:44.113 INFO:tasks.workunit.client.1.smithi141.stdout:1/828: link da/d67/lb5 da/d1a/d1d/d33/dcd/df8/l113 0 2023-12-16T20:11:44.114 INFO:tasks.workunit.client.1.smithi141.stdout:1/829: creat da/d36/d4b/d4d/d89/d61/f114 x:0 0 0 2023-12-16T20:11:44.114 INFO:tasks.workunit.client.1.smithi141.stdout:1/830: write da/d67/f5e [419324,130545] 0 2023-12-16T20:11:44.116 INFO:tasks.workunit.client.1.smithi141.stdout:1/831: rename da/f2c to da/d36/d4b/d4d/d80/dca/ddc/d108/f115 0 2023-12-16T20:11:44.116 INFO:tasks.workunit.client.1.smithi141.stdout:1/832: chown da/d36/d4b/d4d/d80/dca/ddc/ldf 24 1 2023-12-16T20:11:44.117 INFO:tasks.workunit.client.1.smithi141.stdout:1/833: rmdir da/d1a/d1d/d22/d10c 39 2023-12-16T20:11:44.118 INFO:tasks.workunit.client.1.smithi141.stdout:1/834: dread da/d36/d4b/f63 [0,4194304] 0 2023-12-16T20:11:44.119 INFO:tasks.workunit.client.1.smithi141.stdout:1/835: mkdir da/d1a/db0/dd3/df6/d116 0 2023-12-16T20:11:44.135 INFO:tasks.workunit.client.1.smithi141.stdout:1/836: dwrite da/d36/f96 [0,4194304] 0 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: pgmap v10: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 332 MiB/s wr, 463 op/s 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:43 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:44.145 INFO:tasks.workunit.client.1.smithi141.stdout:1/837: write da/fc [2238337,120305] 0 2023-12-16T20:11:44.146 INFO:tasks.workunit.client.1.smithi141.stdout:1/838: dread da/d1a/d1d/f5d [0,4194304] 0 2023-12-16T20:11:44.160 INFO:tasks.workunit.client.1.smithi141.stdout:1/839: dwrite da/d36/d4b/d4d/d80/dca/ddc/d108/f115 [0,4194304] 0 2023-12-16T20:11:44.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/706: sync 2023-12-16T20:11:44.162 INFO:tasks.workunit.client.1.smithi141.stdout:1/840: rename da/d36/d4b/d4d/d80/d94/cf1 to da/d1a/d1d/d33/c117 0 2023-12-16T20:11:44.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/707: dread d4/d49/d73/d3b/d78/fc2 [0,4194304] 0 2023-12-16T20:11:44.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/708: truncate d4/d49/d73/d3b/d78/f4f 2910523 0 2023-12-16T20:11:44.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/709: creat d4/d49/d73/fee x:0 0 0 2023-12-16T20:11:44.173 INFO:tasks.workunit.client.1.smithi141.stdout:1/841: truncate da/fc 978590 0 2023-12-16T20:11:44.179 INFO:tasks.workunit.client.1.smithi141.stdout:1/842: link da/d1a/d1d/d33/dcd/df8/l113 da/d1a/d1d/d33/dcd/df8/l118 0 2023-12-16T20:11:44.179 INFO:tasks.workunit.client.1.smithi141.stdout:1/843: chown da/d36/d4b/d4d/d89/c8c 3284 1 2023-12-16T20:11:44.179 INFO:tasks.workunit.client.1.smithi141.stdout:1/844: fdatasync da/d36/d4b/d4d/d80/d94/fa8 0 2023-12-16T20:11:44.179 INFO:tasks.workunit.client.1.smithi141.stdout:1/845: creat da/d1a/d1d/d33/f119 x:0 0 0 2023-12-16T20:11:44.181 INFO:tasks.workunit.client.1.smithi141.stdout:0/710: write d4/d49/d73/d3b/f7a [5068423,66443] 0 2023-12-16T20:11:44.185 INFO:tasks.workunit.client.1.smithi141.stdout:1/846: mkdir da/d1a/db0/dd3/df6/d116/d11a 0 2023-12-16T20:11:44.185 INFO:tasks.workunit.client.1.smithi141.stdout:1/847: truncate da/d36/d4b/d4d/d80/f93 3610280 0 2023-12-16T20:11:44.188 INFO:tasks.workunit.client.1.smithi141.stdout:1/848: mkdir da/d36/d4b/d4d/dd7/de1/d111/d11b 0 2023-12-16T20:11:44.191 INFO:tasks.workunit.client.1.smithi141.stdout:0/711: rename d4/d49/d73/d8a/d9b to d4/d49/da1/dbd/def 0 2023-12-16T20:11:44.193 INFO:tasks.workunit.client.1.smithi141.stdout:1/849: mknod da/d36/d4b/c11c 0 2023-12-16T20:11:44.194 INFO:tasks.workunit.client.1.smithi141.stdout:1/850: stat da/d1a/db0/dd3/df6/d116/d11a 0 2023-12-16T20:11:44.194 INFO:tasks.workunit.client.1.smithi141.stdout:1/851: write da/d1a/d1d/d22/d10c/fa6 [471994,66484] 0 2023-12-16T20:11:44.196 INFO:tasks.workunit.client.1.smithi141.stdout:0/712: rename d4/d49/d73/fee to d4/d49/da1/ff0 0 2023-12-16T20:11:44.196 INFO:tasks.workunit.client.1.smithi141.stdout:0/713: chown d4/d49/d73/d3b/d78/d7f/d80/d83 27180 1 2023-12-16T20:11:44.197 INFO:tasks.workunit.client.1.smithi141.stdout:1/852: creat da/d36/d4b/d4d/d80/d94/f11d x:0 0 0 2023-12-16T20:11:44.200 INFO:tasks.workunit.client.1.smithi141.stdout:0/714: rename d4/d49/c6f to d4/d49/d73/d3b/cf1 0 2023-12-16T20:11:44.201 INFO:tasks.workunit.client.1.smithi141.stdout:1/853: dread da/d36/d4b/d4d/dd7/de1/f78 [0,4194304] 0 2023-12-16T20:11:44.211 INFO:tasks.workunit.client.1.smithi141.stdout:0/715: dread d4/d49/da1/fd3 [0,4194304] 0 2023-12-16T20:11:44.213 INFO:tasks.workunit.client.1.smithi141.stdout:0/716: unlink d4/d49/d73/d3b/d78/f81 0 2023-12-16T20:11:44.215 INFO:tasks.workunit.client.1.smithi141.stdout:0/717: symlink d4/d49/d73/d3b/d78/d7f/lf2 0 2023-12-16T20:11:44.215 INFO:tasks.workunit.client.1.smithi141.stdout:1/854: write da/fb9 [104283,100550] 0 2023-12-16T20:11:44.233 INFO:tasks.workunit.client.1.smithi141.stdout:1/855: dwrite da/f52 [0,4194304] 0 2023-12-16T20:11:44.234 INFO:tasks.workunit.client.1.smithi141.stdout:1/856: creat da/d1a/db0/f11e x:0 0 0 2023-12-16T20:11:44.234 INFO:tasks.workunit.client.1.smithi141.stdout:1/857: mknod da/d76/c11f 0 2023-12-16T20:11:44.235 INFO:tasks.workunit.client.1.smithi141.stdout:1/858: dread - da/d36/d4b/d4d/d80/d94/d9d/dfc/fb7 zero size 2023-12-16T20:11:44.235 INFO:tasks.workunit.client.1.smithi141.stdout:1/859: write da/fc [129590,52038] 0 2023-12-16T20:11:44.235 INFO:tasks.workunit.client.1.smithi141.stdout:1/860: dread - da/d36/d4b/d4d/d80/d94/f11d zero size 2023-12-16T20:11:44.251 INFO:tasks.workunit.client.1.smithi141.stdout:1/861: dwrite da/d1a/d1d/fc8 [0,4194304] 0 2023-12-16T20:11:44.253 INFO:tasks.workunit.client.1.smithi141.stdout:1/862: creat da/d36/d4b/d4d/d80/dca/ddc/d108/f120 x:0 0 0 2023-12-16T20:11:44.254 INFO:tasks.workunit.client.1.smithi141.stdout:1/863: fdatasync da/d1a/d1d/d22/f101 0 2023-12-16T20:11:44.317 INFO:tasks.workunit.client.1.smithi141.stdout:5/729: sync 2023-12-16T20:11:44.317 INFO:tasks.workunit.client.1.smithi141.stdout:5/730: write d0/d14/d2c/d4a/f9b [866100,108839] 0 2023-12-16T20:11:44.317 INFO:tasks.workunit.client.1.smithi141.stdout:5/731: chown d0/d25/fdd 2538478 1 2023-12-16T20:11:44.432 INFO:tasks.workunit.client.1.smithi141.stdout:9/720: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:3/866: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:6/867: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:7/735: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:4/830: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:2/695: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:8/905: sync 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:8/906: chown d14/d19/d95/dab/dfd/d110/db4/d58/cc0 2991541 1 2023-12-16T20:11:44.433 INFO:tasks.workunit.client.1.smithi141.stdout:7/736: link d5/d2a/f41 d5/d2a/fef 0 2023-12-16T20:11:44.434 INFO:tasks.workunit.client.1.smithi141.stdout:9/721: mknod d1/d10/d27/d36/cf5 0 2023-12-16T20:11:44.434 INFO:tasks.workunit.client.1.smithi141.stdout:6/868: mkdir d1/d3/d4b/d119 0 2023-12-16T20:11:44.436 INFO:tasks.workunit.client.1.smithi141.stdout:8/907: dread d14/d19/d1b/d3d/f33 [0,4194304] 0 2023-12-16T20:11:44.436 INFO:tasks.workunit.client.1.smithi141.stdout:8/908: readlink d14/d19/d1b/d24/d4b/l9d 0 2023-12-16T20:11:44.437 INFO:tasks.workunit.client.1.smithi141.stdout:3/867: symlink d0/d1c/d2c/d72/l123 0 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:2/696: unlink d6/d3a/d47/d58/d66/f7b 0 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:2/697: read - d6/da/d4a/fbe zero size 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:4/831: mknod d1a/d4e/d63/daa/c131 0 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:8/909: stat d14/d19/d1b/d24/d4b/l65 0 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:9/722: creat d1/d26/d4a/d73/ff6 x:0 0 0 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:8/910: chown d14/d19/d1b/d24/da3/faa 250 1 2023-12-16T20:11:44.440 INFO:tasks.workunit.client.1.smithi141.stdout:8/911: chown d14/fa4 41 1 2023-12-16T20:11:44.441 INFO:tasks.workunit.client.1.smithi141.stdout:9/723: fdatasync d1/d26/d4a/d73/d76/fcf 0 2023-12-16T20:11:44.441 INFO:tasks.workunit.client.1.smithi141.stdout:9/724: write d1/d10/d14/d20/da/d3f/dea/fef [501617,112405] 0 2023-12-16T20:11:44.442 INFO:tasks.workunit.client.1.smithi141.stdout:8/912: stat d14/d19/d95/dab/dfd/d110/db4/d58/cb9 0 2023-12-16T20:11:44.442 INFO:tasks.workunit.client.1.smithi141.stdout:8/913: truncate d14/d19/d1b/d24/d4b/d8c/fa6 1021305 0 2023-12-16T20:11:44.442 INFO:tasks.workunit.client.1.smithi141.stdout:7/737: dread d5/d16/d30/d4e/fec [0,4194304] 0 2023-12-16T20:11:44.442 INFO:tasks.workunit.client.1.smithi141.stdout:6/869: unlink d1/dd/d2f/l57 0 2023-12-16T20:11:44.444 INFO:tasks.workunit.client.1.smithi141.stdout:7/738: dread d5/d16/d30/f57 [0,4194304] 0 2023-12-16T20:11:44.444 INFO:tasks.workunit.client.1.smithi141.stdout:8/914: dread d14/d19/d95/dab/dfd/d110/db4/d5b/f7b [0,4194304] 0 2023-12-16T20:11:44.444 INFO:tasks.workunit.client.1.smithi141.stdout:7/739: chown d5/d16/de3/d1e/ca1 1 1 2023-12-16T20:11:44.444 INFO:tasks.workunit.client.1.smithi141.stdout:9/725: symlink d1/lf7 0 2023-12-16T20:11:44.444 INFO:tasks.workunit.client.1.smithi141.stdout:9/726: chown d1/d26/d4a/dde/le4 10287 1 2023-12-16T20:11:44.445 INFO:tasks.workunit.client.1.smithi141.stdout:6/870: link d1/dd/d2f/d48/f84 d1/d12/d20/f11a 0 2023-12-16T20:11:44.447 INFO:tasks.workunit.client.1.smithi141.stdout:8/915: mkdir d14/d19/d1b/d3d/d122 0 2023-12-16T20:11:44.447 INFO:tasks.workunit.client.1.smithi141.stdout:8/916: dread - d14/d19/d95/dab/dfd/d110/db4/d5b/f113 zero size 2023-12-16T20:11:44.447 INFO:tasks.workunit.client.1.smithi141.stdout:8/917: write d14/d19/d95/dab/dfd/d110/db4/d69/dd4/ff4 [961842,7980] 0 2023-12-16T20:11:44.448 INFO:tasks.workunit.client.1.smithi141.stdout:7/740: symlink d5/d16/de3/d1e/d71/ddf/dee/lf0 0 2023-12-16T20:11:44.450 INFO:tasks.workunit.client.1.smithi141.stdout:6/871: mknod d1/d12/d22/d25/de0/c11b 0 2023-12-16T20:11:44.450 INFO:tasks.workunit.client.1.smithi141.stdout:8/918: chown d14/d19/d1b/f3f 5 1 2023-12-16T20:11:44.450 INFO:tasks.workunit.client.1.smithi141.stdout:8/919: dread - d14/d19/d95/dab/dfd/d110/db4/d69/f107 zero size 2023-12-16T20:11:44.451 INFO:tasks.workunit.client.1.smithi141.stdout:2/698: write d6/da/d1b/d5b/faa [2169679,23673] 0 2023-12-16T20:11:44.451 INFO:tasks.workunit.client.1.smithi141.stdout:4/832: write d1a/d2a/d3b/d69/fd7 [778598,106904] 0 2023-12-16T20:11:44.452 INFO:tasks.workunit.client.1.smithi141.stdout:6/872: read d1/d12/d22/d25/d38/fc7 [86514,44786] 0 2023-12-16T20:11:44.452 INFO:tasks.workunit.client.1.smithi141.stdout:9/727: rmdir d1/d10/d14/d20/da 39 2023-12-16T20:11:44.453 INFO:tasks.workunit.client.1.smithi141.stdout:8/920: unlink d14/d19/d95/dab/dfd/d110/db4/d108/l11c 0 2023-12-16T20:11:44.454 INFO:tasks.workunit.client.1.smithi141.stdout:8/921: dread - d14/d19/ff1 zero size 2023-12-16T20:11:44.454 INFO:tasks.workunit.client.1.smithi141.stdout:8/922: write d14/d19/d95/dab/dfd/d110/db4/d5b/dea/f100 [1327729,41608] 0 2023-12-16T20:11:44.456 INFO:tasks.workunit.client.1.smithi141.stdout:4/833: creat d1a/d54/f132 x:0 0 0 2023-12-16T20:11:44.457 INFO:tasks.workunit.client.1.smithi141.stdout:9/728: mknod d1/d10/d33/d47/cf8 0 2023-12-16T20:11:44.457 INFO:tasks.workunit.client.1.smithi141.stdout:3/868: dwrite d0/d1c/d40/f1b [0,4194304] 0 2023-12-16T20:11:44.457 INFO:tasks.workunit.client.1.smithi141.stdout:9/729: chown d1/d26/d3c 6697 1 2023-12-16T20:11:44.457 INFO:tasks.workunit.client.1.smithi141.stdout:3/869: truncate d0/d1c/d40/d3f/d52/d5d/d95/f10a 956150 0 2023-12-16T20:11:44.459 INFO:tasks.workunit.client.1.smithi141.stdout:8/923: mknod d14/d35/c123 0 2023-12-16T20:11:44.461 INFO:tasks.workunit.client.1.smithi141.stdout:4/834: mknod d1a/d2a/d3b/c133 0 2023-12-16T20:11:44.462 INFO:tasks.workunit.client.1.smithi141.stdout:7/741: write d5/d16/de3/d89/fd8 [5457862,130779] 0 2023-12-16T20:11:44.463 INFO:tasks.workunit.client.1.smithi141.stdout:6/873: truncate d1/d12/f16 1845068 0 2023-12-16T20:11:44.464 INFO:tasks.workunit.client.1.smithi141.stdout:6/874: creat d1/dd/d2f/d48/f11c x:0 0 0 2023-12-16T20:11:44.464 INFO:tasks.workunit.client.1.smithi141.stdout:9/730: creat d1/d10/d14/d20/d3b/ff9 x:0 0 0 2023-12-16T20:11:44.467 INFO:tasks.workunit.client.1.smithi141.stdout:3/870: mknod d0/d1c/d40/d3f/d52/d5d/d109/c124 0 2023-12-16T20:11:44.467 INFO:tasks.workunit.client.1.smithi141.stdout:3/871: write d0/d1c/d2c/d10d/df9/fcf [1167159,73523] 0 2023-12-16T20:11:44.471 INFO:tasks.workunit.client.1.smithi141.stdout:4/835: creat d1a/d2a/d3b/d69/df0/d126/f134 x:0 0 0 2023-12-16T20:11:44.477 INFO:tasks.workunit.client.1.smithi141.stdout:2/699: dwrite d6/f17 [0,4194304] 0 2023-12-16T20:11:44.477 INFO:tasks.workunit.client.1.smithi141.stdout:2/700: write d6/d32/d52/fc3 [797514,80600] 0 2023-12-16T20:11:44.478 INFO:tasks.workunit.client.1.smithi141.stdout:2/701: creat d6/da/d1b/d5b/d6a/d85/fe6 x:0 0 0 2023-12-16T20:11:44.481 INFO:tasks.workunit.client.1.smithi141.stdout:3/872: write d0/d1c/d2c/d72/d74/dda/ff4 [535535,70825] 0 2023-12-16T20:11:44.483 INFO:tasks.workunit.client.1.smithi141.stdout:6/875: rename d1/d12/d22/f88 to d1/d3/d4b/d60/f11d 0 2023-12-16T20:11:44.483 INFO:tasks.workunit.client.1.smithi141.stdout:6/876: stat d1/dd/d2f/ccc 0 2023-12-16T20:11:44.491 INFO:tasks.workunit.client.1.smithi141.stdout:2/702: symlink d6/da/d4a/d5e/le7 0 2023-12-16T20:11:44.492 INFO:tasks.workunit.client.1.smithi141.stdout:3/873: dread d0/d1c/d2c/d10d/f71 [0,4194304] 0 2023-12-16T20:11:44.496 INFO:tasks.workunit.client.1.smithi141.stdout:7/742: dwrite d5/d2a/f41 [0,4194304] 0 2023-12-16T20:11:44.496 INFO:tasks.workunit.client.1.smithi141.stdout:8/924: dwrite d14/d19/d1b/d24/ff0 [0,4194304] 0 2023-12-16T20:11:44.502 INFO:tasks.workunit.client.1.smithi141.stdout:4/836: getdents d1a/d4e/d63/daa/db9/df6 0 2023-12-16T20:11:44.504 INFO:tasks.workunit.client.1.smithi141.stdout:3/874: dread d0/d1c/d40/f1b [0,4194304] 0 2023-12-16T20:11:44.504 INFO:tasks.workunit.client.1.smithi141.stdout:3/875: chown d0/d1c/d40/d3f/c118 93534 1 2023-12-16T20:11:44.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/743: dread d5/d16/d46/f90 [4194304,4194304] 0 2023-12-16T20:11:44.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/744: creat d5/d16/d30/d36/ff1 x:0 0 0 2023-12-16T20:11:44.509 INFO:tasks.workunit.client.1.smithi141.stdout:4/837: dread d1a/d3c/d9b/fac [0,4194304] 0 2023-12-16T20:11:44.509 INFO:tasks.workunit.client.1.smithi141.stdout:4/838: chown d1a/f29 9250280 1 2023-12-16T20:11:44.510 INFO:tasks.workunit.client.1.smithi141.stdout:8/925: mkdir d14/d19/d1b/d3d/d5e/d124 0 2023-12-16T20:11:44.512 INFO:tasks.workunit.client.1.smithi141.stdout:3/876: rename d0/d1c/d40/l58 to d0/d1c/d40/d3f/d52/l125 0 2023-12-16T20:11:44.518 INFO:tasks.workunit.client.1.smithi141.stdout:4/839: unlink d1a/f32 0 2023-12-16T20:11:44.519 INFO:tasks.workunit.client.1.smithi141.stdout:4/840: creat d1a/d59/d89/d8a/f135 x:0 0 0 2023-12-16T20:11:44.519 INFO:tasks.workunit.client.1.smithi141.stdout:8/926: dread - d14/d19/d1b/f90 zero size 2023-12-16T20:11:44.519 INFO:tasks.workunit.client.1.smithi141.stdout:8/927: write d14/d19/d95/dab/dfd/d110/db4/d58/f11f [891113,36563] 0 2023-12-16T20:11:44.521 INFO:tasks.workunit.client.1.smithi141.stdout:3/877: rename d0/d1c/d40/d85/l91 to d0/d1c/d40/d112/l126 0 2023-12-16T20:11:44.521 INFO:tasks.workunit.client.1.smithi141.stdout:3/878: chown d0/d1c/d40/d3f/cfc 1191225 1 2023-12-16T20:11:44.521 INFO:tasks.workunit.client.1.smithi141.stdout:2/703: dwrite d6/d12/d1f/d46/d5a/fb6 [0,4194304] 0 2023-12-16T20:11:44.522 INFO:tasks.workunit.client.1.smithi141.stdout:4/841: symlink d1a/d2a/d3b/dcd/d128/l136 0 2023-12-16T20:11:44.522 INFO:tasks.workunit.client.1.smithi141.stdout:4/842: chown d1a/l2b 7074 1 2023-12-16T20:11:44.522 INFO:tasks.workunit.client.1.smithi141.stdout:4/843: truncate d1a/f29 4663485 0 2023-12-16T20:11:44.522 INFO:tasks.workunit.client.1.smithi141.stdout:6/877: dwrite d1/d12/d20/d3a/f80 [0,4194304] 0 2023-12-16T20:11:44.522 INFO:tasks.workunit.client.1.smithi141.stdout:6/878: chown d1/d12/d20/d44/f72 37019663 1 2023-12-16T20:11:44.523 INFO:tasks.workunit.client.1.smithi141.stdout:3/879: creat d0/d1c/d2c/d72/d74/dda/f127 x:0 0 0 2023-12-16T20:11:44.525 INFO:tasks.workunit.client.1.smithi141.stdout:8/928: rename d14/d19/d1b/d24/d4b/fb6 to d14/d19/d1b/d24/d4b/d8f/f125 0 2023-12-16T20:11:44.525 INFO:tasks.workunit.client.1.smithi141.stdout:6/879: dread d1/d12/d20/d89/d95/ff2 [0,4194304] 0 2023-12-16T20:11:44.527 INFO:tasks.workunit.client.1.smithi141.stdout:2/704: mkdir d6/da/d33/d54/d7c/de8 0 2023-12-16T20:11:44.529 INFO:tasks.workunit.client.1.smithi141.stdout:3/880: mkdir d0/d1c/d6a/d128 0 2023-12-16T20:11:44.529 INFO:tasks.workunit.client.1.smithi141.stdout:7/745: dwrite d5/d16/d1a/d40/f58 [4194304,4194304] 0 2023-12-16T20:11:44.529 INFO:tasks.workunit.client.1.smithi141.stdout:3/881: write d0/d1c/d6a/d76/da2/fac [3519799,75633] 0 2023-12-16T20:11:44.532 INFO:tasks.workunit.client.1.smithi141.stdout:4/844: rename d1a/d2a/d3b/d69/f83 to d1a/d2a/d3b/d69/df0/f137 0 2023-12-16T20:11:44.534 INFO:tasks.workunit.client.1.smithi141.stdout:8/929: link d14/d71/d81/ffc d14/d19/d95/dab/dfd/f126 0 2023-12-16T20:11:44.536 INFO:tasks.workunit.client.1.smithi141.stdout:6/880: mkdir d1/dd/de/d8a/d11e 0 2023-12-16T20:11:44.536 INFO:tasks.workunit.client.1.smithi141.stdout:6/881: write d1/dd/de/f27 [1095552,58715] 0 2023-12-16T20:11:44.539 INFO:tasks.workunit.client.1.smithi141.stdout:7/746: link d5/d2a/faa d5/d16/d30/d36/ff2 0 2023-12-16T20:11:44.545 INFO:tasks.workunit.client.1.smithi141.stdout:2/705: rename d6/d32/d52/d53/f8d to d6/d32/d7a/ddf/d98/fe9 0 2023-12-16T20:11:44.545 INFO:tasks.workunit.client.1.smithi141.stdout:2/706: write d6/d12/d1f/d46/d5a/fb7 [675166,102773] 0 2023-12-16T20:11:44.545 INFO:tasks.workunit.client.1.smithi141.stdout:2/707: dread - d6/d32/d7a/ddf/d98/fdc zero size 2023-12-16T20:11:44.546 INFO:tasks.workunit.client.1.smithi141.stdout:6/882: unlink d1/dd/d2f/f30 0 2023-12-16T20:11:44.548 INFO:tasks.workunit.client.1.smithi141.stdout:3/882: dwrite d0/d1c/fdd [0,4194304] 0 2023-12-16T20:11:44.553 INFO:tasks.workunit.client.1.smithi141.stdout:7/747: mkdir d5/d16/de3/d1e/d71/df3 0 2023-12-16T20:11:44.553 INFO:tasks.workunit.client.1.smithi141.stdout:8/930: dwrite d14/f94 [0,4194304] 0 2023-12-16T20:11:44.554 INFO:tasks.workunit.client.1.smithi141.stdout:6/883: mknod d1/d12/d10d/c11f 0 2023-12-16T20:11:44.558 INFO:tasks.workunit.client.1.smithi141.stdout:3/883: rename d0/d1c/d40/d3c/c7d to d0/d1c/d2c/d10d/df9/df8/dfd/c129 0 2023-12-16T20:11:44.559 INFO:tasks.workunit.client.1.smithi141.stdout:7/748: mknod d5/d2a/d45/cf4 0 2023-12-16T20:11:44.560 INFO:tasks.workunit.client.1.smithi141.stdout:7/749: fdatasync d5/d16/d30/d36/ff2 0 2023-12-16T20:11:44.562 INFO:tasks.workunit.client.1.smithi141.stdout:8/931: creat d14/d19/d95/dab/dfd/d110/db4/d69/dfe/f127 x:0 0 0 2023-12-16T20:11:44.562 INFO:tasks.workunit.client.1.smithi141.stdout:8/932: chown d14/d19/d95/dab/dfd/d110/db4/d58/d105/l106 1696 1 2023-12-16T20:11:44.562 INFO:tasks.workunit.client.1.smithi141.stdout:2/708: dwrite d6/da/f35 [0,4194304] 0 2023-12-16T20:11:44.563 INFO:tasks.workunit.client.1.smithi141.stdout:2/709: creat d6/d3a/fea x:0 0 0 2023-12-16T20:11:44.563 INFO:tasks.workunit.client.1.smithi141.stdout:6/884: mkdir d1/d12/d20/d85/dfb/d120 0 2023-12-16T20:11:44.566 INFO:tasks.workunit.client.1.smithi141.stdout:3/884: rename d0/d1c/d40/l35 to d0/d1c/d40/d3c/dce/l12a 0 2023-12-16T20:11:44.568 INFO:tasks.workunit.client.1.smithi141.stdout:3/885: dread d0/d1c/d40/d3c/dce/ff2 [0,4194304] 0 2023-12-16T20:11:44.568 INFO:tasks.workunit.client.1.smithi141.stdout:3/886: chown d0/l26 3168 1 2023-12-16T20:11:44.570 INFO:tasks.workunit.client.1.smithi141.stdout:6/885: dread d1/dd/d2f/f5f [0,4194304] 0 2023-12-16T20:11:44.578 INFO:tasks.workunit.client.1.smithi141.stdout:3/887: dread d0/d1c/d40/d85/f77 [0,4194304] 0 2023-12-16T20:11:44.590 INFO:tasks.workunit.client.1.smithi141.stdout:6/886: mknod d1/d12/d22/d25/de0/c121 0 2023-12-16T20:11:44.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/710: dwrite d6/da/d1b/f5d [0,4194304] 0 2023-12-16T20:11:44.590 INFO:tasks.workunit.client.1.smithi141.stdout:2/711: write d6/d3a/d47/d58/d66/fe2 [580993,86586] 0 2023-12-16T20:11:44.591 INFO:tasks.workunit.client.1.smithi141.stdout:8/933: mkdir d14/d19/d1b/d24/d128 0 2023-12-16T20:11:44.592 INFO:tasks.workunit.client.1.smithi141.stdout:8/934: readlink d14/d19/d95/dab/dfd/d110/db4/d5b/l6e 0 2023-12-16T20:11:44.592 INFO:tasks.workunit.client.1.smithi141.stdout:8/935: read d14/d19/d1b/d3d/f33 [318983,117678] 0 2023-12-16T20:11:44.592 INFO:tasks.workunit.client.1.smithi141.stdout:8/936: write d14/d19/d95/dab/dfd/d110/db4/d69/f107 [407546,84460] 0 2023-12-16T20:11:44.592 INFO:tasks.workunit.client.1.smithi141.stdout:8/937: truncate d14/d19/d95/dab/dfd/d110/db4/d5b/f113 478387 0 2023-12-16T20:11:44.602 INFO:tasks.workunit.client.1.smithi141.stdout:2/712: symlink d6/d3a/d47/d58/leb 0 2023-12-16T20:11:44.602 INFO:tasks.workunit.client.1.smithi141.stdout:2/713: chown d6/d32/d7a/fc1 463 1 2023-12-16T20:11:44.606 INFO:tasks.workunit.client.1.smithi141.stdout:8/938: creat d14/d19/d1b/f129 x:0 0 0 2023-12-16T20:11:44.606 INFO:tasks.workunit.client.1.smithi141.stdout:3/888: rename d0/d1c/d40/d3f/d52 to d0/d1c/d40/d12b 0 2023-12-16T20:11:44.611 INFO:tasks.workunit.client.1.smithi141.stdout:6/887: getdents d1/dd/d2f/d48 0 2023-12-16T20:11:44.611 INFO:tasks.workunit.client.1.smithi141.stdout:7/750: rmdir d5 39 2023-12-16T20:11:44.612 INFO:tasks.workunit.client.1.smithi141.stdout:3/889: mkdir d0/d1c/d40/d12b/d63/d12c 0 2023-12-16T20:11:44.615 INFO:tasks.workunit.client.1.smithi141.stdout:6/888: creat d1/d12/d22/d25/dd0/f122 x:0 0 0 2023-12-16T20:11:44.616 INFO:tasks.workunit.client.1.smithi141.stdout:6/889: stat d1/dd/d2f/df7 0 2023-12-16T20:11:44.617 INFO:tasks.workunit.client.1.smithi141.stdout:7/751: unlink d5/d2a/f34 0 2023-12-16T20:11:44.621 INFO:tasks.workunit.client.1.smithi141.stdout:3/890: truncate d0/d1c/d40/f43 1688146 0 2023-12-16T20:11:44.622 INFO:tasks.workunit.client.1.smithi141.stdout:6/890: rmdir d1/d12/d22/d25/dc3/dc6/df9 39 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:8/939: dwrite d14/d19/d95/dab/dfd/d110/f112 [8388608,4194304] 0 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:8/940: fsync d14/fe8 0 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:8/941: write d14/d19/d1b/f90 [496427,39222] 0 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:6/891: fsync d1/d12/d22/d25/fbb 0 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:7/752: write d5/d16/d46/d61/f6b [2242307,103218] 0 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:6/892: dread - d1/d12/d10d/d47/fdb zero size 2023-12-16T20:11:44.630 INFO:tasks.workunit.client.1.smithi141.stdout:6/893: chown d1/d12/d20/cf3 1684804240 1 2023-12-16T20:11:44.631 INFO:tasks.workunit.client.1.smithi141.stdout:7/753: rmdir d5/d16/d1a/dd7 39 2023-12-16T20:11:44.633 INFO:tasks.workunit.client.1.smithi141.stdout:6/894: truncate d1/d12/d20/d44/f5b 140764 0 2023-12-16T20:11:44.637 INFO:tasks.workunit.client.1.smithi141.stdout:7/754: symlink d5/d16/d1a/d40/dab/dd5/lf5 0 2023-12-16T20:11:44.641 INFO:tasks.workunit.client.1.smithi141.stdout:8/942: dread d14/d19/d1b/d24/ff0 [0,4194304] 0 2023-12-16T20:11:44.641 INFO:tasks.workunit.client.1.smithi141.stdout:8/943: dread - d14/d19/d95/dab/dfd/fe1 zero size 2023-12-16T20:11:44.641 INFO:tasks.workunit.client.1.smithi141.stdout:8/944: truncate d14/f23 2095642 0 2023-12-16T20:11:44.641 INFO:tasks.workunit.client.1.smithi141.stdout:7/755: mknod d5/d16/d1a/d40/dab/dd5/cf6 0 2023-12-16T20:11:44.641 INFO:tasks.workunit.client.1.smithi141.stdout:7/756: fsync d5/d2a/f41 0 2023-12-16T20:11:44.642 INFO:tasks.workunit.client.1.smithi141.stdout:3/891: dwrite d0/fc5 [0,4194304] 0 2023-12-16T20:11:44.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/945: symlink d14/d19/d95/dab/dfd/d110/db4/d5b/dea/l12a 0 2023-12-16T20:11:44.644 INFO:tasks.workunit.client.1.smithi141.stdout:8/946: chown d14/d19/d95/dab/dfd/d110/db4/d58/fc9 450928 1 2023-12-16T20:11:44.648 INFO:tasks.workunit.client.1.smithi141.stdout:3/892: mknod d0/d1c/d40/d12b/d5d/d109/c12d 0 2023-12-16T20:11:44.654 INFO:tasks.workunit.client.1.smithi141.stdout:3/893: truncate d0/f29 1428942 0 2023-12-16T20:11:44.657 INFO:tasks.workunit.client.1.smithi141.stdout:6/895: rename d1/d3 to d1/d5e/d123 0 2023-12-16T20:11:44.657 INFO:tasks.workunit.client.1.smithi141.stdout:6/896: read d1/d12/d20/d44/ddf/fee [4179065,128357] 0 2023-12-16T20:11:44.657 INFO:tasks.workunit.client.1.smithi141.stdout:6/897: truncate d1/d12/d10d/f81 4378850 0 2023-12-16T20:11:44.657 INFO:tasks.workunit.client.1.smithi141.stdout:6/898: stat d1/d12/d20/ff1 0 2023-12-16T20:11:44.658 INFO:tasks.workunit.client.1.smithi141.stdout:1/864: sync 2023-12-16T20:11:44.658 INFO:tasks.workunit.client.1.smithi141.stdout:0/718: sync 2023-12-16T20:11:44.658 INFO:tasks.workunit.client.1.smithi141.stdout:1/865: creat da/d1a/d1d/d22/f121 x:0 0 0 2023-12-16T20:11:44.659 INFO:tasks.workunit.client.1.smithi141.stdout:3/894: symlink d0/d1c/d40/d3f/dc1/l12e 0 2023-12-16T20:11:44.661 INFO:tasks.workunit.client.1.smithi141.stdout:7/757: dwrite d5/d16/d1a/f25 [0,4194304] 0 2023-12-16T20:11:44.664 INFO:tasks.workunit.client.1.smithi141.stdout:6/899: mkdir d1/d12/d22/d25/de0/de9/dea/d124 0 2023-12-16T20:11:44.666 INFO:tasks.workunit.client.1.smithi141.stdout:3/895: mknod d0/d1c/d40/d12b/d63/df6/c12f 0 2023-12-16T20:11:44.669 INFO:tasks.workunit.client.1.smithi141.stdout:7/758: link d5/d16/de3/d89/f95 d5/d16/d1a/d40/dcb/ff7 0 2023-12-16T20:11:44.669 INFO:tasks.workunit.client.1.smithi141.stdout:7/759: readlink d5/d16/d30/d36/lb8 0 2023-12-16T20:11:44.669 INFO:tasks.workunit.client.1.smithi141.stdout:7/760: fsync d5/d16/de3/d1e/d71/d96/fdb 0 2023-12-16T20:11:44.669 INFO:tasks.workunit.client.1.smithi141.stdout:7/761: truncate d5/d16/d46/fa7 12672 0 2023-12-16T20:11:44.669 INFO:tasks.workunit.client.1.smithi141.stdout:7/762: write d5/d16/d30/d4e/d6e/fc8 [338003,44534] 0 2023-12-16T20:11:44.672 INFO:tasks.workunit.client.1.smithi141.stdout:6/900: symlink d1/d12/d22/d25/dc3/dc6/df9/l125 0 2023-12-16T20:11:44.672 INFO:tasks.workunit.client.1.smithi141.stdout:6/901: write d1/d5e/d123/d4f/faa [4694690,91837] 0 2023-12-16T20:11:44.673 INFO:tasks.workunit.client.1.smithi141.stdout:6/902: getdents d1/d12/d20/d85 0 2023-12-16T20:11:44.673 INFO:tasks.workunit.client.1.smithi141.stdout:6/903: write d1/d12/d20/d44/f72 [570351,86363] 0 2023-12-16T20:11:44.675 INFO:tasks.workunit.client.1.smithi141.stdout:6/904: stat d1/d12/d20/d89/d95/l83 0 2023-12-16T20:11:44.675 INFO:tasks.workunit.client.1.smithi141.stdout:1/866: write da/d36/d4b/d4d/d89/d61/f102 [4090609,75960] 0 2023-12-16T20:11:44.677 INFO:tasks.workunit.client.1.smithi141.stdout:6/905: dread d1/d12/d20/d89/d95/ff2 [0,4194304] 0 2023-12-16T20:11:44.680 INFO:tasks.workunit.client.1.smithi141.stdout:6/906: rmdir d1/dd 39 2023-12-16T20:11:44.683 INFO:tasks.workunit.client.1.smithi141.stdout:8/947: rename d14/d19/d95/dab/dfd/d110 to d14/d19/d1b/d3d/d5e/d12b 0 2023-12-16T20:11:44.684 INFO:tasks.workunit.client.1.smithi141.stdout:0/719: dwrite d4/d49/da1/dbd/fc4 [0,4194304] 0 2023-12-16T20:11:44.684 INFO:tasks.workunit.client.1.smithi141.stdout:8/948: write d14/d71/d81/f75 [5503,108529] 0 2023-12-16T20:11:44.687 INFO:tasks.workunit.client.1.smithi141.stdout:3/896: dwrite d0/d1c/d6a/d76/f10f [0,4194304] 0 2023-12-16T20:11:44.687 INFO:tasks.workunit.client.1.smithi141.stdout:3/897: readlink d0/d1c/d40/d112/l126 0 2023-12-16T20:11:44.687 INFO:tasks.workunit.client.1.smithi141.stdout:3/898: write d0/d1c/d2c/ffa [343661,38080] 0 2023-12-16T20:11:44.688 INFO:tasks.workunit.client.1.smithi141.stdout:7/763: rename d5/d2a/f60 to d5/d16/de3/d1e/d71/ddf/dee/ff8 0 2023-12-16T20:11:44.688 INFO:tasks.workunit.client.1.smithi141.stdout:7/764: fsync d5/d16/de3/d1e/d71/f8e 0 2023-12-16T20:11:44.689 INFO:tasks.workunit.client.1.smithi141.stdout:1/867: read da/d1a/d31/fd0 [1041490,34829] 0 2023-12-16T20:11:44.691 INFO:tasks.workunit.client.1.smithi141.stdout:8/949: symlink d14/d19/d1b/d3d/d5e/d12b/db4/d58/d8b/l12c 0 2023-12-16T20:11:44.701 INFO:tasks.workunit.client.1.smithi141.stdout:7/765: getdents d5/d16/d1a/d40/dab 0 2023-12-16T20:11:44.704 INFO:tasks.workunit.client.1.smithi141.stdout:1/868: symlink da/d36/d4b/d4d/d80/dca/ddc/d108/l122 0 2023-12-16T20:11:44.714 INFO:tasks.workunit.client.1.smithi141.stdout:8/950: dwrite d14/d19/d1b/d3d/d5e/d12b/db4/f5a [0,4194304] 0 2023-12-16T20:11:44.717 INFO:tasks.workunit.client.1.smithi141.stdout:8/951: dread d14/d19/d1b/d3d/d5e/d12b/db4/d69/dd4/ff4 [0,4194304] 0 2023-12-16T20:11:44.724 INFO:tasks.workunit.client.1.smithi141.stdout:8/952: creat d14/d19/d1b/d3d/d5e/d12b/db4/d58/d8b/f12d x:0 0 0 2023-12-16T20:11:44.725 INFO:tasks.workunit.client.1.smithi141.stdout:7/766: dwrite d5/d16/de3/d89/fd8 [4194304,4194304] 0 2023-12-16T20:11:44.727 INFO:tasks.workunit.client.1.smithi141.stdout:0/720: rename d4/d49/d4b to d4/d49/da1/df3 0 2023-12-16T20:11:44.728 INFO:tasks.workunit.client.1.smithi141.stdout:8/953: creat d14/d19/d1b/d24/d128/f12e x:0 0 0 2023-12-16T20:11:44.730 INFO:tasks.workunit.client.1.smithi141.stdout:7/767: mknod d5/d16/d1a/cf9 0 2023-12-16T20:11:44.730 INFO:tasks.workunit.client.1.smithi141.stdout:7/768: chown d5/d2a/d45/d5a/fc5 0 1 2023-12-16T20:11:44.733 INFO:tasks.workunit.client.1.smithi141.stdout:3/899: rename d0/d1c/d40/d3c/c120 to d0/d1c/d40/d12b/d5d/d11b/c130 0 2023-12-16T20:11:44.736 INFO:tasks.workunit.client.1.smithi141.stdout:1/869: rename da/d1a/d1d/d22/d10c/fcc to da/d1a/d1d/d22/f123 0 2023-12-16T20:11:44.739 INFO:tasks.workunit.client.1.smithi141.stdout:1/870: mknod da/d36/d4b/d4d/d80/dca/ddc/d108/c124 0 2023-12-16T20:11:44.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/871: symlink da/d36/d4b/d4d/d89/d6c/l125 0 2023-12-16T20:11:44.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/872: creat da/d76/f126 x:0 0 0 2023-12-16T20:11:44.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/873: creat da/d36/d4b/d4d/d89/d6c/f127 x:0 0 0 2023-12-16T20:11:44.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/874: chown da/d1a/d1d/d33/d7f 521760785 1 2023-12-16T20:11:44.742 INFO:tasks.workunit.client.1.smithi141.stdout:1/875: write da/d1a/d1d/d33/fd4 [845199,95304] 0 2023-12-16T20:11:44.751 INFO:tasks.workunit.client.1.smithi141.stdout:3/900: write d0/fc5 [2217265,47752] 0 2023-12-16T20:11:44.751 INFO:tasks.workunit.client.1.smithi141.stdout:3/901: write d0/f29 [2380612,81197] 0 2023-12-16T20:11:44.751 INFO:tasks.workunit.client.1.smithi141.stdout:3/902: chown d0/d1c/d40/d3c/cb8 10381 1 2023-12-16T20:11:44.752 INFO:tasks.workunit.client.1.smithi141.stdout:1/876: dread da/fac [0,4194304] 0 2023-12-16T20:11:44.753 INFO:tasks.workunit.client.1.smithi141.stdout:3/903: mknod d0/d1c/d40/d3f/c131 0 2023-12-16T20:11:44.756 INFO:tasks.workunit.client.1.smithi141.stdout:1/877: dread da/d36/d4b/d4d/d89/f32 [4194304,4194304] 0 2023-12-16T20:11:44.756 INFO:tasks.workunit.client.1.smithi141.stdout:1/878: chown da/d36/f5c 7947 1 2023-12-16T20:11:44.756 INFO:tasks.workunit.client.1.smithi141.stdout:3/904: write d0/d1c/d40/d12b/d5d/f10e [1336694,17344] 0 2023-12-16T20:11:44.757 INFO:tasks.workunit.client.1.smithi141.stdout:1/879: truncate da/d67/f68 3899739 0 2023-12-16T20:11:44.759 INFO:tasks.workunit.client.1.smithi141.stdout:3/905: mkdir d0/d1c/d40/d12b/d5d/d11b/d132 0 2023-12-16T20:11:44.760 INFO:tasks.workunit.client.1.smithi141.stdout:1/880: mkdir da/d1a/d31/d81/db6/d128 0 2023-12-16T20:11:44.760 INFO:tasks.workunit.client.1.smithi141.stdout:7/769: dwrite d5/d16/d46/d61/fbb [4194304,4194304] 0 2023-12-16T20:11:44.760 INFO:tasks.workunit.client.1.smithi141.stdout:7/770: chown d5/d2a/d45/d5a/lea 613 1 2023-12-16T20:11:44.761 INFO:tasks.workunit.client.1.smithi141.stdout:8/954: dwrite d14/d19/d1b/d3d/f3e [0,4194304] 0 2023-12-16T20:11:44.761 INFO:tasks.workunit.client.1.smithi141.stdout:3/906: creat d0/d1c/d2c/dc0/f133 x:0 0 0 2023-12-16T20:11:44.761 INFO:tasks.workunit.client.1.smithi141.stdout:3/907: write d0/d1c/d2c/f5b [1085480,75345] 0 2023-12-16T20:11:44.762 INFO:tasks.workunit.client.1.smithi141.stdout:0/721: dwrite d4/d74/dc1/dbe/fde [0,4194304] 0 2023-12-16T20:11:44.762 INFO:tasks.workunit.client.1.smithi141.stdout:1/881: rmdir da/d1a/d31 39 2023-12-16T20:11:44.764 INFO:tasks.workunit.client.1.smithi141.stdout:7/771: mkdir d5/d16/d30/d36/d8c/dfa 0 2023-12-16T20:11:44.769 INFO:tasks.workunit.client.1.smithi141.stdout:8/955: mkdir d14/d19/d1b/d3d/d5e/dbe/d12f 0 2023-12-16T20:11:44.784 INFO:tasks.workunit.client.1.smithi141.stdout:1/882: symlink da/d1a/dd1/d10b/l129 0 2023-12-16T20:11:44.786 INFO:tasks.workunit.client.1.smithi141.stdout:8/956: symlink d14/d19/d1b/d3d/d5e/d124/l130 0 2023-12-16T20:11:44.786 INFO:tasks.workunit.client.1.smithi141.stdout:7/772: dwrite d5/d2a/d45/d5a/fc5 [0,4194304] 0 2023-12-16T20:11:44.787 INFO:tasks.workunit.client.1.smithi141.stdout:7/773: write d5/d2a/fa9 [961069,1385] 0 2023-12-16T20:11:44.788 INFO:tasks.workunit.client.1.smithi141.stdout:3/908: dwrite d0/fc5 [0,4194304] 0 2023-12-16T20:11:44.790 INFO:tasks.workunit.client.1.smithi141.stdout:3/909: read d0/d1c/d2c/ffa [172282,101844] 0 2023-12-16T20:11:44.791 INFO:tasks.workunit.client.1.smithi141.stdout:1/883: creat da/d1a/dd1/d10b/f12a x:0 0 0 2023-12-16T20:11:44.791 INFO:tasks.workunit.client.1.smithi141.stdout:1/884: dread - da/d36/d4b/ff7 zero size 2023-12-16T20:11:44.793 INFO:tasks.workunit.client.1.smithi141.stdout:1/885: read da/d1a/d1d/d22/d10c/feb [366667,65412] 0 2023-12-16T20:11:44.793 INFO:tasks.workunit.client.1.smithi141.stdout:1/886: getdents da/d36/d112 0 2023-12-16T20:11:44.795 INFO:tasks.workunit.client.1.smithi141.stdout:8/957: mkdir d14/d19/d95/dab/d131 0 2023-12-16T20:11:44.795 INFO:tasks.workunit.client.1.smithi141.stdout:8/958: dread - d14/d19/d1b/d3d/d5e/d12b/db4/d5b/dea/deb/f102 zero size 2023-12-16T20:11:44.795 INFO:tasks.workunit.client.1.smithi141.stdout:8/959: fdatasync d14/d19/d1b/f3f 0 2023-12-16T20:11:44.801 INFO:tasks.workunit.client.1.smithi141.stdout:7/774: link d5/l67 d5/d16/de3/d89/d9b/dd4/lfb 0 2023-12-16T20:11:44.801 INFO:tasks.workunit.client.1.smithi141.stdout:7/775: chown d5/d16/d46/lb5 4562 1 2023-12-16T20:11:44.801 INFO:tasks.workunit.client.1.smithi141.stdout:3/910: truncate d0/d1c/d6a/d76/da2/fbe 3986186 0 2023-12-16T20:11:44.804 INFO:tasks.workunit.client.1.smithi141.stdout:1/887: mknod da/d1a/d1d/d33/dcd/c12b 0 2023-12-16T20:11:44.804 INFO:tasks.workunit.client.1.smithi141.stdout:1/888: fsync da/d36/d4b/d4d/d89/d61/f114 0 2023-12-16T20:11:44.804 INFO:tasks.workunit.client.1.smithi141.stdout:8/960: stat d14/c3c 0 2023-12-16T20:11:44.808 INFO:tasks.workunit.client.1.smithi141.stdout:1/889: rename da/fb8 to da/d36/d4b/db2/f12c 0 2023-12-16T20:11:44.814 INFO:tasks.workunit.client.1.smithi141.stdout:8/961: dread d14/d19/d1b/d24/f55 [0,4194304] 0 2023-12-16T20:11:44.814 INFO:tasks.workunit.client.1.smithi141.stdout:8/962: write d14/d19/d1b/d3d/d5e/d12b/db4/d58/f11f [1384540,2581] 0 2023-12-16T20:11:44.815 INFO:tasks.workunit.client.1.smithi141.stdout:7/776: dread d5/d16/de3/d89/fd8 [0,4194304] 0 2023-12-16T20:11:44.816 INFO:tasks.workunit.client.1.smithi141.stdout:8/963: mkdir d14/d35/d132 0 2023-12-16T20:11:44.818 INFO:tasks.workunit.client.1.smithi141.stdout:7/777: creat d5/d2a/d45/ffc x:0 0 0 2023-12-16T20:11:44.819 INFO:tasks.workunit.client.1.smithi141.stdout:8/964: mkdir d14/d19/d1b/d24/da3/d133 0 2023-12-16T20:11:44.819 INFO:tasks.workunit.client.1.smithi141.stdout:8/965: fdatasync d14/d19/d1b/d24/ff0 0 2023-12-16T20:11:44.820 INFO:tasks.workunit.client.1.smithi141.stdout:5/732: sync 2023-12-16T20:11:44.820 INFO:tasks.workunit.client.1.smithi141.stdout:3/911: dwrite d0/d1c/d40/f81 [0,4194304] 0 2023-12-16T20:11:44.822 INFO:tasks.workunit.client.1.smithi141.stdout:9/731: sync 2023-12-16T20:11:44.822 INFO:tasks.workunit.client.1.smithi141.stdout:7/778: unlink d5/d16/de3/d1e/d71/fe2 0 2023-12-16T20:11:44.824 INFO:tasks.workunit.client.1.smithi141.stdout:5/733: mknod d0/d9/d16/d2a/d35/d5e/cf7 0 2023-12-16T20:11:44.824 INFO:tasks.workunit.client.1.smithi141.stdout:5/734: creat d0/d14/d2c/d90/ff8 x:0 0 0 2023-12-16T20:11:44.826 INFO:tasks.workunit.client.1.smithi141.stdout:7/779: creat d5/d16/de3/d1e/d71/ddf/ffd x:0 0 0 2023-12-16T20:11:44.827 INFO:tasks.workunit.client.1.smithi141.stdout:5/735: write d0/d25/d30/d8a/fb1 [326550,89903] 0 2023-12-16T20:11:44.827 INFO:tasks.workunit.client.1.smithi141.stdout:9/732: write d1/d10/d14/d20/da/d3f/dea/fef [383388,72063] 0 2023-12-16T20:11:44.829 INFO:tasks.workunit.client.1.smithi141.stdout:7/780: mknod d5/d16/de3/d89/cfe 0 2023-12-16T20:11:44.829 INFO:tasks.workunit.client.1.smithi141.stdout:7/781: dread - d5/d16/de3/d89/f9d zero size 2023-12-16T20:11:44.831 INFO:tasks.workunit.client.1.smithi141.stdout:7/782: creat d5/d16/d30/d4e/d87/fff x:0 0 0 2023-12-16T20:11:44.833 INFO:tasks.workunit.client.1.smithi141.stdout:9/733: dread d1/d10/d14/d20/db3/f62 [0,4194304] 0 2023-12-16T20:11:44.835 INFO:tasks.workunit.client.1.smithi141.stdout:9/734: dread - d1/fd2 zero size 2023-12-16T20:11:44.835 INFO:tasks.workunit.client.1.smithi141.stdout:7/783: creat d5/d2a/d45/dae/f100 x:0 0 0 2023-12-16T20:11:44.835 INFO:tasks.workunit.client.1.smithi141.stdout:7/784: read d5/d16/f75 [3043288,38523] 0 2023-12-16T20:11:44.837 INFO:tasks.workunit.client.1.smithi141.stdout:7/785: rename d5/d16/d30/d4e/fc2 to d5/d16/d30/d36/d8c/dfa/f101 0 2023-12-16T20:11:44.837 INFO:tasks.workunit.client.1.smithi141.stdout:7/786: fsync d5/d16/d1a/d40/f7b 0 2023-12-16T20:11:44.838 INFO:tasks.workunit.client.1.smithi141.stdout:7/787: mkdir d5/d16/d46/d102 0 2023-12-16T20:11:44.841 INFO:tasks.workunit.client.1.smithi141.stdout:7/788: dread d5/d16/d30/d4e/f72 [0,4194304] 0 2023-12-16T20:11:44.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/789: write d5/d16/d30/d4e/fec [7495547,7521] 0 2023-12-16T20:11:44.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/790: truncate d5/d16/de3/d1e/d71/d96/fdb 590290 0 2023-12-16T20:11:44.842 INFO:tasks.workunit.client.1.smithi141.stdout:5/736: write d0/f50 [3373800,82943] 0 2023-12-16T20:11:44.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/791: rmdir d5/d16/d1a/d40/dab/dd5 39 2023-12-16T20:11:44.842 INFO:tasks.workunit.client.1.smithi141.stdout:7/792: fsync d5/d16/f75 0 2023-12-16T20:11:44.845 INFO:tasks.workunit.client.1.smithi141.stdout:5/737: truncate d0/d9/d16/f21 564498 0 2023-12-16T20:11:44.845 INFO:tasks.workunit.client.1.smithi141.stdout:5/738: mknod d0/d9/d16/d2a/cf9 0 2023-12-16T20:11:44.845 INFO:tasks.workunit.client.1.smithi141.stdout:5/739: dread d0/d9/f8e [0,4194304] 0 2023-12-16T20:11:44.849 INFO:tasks.workunit.client.1.smithi141.stdout:9/735: write d1/d10/d27/d36/f3a [626119,24284] 0 2023-12-16T20:11:44.853 INFO:tasks.workunit.client.1.smithi141.stdout:7/793: dread d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:44.853 INFO:tasks.workunit.client.1.smithi141.stdout:7/794: getdents d5/d16/de3/d89/d9b 0 2023-12-16T20:11:44.854 INFO:tasks.workunit.client.1.smithi141.stdout:8/966: dwrite d14/d19/d1b/d3d/d5e/d12b/db4/d58/fc9 [0,4194304] 0 2023-12-16T20:11:44.854 INFO:tasks.workunit.client.1.smithi141.stdout:7/795: creat d5/d16/d1a/d40/dab/f103 x:0 0 0 2023-12-16T20:11:44.856 INFO:tasks.workunit.client.1.smithi141.stdout:1/890: dwrite da/d1a/d31/d81/fa9 [0,4194304] 0 2023-12-16T20:11:44.856 INFO:tasks.workunit.client.1.smithi141.stdout:1/891: chown da/d1a/dd1/d10b/f12a 23311 1 2023-12-16T20:11:44.856 INFO:tasks.workunit.client.1.smithi141.stdout:3/912: dwrite d0/d1c/fa1 [0,4194304] 0 2023-12-16T20:11:44.856 INFO:tasks.workunit.client.1.smithi141.stdout:3/913: dread - d0/d1c/d6a/d76/de3/ff3 zero size 2023-12-16T20:11:44.856 INFO:tasks.workunit.client.1.smithi141.stdout:3/914: fsync d0/d1c/d40/d3f/f80 0 2023-12-16T20:11:44.857 INFO:tasks.workunit.client.1.smithi141.stdout:9/736: dread d1/d10/d14/d20/d84/fb2 [0,4194304] 0 2023-12-16T20:11:44.857 INFO:tasks.workunit.client.1.smithi141.stdout:9/737: chown d1/d10/d14/d20/db3/f62 445 1 2023-12-16T20:11:44.857 INFO:tasks.workunit.client.1.smithi141.stdout:9/738: creat d1/d10/d14/d20/d84/ffa x:0 0 0 2023-12-16T20:11:44.859 INFO:tasks.workunit.client.1.smithi141.stdout:3/915: dread d0/f68 [0,4194304] 0 2023-12-16T20:11:44.859 INFO:tasks.workunit.client.1.smithi141.stdout:8/967: creat d14/d19/d1b/d3d/d5e/d12b/db4/d5b/f134 x:0 0 0 2023-12-16T20:11:44.859 INFO:tasks.workunit.client.1.smithi141.stdout:7/796: mkdir d5/d16/de3/d89/d9b/dd4/d104 0 2023-12-16T20:11:44.859 INFO:tasks.workunit.client.1.smithi141.stdout:7/797: fdatasync d5/d16/d30/d36/f39 0 2023-12-16T20:11:44.870 INFO:tasks.workunit.client.1.smithi141.stdout:3/916: dread d0/f6 [0,4194304] 0 2023-12-16T20:11:44.873 INFO:tasks.workunit.client.1.smithi141.stdout:9/739: rename d1/d10/d27/d36/cf5 to d1/d10/d14/d20/da/cfb 0 2023-12-16T20:11:44.882 INFO:tasks.workunit.client.1.smithi141.stdout:1/892: dwrite da/d1a/d1d/d33/f119 [0,4194304] 0 2023-12-16T20:11:44.882 INFO:tasks.workunit.client.1.smithi141.stdout:1/893: creat da/d36/d4b/d4d/d89/d6c/f12d x:0 0 0 2023-12-16T20:11:44.882 INFO:tasks.workunit.client.1.smithi141.stdout:3/917: rename d0/d1c/d40/d12b/d5d/d11b/d132 to d0/d1c/d6a/d76/de3/d134 0 2023-12-16T20:11:44.888 INFO:tasks.workunit.client.1.smithi141.stdout:5/740: truncate d0/d25/d30/d8a/fb1 156279 0 2023-12-16T20:11:44.888 INFO:tasks.workunit.client.1.smithi141.stdout:1/894: mknod da/d36/d4b/d4d/c12e 0 2023-12-16T20:11:44.888 INFO:tasks.workunit.client.1.smithi141.stdout:1/895: creat da/d1a/db0/f12f x:0 0 0 2023-12-16T20:11:44.889 INFO:tasks.workunit.client.1.smithi141.stdout:3/918: mknod d0/d1c/d40/d12b/d63/df6/c135 0 2023-12-16T20:11:44.892 INFO:tasks.workunit.client.1.smithi141.stdout:5/741: truncate d0/d9/d16/d2a/d4f/fc2 357672 0 2023-12-16T20:11:44.892 INFO:tasks.workunit.client.1.smithi141.stdout:5/742: chown d0/d14/d75/ce5 59682 1 2023-12-16T20:11:44.892 INFO:tasks.workunit.client.1.smithi141.stdout:5/743: creat d0/d9/d16/d72/dd7/ffa x:0 0 0 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/896: rmdir da/d36/d4b/d4d/d89 39 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/897: chown da/d1a/d1d/l8a 7581484 1 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/898: write da/d1a/d31/f7e [1906859,87093] 0 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/899: write da/d76/f126 [805999,97083] 0 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/900: truncate da/d36/d4b/d4d/d89/d61/f114 223758 0 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/901: chown da/d1a/d31/d81/db6 6 1 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:1/902: dread - da/d1a/d1d/d22/f105 zero size 2023-12-16T20:11:44.894 INFO:tasks.workunit.client.1.smithi141.stdout:3/919: mknod d0/d1c/d2c/d72/c136 0 2023-12-16T20:11:44.895 INFO:tasks.workunit.client.1.smithi141.stdout:3/920: getdents d0/d1c/d2c/d72/d74/dda/d11c 0 2023-12-16T20:11:44.896 INFO:tasks.workunit.client.1.smithi141.stdout:5/744: mkdir d0/d25/dce/dfb 0 2023-12-16T20:11:44.899 INFO:tasks.workunit.client.1.smithi141.stdout:1/903: unlink da/d36/d4b/d4d/d80/cdd 0 2023-12-16T20:11:44.899 INFO:tasks.workunit.client.1.smithi141.stdout:9/740: dwrite d1/d10/d33/d47/d8d/dc4/fcb [0,4194304] 0 2023-12-16T20:11:44.900 INFO:tasks.workunit.client.1.smithi141.stdout:7/798: dwrite d5/d16/de3/d1e/d71/fcd [0,4194304] 0 2023-12-16T20:11:44.900 INFO:tasks.workunit.client.1.smithi141.stdout:8/968: dwrite d14/d19/d1b/d3d/f3e [4194304,4194304] 0 2023-12-16T20:11:44.901 INFO:tasks.workunit.client.1.smithi141.stdout:3/921: mknod d0/d1c/d40/d12b/d63/df6/c137 0 2023-12-16T20:11:44.901 INFO:tasks.workunit.client.1.smithi141.stdout:3/922: write d0/d1c/d40/f92 [1386668,13651] 0 2023-12-16T20:11:44.901 INFO:tasks.workunit.client.1.smithi141.stdout:3/923: write d0/d1c/d40/d12b/d5d/fd6 [302937,2297] 0 2023-12-16T20:11:44.902 INFO:tasks.workunit.client.1.smithi141.stdout:1/904: rmdir da/d1a/d1d/d33/dcd/df8 39 2023-12-16T20:11:44.902 INFO:tasks.workunit.client.1.smithi141.stdout:1/905: creat da/d36/d4b/d4d/d80/d94/d9d/f130 x:0 0 0 2023-12-16T20:11:44.908 INFO:tasks.workunit.client.1.smithi141.stdout:8/969: truncate d14/d19/d95/fe7 592746 0 2023-12-16T20:11:44.909 INFO:tasks.workunit.client.1.smithi141.stdout:3/924: creat d0/d1c/d40/d3f/f138 x:0 0 0 2023-12-16T20:11:44.909 INFO:tasks.workunit.client.1.smithi141.stdout:3/925: write d0/d1c/d40/d85/d4c/f55 [1971767,102584] 0 2023-12-16T20:11:44.911 INFO:tasks.workunit.client.1.smithi141.stdout:9/741: write d1/d10/f12 [2675068,84169] 0 2023-12-16T20:11:44.911 INFO:tasks.workunit.client.1.smithi141.stdout:9/742: readlink d1/d26/d4a/lae 0 2023-12-16T20:11:44.913 INFO:tasks.workunit.client.1.smithi141.stdout:8/970: unlink ca 0 2023-12-16T20:11:44.913 INFO:tasks.workunit.client.1.smithi141.stdout:8/971: creat d14/d19/d95/f135 x:0 0 0 2023-12-16T20:11:44.914 INFO:tasks.workunit.client.1.smithi141.stdout:3/926: link d0/d1c/d2c/d10d/fed d0/d1c/f139 0 2023-12-16T20:11:44.915 INFO:tasks.workunit.client.1.smithi141.stdout:9/743: rmdir d1/d26/d3c 39 2023-12-16T20:11:44.919 INFO:tasks.workunit.client.1.smithi141.stdout:3/927: creat d0/d1c/d40/d12b/f13a x:0 0 0 2023-12-16T20:11:44.920 INFO:tasks.workunit.client.1.smithi141.stdout:8/972: mknod d14/c136 0 2023-12-16T20:11:44.921 INFO:tasks.workunit.client.1.smithi141.stdout:8/973: rename d14/d19/d1b/d3d/d5e/d12b/db4/d58/d8b/fc7 to d14/d19/d1b/d24/da3/f137 0 2023-12-16T20:11:44.921 INFO:tasks.workunit.client.1.smithi141.stdout:8/974: truncate d14/d19/d1b/d3d/d5e/f120 432333 0 2023-12-16T20:11:44.922 INFO:tasks.workunit.client.1.smithi141.stdout:8/975: mkdir d14/d19/d1b/d24/d4b/d8c/d138 0 2023-12-16T20:11:44.923 INFO:tasks.workunit.client.1.smithi141.stdout:1/906: dwrite da/d36/f5c [0,4194304] 0 2023-12-16T20:11:44.923 INFO:tasks.workunit.client.1.smithi141.stdout:8/976: getdents d14/d19/d95/dab/dfd 0 2023-12-16T20:11:44.927 INFO:tasks.workunit.client.1.smithi141.stdout:8/977: dread d14/f23 [0,4194304] 0 2023-12-16T20:11:44.928 INFO:tasks.workunit.client.1.smithi141.stdout:9/744: dread d1/d10/d14/d20/da/f32 [0,4194304] 0 2023-12-16T20:11:44.929 INFO:tasks.workunit.client.1.smithi141.stdout:8/978: creat d14/d19/d1b/f139 x:0 0 0 2023-12-16T20:11:44.931 INFO:tasks.workunit.client.1.smithi141.stdout:9/745: creat d1/d10/d14/d20/da/d3f/d66/ffc x:0 0 0 2023-12-16T20:11:44.935 INFO:tasks.workunit.client.1.smithi141.stdout:8/979: creat d14/d19/d1b/d3d/d122/f13a x:0 0 0 2023-12-16T20:11:44.935 INFO:tasks.workunit.client.1.smithi141.stdout:3/928: dwrite d0/d1c/d2c/d10d/df9/df8/f10c [0,4194304] 0 2023-12-16T20:11:44.935 INFO:tasks.workunit.client.1.smithi141.stdout:3/929: read d0/d1c/d40/d85/d4c/f8a [1916637,64953] 0 2023-12-16T20:11:44.936 INFO:tasks.workunit.client.1.smithi141.stdout:9/746: creat d1/d10/d14/d20/ffd x:0 0 0 2023-12-16T20:11:44.938 INFO:tasks.workunit.client.1.smithi141.stdout:8/980: write d14/d19/d1b/f3a [914795,45347] 0 2023-12-16T20:11:44.947 INFO:tasks.workunit.client.1.smithi141.stdout:9/747: symlink d1/d10/d33/d47/d8d/ddf/de6/lfe 0 2023-12-16T20:11:44.947 INFO:tasks.workunit.client.1.smithi141.stdout:9/748: readlink d1/d10/d27/d36/l3e 0 2023-12-16T20:11:44.947 INFO:tasks.workunit.client.1.smithi141.stdout:8/981: symlink d14/d19/d1b/d3d/d5e/d12b/db4/d5b/dea/l13b 0 2023-12-16T20:11:44.951 INFO:tasks.workunit.client.1.smithi141.stdout:8/982: fsync d14/d19/d1b/d3d/d5e/d12b/db4/d69/dd4/ff4 0 2023-12-16T20:11:44.952 INFO:tasks.workunit.client.1.smithi141.stdout:3/930: dwrite d0/d1c/d2c/d10d/df9/df8/f10c [0,4194304] 0 2023-12-16T20:11:44.953 INFO:tasks.workunit.client.1.smithi141.stdout:3/931: chown d0/d1c/d2c/dc0/f133 3913839 1 2023-12-16T20:11:44.954 INFO:tasks.workunit.client.1.smithi141.stdout:8/983: truncate d14/f23 627618 0 2023-12-16T20:11:44.955 INFO:tasks.workunit.client.1.smithi141.stdout:3/932: symlink d0/d1c/d40/l13b 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/845: sync 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:2/714: sync 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/846: creat d1a/d59/d89/d8a/f138 x:0 0 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/847: chown d1a 168 1 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/848: creat d1a/d4e/d63/dd1/f139 x:0 0 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/849: stat d1a/d54/ccb 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:4/850: write d1a/f100 [560667,47146] 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:3/933: creat d0/d1c/d2c/d10d/df9/df8/de9/f13c x:0 0 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:3/934: fdatasync d0/d1c/d2c/d10d/df9/fe1 0 2023-12-16T20:11:44.957 INFO:tasks.workunit.client.1.smithi141.stdout:3/935: chown d0/d1c/d6a/d76/c7e 496 1 2023-12-16T20:11:44.959 INFO:tasks.workunit.client.1.smithi141.stdout:2/715: symlink d6/da/d4a/lec 0 2023-12-16T20:11:44.962 INFO:tasks.workunit.client.1.smithi141.stdout:3/936: rmdir d0/d1c/d40/d12b/d63 39 2023-12-16T20:11:44.962 INFO:tasks.workunit.client.1.smithi141.stdout:4/851: getdents d1a/d2a/d3b/dcd 0 2023-12-16T20:11:44.964 INFO:tasks.workunit.client.1.smithi141.stdout:4/852: symlink d1a/d4e/d63/daa/l13a 0 2023-12-16T20:11:44.964 INFO:tasks.workunit.client.1.smithi141.stdout:4/853: dread - d1a/d54/d87/da8/f7d zero size 2023-12-16T20:11:44.964 INFO:tasks.workunit.client.1.smithi141.stdout:4/854: creat d1a/d2a/d3b/f13b x:0 0 0 2023-12-16T20:11:44.967 INFO:tasks.workunit.client.1.smithi141.stdout:8/984: write d14/d19/d1b/d3d/f96 [7452643,105199] 0 2023-12-16T20:11:44.967 INFO:tasks.workunit.client.1.smithi141.stdout:9/749: dwrite d1/d10/f6c [0,4194304] 0 2023-12-16T20:11:44.971 INFO:tasks.workunit.client.1.smithi141.stdout:4/855: dread d1a/d2a/f78 [0,4194304] 0 2023-12-16T20:11:44.971 INFO:tasks.workunit.client.1.smithi141.stdout:4/856: write d1a/d2a/d3b/d69/fa3 [4068877,65626] 0 2023-12-16T20:11:44.971 INFO:tasks.workunit.client.1.smithi141.stdout:4/857: creat d1a/d2a/d3b/d69/df0/d126/f13c x:0 0 0 2023-12-16T20:11:44.971 INFO:tasks.workunit.client.1.smithi141.stdout:2/716: write d6/da/d1b/f5d [2581612,63077] 0 2023-12-16T20:11:44.971 INFO:tasks.workunit.client.1.smithi141.stdout:2/717: write d6/d32/d7a/d5f/d92/fc5 [979408,101126] 0 2023-12-16T20:11:44.975 INFO:tasks.workunit.client.1.smithi141.stdout:4/858: mkdir d1a/d3c/d9b/da1/da6/d13d 0 2023-12-16T20:11:44.977 INFO:tasks.workunit.client.1.smithi141.stdout:3/937: read d0/d1c/d6a/d76/da2/fbe [1605431,38002] 0 2023-12-16T20:11:44.977 INFO:tasks.workunit.client.1.smithi141.stdout:2/718: creat d6/dd1/fed x:0 0 0 2023-12-16T20:11:44.980 INFO:tasks.workunit.client.1.smithi141.stdout:4/859: mknod d1a/d54/d87/dbf/df3/c13e 0 2023-12-16T20:11:44.981 INFO:tasks.workunit.client.1.smithi141.stdout:9/750: write d1/d10/d27/d36/f50 [1114878,58583] 0 2023-12-16T20:11:44.981 INFO:tasks.workunit.client.1.smithi141.stdout:9/751: write d1/d26/d4a/f88 [314012,111186] 0 2023-12-16T20:11:44.982 INFO:tasks.workunit.client.1.smithi141.stdout:3/938: mkdir d0/d1c/d40/d12b/d5d/d95/ddc/d13d 0 2023-12-16T20:11:44.984 INFO:tasks.workunit.client.1.smithi141.stdout:2/719: mknod d6/d3a/d9d/cee 0 2023-12-16T20:11:44.986 INFO:tasks.workunit.client.1.smithi141.stdout:4/860: mknod d1a/d4e/d63/daa/db9/c13f 0 2023-12-16T20:11:44.987 INFO:tasks.workunit.client.1.smithi141.stdout:2/720: dread d6/d3a/d47/d58/d66/fe2 [0,4194304] 0 2023-12-16T20:11:44.988 INFO:tasks.workunit.client.1.smithi141.stdout:4/861: mkdir d1a/d2a/dc3/d140 0 2023-12-16T20:11:44.989 INFO:tasks.workunit.client.1.smithi141.stdout:2/721: mknod d6/da/d1b/d5b/d6a/cef 0 2023-12-16T20:11:44.989 INFO:tasks.workunit.client.1.smithi141.stdout:2/722: readlink d6/da/d33/d54/d7c/lb0 0 2023-12-16T20:11:44.989 INFO:tasks.workunit.client.1.smithi141.stdout:2/723: fsync d6/d32/f64 0 2023-12-16T20:11:44.991 INFO:tasks.workunit.client.1.smithi141.stdout:4/862: creat d1a/d2a/d3b/dcd/f141 x:0 0 0 2023-12-16T20:11:44.991 INFO:tasks.workunit.client.1.smithi141.stdout:9/752: dread d1/d10/d33/d47/d8d/ddf/fbe [0,4194304] 0 2023-12-16T20:11:44.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/753: truncate d1/d10/d33/d47/d83/ddd/ff0 477882 0 2023-12-16T20:11:44.992 INFO:tasks.workunit.client.1.smithi141.stdout:9/754: chown d1/d10/d14/d20/da/d3f/l45 702877671 1 2023-12-16T20:11:44.993 INFO:tasks.workunit.client.1.smithi141.stdout:9/755: mkdir d1/d10/d14/d20/da/dff 0 2023-12-16T20:11:44.994 INFO:tasks.workunit.client.1.smithi141.stdout:3/939: dread d0/d1c/d2c/d10d/df9/df8/f10c [0,4194304] 0 2023-12-16T20:11:45.001 INFO:tasks.workunit.client.1.smithi141.stdout:8/985: dwrite d14/d19/d1b/d3d/d5e/dbe/dc3/f115 [0,4194304] 0 2023-12-16T20:11:45.001 INFO:tasks.workunit.client.1.smithi141.stdout:2/724: dread d6/d32/d7a/d5f/d92/f9f [0,4194304] 0 2023-12-16T20:11:45.002 INFO:tasks.workunit.client.1.smithi141.stdout:2/725: chown d6/d12/d1f/lb9 253 1 2023-12-16T20:11:45.002 INFO:tasks.workunit.client.1.smithi141.stdout:2/726: read d6/da/d1b/d5b/faa [2762968,28503] 0 2023-12-16T20:11:45.002 INFO:tasks.workunit.client.1.smithi141.stdout:4/863: write d1a/d3c/d9b/da1/da6/fd8 [7758314,8445] 0 2023-12-16T20:11:45.002 INFO:tasks.workunit.client.1.smithi141.stdout:4/864: read - d1a/d54/ff8 zero size 2023-12-16T20:11:45.006 INFO:tasks.workunit.client.1.smithi141.stdout:4/865: symlink d1a/d59/l142 0 2023-12-16T20:11:45.006 INFO:tasks.workunit.client.1.smithi141.stdout:4/866: dread - d1a/d59/f112 zero size 2023-12-16T20:11:45.006 INFO:tasks.workunit.client.1.smithi141.stdout:4/867: dread - d1a/d59/f9e zero size 2023-12-16T20:11:45.007 INFO:tasks.workunit.client.1.smithi141.stdout:8/986: link d14/d19/d1b/d24/fb7 d14/d19/d1b/d3d/d5e/d12b/db4/d5b/dea/deb/d109/f13c 0 2023-12-16T20:11:45.010 INFO:tasks.workunit.client.1.smithi141.stdout:8/987: mknod d14/d19/d1b/d3d/d5e/d12b/db4/d69/c13d 0 2023-12-16T20:11:45.011 INFO:tasks.workunit.client.1.smithi141.stdout:4/868: rmdir d1a/d2a/d3b/db2 39 2023-12-16T20:11:45.015 INFO:tasks.workunit.client.1.smithi141.stdout:4/869: symlink d1a/d2a/dc3/d140/l143 0 2023-12-16T20:11:45.015 INFO:tasks.workunit.client.1.smithi141.stdout:4/870: readlink d1a/d3c/d9b/da1/l104 0 2023-12-16T20:11:45.036 INFO:tasks.workunit.client.1.smithi141.stdout:4/871: dwrite d1a/d3c/d9b/da1/fb0 [4194304,4194304] 0 2023-12-16T20:11:45.036 INFO:tasks.workunit.client.1.smithi141.stdout:4/872: fdatasync d1a/d4e/f56 0 2023-12-16T20:11:45.038 INFO:tasks.workunit.client.1.smithi141.stdout:4/873: rename d1a/d2a/d3b/dcd/l12d to d1a/d2a/d3b/db2/l144 0 2023-12-16T20:11:45.038 INFO:tasks.workunit.client.1.smithi141.stdout:4/874: readlink d1a/d4e/d63/l93 0 2023-12-16T20:11:45.038 INFO:tasks.workunit.client.1.smithi141.stdout:4/875: write d1a/d2a/d3b/dcd/fee [464215,44889] 0 2023-12-16T20:11:45.039 INFO:tasks.workunit.client.1.smithi141.stdout:4/876: unlink d1a/d2a/d3b/dcd/cf9 0 2023-12-16T20:11:45.040 INFO:tasks.workunit.client.1.smithi141.stdout:9/756: dwrite d1/d26/d4a/d73/ff6 [0,4194304] 0 2023-12-16T20:11:45.040 INFO:tasks.workunit.client.1.smithi141.stdout:2/727: dwrite d6/d12/d15/faf [0,4194304] 0 2023-12-16T20:11:45.040 INFO:tasks.workunit.client.1.smithi141.stdout:4/877: creat d1a/d3c/d9b/da1/dcf/f145 x:0 0 0 2023-12-16T20:11:45.042 INFO:tasks.workunit.client.1.smithi141.stdout:3/940: dwrite d0/f101 [0,4194304] 0 2023-12-16T20:11:45.043 INFO:tasks.workunit.client.1.smithi141.stdout:3/941: chown d0/d1c/d40/d3c/c66 195 1 2023-12-16T20:11:45.045 INFO:tasks.workunit.client.1.smithi141.stdout:4/878: rename d1a/d3c/l43 to d1a/d59/l146 0 2023-12-16T20:11:45.057 INFO:tasks.workunit.client.1.smithi141.stdout:3/942: dread d0/d1c/d40/d3f/f73 [0,4194304] 0 2023-12-16T20:11:45.059 INFO:tasks.workunit.client.1.smithi141.stdout:3/943: link d0/f9c d0/d1c/d6a/d76/da2/dd9/f13e 0 2023-12-16T20:11:45.061 INFO:tasks.workunit.client.1.smithi141.stdout:3/944: creat d0/d1c/da9/f13f x:0 0 0 2023-12-16T20:11:45.063 INFO:tasks.workunit.client.1.smithi141.stdout:4/879: dwrite d1a/d59/f112 [0,4194304] 0 2023-12-16T20:11:45.063 INFO:tasks.workunit.client.1.smithi141.stdout:4/880: fdatasync d1a/d2a/dc3/fea 0 2023-12-16T20:11:45.063 INFO:tasks.workunit.client.1.smithi141.stdout:4/881: read - d1a/d2a/d3b/dcd/f141 zero size 2023-12-16T20:11:45.063 INFO:tasks.workunit.client.1.smithi141.stdout:4/882: stat d1a/d3c/d9b/da1/dcf/df1 0 2023-12-16T20:11:45.067 INFO:tasks.workunit.client.1.smithi141.stdout:4/883: creat d1a/d2a/d3b/d69/f147 x:0 0 0 2023-12-16T20:11:45.067 INFO:tasks.workunit.client.1.smithi141.stdout:4/884: chown d1a/d2a/d3b 122 1 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/757: dwrite d1/d10/d27/f79 [0,4194304] 0 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/758: chown d1/d10/d14/d20/da/d3f 3 1 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/759: truncate d1/d10/d14/d20/d3b/ff9 983739 0 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/760: write d1/d10/d14/d20/db3/f62 [1759821,111933] 0 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:9/761: chown d1/d10/d33/d47/d83/fa5 83 1 2023-12-16T20:11:45.069 INFO:tasks.workunit.client.1.smithi141.stdout:4/885: symlink d1a/d54/d87/dbf/df3/l148 0 2023-12-16T20:11:45.071 INFO:tasks.workunit.client.1.smithi141.stdout:4/886: dread d1a/d3c/d9b/fb6 [0,4194304] 0 2023-12-16T20:11:45.073 INFO:tasks.workunit.client.1.smithi141.stdout:9/762: unlink d1/d10/fb6 0 2023-12-16T20:11:45.073 INFO:tasks.workunit.client.1.smithi141.stdout:9/763: chown d1/d10/d33/d47/d8d 3533584 1 2023-12-16T20:11:45.073 INFO:tasks.workunit.client.1.smithi141.stdout:4/887: symlink d1a/d59/l149 0 2023-12-16T20:11:45.075 INFO:tasks.workunit.client.1.smithi141.stdout:4/888: creat d1a/d3c/d9b/d12c/f14a x:0 0 0 2023-12-16T20:11:45.075 INFO:tasks.workunit.client.1.smithi141.stdout:4/889: write d1a/d4e/d63/dd1/fdc [722955,97081] 0 2023-12-16T20:11:45.075 INFO:tasks.workunit.client.1.smithi141.stdout:4/890: chown d1a/d3c/d9b/da1/dcf 126884 1 2023-12-16T20:11:45.082 INFO:tasks.workunit.client.1.smithi141.stdout:3/945: getdents d0/d1c/da9 0 2023-12-16T20:11:45.082 INFO:tasks.workunit.client.1.smithi141.stdout:9/764: write d1/d26/f4d [3442663,88100] 0 2023-12-16T20:11:45.084 INFO:tasks.workunit.client.1.smithi141.stdout:3/946: symlink d0/d1c/d40/d3c/dce/l140 0 2023-12-16T20:11:45.084 INFO:tasks.workunit.client.1.smithi141.stdout:3/947: write d0/d1c/d2c/dc0/f133 [802207,53238] 0 2023-12-16T20:11:45.084 INFO:tasks.workunit.client.1.smithi141.stdout:3/948: fdatasync d0/d1c/d40/f1e 0 2023-12-16T20:11:45.086 INFO:tasks.workunit.client.1.smithi141.stdout:9/765: creat d1/d26/d4a/f100 x:0 0 0 2023-12-16T20:11:45.086 INFO:tasks.workunit.client.1.smithi141.stdout:9/766: chown d1/d26/fad 66 1 2023-12-16T20:11:45.087 INFO:tasks.workunit.client.1.smithi141.stdout:3/949: getdents d0/d1c/de8/def 0 2023-12-16T20:11:45.108 INFO:tasks.workunit.client.1.smithi141.stdout:9/767: dwrite d1/d10/d14/d20/d3b/f46 [0,4194304] 0 2023-12-16T20:11:45.108 INFO:tasks.workunit.client.1.smithi141.stdout:3/950: dwrite d0/d1c/d2c/d10d/df9/df8/de9/f13c [0,4194304] 0 2023-12-16T20:11:45.113 INFO:tasks.workunit.client.1.smithi141.stdout:6/907: sync 2023-12-16T20:11:45.113 INFO:tasks.workunit.client.1.smithi141.stdout:0/722: sync 2023-12-16T20:11:45.113 INFO:tasks.workunit.client.1.smithi141.stdout:0/723: chown d4/d49/d73/l77 16 1 2023-12-16T20:11:45.113 INFO:tasks.workunit.client.1.smithi141.stdout:0/724: fdatasync d4/d49/d8f/fac 0 2023-12-16T20:11:45.115 INFO:tasks.workunit.client.1.smithi141.stdout:9/768: rmdir d1/d10/d33 39 2023-12-16T20:11:45.117 INFO:tasks.workunit.client.1.smithi141.stdout:3/951: dread d0/d1c/d40/f99 [0,4194304] 0 2023-12-16T20:11:45.117 INFO:tasks.workunit.client.1.smithi141.stdout:0/725: mkdir d4/d49/d73/df4 0 2023-12-16T20:11:45.118 INFO:tasks.workunit.client.1.smithi141.stdout:9/769: truncate d1/d10/d14/d20/db3/f40 3917024 0 2023-12-16T20:11:45.118 INFO:tasks.workunit.client.1.smithi141.stdout:9/770: chown d1/d10/d14/d20/da/d3f/d66/c6e 1604282 1 2023-12-16T20:11:45.120 INFO:tasks.workunit.client.1.smithi141.stdout:3/952: link d0/d1c/d2c/ffa d0/d1c/f141 0 2023-12-16T20:11:45.120 INFO:tasks.workunit.client.1.smithi141.stdout:3/953: fsync d0/d1c/d40/d3c/dce/ff2 0 2023-12-16T20:11:45.121 INFO:tasks.workunit.client.1.smithi141.stdout:0/726: mknod d4/d49/d73/d8a/da4/cf5 0 2023-12-16T20:11:45.122 INFO:tasks.workunit.client.1.smithi141.stdout:3/954: mknod d0/d1c/de8/def/c142 0 2023-12-16T20:11:45.127 INFO:tasks.workunit.client.1.smithi141.stdout:0/727: symlink d4/d49/d73/df4/lf6 0 2023-12-16T20:11:45.128 INFO:tasks.workunit.client.1.smithi141.stdout:0/728: rmdir d4/d49/d73/d8a/da4/dcc 39 2023-12-16T20:11:45.131 INFO:tasks.workunit.client.1.smithi141.stdout:0/729: rename d4/d49/d73/d3b/d78/l6e to d4/d49/db9/dcd/lf7 0 2023-12-16T20:11:45.142 INFO:tasks.workunit.client.1.smithi141.stdout:3/955: dwrite d0/d1c/da9/fd1 [0,4194304] 0 2023-12-16T20:11:45.143 INFO:tasks.workunit.client.1.smithi141.stdout:6/908: dwrite d1/d77/fb9 [0,4194304] 0 2023-12-16T20:11:45.145 INFO:tasks.workunit.client.1.smithi141.stdout:3/956: symlink d0/d1c/d2c/l143 0 2023-12-16T20:11:45.146 INFO:tasks.workunit.client.1.smithi141.stdout:6/909: mkdir d1/d12/d126 0 2023-12-16T20:11:45.147 INFO:tasks.workunit.client.1.smithi141.stdout:3/957: mkdir d0/d1c/d40/d12b/d5d/d109/d144 0 2023-12-16T20:11:45.147 INFO:tasks.workunit.client.1.smithi141.stdout:3/958: write d0/d1c/d40/d85/d4c/f4f [1262198,70893] 0 2023-12-16T20:11:45.147 INFO:tasks.workunit.client.1.smithi141.stdout:3/959: creat d0/d1c/d2c/d72/d74/dda/f145 x:0 0 0 2023-12-16T20:11:45.154 INFO:tasks.workunit.client.1.smithi141.stdout:3/960: mkdir d0/d146 0 2023-12-16T20:11:45.155 INFO:tasks.workunit.client.1.smithi141.stdout:3/961: read - d0/f11f zero size 2023-12-16T20:11:45.155 INFO:tasks.workunit.client.1.smithi141.stdout:3/962: fdatasync d0/d1c/d40/d3f/f73 0 2023-12-16T20:11:45.155 INFO:tasks.workunit.client.1.smithi141.stdout:0/730: write d4/d49/d73/f96 [407572,115724] 0 2023-12-16T20:11:45.155 INFO:tasks.workunit.client.1.smithi141.stdout:3/963: creat d0/d1c/da9/f147 x:0 0 0 2023-12-16T20:11:45.156 INFO:tasks.workunit.client.1.smithi141.stdout:3/964: write d0/d1c/f141 [811225,102175] 0 2023-12-16T20:11:45.156 INFO:tasks.workunit.client.1.smithi141.stdout:3/965: chown d0/d1c/d40/d85/cb2 7741 1 2023-12-16T20:11:45.157 INFO:tasks.workunit.client.1.smithi141.stdout:3/966: write d0/d1c/d2c/d72/d74/f97 [258741,3821] 0 2023-12-16T20:11:45.157 INFO:tasks.workunit.client.1.smithi141.stdout:6/910: write d1/dd/d2f/d48/f84 [2991026,29660] 0 2023-12-16T20:11:45.157 INFO:tasks.workunit.client.1.smithi141.stdout:6/911: chown d1/d12/d20/d44/lbf 1 1 2023-12-16T20:11:45.158 INFO:tasks.workunit.client.1.smithi141.stdout:3/967: truncate d0/d1c/d2c/dc0/f133 798332 0 2023-12-16T20:11:45.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/912: write d1/dbd/ff5 [1017046,95541] 0 2023-12-16T20:11:45.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/913: read d1/dbd/ff5 [515400,105197] 0 2023-12-16T20:11:45.160 INFO:tasks.workunit.client.1.smithi141.stdout:3/968: creat d0/d1c/d40/d3c/dce/f148 x:0 0 0 2023-12-16T20:11:45.161 INFO:tasks.workunit.client.1.smithi141.stdout:6/914: mkdir d1/dd/d2f/d48/d127 0 2023-12-16T20:11:45.162 INFO:tasks.workunit.client.1.smithi141.stdout:3/969: mkdir d0/d1c/d2c/d72/d74/d149 0 2023-12-16T20:11:45.164 INFO:tasks.workunit.client.1.smithi141.stdout:6/915: creat d1/dd/d2f/de6/f128 x:0 0 0 2023-12-16T20:11:45.165 INFO:tasks.workunit.client.1.smithi141.stdout:3/970: mkdir d0/d1c/d2c/d72/d74/dda/d11c/d14a 0 2023-12-16T20:11:45.168 INFO:tasks.workunit.client.1.smithi141.stdout:6/916: mkdir d1/d5e/d123/d4b/d60/def/d129 0 2023-12-16T20:11:45.174 INFO:tasks.workunit.client.1.smithi141.stdout:6/917: dread d1/d12/d22/d25/d38/fc7 [0,4194304] 0 2023-12-16T20:11:45.174 INFO:tasks.workunit.client.1.smithi141.stdout:6/918: read d1/d12/d20/d44/d4a/f79 [236258,20932] 0 2023-12-16T20:11:45.174 INFO:tasks.workunit.client.1.smithi141.stdout:6/919: write d1/d12/d20/d3a/f6d [3845513,52962] 0 2023-12-16T20:11:45.175 INFO:tasks.workunit.client.1.smithi141.stdout:6/920: write d1/d12/d20/d44/ddf/fee [3834963,91977] 0 2023-12-16T20:11:45.188 INFO:tasks.workunit.client.1.smithi141.stdout:6/921: dread d1/fc4 [0,4194304] 0 2023-12-16T20:11:45.188 INFO:tasks.workunit.client.1.smithi141.stdout:6/922: write d1/d77/d9e/fb6 [810914,55815] 0 2023-12-16T20:11:45.188 INFO:tasks.workunit.client.1.smithi141.stdout:6/923: chown d1/dd/d2f/f5f 0 1 2023-12-16T20:11:45.193 INFO:tasks.workunit.client.1.smithi141.stdout:3/971: dwrite d0/d1c/d6a/f8d [0,4194304] 0 2023-12-16T20:11:45.196 INFO:tasks.workunit.client.1.smithi141.stdout:3/972: rmdir d0/d1c/d40/d85/d4c 39 2023-12-16T20:11:45.199 INFO:tasks.workunit.client.1.smithi141.stdout:0/731: dwrite d4/d49/d73/fad [0,4194304] 0 2023-12-16T20:11:45.199 INFO:tasks.workunit.client.1.smithi141.stdout:3/973: creat d0/d1c/d40/d12b/d5d/d95/f14b x:0 0 0 2023-12-16T20:11:45.204 INFO:tasks.workunit.client.1.smithi141.stdout:0/732: mknod d4/d49/cf8 0 2023-12-16T20:11:45.205 INFO:tasks.workunit.client.1.smithi141.stdout:3/974: rmdir d0/d1c/de8 39 2023-12-16T20:11:45.205 INFO:tasks.workunit.client.1.smithi141.stdout:6/924: dwrite d1/d12/d20/d44/f6b [0,4194304] 0 2023-12-16T20:11:45.205 INFO:tasks.workunit.client.1.smithi141.stdout:6/925: dread - d1/dd/d2f/d48/f11c zero size 2023-12-16T20:11:45.205 INFO:tasks.workunit.client.1.smithi141.stdout:0/733: symlink d4/lf9 0 2023-12-16T20:11:45.207 INFO:tasks.workunit.client.1.smithi141.stdout:3/975: getdents d0/d1c/d40/d12b/d63 0 2023-12-16T20:11:45.209 INFO:tasks.workunit.client.1.smithi141.stdout:0/734: mkdir d4/d49/da1/df3/da3/dfa 0 2023-12-16T20:11:45.209 INFO:tasks.workunit.client.1.smithi141.stdout:0/735: truncate d4/f3e 4829285 0 2023-12-16T20:11:45.210 INFO:tasks.workunit.client.1.smithi141.stdout:0/736: creat d4/d7/db0/ffb x:0 0 0 2023-12-16T20:11:45.211 INFO:tasks.workunit.client.1.smithi141.stdout:1/907: sync 2023-12-16T20:11:45.211 INFO:tasks.workunit.client.1.smithi141.stdout:7/799: sync 2023-12-16T20:11:45.211 INFO:tasks.workunit.client.1.smithi141.stdout:7/800: chown d5/d16/de3/d1e/l2e 103292 1 2023-12-16T20:11:45.212 INFO:tasks.workunit.client.1.smithi141.stdout:5/745: sync 2023-12-16T20:11:45.212 INFO:tasks.workunit.client.1.smithi141.stdout:5/746: creat d0/d9/d16/d2a/d35/d4c/ffc x:0 0 0 2023-12-16T20:11:45.217 INFO:tasks.workunit.client.1.smithi141.stdout:6/926: dread d1/d12/d22/d25/d38/faf [0,4194304] 0 2023-12-16T20:11:45.217 INFO:tasks.workunit.client.1.smithi141.stdout:5/747: mknod d0/cfd 0 2023-12-16T20:11:45.217 INFO:tasks.workunit.client.1.smithi141.stdout:1/908: getdents da/d36/d4b/d4d/d89/d61 0 2023-12-16T20:11:45.219 INFO:tasks.workunit.client.1.smithi141.stdout:5/748: mknod d0/d9/d85/cfe 0 2023-12-16T20:11:45.222 INFO:tasks.workunit.client.1.smithi141.stdout:1/909: symlink da/d1a/db0/dd3/df6/l131 0 2023-12-16T20:11:45.222 INFO:tasks.workunit.client.1.smithi141.stdout:1/910: dread - da/d36/d4b/d4d/dd7/fef zero size 2023-12-16T20:11:45.223 INFO:tasks.workunit.client.1.smithi141.stdout:5/749: mkdir d0/d9/dff 0 2023-12-16T20:11:45.226 INFO:tasks.workunit.client.1.smithi141.stdout:1/911: creat da/d36/d4b/d4d/dd7/de1/d111/d11b/f132 x:0 0 0 2023-12-16T20:11:45.227 INFO:tasks.workunit.client.1.smithi141.stdout:5/750: rename d0/d25/fd3 to d0/d25/d30/d67/f100 0 2023-12-16T20:11:45.228 INFO:tasks.workunit.client.1.smithi141.stdout:1/912: mkdir da/d76/d133 0 2023-12-16T20:11:45.228 INFO:tasks.workunit.client.1.smithi141.stdout:1/913: creat da/d36/d4b/db2/f134 x:0 0 0 2023-12-16T20:11:45.229 INFO:tasks.workunit.client.1.smithi141.stdout:5/751: creat d0/d25/f101 x:0 0 0 2023-12-16T20:11:45.231 INFO:tasks.workunit.client.1.smithi141.stdout:1/914: symlink da/d1a/d31/l135 0 2023-12-16T20:11:45.241 INFO:tasks.workunit.client.1.smithi141.stdout:0/737: dwrite d4/d49/f5a [0,4194304] 0 2023-12-16T20:11:45.241 INFO:tasks.workunit.client.1.smithi141.stdout:6/927: dwrite d1/d12/f110 [0,4194304] 0 2023-12-16T20:11:45.241 INFO:tasks.workunit.client.1.smithi141.stdout:7/801: dwrite d5/d16/de3/d1e/d71/d96/fdb [0,4194304] 0 2023-12-16T20:11:45.246 INFO:tasks.workunit.client.1.smithi141.stdout:6/928: creat d1/d5e/d123/f12a x:0 0 0 2023-12-16T20:11:45.246 INFO:tasks.workunit.client.1.smithi141.stdout:6/929: write d1/dd/f1e [3611464,128022] 0 2023-12-16T20:11:45.246 INFO:tasks.workunit.client.1.smithi141.stdout:6/930: chown d1/d77/d9e/fb6 1564 1 2023-12-16T20:11:45.247 INFO:tasks.workunit.client.1.smithi141.stdout:7/802: rmdir d5/d16/de3/d89/d9b 39 2023-12-16T20:11:45.249 INFO:tasks.workunit.client.1.smithi141.stdout:3/976: dwrite d0/d1c/d2c/d72/d74/dda/ff4 [0,4194304] 0 2023-12-16T20:11:45.249 INFO:tasks.workunit.client.1.smithi141.stdout:0/738: dread d4/d5c/f72 [0,4194304] 0 2023-12-16T20:11:45.251 INFO:tasks.workunit.client.1.smithi141.stdout:5/752: rename d0/d9/d16/d2a/d35/d4c to d0/d9/d99/d102 0 2023-12-16T20:11:45.251 INFO:tasks.workunit.client.1.smithi141.stdout:5/753: write d0/d25/d30/d67/fe6 [929451,126512] 0 2023-12-16T20:11:45.252 INFO:tasks.workunit.client.1.smithi141.stdout:6/931: mknod d1/d5e/d123/d4f/c12b 0 2023-12-16T20:11:45.252 INFO:tasks.workunit.client.1.smithi141.stdout:7/803: rmdir d5/d16/d1a/d40/dcb 39 2023-12-16T20:11:45.253 INFO:tasks.workunit.client.1.smithi141.stdout:0/739: mkdir d4/d7/db0/ddb/dfc 0 2023-12-16T20:11:45.254 INFO:tasks.workunit.client.1.smithi141.stdout:3/977: mknod d0/d1c/d40/d85/c14c 0 2023-12-16T20:11:45.255 INFO:tasks.workunit.client.1.smithi141.stdout:0/740: dread d4/d49/f52 [0,4194304] 0 2023-12-16T20:11:45.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/915: rename da/d1a/d1d/d33/dcd/df8 to da/d36/d4b/d4d/d89/d136 0 2023-12-16T20:11:45.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/916: truncate da/d36/d4b/d4d/dd7/de1/d111/d11b/f132 583267 0 2023-12-16T20:11:45.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/917: chown da/d1a/d31/l135 64 1 2023-12-16T20:11:45.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/918: chown da/d36/f96 96 1 2023-12-16T20:11:45.257 INFO:tasks.workunit.client.1.smithi141.stdout:5/754: link d0/d14/d98/laa d0/d9/d99/l103 0 2023-12-16T20:11:45.258 INFO:tasks.workunit.client.1.smithi141.stdout:0/741: write d4/d49/d73/d3b/d78/fa5 [679782,40677] 0 2023-12-16T20:11:45.260 INFO:tasks.workunit.client.1.smithi141.stdout:0/742: dread d4/d49/d73/d3b/f59 [0,4194304] 0 2023-12-16T20:11:45.260 INFO:tasks.workunit.client.1.smithi141.stdout:3/978: unlink d0/d1c/d40/f1b 0 2023-12-16T20:11:45.260 INFO:tasks.workunit.client.1.smithi141.stdout:3/979: chown d0/d1c/d40/d12b/d5d/d109/c12d 59 1 2023-12-16T20:11:45.260 INFO:tasks.workunit.client.1.smithi141.stdout:3/980: chown d0/d1c/d6a/d76/da2/fc3 372660 1 2023-12-16T20:11:45.260 INFO:tasks.workunit.client.1.smithi141.stdout:3/981: creat d0/d1c/da9/f14d x:0 0 0 2023-12-16T20:11:45.261 INFO:tasks.workunit.client.1.smithi141.stdout:7/804: rename d5/d16/de3/d1e/d71/fb9 to d5/d2a/d45/d5a/f105 0 2023-12-16T20:11:45.261 INFO:tasks.workunit.client.1.smithi141.stdout:6/932: symlink d1/dd/l12c 0 2023-12-16T20:11:45.262 INFO:tasks.workunit.client.1.smithi141.stdout:3/982: symlink d0/d1c/d2c/d10d/df9/df8/de9/l14e 0 2023-12-16T20:11:45.263 INFO:tasks.workunit.client.1.smithi141.stdout:0/743: rename d4/d7/c7d to d4/d49/d73/d8a/da4/dcc/cfd 0 2023-12-16T20:11:45.265 INFO:tasks.workunit.client.1.smithi141.stdout:7/805: creat d5/d16/de3/d1e/f106 x:0 0 0 2023-12-16T20:11:45.265 INFO:tasks.workunit.client.1.smithi141.stdout:6/933: chown d1/dd/de/l11 0 1 2023-12-16T20:11:45.266 INFO:tasks.workunit.client.1.smithi141.stdout:5/755: dread d0/d9/f89 [0,4194304] 0 2023-12-16T20:11:45.267 INFO:tasks.workunit.client.1.smithi141.stdout:0/744: unlink d4/d49/da1/ff0 0 2023-12-16T20:11:45.267 INFO:tasks.workunit.client.1.smithi141.stdout:6/934: mkdir d1/d12/d20/d12d 0 2023-12-16T20:11:45.269 INFO:tasks.workunit.client.1.smithi141.stdout:5/756: symlink d0/d25/dce/dd1/l104 0 2023-12-16T20:11:45.269 INFO:tasks.workunit.client.1.smithi141.stdout:5/757: write d0/d9/d99/d102/ffc [137998,29047] 0 2023-12-16T20:11:45.269 INFO:tasks.workunit.client.1.smithi141.stdout:6/935: mknod d1/d12/d20/d85/dfb/d120/c12e 0 2023-12-16T20:11:45.270 INFO:tasks.workunit.client.1.smithi141.stdout:6/936: symlink d1/d12/d10d/d47/l12f 0 2023-12-16T20:11:45.276 INFO:tasks.workunit.client.1.smithi141.stdout:7/806: write d5/d2a/d45/d5a/fc5 [981493,106906] 0 2023-12-16T20:11:45.280 INFO:tasks.workunit.client.1.smithi141.stdout:7/807: mknod d5/d2a/d45/dae/c107 0 2023-12-16T20:11:45.281 INFO:tasks.workunit.client.1.smithi141.stdout:1/919: dwrite da/d36/f3f [4194304,4194304] 0 2023-12-16T20:11:45.281 INFO:tasks.workunit.client.1.smithi141.stdout:7/808: symlink d5/d16/de3/d89/d9b/dd4/d104/l108 0 2023-12-16T20:11:45.282 INFO:tasks.workunit.client.1.smithi141.stdout:7/809: chown d5/d16/d30/d4e/d87/fff 14594 1 2023-12-16T20:11:45.283 INFO:tasks.workunit.client.1.smithi141.stdout:1/920: mkdir da/d1a/d31/d81/d137 0 2023-12-16T20:11:45.283 INFO:tasks.workunit.client.1.smithi141.stdout:0/745: write d4/f33 [2938368,38399] 0 2023-12-16T20:11:45.284 INFO:tasks.workunit.client.1.smithi141.stdout:0/746: write d4/d7/db0/ffb [872563,29449] 0 2023-12-16T20:11:45.285 INFO:tasks.workunit.client.1.smithi141.stdout:3/983: dread d0/d1c/d40/d3c/fcc [0,4194304] 0 2023-12-16T20:11:45.290 INFO:tasks.workunit.client.1.smithi141.stdout:3/984: mkdir d0/d1c/d2c/d14f 0 2023-12-16T20:11:45.292 INFO:tasks.workunit.client.1.smithi141.stdout:3/985: mknod d0/d1c/d6a/d76/da2/dd9/c150 0 2023-12-16T20:11:45.293 INFO:tasks.workunit.client.1.smithi141.stdout:6/937: dwrite d1/d5e/d123/d4b/d60/f9b [0,4194304] 0 2023-12-16T20:11:45.293 INFO:tasks.workunit.client.1.smithi141.stdout:5/758: dwrite d0/d9/d16/d72/f92 [0,4194304] 0 2023-12-16T20:11:45.297 INFO:tasks.workunit.client.1.smithi141.stdout:6/938: unlink d1/d12/d20/d44/l73 0 2023-12-16T20:11:45.297 INFO:tasks.workunit.client.1.smithi141.stdout:6/939: creat d1/d12/d20/d89/f130 x:0 0 0 2023-12-16T20:11:45.301 INFO:tasks.workunit.client.1.smithi141.stdout:0/747: dread d4/d49/d73/d3b/f67 [0,4194304] 0 2023-12-16T20:11:45.302 INFO:tasks.workunit.client.1.smithi141.stdout:5/759: link d0/dd2/lae d0/d25/dce/dfb/l105 0 2023-12-16T20:11:45.304 INFO:tasks.workunit.client.1.smithi141.stdout:0/748: mknod d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/cfe 0 2023-12-16T20:11:45.312 INFO:tasks.workunit.client.1.smithi141.stdout:3/986: dread d0/d1c/d40/f1d [0,4194304] 0 2023-12-16T20:11:45.313 INFO:tasks.workunit.client.1.smithi141.stdout:1/921: dwrite da/d36/d4b/d4d/d80/d94/d9d/f130 [0,4194304] 0 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/987: getdents d0/d1c/d40/d3c 0 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/988: fdatasync d0/d1c/d40/f27 0 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/989: dread - d0/d1c/d2c/d72/f103 zero size 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/990: fsync d0/d1c/d40/d3f/f73 0 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:3/991: chown d0/d1c/d2c 1194136 1 2023-12-16T20:11:45.314 INFO:tasks.workunit.client.1.smithi141.stdout:7/810: dwrite d5/d16/d30/d4e/fde [0,4194304] 0 2023-12-16T20:11:45.315 INFO:tasks.workunit.client.1.smithi141.stdout:7/811: truncate d5/d16/d1a/d40/f7b 2258448 0 2023-12-16T20:11:45.319 INFO:tasks.workunit.client.1.smithi141.stdout:1/922: mkdir da/d36/d4b/d4d/d89/d138 0 2023-12-16T20:11:45.319 INFO:tasks.workunit.client.1.smithi141.stdout:1/923: stat da/d1a/d1d/d33/ff4 0 2023-12-16T20:11:45.324 INFO:tasks.workunit.client.1.smithi141.stdout:7/812: getdents d5/d16/d46/d61 0 2023-12-16T20:11:45.324 INFO:tasks.workunit.client.1.smithi141.stdout:3/992: rmdir d0/d1c/d40/d3c/dce 39 2023-12-16T20:11:45.324 INFO:tasks.workunit.client.1.smithi141.stdout:3/993: chown d0/d1c/d2c/d10d/df9/df8/de9/l14e 70799988 1 2023-12-16T20:11:45.325 INFO:tasks.workunit.client.1.smithi141.stdout:3/994: rename d0/d1c/de8/def/c119 to d0/d1c/d40/d12b/d5d/d109/c151 0 2023-12-16T20:11:45.326 INFO:tasks.workunit.client.1.smithi141.stdout:3/995: mkdir d0/d1c/d2c/d10d/df9/df8/da3/d152 0 2023-12-16T20:11:45.327 INFO:tasks.workunit.client.1.smithi141.stdout:7/813: dread d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:45.327 INFO:tasks.workunit.client.1.smithi141.stdout:3/996: creat d0/d1c/f153 x:0 0 0 2023-12-16T20:11:45.327 INFO:tasks.workunit.client.1.smithi141.stdout:3/997: fsync d0/d1c/d40/d12b/f9e 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:1/924: dread da/d36/d4b/d4d/d89/d61/f71 [0,4194304] 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:1/925: dread - da/d1a/dd1/d10b/f12a zero size 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:1/926: write da/d1a/d1d/d22/f123 [249556,1937] 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:0/749: dwrite d4/d49/d8f/fac [0,4194304] 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:5/760: dwrite d0/d9/d16/d2a/d35/f3f [0,4194304] 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:0/750: readlink d4/d49/d73/d3b/d78/d7f/lf2 0 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:5/761: chown d0/d14/d75/fbf 103385279 1 2023-12-16T20:11:45.336 INFO:tasks.workunit.client.1.smithi141.stdout:5/762: readlink d0/d14/d2c/d90/l9c 0 2023-12-16T20:11:45.337 INFO:tasks.workunit.client.1.smithi141.stdout:7/814: dread d5/d16/d1a/d40/dab/dd5/fed [0,4194304] 0 2023-12-16T20:11:45.337 INFO:tasks.workunit.client.1.smithi141.stdout:0/751: write d4/d49/d73/d3b/d78/d7f/f8c [657819,62113] 0 2023-12-16T20:11:45.337 INFO:tasks.workunit.client.1.smithi141.stdout:5/763: symlink d0/d25/dce/dfb/l106 0 2023-12-16T20:11:45.342 INFO:tasks.workunit.client.1.smithi141.stdout:5/764: mkdir d0/d25/dce/dd1/d107 0 2023-12-16T20:11:45.346 INFO:tasks.workunit.client.1.smithi141.stdout:7/815: rename d5/d2a/d45/d5a to d5/d16/d30/d36/d8c/dfa/d109 0 2023-12-16T20:11:45.348 INFO:tasks.workunit.client.1.smithi141.stdout:7/816: creat d5/d2a/f10a x:0 0 0 2023-12-16T20:11:45.348 INFO:tasks.workunit.client.1.smithi141.stdout:7/817: write d5/d16/de3/d89/fd8 [2224640,35393] 0 2023-12-16T20:11:45.348 INFO:tasks.workunit.client.1.smithi141.stdout:7/818: truncate d5/d16/d46/d61/fdd 325899 0 2023-12-16T20:11:45.349 INFO:tasks.workunit.client.1.smithi141.stdout:0/752: rename d4/d7/c99 to d4/d49/d73/d8a/da4/dcc/cff 0 2023-12-16T20:11:45.350 INFO:tasks.workunit.client.1.smithi141.stdout:3/998: dwrite d0/fc5 [4194304,4194304] 0 2023-12-16T20:11:45.351 INFO:tasks.workunit.client.1.smithi141.stdout:7/819: symlink d5/d16/de3/d1e/l10b 0 2023-12-16T20:11:45.353 INFO:tasks.workunit.client.1.smithi141.stdout:0/753: creat d4/d7/f100 x:0 0 0 2023-12-16T20:11:45.353 INFO:tasks.workunit.client.1.smithi141.stdout:0/754: chown d4/d74 18907 1 2023-12-16T20:11:45.355 INFO:tasks.workunit.client.1.smithi141.stdout:3/999: mkdir d0/d1c/d2c/d10d/df9/d154 0 2023-12-16T20:11:45.356 INFO:tasks.workunit.client.1.smithi141.stdout:7/820: truncate d5/d16/f83 737422 0 2023-12-16T20:11:45.357 INFO:tasks.workunit.client.1.smithi141.stdout:1/927: dwrite da/d76/fbc [0,4194304] 0 2023-12-16T20:11:45.358 INFO:tasks.workunit.client.1.smithi141.stdout:5/765: dwrite d0/d9/d99/d102/f9a [0,4194304] 0 2023-12-16T20:11:45.358 INFO:tasks.workunit.client.1.smithi141.stdout:7/821: symlink d5/d16/de3/deb/l10c 0 2023-12-16T20:11:45.360 INFO:tasks.workunit.client.1.smithi141.stdout:0/755: getdents d4 0 2023-12-16T20:11:45.364 INFO:tasks.workunit.client.1.smithi141.stdout:7/822: read d5/d2a/f3d [2952851,113479] 0 2023-12-16T20:11:45.364 INFO:tasks.workunit.client.1.smithi141.stdout:7/823: stat d5/d16/d1a/l9a 0 2023-12-16T20:11:45.366 INFO:tasks.workunit.client.1.smithi141.stdout:5/766: mknod d0/d25/d30/d8a/c108 0 2023-12-16T20:11:45.366 INFO:tasks.workunit.client.1.smithi141.stdout:5/767: write d0/d25/d30/d67/fe6 [1781419,103397] 0 2023-12-16T20:11:45.369 INFO:tasks.workunit.client.1.smithi141.stdout:0/756: rename d4/c41 to d4/d5c/c101 0 2023-12-16T20:11:45.370 INFO:tasks.workunit.client.1.smithi141.stdout:1/928: getdents da/d67 0 2023-12-16T20:11:45.370 INFO:tasks.workunit.client.1.smithi141.stdout:1/929: creat da/d1a/d1d/d33/d7f/f139 x:0 0 0 2023-12-16T20:11:45.372 INFO:tasks.workunit.client.1.smithi141.stdout:7/824: getdents d5/d16/d1a/d40/dab/dd5 0 2023-12-16T20:11:45.373 INFO:tasks.workunit.client.1.smithi141.stdout:5/768: mkdir d0/d9/d16/d2a/d35/dbe/d109 0 2023-12-16T20:11:45.373 INFO:tasks.workunit.client.1.smithi141.stdout:5/769: chown d0/d9/d99/d102/ffc 578812 1 2023-12-16T20:11:45.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/930: mknod da/d36/d4b/db2/c13a 0 2023-12-16T20:11:45.376 INFO:tasks.workunit.client.1.smithi141.stdout:1/931: write da/d1a/d31/d81/fc2 [811324,22772] 0 2023-12-16T20:11:45.377 INFO:tasks.workunit.client.1.smithi141.stdout:7/825: creat d5/d16/de3/d89/f10d x:0 0 0 2023-12-16T20:11:45.379 INFO:tasks.workunit.client.1.smithi141.stdout:0/757: symlink d4/d74/dc1/l102 0 2023-12-16T20:11:45.381 INFO:tasks.workunit.client.1.smithi141.stdout:1/932: symlink da/d1a/d31/d81/db6/d128/l13b 0 2023-12-16T20:11:45.382 INFO:tasks.workunit.client.1.smithi141.stdout:0/758: chown d4/d49/d73 65160 1 2023-12-16T20:11:45.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/933: rename da/d1a/d1d/d33/fd4 to da/d36/d4b/d4d/dd7/f13c 0 2023-12-16T20:11:45.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/934: fsync da/f52 0 2023-12-16T20:11:45.386 INFO:tasks.workunit.client.1.smithi141.stdout:1/935: truncate da/f79 8816479 0 2023-12-16T20:11:45.386 INFO:tasks.workunit.client.1.smithi141.stdout:8/988: sync 2023-12-16T20:11:45.387 INFO:tasks.workunit.client.1.smithi141.stdout:0/759: chown d4/d7/l29 1133224 1 2023-12-16T20:11:45.389 INFO:tasks.workunit.client.1.smithi141.stdout:8/989: mkdir d14/d19/d1b/d3d/d5e/d12b/db4/d69/d13e 0 2023-12-16T20:11:45.389 INFO:tasks.workunit.client.1.smithi141.stdout:8/990: read d14/d19/f20 [419895,99512] 0 2023-12-16T20:11:45.392 INFO:tasks.workunit.client.1.smithi141.stdout:0/760: creat d4/d49/da1/dd4/f103 x:0 0 0 2023-12-16T20:11:45.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/826: dwrite d5/d16/de3/d1e/f80 [0,4194304] 0 2023-12-16T20:11:45.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/827: write d5/d2a/f2d [2857458,39923] 0 2023-12-16T20:11:45.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/828: write d5/f8d [4077766,11072] 0 2023-12-16T20:11:45.397 INFO:tasks.workunit.client.1.smithi141.stdout:8/991: symlink d14/d19/l13f 0 2023-12-16T20:11:45.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/761: mkdir d4/d49/da1/dbd/def/d104 0 2023-12-16T20:11:45.400 INFO:tasks.workunit.client.1.smithi141.stdout:7/829: mknod d5/d16/de3/deb/c10e 0 2023-12-16T20:11:45.400 INFO:tasks.workunit.client.1.smithi141.stdout:7/830: chown d5/d16/de3/d1e/l20 362 1 2023-12-16T20:11:45.401 INFO:tasks.workunit.client.1.smithi141.stdout:0/762: fdatasync d4/d5c/f98 0 2023-12-16T20:11:45.404 INFO:tasks.workunit.client.1.smithi141.stdout:1/936: dwrite da/d36/d4b/d4d/d89/f97 [0,4194304] 0 2023-12-16T20:11:45.405 INFO:tasks.workunit.client.1.smithi141.stdout:7/831: rename d5/d16/d30/d4e/d6e/la2 to d5/d16/d1a/d40/dab/l10f 0 2023-12-16T20:11:45.406 INFO:tasks.workunit.client.1.smithi141.stdout:0/763: mknod d4/d7/db0/ddb/c105 0 2023-12-16T20:11:45.406 INFO:tasks.workunit.client.1.smithi141.stdout:0/764: write d4/d49/d73/d8a/f91 [4203814,107098] 0 2023-12-16T20:11:45.409 INFO:tasks.workunit.client.1.smithi141.stdout:7/832: getdents d5/d16/d1a/de7 0 2023-12-16T20:11:45.409 INFO:tasks.workunit.client.1.smithi141.stdout:7/833: chown d5/d16/d30/d36/fc7 504134 1 2023-12-16T20:11:45.409 INFO:tasks.workunit.client.1.smithi141.stdout:7/834: truncate d5/d16/d46/d61/fdd 593137 0 2023-12-16T20:11:45.409 INFO:tasks.workunit.client.1.smithi141.stdout:7/835: truncate d5/d16/d30/d36/ff2 95371 0 2023-12-16T20:11:45.410 INFO:tasks.workunit.client.1.smithi141.stdout:0/765: truncate d4/d5c/f87 1430980 0 2023-12-16T20:11:45.412 INFO:tasks.workunit.client.1.smithi141.stdout:7/836: mkdir d5/d16/de3/d1e/d71/df3/d110 0 2023-12-16T20:11:45.413 INFO:tasks.workunit.client.1.smithi141.stdout:0/766: symlink d4/d49/d73/l106 0 2023-12-16T20:11:45.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/837: mkdir d5/d16/d1a/d111 0 2023-12-16T20:11:45.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/838: chown d5/d16/d30/d36/laf 865367374 1 2023-12-16T20:11:45.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/839: readlink d5/d16/d30/d36/lb8 0 2023-12-16T20:11:45.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/840: readlink d5/d16/de3/d1e/lc4 0 2023-12-16T20:11:45.417 INFO:tasks.workunit.client.1.smithi141.stdout:7/841: dread - d5/d2a/d45/fd9 zero size 2023-12-16T20:11:45.418 INFO:tasks.workunit.client.1.smithi141.stdout:8/992: dwrite d14/d19/d1b/d3d/d5e/d12b/db4/d58/fc1 [0,4194304] 0 2023-12-16T20:11:45.418 INFO:tasks.workunit.client.1.smithi141.stdout:0/767: mkdir d4/d49/da1/df3/da3/d107 0 2023-12-16T20:11:45.420 INFO:tasks.workunit.client.1.smithi141.stdout:1/937: dwrite da/d1a/d1d/fd8 [0,4194304] 0 2023-12-16T20:11:45.420 INFO:tasks.workunit.client.1.smithi141.stdout:1/938: fdatasync da/d36/d4b/d4d/d89/d61/f114 0 2023-12-16T20:11:45.420 INFO:tasks.workunit.client.1.smithi141.stdout:7/842: creat d5/d16/d1a/f112 x:0 0 0 2023-12-16T20:11:45.421 INFO:tasks.workunit.client.1.smithi141.stdout:7/843: dread d5/d16/d30/d4e/d6e/fc8 [0,4194304] 0 2023-12-16T20:11:45.422 INFO:tasks.workunit.client.1.smithi141.stdout:7/844: creat d5/d2a/f113 x:0 0 0 2023-12-16T20:11:45.424 INFO:tasks.workunit.client.1.smithi141.stdout:8/993: read d14/f64 [4350151,60743] 0 2023-12-16T20:11:45.429 INFO:tasks.workunit.client.1.smithi141.stdout:1/939: rename da/d1a/d31/d81/d10e to da/d36/d4b/d4d/d89/d6c/d13d 0 2023-12-16T20:11:45.430 INFO:tasks.workunit.client.1.smithi141.stdout:1/940: dread da/d36/d4b/d4d/dd7/de1/f78 [0,4194304] 0 2023-12-16T20:11:45.432 INFO:tasks.workunit.client.1.smithi141.stdout:7/845: link d5/d2a/f7e d5/d16/de3/d1e/d71/df3/f114 0 2023-12-16T20:11:45.433 INFO:tasks.workunit.client.1.smithi141.stdout:8/994: chown d14/d19/d1b/c7d 0 1 2023-12-16T20:11:45.436 INFO:tasks.workunit.client.1.smithi141.stdout:0/768: dwrite d4/d7/fd [8388608,4194304] 0 2023-12-16T20:11:45.437 INFO:tasks.workunit.client.1.smithi141.stdout:7/846: creat d5/d16/d30/d36/d8c/dfa/d109/f115 x:0 0 0 2023-12-16T20:11:45.437 INFO:tasks.workunit.client.1.smithi141.stdout:7/847: truncate d5/d2a/f10a 738528 0 2023-12-16T20:11:45.442 INFO:tasks.workunit.client.1.smithi141.stdout:7/848: mkdir d5/d16/d30/d36/d116 0 2023-12-16T20:11:45.442 INFO:tasks.workunit.client.1.smithi141.stdout:7/849: dread - d5/d16/d30/d36/d8c/dfa/d109/f115 zero size 2023-12-16T20:11:45.443 INFO:tasks.workunit.client.1.smithi141.stdout:1/941: dread da/d36/f96 [0,4194304] 0 2023-12-16T20:11:45.444 INFO:tasks.workunit.client.1.smithi141.stdout:7/850: mknod d5/d16/d30/c117 0 2023-12-16T20:11:45.444 INFO:tasks.workunit.client.1.smithi141.stdout:7/851: truncate d5/d16/d30/d36/d8c/dfa/d109/f105 912954 0 2023-12-16T20:11:45.447 INFO:tasks.workunit.client.1.smithi141.stdout:7/852: rename d5/l48 to d5/d16/d1a/dd7/de6/l118 0 2023-12-16T20:11:45.448 INFO:tasks.workunit.client.1.smithi141.stdout:0/769: read d4/d49/f5a [3468476,15115] 0 2023-12-16T20:11:45.449 INFO:tasks.workunit.client.1.smithi141.stdout:8/995: write d14/d71/d81/fe9 [3673310,72017] 0 2023-12-16T20:11:45.449 INFO:tasks.workunit.client.1.smithi141.stdout:8/996: read - d14/d19/d1b/d3d/d5e/d12b/db4/f6d zero size 2023-12-16T20:11:45.449 INFO:tasks.workunit.client.1.smithi141.stdout:8/997: chown d14/d19/d1b/d24/d4b/d8f/f125 6 1 2023-12-16T20:11:45.451 INFO:tasks.workunit.client.1.smithi141.stdout:7/853: truncate d5/f13 2581316 0 2023-12-16T20:11:45.454 INFO:tasks.workunit.client.1.smithi141.stdout:0/770: creat d4/d49/d73/d8a/da4/dcc/f108 x:0 0 0 2023-12-16T20:11:45.458 INFO:tasks.workunit.client.1.smithi141.stdout:5/770: dwrite d0/d14/f37 [0,4194304] 0 2023-12-16T20:11:45.458 INFO:tasks.workunit.client.1.smithi141.stdout:8/998: dread d14/d19/d1b/d3d/d5e/d12b/db4/f5a [0,4194304] 0 2023-12-16T20:11:45.460 INFO:tasks.workunit.client.1.smithi141.stdout:1/942: dwrite da/d36/d4b/db2/f134 [0,4194304] 0 2023-12-16T20:11:45.460 INFO:tasks.workunit.client.1.smithi141.stdout:1/943: write da/d1a/d31/fd2 [553390,56313] 0 2023-12-16T20:11:45.460 INFO:tasks.workunit.client.1.smithi141.stdout:1/944: creat da/d36/d4b/d4d/d80/d94/f13e x:0 0 0 2023-12-16T20:11:45.470 INFO:tasks.workunit.client.1.smithi141.stdout:7/854: unlink d5/d16/d30/d4e/lbf 0 2023-12-16T20:11:45.471 INFO:tasks.workunit.client.1.smithi141.stdout:0/771: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/db5/l109 0 2023-12-16T20:11:45.474 INFO:tasks.workunit.client.1.smithi141.stdout:8/999: rmdir d14/d19/d1b/d3d/d5e/d12b/db4/d5b/dea 39 2023-12-16T20:11:45.476 INFO:tasks.workunit.client.1.smithi141.stdout:5/771: rename d0/cfd to d0/d9/d16/d2a/d35/dbe/d109/c10a 0 2023-12-16T20:11:45.481 INFO:tasks.workunit.client.1.smithi141.stdout:1/945: mkdir da/d1a/dd1/d10b/d13f 0 2023-12-16T20:11:45.483 INFO:tasks.workunit.client.1.smithi141.stdout:7/855: symlink d5/d16/de3/d1e/d71/df3/d110/l119 0 2023-12-16T20:11:45.483 INFO:tasks.workunit.client.1.smithi141.stdout:7/856: write d5/d16/d1a/d40/dab/dd5/fed [883509,72942] 0 2023-12-16T20:11:45.483 INFO:tasks.workunit.client.1.smithi141.stdout:5/772: creat d0/d25/dce/dd1/d107/f10b x:0 0 0 2023-12-16T20:11:45.484 INFO:tasks.workunit.client.1.smithi141.stdout:1/946: getdents da/d1a/db0/dd3 0 2023-12-16T20:11:45.486 INFO:tasks.workunit.client.1.smithi141.stdout:7/857: rename d5/d16/d30/c117 to d5/d16/de3/d89/d9b/dd4/d104/c11a 0 2023-12-16T20:11:45.488 INFO:tasks.workunit.client.1.smithi141.stdout:0/772: dwrite d4/d49/da1/dbd/def/fe1 [0,4194304] 0 2023-12-16T20:11:45.491 INFO:tasks.workunit.client.1.smithi141.stdout:0/773: mknod d4/d49/d73/d3b/d78/d7f/d80/d83/db5/c10a 0 2023-12-16T20:11:45.492 INFO:tasks.workunit.client.1.smithi141.stdout:0/774: readlink d4/d49/d73/l63 0 2023-12-16T20:11:45.493 INFO:tasks.workunit.client.1.smithi141.stdout:7/858: rmdir d5/d2a/d45/dae 39 2023-12-16T20:11:45.493 INFO:tasks.workunit.client.1.smithi141.stdout:5/773: dread d0/d14/f37 [0,4194304] 0 2023-12-16T20:11:45.495 INFO:tasks.workunit.client.1.smithi141.stdout:7/859: getdents d5/d16/d46 0 2023-12-16T20:11:45.495 INFO:tasks.workunit.client.1.smithi141.stdout:7/860: chown d5/d16/d30/d36/d8c 65 1 2023-12-16T20:11:45.496 INFO:tasks.workunit.client.1.smithi141.stdout:0/775: unlink d4/lb1 0 2023-12-16T20:11:45.497 INFO:tasks.workunit.client.1.smithi141.stdout:0/776: creat d4/d49/d73/d3b/f10b x:0 0 0 2023-12-16T20:11:45.497 INFO:tasks.workunit.client.1.smithi141.stdout:0/777: truncate d4/d49/d73/d3b/d78/d7f/d80/d83/f89 8930290 0 2023-12-16T20:11:45.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/861: write d5/d16/de3/d1e/f52 [644922,130] 0 2023-12-16T20:11:45.505 INFO:tasks.workunit.client.1.smithi141.stdout:7/862: write d5/d16/d30/d4e/fec [156831,40950] 0 2023-12-16T20:11:45.506 INFO:tasks.workunit.client.1.smithi141.stdout:7/863: creat d5/d16/d30/d36/d8c/dfa/f11b x:0 0 0 2023-12-16T20:11:45.507 INFO:tasks.workunit.client.1.smithi141.stdout:0/778: read d4/d49/da1/df3/da3/fe2 [3446102,38646] 0 2023-12-16T20:11:45.507 INFO:tasks.workunit.client.1.smithi141.stdout:7/864: symlink d5/d16/d1a/l11c 0 2023-12-16T20:11:45.507 INFO:tasks.workunit.client.1.smithi141.stdout:7/865: fsync d5/fa8 0 2023-12-16T20:11:45.508 INFO:tasks.workunit.client.1.smithi141.stdout:0/779: mkdir d4/d49/d8f/d10c 0 2023-12-16T20:11:45.510 INFO:tasks.workunit.client.1.smithi141.stdout:5/774: dwrite d0/d14/d2c/f68 [0,4194304] 0 2023-12-16T20:11:45.510 INFO:tasks.workunit.client.1.smithi141.stdout:7/866: creat d5/d16/de3/d1e/d71/df3/d110/f11d x:0 0 0 2023-12-16T20:11:45.510 INFO:tasks.workunit.client.1.smithi141.stdout:5/775: dread - d0/d9/d16/d72/dd7/ffa zero size 2023-12-16T20:11:45.511 INFO:tasks.workunit.client.1.smithi141.stdout:5/776: creat d0/d14/d2c/d90/f10c x:0 0 0 2023-12-16T20:11:45.511 INFO:tasks.workunit.client.1.smithi141.stdout:5/777: fdatasync d0/d9/d16/d72/f92 0 2023-12-16T20:11:45.511 INFO:tasks.workunit.client.1.smithi141.stdout:2/728: sync 2023-12-16T20:11:45.512 INFO:tasks.workunit.client.1.smithi141.stdout:7/867: rmdir d5/d16/d1a/de7 39 2023-12-16T20:11:45.512 INFO:tasks.workunit.client.1.smithi141.stdout:5/778: truncate d0/d9/d16/d72/f92 2026894 0 2023-12-16T20:11:45.521 INFO:tasks.workunit.client.1.smithi141.stdout:2/729: read d6/d3a/d47/d58/f87 [734636,90088] 0 2023-12-16T20:11:45.523 INFO:tasks.workunit.client.1.smithi141.stdout:5/779: dread d0/d25/f93 [0,4194304] 0 2023-12-16T20:11:45.524 INFO:tasks.workunit.client.1.smithi141.stdout:5/780: creat d0/d14/d75/f10d x:0 0 0 2023-12-16T20:11:45.527 INFO:tasks.workunit.client.1.smithi141.stdout:5/781: symlink d0/d25/l10e 0 2023-12-16T20:11:45.527 INFO:tasks.workunit.client.1.smithi141.stdout:2/730: write d6/da/d1b/f27 [169283,40362] 0 2023-12-16T20:11:45.527 INFO:tasks.workunit.client.1.smithi141.stdout:5/782: fsync d0/d9/d16/d2a/d4f/fc2 0 2023-12-16T20:11:45.527 INFO:tasks.workunit.client.1.smithi141.stdout:5/783: write d0/ff1 [857495,75700] 0 2023-12-16T20:11:45.529 INFO:tasks.workunit.client.1.smithi141.stdout:2/731: truncate d6/d12/d1f/d46/d5a/fb6 220214 0 2023-12-16T20:11:45.531 INFO:tasks.workunit.client.1.smithi141.stdout:2/732: mknod d6/da/d33/d54/d73/d80/cf0 0 2023-12-16T20:11:45.531 INFO:tasks.workunit.client.1.smithi141.stdout:2/733: creat d6/d3a/ff1 x:0 0 0 2023-12-16T20:11:45.533 INFO:tasks.workunit.client.1.smithi141.stdout:2/734: symlink d6/d3a/d47/d58/d8c/lf2 0 2023-12-16T20:11:45.535 INFO:tasks.workunit.client.1.smithi141.stdout:0/780: dwrite d4/d5c/f98 [0,4194304] 0 2023-12-16T20:11:45.537 INFO:tasks.workunit.client.1.smithi141.stdout:0/781: getdents d4/d49/da1/df3/da3 0 2023-12-16T20:11:45.538 INFO:tasks.workunit.client.1.smithi141.stdout:7/868: dwrite d5/d16/de3/d1e/d71/df3/f114 [0,4194304] 0 2023-12-16T20:11:45.538 INFO:tasks.workunit.client.1.smithi141.stdout:5/784: fsync d0/d14/d75/f10d 0 2023-12-16T20:11:45.542 INFO:tasks.workunit.client.1.smithi141.stdout:0/782: dread d4/d5c/f87 [0,4194304] 0 2023-12-16T20:11:45.542 INFO:tasks.workunit.client.1.smithi141.stdout:7/869: mknod d5/d16/d1a/dd7/de6/c11e 0 2023-12-16T20:11:45.542 INFO:tasks.workunit.client.1.smithi141.stdout:7/870: creat d5/d16/de3/d1e/f11f x:0 0 0 2023-12-16T20:11:45.548 INFO:tasks.workunit.client.1.smithi141.stdout:7/871: link d5/d16/de3/d89/ce1 d5/d16/d1a/d40/dcb/c120 0 2023-12-16T20:11:45.551 INFO:tasks.workunit.client.1.smithi141.stdout:7/872: mknod d5/d16/d1a/c121 0 2023-12-16T20:11:45.553 INFO:tasks.workunit.client.1.smithi141.stdout:7/873: mkdir d5/d16/d30/d36/d8c/d122 0 2023-12-16T20:11:45.553 INFO:tasks.workunit.client.1.smithi141.stdout:7/874: getdents d5/d16/d1a/dce 0 2023-12-16T20:11:45.554 INFO:tasks.workunit.client.1.smithi141.stdout:9/771: sync 2023-12-16T20:11:45.554 INFO:tasks.workunit.client.1.smithi141.stdout:4/891: sync 2023-12-16T20:11:45.554 INFO:tasks.workunit.client.1.smithi141.stdout:4/892: write d1a/d2a/dc3/fea [449416,104783] 0 2023-12-16T20:11:45.555 INFO:tasks.workunit.client.1.smithi141.stdout:9/772: mkdir d1/d10/d14/d20/dd6/d101 0 2023-12-16T20:11:45.555 INFO:tasks.workunit.client.1.smithi141.stdout:9/773: write d1/d10/d33/d47/d8d/ddf/dcd/fda [919092,121244] 0 2023-12-16T20:11:45.556 INFO:tasks.workunit.client.1.smithi141.stdout:9/774: chown d1/d10/d33/d47/d83/ddd/fed 2 1 2023-12-16T20:11:45.556 INFO:tasks.workunit.client.1.smithi141.stdout:4/893: mkdir d1a/d2a/dc2/d14b 0 2023-12-16T20:11:45.559 INFO:tasks.workunit.client.1.smithi141.stdout:9/775: creat d1/d10/d33/d47/d8d/f102 x:0 0 0 2023-12-16T20:11:45.561 INFO:tasks.workunit.client.1.smithi141.stdout:2/735: dwrite d6/da/d1b/d5b/d6a/d85/fd7 [0,4194304] 0 2023-12-16T20:11:45.561 INFO:tasks.workunit.client.1.smithi141.stdout:2/736: truncate d6/d32/d7a/fcc 516026 0 2023-12-16T20:11:45.561 INFO:tasks.workunit.client.1.smithi141.stdout:2/737: fdatasync d6/d32/d7a/fcc 0 2023-12-16T20:11:45.562 INFO:tasks.workunit.client.1.smithi141.stdout:2/738: fdatasync d6/d32/d7a/ddf/d98/fe9 0 2023-12-16T20:11:45.565 INFO:tasks.workunit.client.1.smithi141.stdout:2/739: creat d6/d32/d52/ff3 x:0 0 0 2023-12-16T20:11:45.568 INFO:tasks.workunit.client.1.smithi141.stdout:2/740: link d6/d12/d1f/d46/lb4 d6/da/d4a/d5e/lf4 0 2023-12-16T20:11:45.570 INFO:tasks.workunit.client.1.smithi141.stdout:2/741: mknod d6/d32/da1/cf5 0 2023-12-16T20:11:45.570 INFO:tasks.workunit.client.1.smithi141.stdout:9/776: write d1/d26/d4a/d73/ff6 [3467322,30157] 0 2023-12-16T20:11:45.570 INFO:tasks.workunit.client.1.smithi141.stdout:9/777: chown d1/d10/d33/d6a/d75 2390 1 2023-12-16T20:11:45.570 INFO:tasks.workunit.client.1.smithi141.stdout:9/778: read d1/d10/d33/f8b [263260,111926] 0 2023-12-16T20:11:45.571 INFO:tasks.workunit.client.1.smithi141.stdout:2/742: mkdir d6/d32/d7a/ddf/d98/df6 0 2023-12-16T20:11:45.572 INFO:tasks.workunit.client.1.smithi141.stdout:9/779: mknod d1/d10/d33/d47/d8d/ddf/dcd/dd9/c103 0 2023-12-16T20:11:45.574 INFO:tasks.workunit.client.1.smithi141.stdout:2/743: creat d6/d32/d7a/dad/ff7 x:0 0 0 2023-12-16T20:11:45.575 INFO:tasks.workunit.client.1.smithi141.stdout:2/744: creat d6/da/d1b/ff8 x:0 0 0 2023-12-16T20:11:45.575 INFO:tasks.workunit.client.1.smithi141.stdout:2/745: getdents d6/d3a/d9d 0 2023-12-16T20:11:45.575 INFO:tasks.workunit.client.1.smithi141.stdout:2/746: stat d6/da/d33/l83 0 2023-12-16T20:11:45.578 INFO:tasks.workunit.client.1.smithi141.stdout:5/785: dwrite d0/dd2/f6e [0,4194304] 0 2023-12-16T20:11:45.578 INFO:tasks.workunit.client.1.smithi141.stdout:5/786: creat d0/d14/d2c/d90/f10f x:0 0 0 2023-12-16T20:11:45.578 INFO:tasks.workunit.client.1.smithi141.stdout:5/787: truncate d0/d14/d2c/d90/ff8 915449 0 2023-12-16T20:11:45.580 INFO:tasks.workunit.client.1.smithi141.stdout:5/788: stat d0/d9/d16/l4e 0 2023-12-16T20:11:45.581 INFO:tasks.workunit.client.1.smithi141.stdout:5/789: creat d0/d25/d30/d8a/da0/f110 x:0 0 0 2023-12-16T20:11:45.582 INFO:tasks.workunit.client.1.smithi141.stdout:9/780: read d1/d10/d33/d47/d8d/ddf/fbe [1866332,14839] 0 2023-12-16T20:11:45.582 INFO:tasks.workunit.client.1.smithi141.stdout:9/781: dread - d1/d26/d4a/f100 zero size 2023-12-16T20:11:45.583 INFO:tasks.workunit.client.1.smithi141.stdout:5/790: rename d0/d9/d16/d2a/d35/cbc to d0/dd2/c111 0 2023-12-16T20:11:45.583 INFO:tasks.workunit.client.1.smithi141.stdout:5/791: chown d0/d25/d30/l69 0 1 2023-12-16T20:11:45.592 INFO:tasks.workunit.client.1.smithi141.stdout:0/783: dwrite d4/d49/d73/f96 [0,4194304] 0 2023-12-16T20:11:45.592 INFO:tasks.workunit.client.1.smithi141.stdout:0/784: dread d4/d49/d73/d3b/f79 [0,4194304] 0 2023-12-16T20:11:45.592 INFO:tasks.workunit.client.1.smithi141.stdout:0/785: readlink d4/d49/l69 0 2023-12-16T20:11:45.595 INFO:tasks.workunit.client.1.smithi141.stdout:0/786: creat d4/d49/d73/d3b/ded/f10d x:0 0 0 2023-12-16T20:11:45.596 INFO:tasks.workunit.client.1.smithi141.stdout:0/787: creat d4/d7/f10e x:0 0 0 2023-12-16T20:11:45.596 INFO:tasks.workunit.client.1.smithi141.stdout:7/875: dwrite d5/d16/d30/d4e/fec [0,4194304] 0 2023-12-16T20:11:45.596 INFO:tasks.workunit.client.1.smithi141.stdout:7/876: readlink l2 0 2023-12-16T20:11:45.597 INFO:tasks.workunit.client.1.smithi141.stdout:9/782: write d1/d10/d33/d47/f5b [3370254,90346] 0 2023-12-16T20:11:45.597 INFO:tasks.workunit.client.1.smithi141.stdout:9/783: creat d1/d10/d14/d20/d90/f104 x:0 0 0 2023-12-16T20:11:45.597 INFO:tasks.workunit.client.1.smithi141.stdout:0/788: creat d4/d7/f10f x:0 0 0 2023-12-16T20:11:45.597 INFO:tasks.workunit.client.1.smithi141.stdout:0/789: readlink d4/d49/d73/d3b/l64 0 2023-12-16T20:11:45.599 INFO:tasks.workunit.client.1.smithi141.stdout:9/784: link d1/d10/d33/d6a/d72/ce8 d1/d10/d14/d20/d84/c105 0 2023-12-16T20:11:45.601 INFO:tasks.workunit.client.1.smithi141.stdout:0/790: link d4/d7/l8b d4/d49/db9/dcd/de8/l110 0 2023-12-16T20:11:45.602 INFO:tasks.workunit.client.1.smithi141.stdout:9/785: symlink d1/d10/d33/d47/d83/ddd/l106 0 2023-12-16T20:11:45.604 INFO:tasks.workunit.client.1.smithi141.stdout:0/791: readlink d4/l2d 0 2023-12-16T20:11:45.604 INFO:tasks.workunit.client.1.smithi141.stdout:0/792: read d4/d7/f50 [573084,77593] 0 2023-12-16T20:11:45.605 INFO:tasks.workunit.client.1.smithi141.stdout:9/786: mkdir d1/d10/d14/d20/da/d3f/dea/d107 0 2023-12-16T20:11:45.605 INFO:tasks.workunit.client.1.smithi141.stdout:9/787: stat d1/d10/d14/d20/da/lc7 0 2023-12-16T20:11:45.605 INFO:tasks.workunit.client.1.smithi141.stdout:9/788: chown d1/d26/da1 409621 1 2023-12-16T20:11:45.605 INFO:tasks.workunit.client.1.smithi141.stdout:9/789: write d1/d10/d27/fa9 [4672721,103016] 0 2023-12-16T20:11:45.606 INFO:tasks.workunit.client.1.smithi141.stdout:9/790: creat d1/d26/d4a/f108 x:0 0 0 2023-12-16T20:11:45.609 INFO:tasks.workunit.client.1.smithi141.stdout:9/791: symlink d1/d10/d14/d20/dd6/l109 0 2023-12-16T20:11:45.610 INFO:tasks.workunit.client.1.smithi141.stdout:9/792: rmdir d1/d10/d33/d47/d8d/ddf/de6/de9 39 2023-12-16T20:11:45.610 INFO:tasks.workunit.client.1.smithi141.stdout:9/793: fsync d1/d10/d14/d20/da/d3f/f98 0 2023-12-16T20:11:45.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/792: dwrite d0/d25/d30/fe3 [0,4194304] 0 2023-12-16T20:11:45.611 INFO:tasks.workunit.client.1.smithi141.stdout:5/793: write d0/d9/d16/d2a/d35/f6a [828195,109797] 0 2023-12-16T20:11:45.611 INFO:tasks.workunit.client.1.smithi141.stdout:2/747: dwrite d6/da/d1b/d5b/f78 [0,4194304] 0 2023-12-16T20:11:45.611 INFO:tasks.workunit.client.1.smithi141.stdout:9/794: mkdir d1/d10/d33/d47/d8d/ddf/de6/d10a 0 2023-12-16T20:11:45.616 INFO:tasks.workunit.client.1.smithi141.stdout:9/795: read d1/d10/d14/f31 [2791987,11930] 0 2023-12-16T20:11:45.621 INFO:tasks.workunit.client.1.smithi141.stdout:5/794: creat d0/d9/d99/d102/f112 x:0 0 0 2023-12-16T20:11:45.622 INFO:tasks.workunit.client.1.smithi141.stdout:2/748: rename d6/l8 to d6/d32/d7a/ddf/d98/df6/lf9 0 2023-12-16T20:11:45.622 INFO:tasks.workunit.client.1.smithi141.stdout:2/749: write d6/da/d1b/d5b/d6a/d85/fe6 [994227,24067] 0 2023-12-16T20:11:45.623 INFO:tasks.workunit.client.1.smithi141.stdout:9/796: link d1/d10/d14/d20/d84/fe1 d1/d26/d4a/d73/d76/f10b 0 2023-12-16T20:11:45.623 INFO:tasks.workunit.client.1.smithi141.stdout:9/797: write d1/d10/d33/d47/d8d/ddf/fc0 [204304,60599] 0 2023-12-16T20:11:45.624 INFO:tasks.workunit.client.1.smithi141.stdout:5/795: rmdir d0/d9/d16/d72 39 2023-12-16T20:11:45.625 INFO:tasks.workunit.client.1.smithi141.stdout:7/877: dwrite d5/d2a/f3e [0,4194304] 0 2023-12-16T20:11:45.625 INFO:tasks.workunit.client.1.smithi141.stdout:0/793: dwrite d4/d49/d73/d3b/f59 [0,4194304] 0 2023-12-16T20:11:45.625 INFO:tasks.workunit.client.1.smithi141.stdout:0/794: read - d4/d49/d73/fd9 zero size 2023-12-16T20:11:45.625 INFO:tasks.workunit.client.1.smithi141.stdout:0/795: stat d4/d49/d73/d3b/d78/d7f/d80/d83/lb4 0 2023-12-16T20:11:45.628 INFO:tasks.workunit.client.1.smithi141.stdout:9/798: rmdir d1/d10/d33/d47/d8d/dc4/ddb 0 2023-12-16T20:11:45.629 INFO:tasks.workunit.client.1.smithi141.stdout:9/799: creat d1/d26/d4a/f10c x:0 0 0 2023-12-16T20:11:45.630 INFO:tasks.workunit.client.1.smithi141.stdout:5/796: symlink d0/d25/d30/l113 0 2023-12-16T20:11:45.635 INFO:tasks.workunit.client.1.smithi141.stdout:0/796: truncate d4/d49/d73/f46 1666318 0 2023-12-16T20:11:45.636 INFO:tasks.workunit.client.1.smithi141.stdout:2/750: getdents d6/d32/d7a/dad 0 2023-12-16T20:11:45.638 INFO:tasks.workunit.client.1.smithi141.stdout:7/878: write d5/d16/de3/d1e/d71/fcd [3472946,39875] 0 2023-12-16T20:11:45.640 INFO:tasks.workunit.client.1.smithi141.stdout:9/800: creat d1/d10/d14/d20/da/d3f/f10d x:0 0 0 2023-12-16T20:11:45.640 INFO:tasks.workunit.client.1.smithi141.stdout:9/801: readlink d1/d10/d27/l2c 0 2023-12-16T20:11:45.641 INFO:tasks.workunit.client.1.smithi141.stdout:5/797: link d0/d9/d16/d2a/d35/d91/ff6 d0/d14/d98/f114 0 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: pgmap v11: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 332 MiB/s wr, 463 op/s 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:45 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.645 INFO:tasks.workunit.client.1.smithi141.stdout:2/751: rename d6/d32/d7a/ddf/d98/fac to d6/d32/d7a/ddf/d98/ffa 0 2023-12-16T20:11:45.645 INFO:tasks.workunit.client.1.smithi141.stdout:2/752: chown d6/d32/d7a/ddf/d98/ffa 15037 1 2023-12-16T20:11:45.647 INFO:tasks.workunit.client.1.smithi141.stdout:7/879: mknod d5/d16/de3/d89/d9b/c123 0 2023-12-16T20:11:45.649 INFO:tasks.workunit.client.1.smithi141.stdout:9/802: symlink d1/d10/d33/d47/d8d/ddf/dcd/dd9/l10e 0 2023-12-16T20:11:45.653 INFO:tasks.workunit.client.1.smithi141.stdout:2/753: mkdir d6/dc4/dfb 0 2023-12-16T20:11:45.656 INFO:tasks.workunit.client.1.smithi141.stdout:9/803: mkdir d1/d10/d14/d20/da/d10f 0 2023-12-16T20:11:45.656 INFO:tasks.workunit.client.1.smithi141.stdout:0/797: dread d4/f33 [4194304,4194304] 0 2023-12-16T20:11:45.658 INFO:tasks.workunit.client.1.smithi141.stdout:5/798: dread d0/d9/d16/d2a/d35/f6a [0,4194304] 0 2023-12-16T20:11:45.659 INFO:tasks.workunit.client.1.smithi141.stdout:5/799: write d0/f50 [3588544,63988] 0 2023-12-16T20:11:45.659 INFO:tasks.workunit.client.1.smithi141.stdout:2/754: mkdir d6/d3a/d47/d58/d8c/dfc 0 2023-12-16T20:11:45.659 INFO:tasks.workunit.client.1.smithi141.stdout:5/800: dread d0/d9/d16/d2a/d35/d91/ff6 [0,4194304] 0 2023-12-16T20:11:45.659 INFO:tasks.workunit.client.1.smithi141.stdout:5/801: write d0/d9/d16/d2a/d4f/f8f [1080131,89862] 0 2023-12-16T20:11:45.662 INFO:tasks.workunit.client.1.smithi141.stdout:7/880: rmdir d5/d16/d30/d36/d8c/dfa 39 2023-12-16T20:11:45.664 INFO:tasks.workunit.client.1.smithi141.stdout:9/804: creat d1/d10/d14/d20/da/d3f/dea/d107/f110 x:0 0 0 2023-12-16T20:11:45.664 INFO:tasks.workunit.client.1.smithi141.stdout:9/805: dread - d1/d10/d14/d20/da/d3f/fe3 zero size 2023-12-16T20:11:45.664 INFO:tasks.workunit.client.1.smithi141.stdout:9/806: write d1/d10/d33/d47/d8d/ddf/fc0 [1069956,48834] 0 2023-12-16T20:11:45.665 INFO:tasks.workunit.client.1.smithi141.stdout:0/798: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/l111 0 2023-12-16T20:11:45.668 INFO:tasks.workunit.client.1.smithi141.stdout:2/755: link d6/d32/fc8 d6/da/d1b/d5b/ffd 0 2023-12-16T20:11:45.668 INFO:tasks.workunit.client.1.smithi141.stdout:2/756: write d6/d12/d15/f44 [4300272,117456] 0 2023-12-16T20:11:45.669 INFO:tasks.workunit.client.1.smithi141.stdout:5/802: mknod d0/d9/d99/d102/c115 0 2023-12-16T20:11:45.669 INFO:tasks.workunit.client.1.smithi141.stdout:5/803: chown d0/d25/dce/dd1/d107 3058 1 2023-12-16T20:11:45.669 INFO:tasks.workunit.client.1.smithi141.stdout:5/804: write d0/d9/d16/d72/dc6/fef [1018700,21298] 0 2023-12-16T20:11:45.671 INFO:tasks.workunit.client.1.smithi141.stdout:7/881: rmdir d5/d16/de3/d89/d9b/dd4 39 2023-12-16T20:11:45.675 INFO:tasks.workunit.client.1.smithi141.stdout:2/757: creat d6/d12/d15/ffe x:0 0 0 2023-12-16T20:11:45.676 INFO:tasks.workunit.client.1.smithi141.stdout:9/807: dread d1/d10/d14/d20/da/d3f/fc3 [0,4194304] 0 2023-12-16T20:11:45.677 INFO:tasks.workunit.client.1.smithi141.stdout:0/799: dread d4/d5c/f68 [0,4194304] 0 2023-12-16T20:11:45.679 INFO:tasks.workunit.client.1.smithi141.stdout:2/758: rename d6/da/d4a/lde to d6/d12/d1f/d46/lff 0 2023-12-16T20:11:45.679 INFO:tasks.workunit.client.1.smithi141.stdout:2/759: read - d6/da/fae zero size 2023-12-16T20:11:45.682 INFO:tasks.workunit.client.1.smithi141.stdout:9/808: mkdir d1/d26/d4a/d111 0 2023-12-16T20:11:45.682 INFO:tasks.workunit.client.1.smithi141.stdout:9/809: truncate d1/d26/d4a/f108 313090 0 2023-12-16T20:11:45.682 INFO:tasks.workunit.client.1.smithi141.stdout:9/810: write d1/d26/d4a/d73/ff6 [3387982,37524] 0 2023-12-16T20:11:45.683 INFO:tasks.workunit.client.1.smithi141.stdout:5/805: dread d0/d14/f23 [0,4194304] 0 2023-12-16T20:11:45.684 INFO:tasks.workunit.client.1.smithi141.stdout:0/800: symlink d4/d49/da1/df3/da3/d107/l112 0 2023-12-16T20:11:45.686 INFO:tasks.workunit.client.1.smithi141.stdout:2/760: rename d6/da/d1b/f30 to d6/d32/d7a/ddf/f100 0 2023-12-16T20:11:45.686 INFO:tasks.workunit.client.1.smithi141.stdout:2/761: truncate d6/d32/d7a/dad/ff7 364584 0 2023-12-16T20:11:45.686 INFO:tasks.workunit.client.1.smithi141.stdout:2/762: write d6/d32/d52/fa2 [5014742,17040] 0 2023-12-16T20:11:45.687 INFO:tasks.workunit.client.1.smithi141.stdout:2/763: read d6/d12/d1f/fa9 [381125,36290] 0 2023-12-16T20:11:45.687 INFO:tasks.workunit.client.1.smithi141.stdout:2/764: write d6/da/d1b/d5b/ffd [700943,89184] 0 2023-12-16T20:11:45.688 INFO:tasks.workunit.client.1.smithi141.stdout:5/806: dread d0/d9/f89 [0,4194304] 0 2023-12-16T20:11:45.688 INFO:tasks.workunit.client.1.smithi141.stdout:5/807: fdatasync d0/d14/fa7 0 2023-12-16T20:11:45.689 INFO:tasks.workunit.client.1.smithi141.stdout:0/801: creat d4/d49/d8f/f113 x:0 0 0 2023-12-16T20:11:45.689 INFO:tasks.workunit.client.1.smithi141.stdout:0/802: truncate d4/d49/d73/d3b/d78/d7f/fcf 415210 0 2023-12-16T20:11:45.691 INFO:tasks.workunit.client.1.smithi141.stdout:5/808: unlink d0/d9/d16/d72/dd7/fe4 0 2023-12-16T20:11:45.693 INFO:tasks.workunit.client.1.smithi141.stdout:5/809: dread d0/d9/d99/d102/ffc [0,4194304] 0 2023-12-16T20:11:45.693 INFO:tasks.workunit.client.1.smithi141.stdout:5/810: creat d0/d25/d30/d8a/f116 x:0 0 0 2023-12-16T20:11:45.694 INFO:tasks.workunit.client.1.smithi141.stdout:0/803: creat d4/d49/d8f/d10c/f114 x:0 0 0 2023-12-16T20:11:45.696 INFO:tasks.workunit.client.1.smithi141.stdout:7/882: dwrite d5/d16/d30/d36/d8c/dfa/d109/fc5 [0,4194304] 0 2023-12-16T20:11:45.696 INFO:tasks.workunit.client.1.smithi141.stdout:2/765: dread d6/d32/f64 [0,4194304] 0 2023-12-16T20:11:45.696 INFO:tasks.workunit.client.1.smithi141.stdout:2/766: write d6/d3a/fcf [46979,101249] 0 2023-12-16T20:11:45.696 INFO:tasks.workunit.client.1.smithi141.stdout:2/767: fdatasync d6/d3a/d47/d58/f71 0 2023-12-16T20:11:45.699 INFO:tasks.workunit.client.1.smithi141.stdout:2/768: mkdir d6/d32/d101 0 2023-12-16T20:11:45.700 INFO:tasks.workunit.client.1.smithi141.stdout:7/883: rmdir d5/d16/de3/d1e/d71/df3/d110 39 2023-12-16T20:11:45.702 INFO:tasks.workunit.client.1.smithi141.stdout:7/884: mknod d5/d16/d30/d4e/d6e/c124 0 2023-12-16T20:11:45.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/811: dread d0/d9/f34 [0,4194304] 0 2023-12-16T20:11:45.706 INFO:tasks.workunit.client.1.smithi141.stdout:5/812: chown d0/d9/d99/d102/f8d 150283 1 2023-12-16T20:11:45.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/813: creat d0/d14/d2c/f117 x:0 0 0 2023-12-16T20:11:45.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/814: dread - d0/d9/d16/d72/dd7/ffa zero size 2023-12-16T20:11:45.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/815: chown d0/d9/d16/d72/l84 0 1 2023-12-16T20:11:45.710 INFO:tasks.workunit.client.1.smithi141.stdout:5/816: rmdir d0/d9/d99/d102/dc3 39 2023-12-16T20:11:45.713 INFO:tasks.workunit.client.1.smithi141.stdout:2/769: read d6/d12/d15/faf [361985,109590] 0 2023-12-16T20:11:45.713 INFO:tasks.workunit.client.1.smithi141.stdout:7/885: dread d5/d2a/f2c [0,4194304] 0 2023-12-16T20:11:45.714 INFO:tasks.workunit.client.1.smithi141.stdout:2/770: mkdir d6/da/d33/d102 0 2023-12-16T20:11:45.717 INFO:tasks.workunit.client.1.smithi141.stdout:7/886: link d5/d16/d30/d4e/fde d5/f125 0 2023-12-16T20:11:45.726 INFO:tasks.workunit.client.1.smithi141.stdout:0/804: dwrite d4/d7/db0/ffb [0,4194304] 0 2023-12-16T20:11:45.726 INFO:tasks.workunit.client.1.smithi141.stdout:9/811: dwrite d1/d10/d33/d47/d8d/ddf/fc0 [0,4194304] 0 2023-12-16T20:11:45.729 INFO:tasks.workunit.client.1.smithi141.stdout:0/805: readlink d4/l45 0 2023-12-16T20:11:45.730 INFO:tasks.workunit.client.1.smithi141.stdout:7/887: dread d5/d2a/f86 [0,4194304] 0 2023-12-16T20:11:45.730 INFO:tasks.workunit.client.1.smithi141.stdout:0/806: getdents d4/d49/d73/d3b/d78/d7f/d80 0 2023-12-16T20:11:45.731 INFO:tasks.workunit.client.1.smithi141.stdout:9/812: dread d1/d10/d14/d20/da/d3f/d8a/fb4 [0,4194304] 0 2023-12-16T20:11:45.731 INFO:tasks.workunit.client.1.smithi141.stdout:7/888: getdents d5/d2a/d45/dae 0 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: pgmap v11: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 332 MiB/s wr, 463 op/s 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.735 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.736 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.736 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.736 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.736 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:45.736 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:45 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:45.736 INFO:tasks.workunit.client.1.smithi141.stdout:7/889: creat d5/d16/d30/d36/d8c/d122/f126 x:0 0 0 2023-12-16T20:11:45.736 INFO:tasks.workunit.client.1.smithi141.stdout:7/890: write d5/d16/d30/d36/ff1 [698598,909] 0 2023-12-16T20:11:45.738 INFO:tasks.workunit.client.1.smithi141.stdout:7/891: creat d5/d16/de3/d1e/d71/ddf/dee/f127 x:0 0 0 2023-12-16T20:11:45.740 INFO:tasks.workunit.client.1.smithi141.stdout:7/892: creat d5/d16/d46/d102/f128 x:0 0 0 2023-12-16T20:11:45.740 INFO:tasks.workunit.client.1.smithi141.stdout:7/893: chown d5/d2a/d45/dae/c107 3 1 2023-12-16T20:11:45.740 INFO:tasks.workunit.client.1.smithi141.stdout:7/894: readlink d5/d16/de3/d1e/l85 0 2023-12-16T20:11:45.741 INFO:tasks.workunit.client.1.smithi141.stdout:5/817: dwrite d0/d14/f70 [0,4194304] 0 2023-12-16T20:11:45.743 INFO:tasks.workunit.client.1.smithi141.stdout:5/818: getdents d0/d9/d16/d2a/d35/dbe 0 2023-12-16T20:11:45.743 INFO:tasks.workunit.client.1.smithi141.stdout:5/819: fsync d0/d9/d16/d2a/d35/d91/ff6 0 2023-12-16T20:11:45.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/771: dwrite d6/d32/d52/fc3 [0,4194304] 0 2023-12-16T20:11:45.750 INFO:tasks.workunit.client.1.smithi141.stdout:5/820: write d0/d25/d30/d67/fe6 [609047,84787] 0 2023-12-16T20:11:45.750 INFO:tasks.workunit.client.1.smithi141.stdout:5/821: chown d0/d25/dce 8513 1 2023-12-16T20:11:45.750 INFO:tasks.workunit.client.1.smithi141.stdout:5/822: creat d0/d14/d2c/d4a/f118 x:0 0 0 2023-12-16T20:11:45.750 INFO:tasks.workunit.client.1.smithi141.stdout:5/823: fdatasync d0/d9/d16/d72/dd7/ffa 0 2023-12-16T20:11:45.750 INFO:tasks.workunit.client.1.smithi141.stdout:5/824: dread d0/d9/d99/d102/ffc [0,4194304] 0 2023-12-16T20:11:45.751 INFO:tasks.workunit.client.1.smithi141.stdout:2/772: creat d6/d32/da1/f103 x:0 0 0 2023-12-16T20:11:45.757 INFO:tasks.workunit.client.1.smithi141.stdout:2/773: mkdir d6/d32/d52/d53/d104 0 2023-12-16T20:11:45.760 INFO:tasks.workunit.client.1.smithi141.stdout:9/813: dwrite d1/d26/fad [0,4194304] 0 2023-12-16T20:11:45.760 INFO:tasks.workunit.client.1.smithi141.stdout:9/814: truncate d1/d10/d14/d20/da/d3f/d8a/fb4 1176803 0 2023-12-16T20:11:45.760 INFO:tasks.workunit.client.1.smithi141.stdout:9/815: chown d1/d26/d4a/fbd 35304298 1 2023-12-16T20:11:45.761 INFO:tasks.workunit.client.1.smithi141.stdout:9/816: write d1/d26/d4a/d73/fa2 [881571,76235] 0 2023-12-16T20:11:45.761 INFO:tasks.workunit.client.1.smithi141.stdout:9/817: write d1/d10/d14/d20/db3/f62 [2302296,23684] 0 2023-12-16T20:11:45.762 INFO:tasks.workunit.client.1.smithi141.stdout:9/818: creat d1/d10/d33/d47/d8d/ddf/de6/de9/f112 x:0 0 0 2023-12-16T20:11:45.762 INFO:tasks.workunit.client.1.smithi141.stdout:9/819: chown d1/d26/da1 4162480 1 2023-12-16T20:11:45.768 INFO:tasks.workunit.client.1.smithi141.stdout:5/825: dwrite d0/fb4 [0,4194304] 0 2023-12-16T20:11:45.771 INFO:tasks.workunit.client.1.smithi141.stdout:5/826: creat d0/d9/f119 x:0 0 0 2023-12-16T20:11:45.772 INFO:tasks.workunit.client.1.smithi141.stdout:2/774: write d6/f17 [11359647,116864] 0 2023-12-16T20:11:45.772 INFO:tasks.workunit.client.1.smithi141.stdout:2/775: dread - d6/d32/d52/fba zero size 2023-12-16T20:11:45.773 INFO:tasks.workunit.client.1.smithi141.stdout:5/827: creat d0/d94/f11a x:0 0 0 2023-12-16T20:11:45.774 INFO:tasks.workunit.client.1.smithi141.stdout:2/776: read d6/da/d1b/d5b/d6a/d85/f9c [731746,96059] 0 2023-12-16T20:11:45.775 INFO:tasks.workunit.client.1.smithi141.stdout:5/828: link d0/d25/d30/d8a/da0/f110 d0/d9/d16/d2a/d35/dbe/d109/f11b 0 2023-12-16T20:11:45.775 INFO:tasks.workunit.client.1.smithi141.stdout:5/829: truncate d0/d14/d2c/d90/f10f 168653 0 2023-12-16T20:11:45.775 INFO:tasks.workunit.client.1.smithi141.stdout:5/830: stat d0/d14/c39 0 2023-12-16T20:11:45.776 INFO:tasks.workunit.client.1.smithi141.stdout:2/777: creat d6/d12/dd8/f105 x:0 0 0 2023-12-16T20:11:45.776 INFO:tasks.workunit.client.1.smithi141.stdout:2/778: dread - d6/d32/d52/fba zero size 2023-12-16T20:11:45.776 INFO:tasks.workunit.client.1.smithi141.stdout:2/779: truncate d6/d12/d1f/d46/d5a/f76 5094017 0 2023-12-16T20:11:45.777 INFO:tasks.workunit.client.1.smithi141.stdout:5/831: mkdir d0/d25/d30/d8a/d11c 0 2023-12-16T20:11:45.778 INFO:tasks.workunit.client.1.smithi141.stdout:2/780: symlink d6/d12/d1f/d46/l106 0 2023-12-16T20:11:45.778 INFO:tasks.workunit.client.1.smithi141.stdout:2/781: fdatasync d6/da/d68/f82 0 2023-12-16T20:11:45.779 INFO:tasks.workunit.client.1.smithi141.stdout:5/832: rename d0/d9/d16/d2a/d4f to d0/d11d 0 2023-12-16T20:11:45.779 INFO:tasks.workunit.client.1.smithi141.stdout:2/782: symlink d6/d12/d67/l107 0 2023-12-16T20:11:45.781 INFO:tasks.workunit.client.1.smithi141.stdout:5/833: rename d0/d14/l60 to d0/d25/dce/l11e 0 2023-12-16T20:11:45.781 INFO:tasks.workunit.client.1.smithi141.stdout:9/820: dwrite d1/d10/d33/f8b [0,4194304] 0 2023-12-16T20:11:45.781 INFO:tasks.workunit.client.1.smithi141.stdout:9/821: creat d1/d26/f113 x:0 0 0 2023-12-16T20:11:45.781 INFO:tasks.workunit.client.1.smithi141.stdout:9/822: creat d1/d10/d14/d20/da/d3f/dea/d107/f114 x:0 0 0 2023-12-16T20:11:45.784 INFO:tasks.workunit.client.1.smithi141.stdout:2/783: truncate d6/da/d1b/d5b/faa 2199730 0 2023-12-16T20:11:45.786 INFO:tasks.workunit.client.1.smithi141.stdout:5/834: unlink d0/d9/cb8 0 2023-12-16T20:11:45.786 INFO:tasks.workunit.client.1.smithi141.stdout:5/835: chown d0/d9/d16/d2a/d35/d5e/cf7 62897 1 2023-12-16T20:11:45.799 INFO:tasks.workunit.client.1.smithi141.stdout:9/823: rename d1/d10/d14/d20/da/d3f/d8a to d1/d115 0 2023-12-16T20:11:45.800 INFO:tasks.workunit.client.1.smithi141.stdout:5/836: rename d0/d9/d16/d2a/d35/d5e/ce7 to d0/d9/d16/d2a/d35/dbe/c11f 0 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:9/824: rmdir d1/d10/d33/d47/d8d/ddf/dcd/dd9 39 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:9/825: stat d1/d10/d14/d20/da/f78 0 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:9/826: truncate d1/d26/d4a/d73/d76/f10b 799360 0 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:9/827: truncate d1/d10/d14/d20/ffd 689823 0 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:9/828: truncate d1/d10/d14/d20/d84/ffa 982496 0 2023-12-16T20:11:45.801 INFO:tasks.workunit.client.1.smithi141.stdout:5/837: unlink d0/d9/lc0 0 2023-12-16T20:11:45.803 INFO:tasks.workunit.client.1.smithi141.stdout:5/838: rename d0/d9/d16/l4e to d0/d9/d16/d2a/d35/dbe/dda/l120 0 2023-12-16T20:11:45.803 INFO:tasks.workunit.client.1.smithi141.stdout:5/839: truncate d0/d25/d30/d8a/da0/f110 946816 0 2023-12-16T20:11:45.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/829: write d1/d10/d27/d36/f7a [3226191,72511] 0 2023-12-16T20:11:45.865 INFO:tasks.workunit.client.1.smithi141.stdout:9/830: chown d1/d10/d14/d20/da/f32 2812 1 2023-12-16T20:11:45.865 INFO:tasks.workunit.client.1.smithi141.stdout:9/831: read - d1/d10/d33/d47/d8d/f102 zero size 2023-12-16T20:11:45.866 INFO:tasks.workunit.client.1.smithi141.stdout:9/832: unlink d1/d26/d4a/f88 0 2023-12-16T20:11:45.867 INFO:tasks.workunit.client.1.smithi141.stdout:9/833: mkdir d1/d10/d14/d20/da/d3f/dea/d107/d116 0 2023-12-16T20:11:45.867 INFO:tasks.workunit.client.1.smithi141.stdout:9/834: write d1/d10/d14/d20/da/d3f/dea/d107/f110 [805970,129028] 0 2023-12-16T20:11:45.869 INFO:tasks.workunit.client.1.smithi141.stdout:9/835: rename d1/d10/d33/f34 to d1/d26/d3c/f117 0 2023-12-16T20:11:45.869 INFO:tasks.workunit.client.1.smithi141.stdout:9/836: dread - d1/d10/d14/d20/d3b/f6b zero size 2023-12-16T20:11:45.877 INFO:tasks.workunit.client.1.smithi141.stdout:5/840: dwrite d0/d14/f37 [4194304,4194304] 0 2023-12-16T20:11:45.878 INFO:tasks.workunit.client.1.smithi141.stdout:2/784: dwrite d6/da/d33/d54/d73/d80/f9b [0,4194304] 0 2023-12-16T20:11:45.880 INFO:tasks.workunit.client.1.smithi141.stdout:5/841: rename d0/d9/d99/d102/f9a to d0/d94/f121 0 2023-12-16T20:11:45.881 INFO:tasks.workunit.client.1.smithi141.stdout:5/842: write d0/d14/d2c/d90/ff5 [785681,23292] 0 2023-12-16T20:11:45.881 INFO:tasks.workunit.client.1.smithi141.stdout:5/843: write d0/d14/d2c/fb2 [7796169,4268] 0 2023-12-16T20:11:45.887 INFO:tasks.workunit.client.1.smithi141.stdout:9/837: read d1/d26/d4a/d73/f4e [3466227,92316] 0 2023-12-16T20:11:45.887 INFO:tasks.workunit.client.1.smithi141.stdout:5/844: mkdir d0/d94/db3/d122 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:5/845: creat d0/d14/d75/f123 x:0 0 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:5/846: write d0/d9/d16/d2a/d35/f6a [2497245,27297] 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:9/838: getdents d1/d10/d14/d20/d90/dca 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:9/839: truncate d1/d26/d4a/f94 4670916 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:9/840: fsync d1/d10/d33/d47/d8d/ddf/fbf 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:9/841: readlink d1/d10/d27/l5a 0 2023-12-16T20:11:45.888 INFO:tasks.workunit.client.1.smithi141.stdout:9/842: chown d1/d10/d33/f8b 54899964 1 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/847: creat d0/d9/d16/d2a/d35/dbe/d109/f124 x:0 0 0 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/848: write d0/d25/d30/d67/fe6 [2543597,64678] 0 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/849: chown d0/d25/d30/l69 7 1 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/850: creat d0/d14/d98/f125 x:0 0 0 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/851: chown d0/d9/d99/ce2 2080 1 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/852: chown d0/d25/d30/d67/f71 68072766 1 2023-12-16T20:11:45.891 INFO:tasks.workunit.client.1.smithi141.stdout:5/853: fdatasync d0/d25/f96 0 2023-12-16T20:11:45.892 INFO:tasks.workunit.client.1.smithi141.stdout:5/854: readlink d0/dd2/l79 0 2023-12-16T20:11:45.892 INFO:tasks.workunit.client.1.smithi141.stdout:5/855: chown d0/d14/d2c/d90/f10f 61959096 1 2023-12-16T20:11:45.895 INFO:tasks.workunit.client.1.smithi141.stdout:2/785: dread d6/f7 [0,4194304] 0 2023-12-16T20:11:45.917 INFO:tasks.workunit.client.1.smithi141.stdout:9/843: dwrite d1/d10/f22 [4194304,4194304] 0 2023-12-16T20:11:45.919 INFO:tasks.workunit.client.1.smithi141.stdout:6/940: sync 2023-12-16T20:11:45.919 INFO:tasks.workunit.client.1.smithi141.stdout:6/941: chown d1/d12/d10d/f81 41285855 1 2023-12-16T20:11:45.919 INFO:tasks.workunit.client.1.smithi141.stdout:2/786: dwrite d6/da/d68/fab [4194304,4194304] 0 2023-12-16T20:11:45.919 INFO:tasks.workunit.client.1.smithi141.stdout:2/787: write d6/d3a/d47/d58/f72 [1079855,35539] 0 2023-12-16T20:11:45.922 INFO:tasks.workunit.client.1.smithi141.stdout:5/856: dwrite d0/d14/f31 [0,4194304] 0 2023-12-16T20:11:45.922 INFO:tasks.workunit.client.1.smithi141.stdout:5/857: readlink d0/d25/dce/l11e 0 2023-12-16T20:11:45.927 INFO:tasks.workunit.client.1.smithi141.stdout:9/844: dread d1/d10/d33/d47/d8d/ddf/fbf [0,4194304] 0 2023-12-16T20:11:45.928 INFO:tasks.workunit.client.1.smithi141.stdout:6/942: rename d1/d12/d20 to d1/dd/d2f/d48/d127/d131 0 2023-12-16T20:11:45.929 INFO:tasks.workunit.client.1.smithi141.stdout:2/788: rename d6/d12/d1f/fa9 to d6/d32/d7a/ddf/d98/f108 0 2023-12-16T20:11:45.930 INFO:tasks.workunit.client.1.smithi141.stdout:2/789: chown d6/d12/d1f/d46/d5a/f76 36799 1 2023-12-16T20:11:45.931 INFO:tasks.workunit.client.1.smithi141.stdout:5/858: rename d0/d25/d30/f97 to d0/d25/d30/d8a/da0/f126 0 2023-12-16T20:11:45.932 INFO:tasks.workunit.client.1.smithi141.stdout:5/859: link d0/f50 d0/dd2/f127 0 2023-12-16T20:11:45.932 INFO:tasks.workunit.client.1.smithi141.stdout:5/860: readlink d0/d25/dce/l11e 0 2023-12-16T20:11:45.932 INFO:tasks.workunit.client.1.smithi141.stdout:5/861: chown d0/d9/d16/d2a/d35/d91 1221 1 2023-12-16T20:11:45.933 INFO:tasks.workunit.client.1.smithi141.stdout:5/862: mknod d0/d11d/c128 0 2023-12-16T20:11:45.933 INFO:tasks.workunit.client.1.smithi141.stdout:5/863: fdatasync d0/d25/d30/d8a/fb1 0 2023-12-16T20:11:45.934 INFO:tasks.workunit.client.1.smithi141.stdout:5/864: mkdir d0/d9/d16/d2a/d35/dbe/dda/d129 0 2023-12-16T20:11:45.937 INFO:tasks.workunit.client.1.smithi141.stdout:5/865: rename d0/d9/d16/d2a/d35/dbe/dda/l120 to d0/d9/d16/d2a/d35/d5e/dee/l12a 0 2023-12-16T20:11:45.937 INFO:tasks.workunit.client.1.smithi141.stdout:5/866: chown d0/d9/d16/d2a/d35/d5e/dee/l12a 8 1 2023-12-16T20:11:45.939 INFO:tasks.workunit.client.1.smithi141.stdout:9/845: dread d1/d10/d14/d20/da/f32 [0,4194304] 0 2023-12-16T20:11:45.942 INFO:tasks.workunit.client.1.smithi141.stdout:5/867: rename d0/d94 to d0/d12b 0 2023-12-16T20:11:45.942 INFO:tasks.workunit.client.1.smithi141.stdout:6/943: write d1/d12/d22/d25/f7e [5189485,103392] 0 2023-12-16T20:11:45.943 INFO:tasks.workunit.client.1.smithi141.stdout:9/846: unlink d1/l5 0 2023-12-16T20:11:45.959 INFO:tasks.workunit.client.1.smithi141.stdout:5/868: write d0/d14/f70 [934093,107123] 0 2023-12-16T20:11:45.959 INFO:tasks.workunit.client.1.smithi141.stdout:5/869: chown d0/d11d 4609032 1 2023-12-16T20:11:45.966 INFO:tasks.workunit.client.1.smithi141.stdout:9/847: dwrite d1/d10/d33/d47/f5b [4194304,4194304] 0 2023-12-16T20:11:45.970 INFO:tasks.workunit.client.1.smithi141.stdout:2/790: dwrite d6/d12/dd8/f105 [0,4194304] 0 2023-12-16T20:11:45.972 INFO:tasks.workunit.client.1.smithi141.stdout:2/791: getdents d6/da/d33/d54/d73/d80 0 2023-12-16T20:11:45.972 INFO:tasks.workunit.client.1.smithi141.stdout:2/792: stat d6/da/d33/d54/d73/f89 0 2023-12-16T20:11:45.976 INFO:tasks.workunit.client.1.smithi141.stdout:2/793: dread d6/d32/d7a/d5f/d92/fc5 [0,4194304] 0 2023-12-16T20:11:45.977 INFO:tasks.workunit.client.1.smithi141.stdout:2/794: write d6/da/d1b/ff8 [523023,42291] 0 2023-12-16T20:11:45.978 INFO:tasks.workunit.client.1.smithi141.stdout:2/795: symlink d6/d12/d1f/d46/d5a/l109 0 2023-12-16T20:11:45.985 INFO:tasks.workunit.client.1.smithi141.stdout:5/870: dwrite d0/d9/d16/d2a/d35/dbe/d109/f124 [0,4194304] 0 2023-12-16T20:11:45.985 INFO:tasks.workunit.client.1.smithi141.stdout:9/848: dwrite d1/d115/fb4 [0,4194304] 0 2023-12-16T20:11:45.985 INFO:tasks.workunit.client.1.smithi141.stdout:9/849: write d1/d26/d4a/d73/fc5 [856401,49579] 0 2023-12-16T20:11:45.985 INFO:tasks.workunit.client.1.smithi141.stdout:5/871: creat d0/d25/d30/d8a/da0/f12c x:0 0 0 2023-12-16T20:11:45.985 INFO:tasks.workunit.client.1.smithi141.stdout:9/850: creat d1/d10/d14/d20/d3b/f118 x:0 0 0 2023-12-16T20:11:45.986 INFO:tasks.workunit.client.1.smithi141.stdout:6/944: dwrite d1/dd/de/d8a/fc2 [0,4194304] 0 2023-12-16T20:11:45.986 INFO:tasks.workunit.client.1.smithi141.stdout:6/945: write d1/d12/d22/d25/d38/f10a [702052,44215] 0 2023-12-16T20:11:45.991 INFO:tasks.workunit.client.1.smithi141.stdout:6/946: fdatasync d1/d12/d22/d25/fa4 0 2023-12-16T20:11:45.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/872: dread d0/d25/d30/fe3 [0,4194304] 0 2023-12-16T20:11:45.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/873: readlink d0/d9/d16/d2a/d35/d5e/dee/l12a 0 2023-12-16T20:11:45.994 INFO:tasks.workunit.client.1.smithi141.stdout:5/874: readlink d0/dd2/lae 0 2023-12-16T20:11:45.996 INFO:tasks.workunit.client.1.smithi141.stdout:6/947: creat d1/dd/d2f/d48/d127/d131/d85/de5/de8/f132 x:0 0 0 2023-12-16T20:11:45.997 INFO:tasks.workunit.client.1.smithi141.stdout:6/948: symlink d1/d12/d22/d25/dc3/l133 0 2023-12-16T20:11:46.000 INFO:tasks.workunit.client.1.smithi141.stdout:6/949: mknod d1/dd/d2f/d48/d127/d131/d3a/c134 0 2023-12-16T20:11:46.002 INFO:tasks.workunit.client.1.smithi141.stdout:6/950: symlink d1/dd/de/d8a/dd5/l135 0 2023-12-16T20:11:46.004 INFO:tasks.workunit.client.1.smithi141.stdout:6/951: unlink d1/dd/d2f/fb3 0 2023-12-16T20:11:46.004 INFO:tasks.workunit.client.1.smithi141.stdout:6/952: fsync d1/dd/d2f/de6/f128 0 2023-12-16T20:11:46.004 INFO:tasks.workunit.client.1.smithi141.stdout:6/953: chown d1/d77/d9e/fc9 1 1 2023-12-16T20:11:46.006 INFO:tasks.workunit.client.1.smithi141.stdout:6/954: link d1/d5e/d123/d4b/dec/c114 d1/d5e/d123/d4b/d119/c136 0 2023-12-16T20:11:46.006 INFO:tasks.workunit.client.1.smithi141.stdout:6/955: fdatasync d1/dd/d2f/d48/d127/d131/f11a 0 2023-12-16T20:11:46.006 INFO:tasks.workunit.client.1.smithi141.stdout:6/956: truncate d1/dd/d2f/d48/d127/d131/d85/de5/de8/f132 558796 0 2023-12-16T20:11:46.007 INFO:tasks.workunit.client.1.smithi141.stdout:6/957: creat d1/dd/de/d8a/d11e/f137 x:0 0 0 2023-12-16T20:11:46.008 INFO:tasks.workunit.client.1.smithi141.stdout:6/958: chown d1/d12/d22/l40 258883 1 2023-12-16T20:11:46.012 INFO:tasks.workunit.client.1.smithi141.stdout:9/851: dwrite d1/d10/d33/fc2 [0,4194304] 0 2023-12-16T20:11:46.012 INFO:tasks.workunit.client.1.smithi141.stdout:6/959: link d1/d5e/d123/d4b/d60/c8f d1/d5e/d123/d4b/d60/def/d129/c138 0 2023-12-16T20:11:46.016 INFO:tasks.workunit.client.1.smithi141.stdout:6/960: symlink d1/d77/l139 0 2023-12-16T20:11:46.016 INFO:tasks.workunit.client.1.smithi141.stdout:5/875: dwrite d0/d14/f1b [0,4194304] 0 2023-12-16T20:11:46.024 INFO:tasks.workunit.client.1.smithi141.stdout:5/876: unlink d0/d9/d99/d102/f8d 0 2023-12-16T20:11:46.034 INFO:tasks.workunit.client.1.smithi141.stdout:9/852: dwrite d1/d10/d14/d20/da/d3f/f68 [0,4194304] 0 2023-12-16T20:11:46.037 INFO:tasks.workunit.client.1.smithi141.stdout:9/853: rmdir d1/d10/d33/d47/d8d/ddf/dcd/dd3 0 2023-12-16T20:11:46.038 INFO:tasks.workunit.client.1.smithi141.stdout:6/961: getdents d1/dd/d2f 0 2023-12-16T20:11:46.038 INFO:tasks.workunit.client.1.smithi141.stdout:6/962: chown d1/dd/de/d8a/d11e/f137 14 1 2023-12-16T20:11:46.043 INFO:tasks.workunit.client.1.smithi141.stdout:6/963: dread d1/dd/d2f/d48/d127/d131/d3a/f102 [0,4194304] 0 2023-12-16T20:11:46.060 INFO:tasks.workunit.client.1.smithi141.stdout:9/854: dwrite d1/d10/d14/d20/ffd [0,4194304] 0 2023-12-16T20:11:46.065 INFO:tasks.workunit.client.1.smithi141.stdout:9/855: dread d1/d10/d14/f31 [0,4194304] 0 2023-12-16T20:11:46.085 INFO:tasks.workunit.client.1.smithi141.stdout:9/856: dwrite d1/d10/d33/d47/f7f [0,4194304] 0 2023-12-16T20:11:46.085 INFO:tasks.workunit.client.1.smithi141.stdout:9/857: chown d1/d10/d33/d47/d83/ddd/l106 0 1 2023-12-16T20:11:46.107 INFO:tasks.workunit.client.1.smithi141.stdout:9/858: dwrite d1/d10/d33/d47/d8d/ddf/fbe [0,4194304] 0 2023-12-16T20:11:46.108 INFO:tasks.workunit.client.1.smithi141.stdout:9/859: mkdir d1/d10/d14/d20/d90/dca/d119 0 2023-12-16T20:11:46.122 INFO:tasks.workunit.client.1.smithi141.stdout:9/860: dwrite d1/d10/d14/d20/d3b/f118 [0,4194304] 0 2023-12-16T20:11:46.130 INFO:tasks.workunit.client.1.smithi141.stdout:9/861: dread d1/d10/d27/d36/f3a [0,4194304] 0 2023-12-16T20:11:46.131 INFO:tasks.workunit.client.1.smithi141.stdout:9/862: mkdir d1/d26/d4a/d73/d76/d11a 0 2023-12-16T20:11:46.132 INFO:tasks.workunit.client.1.smithi141.stdout:9/863: mkdir d1/d10/d14/d20/d11b 0 2023-12-16T20:11:46.138 INFO:tasks.workunit.client.1.smithi141.stdout:9/864: dread d1/d26/f2f [0,4194304] 0 2023-12-16T20:11:46.140 INFO:tasks.workunit.client.1.smithi141.stdout:9/865: symlink d1/d10/d33/d47/d83/ddd/l11c 0 2023-12-16T20:11:46.155 INFO:tasks.workunit.client.1.smithi141.stdout:9/866: dwrite d1/d10/d27/f4b [4194304,4194304] 0 2023-12-16T20:11:46.157 INFO:tasks.workunit.client.1.smithi141.stdout:9/867: symlink d1/d10/d33/d6a/d72/l11d 0 2023-12-16T20:11:46.157 INFO:tasks.workunit.client.1.smithi141.stdout:9/868: creat d1/d10/f11e x:0 0 0 2023-12-16T20:11:46.159 INFO:tasks.workunit.client.1.smithi141.stdout:9/869: mkdir d1/d10/d33/d47/d8d/dc4/d11f 0 2023-12-16T20:11:46.160 INFO:tasks.workunit.client.1.smithi141.stdout:9/870: mknod d1/d26/d4a/d73/d76/d11a/c120 0 2023-12-16T20:11:46.176 INFO:tasks.workunit.client.1.smithi141.stdout:1/947: sync 2023-12-16T20:11:46.185 INFO:tasks.workunit.client.1.smithi141.stdout:9/871: dwrite d1/d10/d14/d20/da/d3f/dea/d107/f114 [0,4194304] 0 2023-12-16T20:11:46.188 INFO:tasks.workunit.client.1.smithi141.stdout:1/948: dread da/d36/d4b/d4d/d89/d61/f71 [0,4194304] 0 2023-12-16T20:11:46.188 INFO:tasks.workunit.client.1.smithi141.stdout:1/949: chown da/d67/lb5 1 1 2023-12-16T20:11:46.190 INFO:tasks.workunit.client.1.smithi141.stdout:1/950: rename da/d36/d4b/ld6 to da/d36/d4b/d4d/d80/dca/l140 0 2023-12-16T20:11:46.192 INFO:tasks.workunit.client.1.smithi141.stdout:1/951: unlink da/d1a/d31/d81/fc2 0 2023-12-16T20:11:46.194 INFO:tasks.workunit.client.1.smithi141.stdout:1/952: rmdir da/d1a/dd1 39 2023-12-16T20:11:46.195 INFO:tasks.workunit.client.1.smithi141.stdout:9/872: dread d1/d10/d14/d20/da/d3f/dea/d107/f114 [0,4194304] 0 2023-12-16T20:11:46.195 INFO:tasks.workunit.client.1.smithi141.stdout:9/873: fsync d1/d26/d4a/d73/ff6 0 2023-12-16T20:11:46.195 INFO:tasks.workunit.client.1.smithi141.stdout:9/874: chown d1/d10/d27/c2e 1891 1 2023-12-16T20:11:46.198 INFO:tasks.workunit.client.1.smithi141.stdout:9/875: dread d1/d10/d14/d20/d84/fb2 [0,4194304] 0 2023-12-16T20:11:46.198 INFO:tasks.workunit.client.1.smithi141.stdout:9/876: dread - d1/d10/d14/d20/d90/f104 zero size 2023-12-16T20:11:46.198 INFO:tasks.workunit.client.1.smithi141.stdout:9/877: truncate d1/d26/fad 4600292 0 2023-12-16T20:11:46.199 INFO:tasks.workunit.client.1.smithi141.stdout:9/878: truncate d1/d26/d4a/d73/f5e 689961 0 2023-12-16T20:11:46.200 INFO:tasks.workunit.client.1.smithi141.stdout:9/879: symlink d1/d10/d33/d6a/d75/l121 0 2023-12-16T20:11:46.202 INFO:tasks.workunit.client.1.smithi141.stdout:9/880: symlink d1/d26/d4a/dde/dec/l122 0 2023-12-16T20:11:46.202 INFO:tasks.workunit.client.1.smithi141.stdout:1/953: dread da/d36/d4b/d4d/d80/d94/d9d/f130 [0,4194304] 0 2023-12-16T20:11:46.205 INFO:tasks.workunit.client.1.smithi141.stdout:4/894: sync 2023-12-16T20:11:46.205 INFO:tasks.workunit.client.1.smithi141.stdout:7/895: sync 2023-12-16T20:11:46.205 INFO:tasks.workunit.client.1.smithi141.stdout:0/807: sync 2023-12-16T20:11:46.205 INFO:tasks.workunit.client.1.smithi141.stdout:4/895: read d1a/d3c/f65 [2280262,90222] 0 2023-12-16T20:11:46.205 INFO:tasks.workunit.client.1.smithi141.stdout:4/896: fdatasync d1a/d59/d89/f119 0 2023-12-16T20:11:46.206 INFO:tasks.workunit.client.1.smithi141.stdout:7/896: link d5/d16/de3/d89/d9b/dd4/lfb d5/d16/d30/d36/l129 0 2023-12-16T20:11:46.208 INFO:tasks.workunit.client.1.smithi141.stdout:4/897: unlink d1a/d4e/d63/dd1/fd9 0 2023-12-16T20:11:46.209 INFO:tasks.workunit.client.1.smithi141.stdout:7/897: getdents d5/d16/de3/d89/d9b 0 2023-12-16T20:11:46.209 INFO:tasks.workunit.client.1.smithi141.stdout:7/898: write d5/d16/d30/d36/d8c/dfa/f11b [310481,22236] 0 2023-12-16T20:11:46.210 INFO:tasks.workunit.client.1.smithi141.stdout:4/898: symlink d1a/d3c/d9b/l14c 0 2023-12-16T20:11:46.210 INFO:tasks.workunit.client.1.smithi141.stdout:4/899: write d1a/d2a/d3b/d69/f147 [451643,49852] 0 2023-12-16T20:11:46.213 INFO:tasks.workunit.client.1.smithi141.stdout:7/899: mkdir d5/d16/de3/d89/d9b/d12a 0 2023-12-16T20:11:46.214 INFO:tasks.workunit.client.1.smithi141.stdout:0/808: write d4/d49/d73/d3b/f84 [3592350,117085] 0 2023-12-16T20:11:46.215 INFO:tasks.workunit.client.1.smithi141.stdout:0/809: creat d4/d49/d73/f115 x:0 0 0 2023-12-16T20:11:46.215 INFO:tasks.workunit.client.1.smithi141.stdout:0/810: chown d4/d49/da1/dbd/fc4 1990450 1 2023-12-16T20:11:46.220 INFO:tasks.workunit.client.1.smithi141.stdout:0/811: unlink d4/d49/d73/f5b 0 2023-12-16T20:11:46.246 INFO:tasks.workunit.client.1.smithi141.stdout:4/900: dwrite d1a/d4e/d63/dd1/ffd [0,4194304] 0 2023-12-16T20:11:46.246 INFO:tasks.workunit.client.1.smithi141.stdout:1/954: dwrite da/d36/d4b/d4d/d80/d94/f11d [0,4194304] 0 2023-12-16T20:11:46.247 INFO:tasks.workunit.client.1.smithi141.stdout:1/955: creat da/d36/d4b/db2/f141 x:0 0 0 2023-12-16T20:11:46.247 INFO:tasks.workunit.client.1.smithi141.stdout:4/901: rmdir d1a/d54/d87 39 2023-12-16T20:11:46.247 INFO:tasks.workunit.client.1.smithi141.stdout:4/902: dread - d1a/f124 zero size 2023-12-16T20:11:46.247 INFO:tasks.workunit.client.1.smithi141.stdout:9/881: dwrite d1/d26/d4a/f94 [0,4194304] 0 2023-12-16T20:11:46.248 INFO:tasks.workunit.client.1.smithi141.stdout:0/812: dwrite d4/d49/d73/d3b/d78/d7f/f8c [0,4194304] 0 2023-12-16T20:11:46.248 INFO:tasks.workunit.client.1.smithi141.stdout:7/900: dwrite d5/d16/de3/d89/fd8 [4194304,4194304] 0 2023-12-16T20:11:46.250 INFO:tasks.workunit.client.1.smithi141.stdout:1/956: mkdir da/d1a/db0/dd3/df6/d142 0 2023-12-16T20:11:46.250 INFO:tasks.workunit.client.1.smithi141.stdout:1/957: chown da/d1a/f7b 855431 1 2023-12-16T20:11:46.250 INFO:tasks.workunit.client.1.smithi141.stdout:4/903: symlink d1a/d4e/d63/daa/db9/l14d 0 2023-12-16T20:11:46.255 INFO:tasks.workunit.client.1.smithi141.stdout:0/813: mkdir d4/d49/d73/d3b/d78/d7f/d80/d116 0 2023-12-16T20:11:46.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/958: read da/d36/f96 [2979469,87741] 0 2023-12-16T20:11:46.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/959: read - da/d1a/d1d/d22/f121 zero size 2023-12-16T20:11:46.256 INFO:tasks.workunit.client.1.smithi141.stdout:1/960: chown da/d67/f26 22557972 1 2023-12-16T20:11:46.257 INFO:tasks.workunit.client.1.smithi141.stdout:9/882: symlink d1/l123 0 2023-12-16T20:11:46.259 INFO:tasks.workunit.client.1.smithi141.stdout:0/814: dread d4/d49/f5a [0,4194304] 0 2023-12-16T20:11:46.260 INFO:tasks.workunit.client.1.smithi141.stdout:0/815: write d4/d49/da1/df3/f66 [5038062,14707] 0 2023-12-16T20:11:46.261 INFO:tasks.workunit.client.1.smithi141.stdout:7/901: read d5/d16/f83 [230578,17390] 0 2023-12-16T20:11:46.261 INFO:tasks.workunit.client.1.smithi141.stdout:0/816: read d4/d49/d73/d3b/d78/d7f/fcf [349700,782] 0 2023-12-16T20:11:46.263 INFO:tasks.workunit.client.1.smithi141.stdout:7/902: mkdir d5/d16/d30/d36/d12b 0 2023-12-16T20:11:46.266 INFO:tasks.workunit.client.1.smithi141.stdout:0/817: truncate d4/d49/d73/d8a/f91 4308758 0 2023-12-16T20:11:46.268 INFO:tasks.workunit.client.1.smithi141.stdout:0/818: creat d4/d49/db9/dcd/de8/f117 x:0 0 0 2023-12-16T20:11:46.277 INFO:tasks.workunit.client.1.smithi141.stdout:0/819: write d4/d7/db0/ffb [2759779,35663] 0 2023-12-16T20:11:46.277 INFO:tasks.workunit.client.1.smithi141.stdout:4/904: dwrite d1a/d2a/d3b/f45 [0,4194304] 0 2023-12-16T20:11:46.280 INFO:tasks.workunit.client.1.smithi141.stdout:7/903: dwrite d5/f8d [0,4194304] 0 2023-12-16T20:11:46.280 INFO:tasks.workunit.client.1.smithi141.stdout:0/820: rename d4/l28 to d4/d49/db9/dcd/de8/l118 0 2023-12-16T20:11:46.281 INFO:tasks.workunit.client.1.smithi141.stdout:7/904: chown d5/d16/d30/l8a 3005 1 2023-12-16T20:11:46.282 INFO:tasks.workunit.client.1.smithi141.stdout:7/905: write d5/d16/de3/d1e/d71/ddf/ffd [381147,76950] 0 2023-12-16T20:11:46.282 INFO:tasks.workunit.client.1.smithi141.stdout:7/906: chown d5/d2a/f3d 99184 1 2023-12-16T20:11:46.283 INFO:tasks.workunit.client.1.smithi141.stdout:7/907: rename d5/d16/f75 to d5/d16/de3/d1e/d71/f12c 0 2023-12-16T20:11:46.283 INFO:tasks.workunit.client.1.smithi141.stdout:7/908: write d5/d2a/f113 [794416,122997] 0 2023-12-16T20:11:46.284 INFO:tasks.workunit.client.1.smithi141.stdout:7/909: rmdir d5/d16/d30/d36/d8c/d122 39 2023-12-16T20:11:46.287 INFO:tasks.workunit.client.1.smithi141.stdout:7/910: mknod d5/d16/de3/d89/d9b/c12d 0 2023-12-16T20:11:46.287 INFO:tasks.workunit.client.1.smithi141.stdout:7/911: chown d5/d16/d30/d4e/d6e/c124 3952444 1 2023-12-16T20:11:46.296 INFO:tasks.workunit.client.1.smithi141.stdout:0/821: write d4/d49/da1/df3/f53 [3438738,9754] 0 2023-12-16T20:11:46.298 INFO:tasks.workunit.client.1.smithi141.stdout:0/822: read d4/d49/f52 [627393,76264] 0 2023-12-16T20:11:46.304 INFO:tasks.workunit.client.1.smithi141.stdout:7/912: dwrite d5/d16/d1a/f25 [0,4194304] 0 2023-12-16T20:11:46.304 INFO:tasks.workunit.client.1.smithi141.stdout:7/913: write d5/d16/d30/d4e/f8f [874377,33880] 0 2023-12-16T20:11:46.304 INFO:tasks.workunit.client.1.smithi141.stdout:7/914: write d5/d16/d46/d61/f6b [4991938,110734] 0 2023-12-16T20:11:46.307 INFO:tasks.workunit.client.1.smithi141.stdout:7/915: readlink d5/d16/de3/d89/d9b/dd4/d104/l108 0 2023-12-16T20:11:46.308 INFO:tasks.workunit.client.1.smithi141.stdout:7/916: rmdir d5/d2a/d45/dae 39 2023-12-16T20:11:46.318 INFO:tasks.workunit.client.1.smithi141.stdout:0/823: dwrite d4/d49/d73/d3b/f7a [0,4194304] 0 2023-12-16T20:11:46.318 INFO:tasks.workunit.client.1.smithi141.stdout:0/824: dread - d4/d49/da1/fb8 zero size 2023-12-16T20:11:46.319 INFO:tasks.workunit.client.1.smithi141.stdout:0/825: unlink d4/d49/d73/d3b/f7a 0 2023-12-16T20:11:46.320 INFO:tasks.workunit.client.1.smithi141.stdout:0/826: mknod d4/d49/da1/df3/da3/c119 0 2023-12-16T20:11:46.322 INFO:tasks.workunit.client.1.smithi141.stdout:0/827: rmdir d4/d5c 39 2023-12-16T20:11:46.323 INFO:tasks.workunit.client.1.smithi141.stdout:0/828: getdents d4/d49/d73/d3b/ded 0 2023-12-16T20:11:46.335 INFO:tasks.workunit.client.1.smithi141.stdout:7/917: dwrite d5/d16/d30/f57 [0,4194304] 0 2023-12-16T20:11:46.335 INFO:tasks.workunit.client.1.smithi141.stdout:7/918: write d5/d16/d1a/d40/dab/dd5/fed [4630418,57703] 0 2023-12-16T20:11:46.336 INFO:tasks.workunit.client.1.smithi141.stdout:7/919: symlink d5/d16/d30/d36/d12b/l12e 0 2023-12-16T20:11:46.345 INFO:tasks.workunit.client.1.smithi141.stdout:0/829: dwrite d4/d49/da1/df3/f66 [0,4194304] 0 2023-12-16T20:11:46.345 INFO:tasks.workunit.client.1.smithi141.stdout:0/830: stat d4/d7/f10e 0 2023-12-16T20:11:46.348 INFO:tasks.workunit.client.1.smithi141.stdout:0/831: unlink d4/d49/db9/fc5 0 2023-12-16T20:11:46.350 INFO:tasks.workunit.client.1.smithi141.stdout:0/832: rmdir d4/d49/d8f/d10c 39 2023-12-16T20:11:46.350 INFO:tasks.workunit.client.1.smithi141.stdout:0/833: chown d4/d7/f100 203 1 2023-12-16T20:11:46.351 INFO:tasks.workunit.client.1.smithi141.stdout:0/834: creat d4/d49/d73/d3b/d78/d7f/f11a x:0 0 0 2023-12-16T20:11:46.354 INFO:tasks.workunit.client.1.smithi141.stdout:7/920: dwrite d5/d16/d30/d4e/f8f [0,4194304] 0 2023-12-16T20:11:46.377 INFO:tasks.workunit.client.1.smithi141.stdout:0/835: dwrite d4/d7/f50 [0,4194304] 0 2023-12-16T20:11:46.377 INFO:tasks.workunit.client.1.smithi141.stdout:0/836: write d4/d49/d73/d3b/f59 [4888646,67385] 0 2023-12-16T20:11:46.377 INFO:tasks.workunit.client.1.smithi141.stdout:7/921: dwrite d5/d2a/f2d [0,4194304] 0 2023-12-16T20:11:46.379 INFO:tasks.workunit.client.1.smithi141.stdout:7/922: unlink d5/cb 0 2023-12-16T20:11:46.382 INFO:tasks.workunit.client.1.smithi141.stdout:7/923: link d5/d2a/d45/ffc d5/d16/d30/f12f 0 2023-12-16T20:11:46.382 INFO:tasks.workunit.client.1.smithi141.stdout:7/924: chown d5/d2a/f10a 417 1 2023-12-16T20:11:46.394 INFO:tasks.workunit.client.1.smithi141.stdout:0/837: dwrite d4/d49/d73/d3b/d78/d7f/d80/d83/f89 [4194304,4194304] 0 2023-12-16T20:11:46.395 INFO:tasks.workunit.client.1.smithi141.stdout:0/838: symlink d4/d7/db0/ddb/l11b 0 2023-12-16T20:11:46.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/839: dread d4/d49/d73/d3b/f79 [0,4194304] 0 2023-12-16T20:11:46.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/840: truncate d4/d7/fb3 770198 0 2023-12-16T20:11:46.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/841: fdatasync d4/d5c/f87 0 2023-12-16T20:11:46.397 INFO:tasks.workunit.client.1.smithi141.stdout:0/842: chown d4/d49/d73/d8a/da4/dcc/f108 17487674 1 2023-12-16T20:11:46.398 INFO:tasks.workunit.client.1.smithi141.stdout:0/843: creat d4/d49/da1/df3/da3/f11c x:0 0 0 2023-12-16T20:11:46.398 INFO:tasks.workunit.client.1.smithi141.stdout:0/844: readlink d4/l2d 0 2023-12-16T20:11:46.399 INFO:tasks.workunit.client.1.smithi141.stdout:7/925: dwrite d5/d16/d46/d102/f128 [0,4194304] 0 2023-12-16T20:11:46.399 INFO:tasks.workunit.client.1.smithi141.stdout:7/926: readlink d5/d16/d1a/dd7/de6/l118 0 2023-12-16T20:11:46.399 INFO:tasks.workunit.client.1.smithi141.stdout:0/845: creat d4/d49/d73/d3b/d78/d7f/d80/d83/f11d x:0 0 0 2023-12-16T20:11:46.399 INFO:tasks.workunit.client.1.smithi141.stdout:0/846: chown d4/d74/dc1/la8 4546 1 2023-12-16T20:11:46.402 INFO:tasks.workunit.client.1.smithi141.stdout:0/847: mkdir d4/d7/db0/ddb/dfc/d11e 0 2023-12-16T20:11:46.418 INFO:tasks.workunit.client.1.smithi141.stdout:0/848: dwrite d4/d7/fb3 [0,4194304] 0 2023-12-16T20:11:46.421 INFO:tasks.workunit.client.1.smithi141.stdout:0/849: symlink d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/l11f 0 2023-12-16T20:11:46.421 INFO:tasks.workunit.client.1.smithi141.stdout:0/850: fsync d4/d7/db0/ffb 0 2023-12-16T20:11:46.421 INFO:tasks.workunit.client.1.smithi141.stdout:0/851: stat d4/d5c/l65 0 2023-12-16T20:11:46.421 INFO:tasks.workunit.client.1.smithi141.stdout:0/852: write d4/d49/d73/d3b/d78/d7f/fcf [1434940,17956] 0 2023-12-16T20:11:46.424 INFO:tasks.workunit.client.1.smithi141.stdout:0/853: rmdir d4/d49/d73/d3b/d78/d7f 39 2023-12-16T20:11:46.440 INFO:tasks.workunit.client.1.smithi141.stdout:0/854: dwrite d4/d49/d73/d3b/d78/f4f [0,4194304] 0 2023-12-16T20:11:46.449 INFO:tasks.workunit.client.1.smithi141.stdout:0/855: write d4/d49/da1/df3/f66 [1769730,98771] 0 2023-12-16T20:11:46.450 INFO:tasks.workunit.client.1.smithi141.stdout:0/856: rmdir d4/d49/d73/d3b/d78/d7f/d80/d83/ddd 39 2023-12-16T20:11:46.458 INFO:tasks.workunit.client.1.smithi141.stdout:0/857: write d4/d5c/f72 [1770623,89665] 0 2023-12-16T20:11:46.458 INFO:tasks.workunit.client.1.smithi141.stdout:0/858: chown d4/d74/l7c 398177 1 2023-12-16T20:11:46.459 INFO:tasks.workunit.client.1.smithi141.stdout:0/859: symlink d4/d7/db0/l120 0 2023-12-16T20:11:46.460 INFO:tasks.workunit.client.1.smithi141.stdout:0/860: link d4/d7/f50 d4/d49/db9/dcd/de8/f121 0 2023-12-16T20:11:46.461 INFO:tasks.workunit.client.1.smithi141.stdout:0/861: link d4/d49/da1/df3/f9d d4/d49/d73/df4/f122 0 2023-12-16T20:11:46.462 INFO:tasks.workunit.client.1.smithi141.stdout:0/862: symlink d4/d7/db0/ddb/dfc/d11e/l123 0 2023-12-16T20:11:46.462 INFO:tasks.workunit.client.1.smithi141.stdout:0/863: stat d4/l1a 0 2023-12-16T20:11:46.462 INFO:tasks.workunit.client.1.smithi141.stdout:0/864: truncate d4/d49/da1/df3/da3/f11c 1023288 0 2023-12-16T20:11:46.463 INFO:tasks.workunit.client.1.smithi141.stdout:0/865: stat d4/d5c/f87 0 2023-12-16T20:11:46.463 INFO:tasks.workunit.client.1.smithi141.stdout:0/866: dread d4/d49/da1/df3/da3/f11c [0,4194304] 0 2023-12-16T20:11:46.482 INFO:tasks.workunit.client.1.smithi141.stdout:0/867: dwrite d4/d74/dc1/fa0 [0,4194304] 0 2023-12-16T20:11:46.505 INFO:tasks.workunit.client.1.smithi141.stdout:0/868: dwrite d4/d49/da1/fb8 [0,4194304] 0 2023-12-16T20:11:46.513 INFO:tasks.workunit.client.1.smithi141.stdout:0/869: write d4/d49/d73/d8a/f91 [2100112,60636] 0 2023-12-16T20:11:46.513 INFO:tasks.workunit.client.1.smithi141.stdout:0/870: write d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 [4485954,76365] 0 2023-12-16T20:11:46.513 INFO:tasks.workunit.client.1.smithi141.stdout:0/871: truncate d4/d49/db9/dcd/de8/f117 316182 0 2023-12-16T20:11:46.514 INFO:tasks.workunit.client.1.smithi141.stdout:0/872: symlink d4/d49/da1/df3/da3/dfa/l124 0 2023-12-16T20:11:46.514 INFO:tasks.workunit.client.1.smithi141.stdout:0/873: fsync d4/d5c/fd5 0 2023-12-16T20:11:46.515 INFO:tasks.workunit.client.1.smithi141.stdout:0/874: rmdir d4/d7/db0/ddb/dfc 39 2023-12-16T20:11:46.515 INFO:tasks.workunit.client.1.smithi141.stdout:0/875: write d4/d49/d73/df4/f122 [534012,41322] 0 2023-12-16T20:11:46.515 INFO:tasks.workunit.client.1.smithi141.stdout:0/876: truncate d4/d74/dc1/dbe/fde 3126340 0 2023-12-16T20:11:46.520 INFO:tasks.workunit.client.1.smithi141.stdout:0/877: dread d4/d7/db0/ffb [0,4194304] 0 2023-12-16T20:11:46.521 INFO:tasks.workunit.client.1.smithi141.stdout:0/878: creat d4/d49/d73/d3b/d78/d7f/d80/d116/f125 x:0 0 0 2023-12-16T20:11:46.521 INFO:tasks.workunit.client.1.smithi141.stdout:0/879: truncate d4/d49/d73/d3b/d78/d7f/f11a 705392 0 2023-12-16T20:11:46.521 INFO:tasks.workunit.client.1.smithi141.stdout:0/880: chown d4/d49/d8f 19274 1 2023-12-16T20:11:46.521 INFO:tasks.workunit.client.1.smithi141.stdout:0/881: write d4/d7/f1e [3749744,67861] 0 2023-12-16T20:11:46.524 INFO:tasks.workunit.client.1.smithi141.stdout:0/882: truncate d4/d49/d73/d8a/f91 3486370 0 2023-12-16T20:11:46.525 INFO:tasks.workunit.client.1.smithi141.stdout:0/883: creat d4/f126 x:0 0 0 2023-12-16T20:11:46.525 INFO:tasks.workunit.client.1.smithi141.stdout:0/884: fsync d4/d7/f10e 0 2023-12-16T20:11:46.527 INFO:tasks.workunit.client.1.smithi141.stdout:0/885: mkdir d4/d49/d73/d8a/da4/dcc/d127 0 2023-12-16T20:11:46.527 INFO:tasks.workunit.client.1.smithi141.stdout:0/886: chown d4/d49/d73/d3b/d78/d7f 64072 1 2023-12-16T20:11:46.528 INFO:tasks.workunit.client.1.smithi141.stdout:0/887: symlink d4/d49/d73/df4/l128 0 2023-12-16T20:11:46.529 INFO:tasks.workunit.client.1.smithi141.stdout:0/888: symlink d4/d49/d73/df4/l129 0 2023-12-16T20:11:46.531 INFO:tasks.workunit.client.1.smithi141.stdout:0/889: link d4/d7/l29 d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/l12a 0 2023-12-16T20:11:46.531 INFO:tasks.workunit.client.1.smithi141.stdout:0/890: write d4/d49/d73/d3b/d78/fc2 [233064,70700] 0 2023-12-16T20:11:46.551 INFO:tasks.workunit.client.1.smithi141.stdout:0/891: dwrite d4/f33 [0,4194304] 0 2023-12-16T20:11:46.560 INFO:tasks.workunit.client.1.smithi141.stdout:0/892: dread d4/d49/d73/d3b/f59 [0,4194304] 0 2023-12-16T20:11:46.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:46 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi038 to 1559M 2023-12-16T20:11:46.707 INFO:tasks.workunit.client.1.smithi141.stdout:6/964: sync 2023-12-16T20:11:46.707 INFO:tasks.workunit.client.1.smithi141.stdout:5/877: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:2/796: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:9/883: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:1/961: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:4/905: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:4/906: dread - d1a/d2a/d3b/db2/f12e zero size 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:4/907: dread - d1a/d54/d87/da8/da9/f11a zero size 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:2/797: write d6/da/d1b/d5b/d6a/d85/f9c [1740523,22596] 0 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:7/927: sync 2023-12-16T20:11:46.708 INFO:tasks.workunit.client.1.smithi141.stdout:0/893: sync 2023-12-16T20:11:46.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/878: unlink d0/d9/d99/d102/dc3/ca9 0 2023-12-16T20:11:46.709 INFO:tasks.workunit.client.1.smithi141.stdout:5/879: chown d0/d9/d16/fac 28271806 1 2023-12-16T20:11:46.710 INFO:tasks.workunit.client.1.smithi141.stdout:6/965: creat d1/d12/d22/d25/d38/f13a x:0 0 0 2023-12-16T20:11:46.712 INFO:tasks.workunit.client.1.smithi141.stdout:4/908: unlink d1a/d4e/d63/dd1/fdc 0 2023-12-16T20:11:46.714 INFO:tasks.workunit.client.1.smithi141.stdout:4/909: mknod d1a/d3c/d9b/da1/dcf/c14e 0 2023-12-16T20:11:46.714 INFO:tasks.workunit.client.1.smithi141.stdout:4/910: fsync d1a/d54/d87/fe1 0 2023-12-16T20:11:46.715 INFO:tasks.workunit.client.1.smithi141.stdout:9/884: dread d1/d10/d14/d20/da/d3f/dea/d107/f114 [0,4194304] 0 2023-12-16T20:11:46.716 INFO:tasks.workunit.client.1.smithi141.stdout:4/911: symlink d1a/d2a/dc2/l14f 0 2023-12-16T20:11:46.722 INFO:tasks.workunit.client.1.smithi141.stdout:2/798: dread d6/d12/d15/f4c [0,4194304] 0 2023-12-16T20:11:46.727 INFO:tasks.workunit.client.1.smithi141.stdout:2/799: link d6/d12/d1f/d46/f6b d6/d3a/d47/d58/f10a 0 2023-12-16T20:11:46.727 INFO:tasks.workunit.client.1.smithi141.stdout:2/800: fdatasync d6/d12/d15/fa7 0 2023-12-16T20:11:46.728 INFO:tasks.workunit.client.1.smithi141.stdout:6/966: dread d1/d12/d22/d25/fa7 [0,4194304] 0 2023-12-16T20:11:46.731 INFO:tasks.workunit.client.1.smithi141.stdout:6/967: getdents d1/d77/d9e 0 2023-12-16T20:11:46.734 INFO:tasks.workunit.client.1.smithi141.stdout:6/968: symlink d1/dd/l13b 0 2023-12-16T20:11:46.735 INFO:tasks.workunit.client.1.smithi141.stdout:6/969: write d1/dd/d2f/d48/d127/d131/d44/f103 [3882650,6155] 0 2023-12-16T20:11:46.735 INFO:tasks.workunit.client.1.smithi141.stdout:6/970: read d1/d77/d9e/fc9 [1326441,76946] 0 2023-12-16T20:11:46.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/801: write d6/da/d1b/d5b/f78 [2696846,3160] 0 2023-12-16T20:11:46.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/802: readlink d6/da/l3f 0 2023-12-16T20:11:46.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:46 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi038 to 1559M 2023-12-16T20:11:46.775 INFO:tasks.workunit.client.1.smithi141.stdout:9/885: dwrite d1/d26/d4a/d73/f4e [0,4194304] 0 2023-12-16T20:11:46.775 INFO:tasks.workunit.client.1.smithi141.stdout:4/912: dwrite d1a/d2a/d3b/fb5 [0,4194304] 0 2023-12-16T20:11:46.775 INFO:tasks.workunit.client.1.smithi141.stdout:7/928: dwrite d5/d16/d30/d4e/f62 [0,4194304] 0 2023-12-16T20:11:46.775 INFO:tasks.workunit.client.1.smithi141.stdout:7/929: dread - d5/d16/de3/d1e/f106 zero size 2023-12-16T20:11:46.776 INFO:tasks.workunit.client.1.smithi141.stdout:0/894: dwrite d4/d49/d73/d3b/d78/d7f/f11a [0,4194304] 0 2023-12-16T20:11:46.776 INFO:tasks.workunit.client.1.smithi141.stdout:5/880: dwrite d0/d25/d30/d8a/fb1 [0,4194304] 0 2023-12-16T20:11:46.776 INFO:tasks.workunit.client.1.smithi141.stdout:1/962: dwrite da/d36/d4b/d4d/dd7/de1/d111/d11b/f132 [0,4194304] 0 2023-12-16T20:11:46.777 INFO:tasks.workunit.client.1.smithi141.stdout:2/803: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:46.778 INFO:tasks.workunit.client.1.smithi141.stdout:7/930: getdents d5/d16/d30/d36/d12b 0 2023-12-16T20:11:46.781 INFO:tasks.workunit.client.1.smithi141.stdout:5/881: mknod d0/d25/d30/d67/c12d 0 2023-12-16T20:11:46.781 INFO:tasks.workunit.client.1.smithi141.stdout:5/882: truncate d0/d9/d16/d2a/d35/d5e/f6b 767690 0 2023-12-16T20:11:46.786 INFO:tasks.workunit.client.1.smithi141.stdout:7/931: creat d5/d16/d1a/d40/dcb/f130 x:0 0 0 2023-12-16T20:11:46.786 INFO:tasks.workunit.client.1.smithi141.stdout:4/913: dread d1a/d3c/f5d [0,4194304] 0 2023-12-16T20:11:46.786 INFO:tasks.workunit.client.1.smithi141.stdout:1/963: dread da/d1a/d1d/d22/f9b [0,4194304] 0 2023-12-16T20:11:46.786 INFO:tasks.workunit.client.1.smithi141.stdout:1/964: chown da/d1a/d31/d81/db6 225978428 1 2023-12-16T20:11:46.788 INFO:tasks.workunit.client.1.smithi141.stdout:9/886: write d1/d10/d33/f8b [3551770,32827] 0 2023-12-16T20:11:46.788 INFO:tasks.workunit.client.1.smithi141.stdout:9/887: getdents d1/d10/d14/d20/da/d10f 0 2023-12-16T20:11:46.789 INFO:tasks.workunit.client.1.smithi141.stdout:1/965: creat da/d1a/d1d/d33/dcd/f143 x:0 0 0 2023-12-16T20:11:46.790 INFO:tasks.workunit.client.1.smithi141.stdout:2/804: dread d6/d32/d52/fa2 [0,4194304] 0 2023-12-16T20:11:46.791 INFO:tasks.workunit.client.1.smithi141.stdout:5/883: dread d0/d25/dce/dd1/fd5 [0,4194304] 0 2023-12-16T20:11:46.791 INFO:tasks.workunit.client.1.smithi141.stdout:5/884: stat d0/d9/d99/d102/ffc 0 2023-12-16T20:11:46.791 INFO:tasks.workunit.client.1.smithi141.stdout:5/885: creat d0/d14/d75/f12e x:0 0 0 2023-12-16T20:11:46.792 INFO:tasks.workunit.client.1.smithi141.stdout:2/805: mknod d6/d3a/dd5/c10b 0 2023-12-16T20:11:46.793 INFO:tasks.workunit.client.1.smithi141.stdout:5/886: mknod d0/c12f 0 2023-12-16T20:11:46.796 INFO:tasks.workunit.client.1.smithi141.stdout:5/887: rename d0/d9/d16/l56 to d0/dd2/l130 0 2023-12-16T20:11:46.797 INFO:tasks.workunit.client.1.smithi141.stdout:2/806: getdents d6/d12/d15 0 2023-12-16T20:11:46.798 INFO:tasks.workunit.client.1.smithi141.stdout:5/888: mknod d0/d14/d2c/d90/c131 0 2023-12-16T20:11:46.800 INFO:tasks.workunit.client.1.smithi141.stdout:2/807: unlink d6/d32/d7a/d5f/fb3 0 2023-12-16T20:11:46.802 INFO:tasks.workunit.client.1.smithi141.stdout:7/932: dread d5/d16/de3/d1e/d71/f8e [0,4194304] 0 2023-12-16T20:11:46.802 INFO:tasks.workunit.client.1.smithi141.stdout:0/895: dwrite d4/d7/f24 [0,4194304] 0 2023-12-16T20:11:46.802 INFO:tasks.workunit.client.1.smithi141.stdout:5/889: creat d0/d9/d16/d2a/d35/d5e/dee/f132 x:0 0 0 2023-12-16T20:11:46.802 INFO:tasks.workunit.client.1.smithi141.stdout:9/888: dread d1/d26/d4a/d73/fc5 [0,4194304] 0 2023-12-16T20:11:46.803 INFO:tasks.workunit.client.1.smithi141.stdout:7/933: symlink d5/d16/de3/deb/l131 0 2023-12-16T20:11:46.803 INFO:tasks.workunit.client.1.smithi141.stdout:7/934: chown d5/d16/d1a/d40/dab/dd5/lf5 15 1 2023-12-16T20:11:46.803 INFO:tasks.workunit.client.1.smithi141.stdout:7/935: stat d5/d16/d46/d61/l9e 0 2023-12-16T20:11:46.803 INFO:tasks.workunit.client.1.smithi141.stdout:7/936: write d5/d16/de3/d89/f95 [782520,59413] 0 2023-12-16T20:11:46.805 INFO:tasks.workunit.client.1.smithi141.stdout:1/966: dread da/d1a/d1d/d33/f4e [0,4194304] 0 2023-12-16T20:11:46.805 INFO:tasks.workunit.client.1.smithi141.stdout:4/914: dwrite d1a/d2a/d3b/fb5 [4194304,4194304] 0 2023-12-16T20:11:46.805 INFO:tasks.workunit.client.1.smithi141.stdout:1/967: chown da/d1a/d1d/d33/dcd 4334908 1 2023-12-16T20:11:46.805 INFO:tasks.workunit.client.1.smithi141.stdout:4/915: write d1a/d2a/d3b/d69/df0/f137 [578861,130378] 0 2023-12-16T20:11:46.805 INFO:tasks.workunit.client.1.smithi141.stdout:5/890: mknod d0/d12b/c133 0 2023-12-16T20:11:46.806 INFO:tasks.workunit.client.1.smithi141.stdout:9/889: mkdir d1/d10/d33/d47/d8d/ddf/de6/d124 0 2023-12-16T20:11:46.809 INFO:tasks.workunit.client.1.smithi141.stdout:0/896: mkdir d4/d7/d12b 0 2023-12-16T20:11:46.810 INFO:tasks.workunit.client.1.smithi141.stdout:1/968: mknod da/d1a/d1d/d22/c144 0 2023-12-16T20:11:46.810 INFO:tasks.workunit.client.1.smithi141.stdout:1/969: creat da/d76/f145 x:0 0 0 2023-12-16T20:11:46.810 INFO:tasks.workunit.client.1.smithi141.stdout:1/970: write da/d36/d4b/db2/f141 [950197,77338] 0 2023-12-16T20:11:46.810 INFO:tasks.workunit.client.1.smithi141.stdout:4/916: creat d1a/d4e/d63/daa/f150 x:0 0 0 2023-12-16T20:11:46.813 INFO:tasks.workunit.client.1.smithi141.stdout:4/917: mknod d1a/d4e/d63/dd1/c151 0 2023-12-16T20:11:46.813 INFO:tasks.workunit.client.1.smithi141.stdout:4/918: truncate d1a/d54/d87/da8/f7d 317047 0 2023-12-16T20:11:46.813 INFO:tasks.workunit.client.1.smithi141.stdout:4/919: readlink d1a/d2a/d3b/dcd/d128/l136 0 2023-12-16T20:11:46.814 INFO:tasks.workunit.client.1.smithi141.stdout:9/890: rename d1/la7 to d1/d26/d3c/d9b/l125 0 2023-12-16T20:11:46.819 INFO:tasks.workunit.client.1.smithi141.stdout:5/891: dread d0/d25/d30/d67/f58 [0,4194304] 0 2023-12-16T20:11:46.821 INFO:tasks.workunit.client.1.smithi141.stdout:5/892: unlink d0/d25/d30/d67/cd0 0 2023-12-16T20:11:46.821 INFO:tasks.workunit.client.1.smithi141.stdout:5/893: truncate d0/d14/d2c/d4a/f118 210916 0 2023-12-16T20:11:46.822 INFO:tasks.workunit.client.1.smithi141.stdout:5/894: write d0/dd2/fe9 [901435,52329] 0 2023-12-16T20:11:46.823 INFO:tasks.workunit.client.1.smithi141.stdout:4/920: write d1a/f1b [5280909,45065] 0 2023-12-16T20:11:46.825 INFO:tasks.workunit.client.1.smithi141.stdout:1/971: dread da/d36/d4b/d4d/d89/f37 [0,4194304] 0 2023-12-16T20:11:46.828 INFO:tasks.workunit.client.1.smithi141.stdout:1/972: unlink da/d36/d4b/f63 0 2023-12-16T20:11:46.828 INFO:tasks.workunit.client.1.smithi141.stdout:1/973: dread - da/d36/d4b/d4d/d80/d94/f13e zero size 2023-12-16T20:11:46.830 INFO:tasks.workunit.client.1.smithi141.stdout:1/974: getdents da/d1a/db0 0 2023-12-16T20:11:46.835 INFO:tasks.workunit.client.1.smithi141.stdout:4/921: write d1a/d2a/d3b/fb5 [3638311,82170] 0 2023-12-16T20:11:46.836 INFO:tasks.workunit.client.1.smithi141.stdout:4/922: write d1a/d4e/d63/f77 [61784,110887] 0 2023-12-16T20:11:46.837 INFO:tasks.workunit.client.1.smithi141.stdout:4/923: symlink d1a/d54/d87/da8/l152 0 2023-12-16T20:11:46.838 INFO:tasks.workunit.client.1.smithi141.stdout:4/924: fdatasync f19 0 2023-12-16T20:11:46.840 INFO:tasks.workunit.client.1.smithi141.stdout:9/891: dwrite d1/d10/d33/d47/d83/ddd/fed [0,4194304] 0 2023-12-16T20:11:46.840 INFO:tasks.workunit.client.1.smithi141.stdout:0/897: dwrite d4/d49/d73/d3b/f10b [0,4194304] 0 2023-12-16T20:11:46.841 INFO:tasks.workunit.client.1.smithi141.stdout:2/808: dwrite d6/d12/d15/f4c [0,4194304] 0 2023-12-16T20:11:46.841 INFO:tasks.workunit.client.1.smithi141.stdout:2/809: read d6/da/d1b/d5b/faa [495107,19142] 0 2023-12-16T20:11:46.845 INFO:tasks.workunit.client.1.smithi141.stdout:9/892: symlink d1/d10/d14/d20/da/d3f/d66/l126 0 2023-12-16T20:11:46.846 INFO:tasks.workunit.client.1.smithi141.stdout:2/810: write d6/d32/d52/fa2 [4202980,15830] 0 2023-12-16T20:11:46.849 INFO:tasks.workunit.client.1.smithi141.stdout:4/925: read fd [498509,90245] 0 2023-12-16T20:11:46.849 INFO:tasks.workunit.client.1.smithi141.stdout:5/895: dwrite d0/f50 [0,4194304] 0 2023-12-16T20:11:46.849 INFO:tasks.workunit.client.1.smithi141.stdout:5/896: stat d0/d14/d98 0 2023-12-16T20:11:46.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/893: symlink d1/d10/d14/d20/d90/dca/d119/l127 0 2023-12-16T20:11:46.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/894: fdatasync d1/d10/d14/d20/db3/f40 0 2023-12-16T20:11:46.856 INFO:tasks.workunit.client.1.smithi141.stdout:4/926: mkdir d1a/d4e/d63/daa/db9/df6/d153 0 2023-12-16T20:11:46.857 INFO:tasks.workunit.client.1.smithi141.stdout:5/897: symlink d0/d9/d16/d2a/d35/dbe/d109/l134 0 2023-12-16T20:11:46.859 INFO:tasks.workunit.client.1.smithi141.stdout:1/975: dwrite da/d36/d4b/d4d/d80/d94/f11d [0,4194304] 0 2023-12-16T20:11:46.860 INFO:tasks.workunit.client.1.smithi141.stdout:7/937: dwrite d5/d16/d30/d36/d8c/dfa/d109/f105 [0,4194304] 0 2023-12-16T20:11:46.868 INFO:tasks.workunit.client.1.smithi141.stdout:5/898: mkdir d0/d135 0 2023-12-16T20:11:46.868 INFO:tasks.workunit.client.1.smithi141.stdout:9/895: write d1/d10/d27/f4b [4820297,30782] 0 2023-12-16T20:11:46.870 INFO:tasks.workunit.client.1.smithi141.stdout:5/899: dread d0/d9/d16/d72/dc6/fec [0,4194304] 0 2023-12-16T20:11:46.870 INFO:tasks.workunit.client.1.smithi141.stdout:5/900: fsync d0/d25/d30/d67/fd4 0 2023-12-16T20:11:46.871 INFO:tasks.workunit.client.1.smithi141.stdout:9/896: unlink d1/d10/d14/d20/dd6/ldc 0 2023-12-16T20:11:46.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/938: link d5/d2a/d45/cf4 d5/d16/d30/c132 0 2023-12-16T20:11:46.873 INFO:tasks.workunit.client.1.smithi141.stdout:7/939: write d5/d2a/f2c [2014847,74968] 0 2023-12-16T20:11:46.874 INFO:tasks.workunit.client.1.smithi141.stdout:1/976: write da/d36/d4b/d4d/d80/d94/fc4 [1176885,72454] 0 2023-12-16T20:11:46.875 INFO:tasks.workunit.client.1.smithi141.stdout:7/940: rename d5/d16/de3/d1e/d71/ddf/dee/ff8 to d5/d16/d46/d61/f133 0 2023-12-16T20:11:46.875 INFO:tasks.workunit.client.1.smithi141.stdout:7/941: stat d5/d16/d46/f90 0 2023-12-16T20:11:46.875 INFO:tasks.workunit.client.1.smithi141.stdout:5/901: dread d0/d14/d2c/d4a/f9b [0,4194304] 0 2023-12-16T20:11:46.875 INFO:tasks.workunit.client.1.smithi141.stdout:1/977: mkdir da/d36/d4b/d4d/d80/d94/d9d/d146 0 2023-12-16T20:11:46.878 INFO:tasks.workunit.client.1.smithi141.stdout:5/902: creat d0/d25/d30/d67/f136 x:0 0 0 2023-12-16T20:11:46.878 INFO:tasks.workunit.client.1.smithi141.stdout:1/978: mknod da/d36/d4b/d4d/c147 0 2023-12-16T20:11:46.880 INFO:tasks.workunit.client.1.smithi141.stdout:4/927: dwrite d1a/d54/d87/dbf/ffb [4194304,4194304] 0 2023-12-16T20:11:46.881 INFO:tasks.workunit.client.1.smithi141.stdout:2/811: dwrite d6/da/f35 [0,4194304] 0 2023-12-16T20:11:46.882 INFO:tasks.workunit.client.1.smithi141.stdout:4/928: mknod d1a/d3c/c154 0 2023-12-16T20:11:46.882 INFO:tasks.workunit.client.1.smithi141.stdout:4/929: dread - d1a/d4e/d63/dd1/ffc zero size 2023-12-16T20:11:46.885 INFO:tasks.workunit.client.1.smithi141.stdout:9/897: read d1/d10/d14/d20/d3b/f46 [1938257,68472] 0 2023-12-16T20:11:46.886 INFO:tasks.workunit.client.1.smithi141.stdout:2/812: symlink d6/d12/d1f/l10c 0 2023-12-16T20:11:46.889 INFO:tasks.workunit.client.1.smithi141.stdout:4/930: unlink d1a/d54/cca 0 2023-12-16T20:11:46.889 INFO:tasks.workunit.client.1.smithi141.stdout:5/903: dread d0/d9/d16/d2a/fa2 [0,4194304] 0 2023-12-16T20:11:46.889 INFO:tasks.workunit.client.1.smithi141.stdout:5/904: fsync d0/d9/d16/d2a/d35/dbe/d109/f11b 0 2023-12-16T20:11:46.890 INFO:tasks.workunit.client.1.smithi141.stdout:5/905: truncate d0/d25/d30/d67/f1d 4881661 0 2023-12-16T20:11:46.890 INFO:tasks.workunit.client.1.smithi141.stdout:9/898: mknod d1/d10/d33/d47/d83/c128 0 2023-12-16T20:11:46.890 INFO:tasks.workunit.client.1.smithi141.stdout:9/899: read - d1/fd2 zero size 2023-12-16T20:11:46.891 INFO:tasks.workunit.client.1.smithi141.stdout:2/813: write d6/d32/d52/fa2 [1284465,125487] 0 2023-12-16T20:11:46.893 INFO:tasks.workunit.client.1.smithi141.stdout:4/931: getdents d1a/d2a/dc3 0 2023-12-16T20:11:46.893 INFO:tasks.workunit.client.1.smithi141.stdout:4/932: chown d1a/f100 1674 1 2023-12-16T20:11:46.896 INFO:tasks.workunit.client.1.smithi141.stdout:9/900: rename d1/d10/d33/d6a/d75/lf4 to d1/l129 0 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:1/979: dwrite da/d67/f26 [0,4194304] 0 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:1/980: write da/d36/d4b/db2/f12c [1593584,99045] 0 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:9/901: symlink d1/d10/d33/d47/d8d/ddf/dcd/l12a 0 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:9/902: chown d1/d10/d33/d47/d8d/f102 4 1 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/933: write d1a/d3c/f5d [1613947,22929] 0 2023-12-16T20:11:46.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/934: fsync d1a/d54/d87/da8/f10f 0 2023-12-16T20:11:46.906 INFO:tasks.workunit.client.1.smithi141.stdout:1/981: mkdir da/d36/d4b/d4d/dd7/de1/d148 0 2023-12-16T20:11:46.907 INFO:tasks.workunit.client.1.smithi141.stdout:9/903: mknod d1/d10/d14/d20/d3b/c12b 0 2023-12-16T20:11:46.910 INFO:tasks.workunit.client.1.smithi141.stdout:4/935: rmdir d1a/d3c 39 2023-12-16T20:11:46.910 INFO:tasks.workunit.client.1.smithi141.stdout:4/936: truncate d1a/d2a/d3b/f101 815591 0 2023-12-16T20:11:46.911 INFO:tasks.workunit.client.1.smithi141.stdout:1/982: rename da/l86 to da/d36/d112/l149 0 2023-12-16T20:11:46.913 INFO:tasks.workunit.client.1.smithi141.stdout:9/904: creat d1/d10/d14/d20/dd6/f12c x:0 0 0 2023-12-16T20:11:46.915 INFO:tasks.workunit.client.1.smithi141.stdout:4/937: mknod d1a/d59/d89/d125/d12b/c155 0 2023-12-16T20:11:46.916 INFO:tasks.workunit.client.1.smithi141.stdout:2/814: dwrite d6/da/d4a/d5e/f88 [4194304,4194304] 0 2023-12-16T20:11:46.916 INFO:tasks.workunit.client.1.smithi141.stdout:2/815: readlink d6/d12/d67/le0 0 2023-12-16T20:11:46.916 INFO:tasks.workunit.client.1.smithi141.stdout:5/906: dwrite d0/d9/d99/d102/f112 [0,4194304] 0 2023-12-16T20:11:46.916 INFO:tasks.workunit.client.1.smithi141.stdout:5/907: readlink d0/d11d/ld9 0 2023-12-16T20:11:46.916 INFO:tasks.workunit.client.1.smithi141.stdout:1/983: truncate da/f7d 602002 0 2023-12-16T20:11:46.922 INFO:tasks.workunit.client.1.smithi141.stdout:4/938: rename d1a/d3c/d9b/da1/ce6 to d1a/d3c/d122/c156 0 2023-12-16T20:11:46.924 INFO:tasks.workunit.client.1.smithi141.stdout:9/905: dread d1/d10/d14/d20/db3/f40 [0,4194304] 0 2023-12-16T20:11:46.928 INFO:tasks.workunit.client.1.smithi141.stdout:2/816: write d6/da/d4a/d5e/f88 [7017123,130123] 0 2023-12-16T20:11:46.936 INFO:tasks.workunit.client.1.smithi141.stdout:1/984: link da/d36/d4b/d4d/d89/d136/l113 da/d36/d4b/d4d/d80/d94/d9d/l14a 0 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/985: creat da/d1a/d1d/d22/d10c/f14b x:0 0 0 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/986: chown da/d36/d4b/d4d/d89/d61/fec 853 1 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/987: chown da/d36/d4b/db2/f12c 40909107 1 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:1/988: stat da/d7a 0 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:2/817: getdents d6/d12/dd8 0 2023-12-16T20:11:46.938 INFO:tasks.workunit.client.1.smithi141.stdout:2/818: truncate d6/d3a/ff1 852479 0 2023-12-16T20:11:46.939 INFO:tasks.workunit.client.1.smithi141.stdout:1/989: creat da/d36/d4b/d4d/dd7/de1/d111/f14c x:0 0 0 2023-12-16T20:11:46.939 INFO:tasks.workunit.client.1.smithi141.stdout:1/990: write da/d1a/d1d/d22/f9b [1852456,105918] 0 2023-12-16T20:11:46.940 INFO:tasks.workunit.client.1.smithi141.stdout:2/819: truncate d6/da/d1b/d5b/d6a/d85/fe6 100115 0 2023-12-16T20:11:46.941 INFO:tasks.workunit.client.1.smithi141.stdout:2/820: link d6/cd d6/d32/d7a/dad/c10d 0 2023-12-16T20:11:46.942 INFO:tasks.workunit.client.1.smithi141.stdout:2/821: truncate d6/d3a/d47/f65 516929 0 2023-12-16T20:11:46.942 INFO:tasks.workunit.client.1.smithi141.stdout:2/822: read - d6/da/d4a/fbe zero size 2023-12-16T20:11:46.943 INFO:tasks.workunit.client.1.smithi141.stdout:2/823: mkdir d6/d12/d67/d10e 0 2023-12-16T20:11:46.950 INFO:tasks.workunit.client.1.smithi141.stdout:1/991: read da/d1a/d31/d81/fa9 [4136310,66928] 0 2023-12-16T20:11:46.951 INFO:tasks.workunit.client.1.smithi141.stdout:1/992: symlink da/d36/d4b/d4d/l14d 0 2023-12-16T20:11:46.951 INFO:tasks.workunit.client.1.smithi141.stdout:1/993: truncate da/d36/d4b/d4d/d80/dca/ddc/d108/f115 4315259 0 2023-12-16T20:11:46.952 INFO:tasks.workunit.client.1.smithi141.stdout:1/994: rename da/d1a/db0/f11e to da/d36/d4b/d4d/d80/d94/d9d/d146/f14e 0 2023-12-16T20:11:47.018 INFO:tasks.workunit.client.1.smithi141.stdout:4/939: dread d1a/d4e/d63/dd1/ffd [0,4194304] 0 2023-12-16T20:11:47.018 INFO:tasks.workunit.client.1.smithi141.stdout:4/940: stat d1a/f35 0 2023-12-16T20:11:47.018 INFO:tasks.workunit.client.1.smithi141.stdout:1/995: write da/fac [941859,42103] 0 2023-12-16T20:11:47.020 INFO:tasks.workunit.client.1.smithi141.stdout:1/996: write da/d1a/d31/d81/db6/fc0 [1022193,122172] 0 2023-12-16T20:11:47.021 INFO:tasks.workunit.client.1.smithi141.stdout:1/997: mkdir da/d36/d4b/d4d/d89/d138/d14f 0 2023-12-16T20:11:47.022 INFO:tasks.workunit.client.1.smithi141.stdout:4/941: write d1a/d4e/d63/dd1/ffd [1842088,60140] 0 2023-12-16T20:11:47.028 INFO:tasks.workunit.client.1.smithi141.stdout:5/908: dwrite d0/d25/d30/d67/f100 [0,4194304] 0 2023-12-16T20:11:47.028 INFO:tasks.workunit.client.1.smithi141.stdout:5/909: readlink d0/d9/d16/d2a/d35/d91/lb0 0 2023-12-16T20:11:47.029 INFO:tasks.workunit.client.1.smithi141.stdout:7/942: dwrite d5/d16/d46/d61/fdd [0,4194304] 0 2023-12-16T20:11:47.029 INFO:tasks.workunit.client.1.smithi141.stdout:9/906: dwrite d1/d26/fc1 [0,4194304] 0 2023-12-16T20:11:47.032 INFO:tasks.workunit.client.1.smithi141.stdout:5/910: creat d0/d9/d16/d2a/d35/dbe/dda/d129/f137 x:0 0 0 2023-12-16T20:11:47.035 INFO:tasks.workunit.client.1.smithi141.stdout:5/911: dread d0/d11d/f8f [0,4194304] 0 2023-12-16T20:11:47.035 INFO:tasks.workunit.client.1.smithi141.stdout:5/912: readlink d0/d14/d2c/d90/l9c 0 2023-12-16T20:11:47.036 INFO:tasks.workunit.client.1.smithi141.stdout:7/943: link d5/d16/de3/d1e/d71/d96/fdb d5/d16/d30/d36/d8c/f134 0 2023-12-16T20:11:47.036 INFO:tasks.workunit.client.1.smithi141.stdout:7/944: creat d5/d16/d1a/d40/dab/f135 x:0 0 0 2023-12-16T20:11:47.036 INFO:tasks.workunit.client.1.smithi141.stdout:5/913: dread d0/d9/f8e [0,4194304] 0 2023-12-16T20:11:47.039 INFO:tasks.workunit.client.1.smithi141.stdout:4/942: truncate d1a/d3c/f5d 1894053 0 2023-12-16T20:11:47.040 INFO:tasks.workunit.client.1.smithi141.stdout:4/943: creat d1a/d2a/d3b/d69/df0/d126/f157 x:0 0 0 2023-12-16T20:11:47.040 INFO:tasks.workunit.client.1.smithi141.stdout:4/944: chown d1a/f35 2 1 2023-12-16T20:11:47.040 INFO:tasks.workunit.client.1.smithi141.stdout:4/945: write f19 [4567076,77462] 0 2023-12-16T20:11:47.041 INFO:tasks.workunit.client.1.smithi141.stdout:9/907: mkdir d1/d10/d14/d12d 0 2023-12-16T20:11:47.043 INFO:tasks.workunit.client.1.smithi141.stdout:1/998: dwrite da/d1a/f107 [0,4194304] 0 2023-12-16T20:11:47.046 INFO:tasks.workunit.client.1.smithi141.stdout:5/914: dread d0/d14/d2c/f68 [0,4194304] 0 2023-12-16T20:11:47.048 INFO:tasks.workunit.client.1.smithi141.stdout:4/946: unlink d1a/d4e/d63/daa/l13a 0 2023-12-16T20:11:47.049 INFO:tasks.workunit.client.1.smithi141.stdout:9/908: symlink d1/d10/d14/d20/d90/l12e 0 2023-12-16T20:11:47.052 INFO:tasks.workunit.client.1.smithi141.stdout:1/999: symlink da/d36/d4b/d4d/d80/dca/ddc/d108/l150 0 2023-12-16T20:11:47.054 INFO:tasks.workunit.client.1.smithi141.stdout:5/915: rename d0/d9/d16/d72/f92 to d0/d9/d16/d2a/d35/d5e/dee/f138 0 2023-12-16T20:11:47.054 INFO:tasks.workunit.client.1.smithi141.stdout:5/916: chown d0/d14 145361 1 2023-12-16T20:11:47.054 INFO:tasks.workunit.client.1.smithi141.stdout:4/947: creat d1a/d4e/f158 x:0 0 0 2023-12-16T20:11:47.095 INFO:tasks.workunit.client.1.smithi141.stdout:5/917: dwrite d0/d9/d16/d2a/d35/dbe/dda/d129/f137 [0,4194304] 0 2023-12-16T20:11:47.097 INFO:tasks.workunit.client.1.smithi141.stdout:4/948: dwrite d1a/d2a/d3b/d69/df0/d126/f157 [0,4194304] 0 2023-12-16T20:11:47.097 INFO:tasks.workunit.client.1.smithi141.stdout:9/909: dwrite d1/d10/f22 [8388608,4194304] 0 2023-12-16T20:11:47.097 INFO:tasks.workunit.client.1.smithi141.stdout:7/945: dwrite d5/d16/d30/d4e/f72 [0,4194304] 0 2023-12-16T20:11:47.100 INFO:tasks.workunit.client.1.smithi141.stdout:4/949: creat d1a/d2a/dc2/d14b/f159 x:0 0 0 2023-12-16T20:11:47.101 INFO:tasks.workunit.client.1.smithi141.stdout:9/910: mknod d1/d10/d14/d20/da/d3f/d66/c12f 0 2023-12-16T20:11:47.104 INFO:tasks.workunit.client.1.smithi141.stdout:5/918: rmdir d0/d25/d30/d8a 39 2023-12-16T20:11:47.104 INFO:tasks.workunit.client.1.smithi141.stdout:5/919: write d0/d14/d98/fa1 [2093951,39711] 0 2023-12-16T20:11:47.104 INFO:tasks.workunit.client.1.smithi141.stdout:5/920: truncate d0/d25/d30/d8a/da0/f110 1277113 0 2023-12-16T20:11:47.107 INFO:tasks.workunit.client.1.smithi141.stdout:7/946: creat d5/d16/d46/d61/f136 x:0 0 0 2023-12-16T20:11:47.109 INFO:tasks.workunit.client.1.smithi141.stdout:4/950: link d1a/l58 d1a/d2a/d3b/d69/df0/l15a 0 2023-12-16T20:11:47.109 INFO:tasks.workunit.client.1.smithi141.stdout:7/947: truncate d5/d16/de3/d1e/d71/df3/f114 1815631 0 2023-12-16T20:11:47.112 INFO:tasks.workunit.client.1.smithi141.stdout:4/951: mkdir d1a/d59/d89/d15b 0 2023-12-16T20:11:47.112 INFO:tasks.workunit.client.1.smithi141.stdout:9/911: read d1/d115/fb4 [2889527,2573] 0 2023-12-16T20:11:47.117 INFO:tasks.workunit.client.1.smithi141.stdout:5/921: dwrite d0/d9/d16/d2a/d35/dbe/d109/f124 [4194304,4194304] 0 2023-12-16T20:11:47.125 INFO:tasks.workunit.client.1.smithi141.stdout:5/922: write d0/d9/d16/d2a/d35/dbe/dda/d129/f137 [298445,53124] 0 2023-12-16T20:11:47.125 INFO:tasks.workunit.client.1.smithi141.stdout:4/952: read d1a/d59/d89/d8a/fc0 [3116703,49362] 0 2023-12-16T20:11:47.126 INFO:tasks.workunit.client.1.smithi141.stdout:7/948: dread d5/d16/d30/d36/d8c/dfa/d109/f105 [0,4194304] 0 2023-12-16T20:11:47.128 INFO:tasks.workunit.client.1.smithi141.stdout:5/923: read d0/d9/d16/d2a/d35/d91/ff6 [4108,126502] 0 2023-12-16T20:11:47.130 INFO:tasks.workunit.client.1.smithi141.stdout:9/912: dwrite d1/d10/f15 [0,4194304] 0 2023-12-16T20:11:47.137 INFO:tasks.workunit.client.1.smithi141.stdout:9/913: symlink d1/d10/l130 0 2023-12-16T20:11:47.139 INFO:tasks.workunit.client.1.smithi141.stdout:9/914: creat d1/d10/d33/d47/d8d/dc4/d11f/f131 x:0 0 0 2023-12-16T20:11:47.140 INFO:tasks.workunit.client.1.smithi141.stdout:5/924: dread d0/d9/f89 [4194304,4194304] 0 2023-12-16T20:11:47.140 INFO:tasks.workunit.client.1.smithi141.stdout:5/925: write d0/d14/d2c/d4a/f118 [1026708,103668] 0 2023-12-16T20:11:47.140 INFO:tasks.workunit.client.1.smithi141.stdout:9/915: creat d1/d10/d33/d47/f132 x:0 0 0 2023-12-16T20:11:47.141 INFO:tasks.workunit.client.1.smithi141.stdout:5/926: mkdir d0/d25/d30/d8a/d11c/d139 0 2023-12-16T20:11:47.142 INFO:tasks.workunit.client.1.smithi141.stdout:9/916: symlink d1/d10/d14/d20/d84/l133 0 2023-12-16T20:11:47.142 INFO:tasks.workunit.client.1.smithi141.stdout:9/917: fdatasync d1/d10/d33/d47/d8d/dc4/fd4 0 2023-12-16T20:11:47.143 INFO:tasks.workunit.client.1.smithi141.stdout:5/927: dread d0/d14/d2c/d90/ff5 [0,4194304] 0 2023-12-16T20:11:47.144 INFO:tasks.workunit.client.1.smithi141.stdout:5/928: write d0/d9/d16/d2a/fa2 [2937360,93954] 0 2023-12-16T20:11:47.145 INFO:tasks.workunit.client.1.smithi141.stdout:9/918: rename d1/d10/d14/d20/d84/c105 to d1/d10/d14/d20/da/d10f/c134 0 2023-12-16T20:11:47.146 INFO:tasks.workunit.client.1.smithi141.stdout:5/929: mknod d0/d9/d16/d2a/d35/dbe/c13a 0 2023-12-16T20:11:47.146 INFO:tasks.workunit.client.1.smithi141.stdout:5/930: creat d0/d14/d2c/d90/f13b x:0 0 0 2023-12-16T20:11:47.146 INFO:tasks.workunit.client.1.smithi141.stdout:5/931: truncate d0/d14/d98/f114 598266 0 2023-12-16T20:11:47.147 INFO:tasks.workunit.client.1.smithi141.stdout:6/971: sync 2023-12-16T20:11:47.147 INFO:tasks.workunit.client.1.smithi141.stdout:6/972: readlink d1/dd/de/l11 0 2023-12-16T20:11:47.148 INFO:tasks.workunit.client.1.smithi141.stdout:2/824: sync 2023-12-16T20:11:47.148 INFO:tasks.workunit.client.1.smithi141.stdout:0/898: sync 2023-12-16T20:11:47.150 INFO:tasks.workunit.client.1.smithi141.stdout:5/932: unlink d0/d25/d30/d67/f100 0 2023-12-16T20:11:47.150 INFO:tasks.workunit.client.1.smithi141.stdout:6/973: mkdir d1/dd/d2f/d13c 0 2023-12-16T20:11:47.152 INFO:tasks.workunit.client.1.smithi141.stdout:5/933: mknod d0/d14/d98/c13c 0 2023-12-16T20:11:47.152 INFO:tasks.workunit.client.1.smithi141.stdout:5/934: dread - d0/d12b/feb zero size 2023-12-16T20:11:47.152 INFO:tasks.workunit.client.1.smithi141.stdout:5/935: creat d0/f13d x:0 0 0 2023-12-16T20:11:47.153 INFO:tasks.workunit.client.1.smithi141.stdout:6/974: unlink d1/d12/d22/d25/d38/f3e 0 2023-12-16T20:11:47.155 INFO:tasks.workunit.client.1.smithi141.stdout:5/936: creat d0/d9/d99/f13e x:0 0 0 2023-12-16T20:11:47.157 INFO:tasks.workunit.client.1.smithi141.stdout:6/975: creat d1/dd/d2f/d48/d127/d131/d85/dfb/f13d x:0 0 0 2023-12-16T20:11:47.158 INFO:tasks.workunit.client.1.smithi141.stdout:2/825: rename d6/d12 to d6/da/d1b/d10f 0 2023-12-16T20:11:47.158 INFO:tasks.workunit.client.1.smithi141.stdout:6/976: rmdir d1/d5e/d123/d4b/d119 39 2023-12-16T20:11:47.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/977: stat d1/d12/d126 0 2023-12-16T20:11:47.159 INFO:tasks.workunit.client.1.smithi141.stdout:6/978: write d1/dd/d2f/d48/d127/d131/d44/f72 [601905,54892] 0 2023-12-16T20:11:47.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/899: rename d4/d49/d73/d3b/c8e to d4/d49/d73/d8a/da4/c12c 0 2023-12-16T20:11:47.161 INFO:tasks.workunit.client.1.smithi141.stdout:0/900: write d4/d49/d8f/d10c/f114 [984366,114476] 0 2023-12-16T20:11:47.161 INFO:tasks.workunit.client.1.smithi141.stdout:9/919: dwrite d1/d10/d14/d20/da/f32 [4194304,4194304] 0 2023-12-16T20:11:47.161 INFO:tasks.workunit.client.1.smithi141.stdout:4/953: dwrite d1a/d2a/d3b/fad [0,4194304] 0 2023-12-16T20:11:47.161 INFO:tasks.workunit.client.1.smithi141.stdout:6/979: creat d1/d12/d22/f13e x:0 0 0 2023-12-16T20:11:47.163 INFO:tasks.workunit.client.1.smithi141.stdout:5/937: rename d0/d14/d2c/d4a/f9b to d0/d25/d30/f13f 0 2023-12-16T20:11:47.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/938: truncate d0/d25/dce/dd1/d107/f10b 32431 0 2023-12-16T20:11:47.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/939: chown d0/d14/d75/ce5 54 1 2023-12-16T20:11:47.164 INFO:tasks.workunit.client.1.smithi141.stdout:5/940: dread - d0/d25/d30/f6c zero size 2023-12-16T20:11:47.170 INFO:tasks.workunit.client.1.smithi141.stdout:4/954: creat d1a/d4e/d63/f15c x:0 0 0 2023-12-16T20:11:47.172 INFO:tasks.workunit.client.1.smithi141.stdout:6/980: mkdir d1/dd/d2f/d48/d127/d131/d44/d13f 0 2023-12-16T20:11:47.172 INFO:tasks.workunit.client.1.smithi141.stdout:6/981: truncate d1/d5e/d123/fa0 661106 0 2023-12-16T20:11:47.174 INFO:tasks.workunit.client.1.smithi141.stdout:5/941: unlink d0/d9/d16/d2a/d35/dbe/c11f 0 2023-12-16T20:11:47.176 INFO:tasks.workunit.client.1.smithi141.stdout:4/955: symlink d1a/d2a/l15d 0 2023-12-16T20:11:47.179 INFO:tasks.workunit.client.1.smithi141.stdout:4/956: rename d1a/d2a/l6f to d1a/d3c/d9b/da1/dcf/df1/l15e 0 2023-12-16T20:11:47.179 INFO:tasks.workunit.client.1.smithi141.stdout:4/957: write d1a/d2a/dc3/fea [540525,78053] 0 2023-12-16T20:11:47.179 INFO:tasks.workunit.client.1.smithi141.stdout:4/958: rename d1a/d3c/d9b to d1a/d3c/d9b/da1/dcf/df1/d15f 22 2023-12-16T20:11:47.180 INFO:tasks.workunit.client.1.smithi141.stdout:4/959: creat d1a/d54/d87/f160 x:0 0 0 2023-12-16T20:11:47.182 INFO:tasks.workunit.client.1.smithi141.stdout:4/960: getdents d1a/d2a/d3b/d69 0 2023-12-16T20:11:47.184 INFO:tasks.workunit.client.1.smithi141.stdout:4/961: mknod d1a/d3c/d9b/da1/c161 0 2023-12-16T20:11:47.184 INFO:tasks.workunit.client.1.smithi141.stdout:4/962: write d1a/d2a/dc3/fea [1264670,114156] 0 2023-12-16T20:11:47.184 INFO:tasks.workunit.client.1.smithi141.stdout:4/963: write d1a/d4e/d63/daa/f150 [16398,122474] 0 2023-12-16T20:11:47.185 INFO:tasks.workunit.client.1.smithi141.stdout:0/901: dwrite d4/d49/d73/d3b/d78/d7f/f11a [0,4194304] 0 2023-12-16T20:11:47.185 INFO:tasks.workunit.client.1.smithi141.stdout:4/964: creat d1a/d2a/d3b/d69/f162 x:0 0 0 2023-12-16T20:11:47.186 INFO:tasks.workunit.client.1.smithi141.stdout:0/902: dread d4/d49/d73/d3b/d78/fbb [0,4194304] 0 2023-12-16T20:11:47.186 INFO:tasks.workunit.client.1.smithi141.stdout:4/965: truncate d1a/d2a/d3b/d69/f84 2716370 0 2023-12-16T20:11:47.187 INFO:tasks.workunit.client.1.smithi141.stdout:0/903: symlink d4/d49/da1/dbd/l12d 0 2023-12-16T20:11:47.187 INFO:tasks.workunit.client.1.smithi141.stdout:0/904: chown d4/d49/da1/df3/f53 562417 1 2023-12-16T20:11:47.188 INFO:tasks.workunit.client.1.smithi141.stdout:9/920: dwrite d1/d26/fc1 [4194304,4194304] 0 2023-12-16T20:11:47.188 INFO:tasks.workunit.client.1.smithi141.stdout:9/921: stat d1/d10/d33/d47/d83 0 2023-12-16T20:11:47.188 INFO:tasks.workunit.client.1.smithi141.stdout:2/826: dwrite d6/d3a/f2c [4194304,4194304] 0 2023-12-16T20:11:47.189 INFO:tasks.workunit.client.1.smithi141.stdout:5/942: write d0/d14/d2c/f68 [7382280,11862] 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/943: write d0/d9/d16/d2a/d35/d5e/d95/fd6 [430443,85672] 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/944: readlink d0/dd2/l81 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/945: chown d0/dd2/lae 15 1 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/946: readlink d0/l53 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/947: chown d0/d14/d98/f125 0 1 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:5/948: readlink d0/d9/d16/d2a/ld8 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:0/905: mknod d4/d49/d73/d3b/d78/d7f/d80/d83/c12e 0 2023-12-16T20:11:47.190 INFO:tasks.workunit.client.1.smithi141.stdout:4/966: fsync d1a/d4e/d63/daa/f150 0 2023-12-16T20:11:47.194 INFO:tasks.workunit.client.1.smithi141.stdout:9/922: rename d1/d26/d4a/d73/l7c to d1/d10/d33/d47/d8d/ddf/dcd/dd9/l135 0 2023-12-16T20:11:47.195 INFO:tasks.workunit.client.1.smithi141.stdout:2/827: symlink d6/d32/d7a/dad/l110 0 2023-12-16T20:11:47.201 INFO:tasks.workunit.client.1.smithi141.stdout:2/828: dread d6/da/d1b/d5b/f78 [0,4194304] 0 2023-12-16T20:11:47.204 INFO:tasks.workunit.client.1.smithi141.stdout:2/829: dread d6/d32/d7a/ddf/d98/ffa [0,4194304] 0 2023-12-16T20:11:47.210 INFO:tasks.workunit.client.1.smithi141.stdout:5/949: truncate d0/d9/d99/d102/dc3/faf 185912 0 2023-12-16T20:11:47.210 INFO:tasks.workunit.client.1.smithi141.stdout:5/950: fdatasync d0/d14/f1b 0 2023-12-16T20:11:47.212 INFO:tasks.workunit.client.1.smithi141.stdout:0/906: creat d4/d49/d73/d3b/d78/d7f/f12f x:0 0 0 2023-12-16T20:11:47.214 INFO:tasks.workunit.client.1.smithi141.stdout:9/923: rename d1/d26/d4a/dde/dec/l122 to d1/d10/d33/d47/d8d/ddf/de6/l136 0 2023-12-16T20:11:47.214 INFO:tasks.workunit.client.1.smithi141.stdout:9/924: write d1/d26/d4a/d73/d76/fcf [369092,17253] 0 2023-12-16T20:11:47.214 INFO:tasks.workunit.client.1.smithi141.stdout:9/925: chown d1/d10/d33 34413676 1 2023-12-16T20:11:47.215 INFO:tasks.workunit.client.1.smithi141.stdout:2/830: truncate d6/da/d1b/d10f/d15/f4c 1343082 0 2023-12-16T20:11:47.219 INFO:tasks.workunit.client.1.smithi141.stdout:0/907: link d4/d49/da1/dbd/l12d d4/d49/da1/dbd/def/d104/l130 0 2023-12-16T20:11:47.219 INFO:tasks.workunit.client.1.smithi141.stdout:0/908: readlink d4/d49/d73/l77 0 2023-12-16T20:11:47.220 INFO:tasks.workunit.client.1.smithi141.stdout:9/926: rmdir d1/d26/d4a/d73/d76/d11a 39 2023-12-16T20:11:47.220 INFO:tasks.workunit.client.1.smithi141.stdout:9/927: readlink d1/d26/l49 0 2023-12-16T20:11:47.223 INFO:tasks.workunit.client.1.smithi141.stdout:2/831: rename d6/da/d33/d54/d7c/f97 to d6/d3a/f111 0 2023-12-16T20:11:47.224 INFO:tasks.workunit.client.1.smithi141.stdout:0/909: creat d4/d49/d73/d8a/da4/dcc/d127/f131 x:0 0 0 2023-12-16T20:11:47.224 INFO:tasks.workunit.client.1.smithi141.stdout:0/910: creat d4/d7/db0/f132 x:0 0 0 2023-12-16T20:11:47.228 INFO:tasks.workunit.client.1.smithi141.stdout:2/832: unlink d6/da/d1b/ff8 0 2023-12-16T20:11:47.228 INFO:tasks.workunit.client.1.smithi141.stdout:0/911: getdents d4/d49 0 2023-12-16T20:11:47.229 INFO:tasks.workunit.client.1.smithi141.stdout:9/928: rmdir d1/d10/d14/d20/d90 39 2023-12-16T20:11:47.230 INFO:tasks.workunit.client.1.smithi141.stdout:2/833: creat d6/da/d33/f112 x:0 0 0 2023-12-16T20:11:47.230 INFO:tasks.workunit.client.1.smithi141.stdout:0/912: symlink d4/d49/d73/d3b/ded/l133 0 2023-12-16T20:11:47.231 INFO:tasks.workunit.client.1.smithi141.stdout:9/929: getdents d1/d10/d27 0 2023-12-16T20:11:47.233 INFO:tasks.workunit.client.1.smithi141.stdout:2/834: rename d6/d32/d7a/f51 to d6/d32/d7a/ddf/d98/df6/f113 0 2023-12-16T20:11:47.233 INFO:tasks.workunit.client.1.smithi141.stdout:2/835: chown d6/da/d1b/d10f/f29 0 1 2023-12-16T20:11:47.233 INFO:tasks.workunit.client.1.smithi141.stdout:0/913: creat d4/d49/db9/f134 x:0 0 0 2023-12-16T20:11:47.234 INFO:tasks.workunit.client.1.smithi141.stdout:9/930: creat d1/d10/d33/f137 x:0 0 0 2023-12-16T20:11:47.235 INFO:tasks.workunit.client.1.smithi141.stdout:2/836: link d6/d3a/fcf d6/dc4/f114 0 2023-12-16T20:11:47.235 INFO:tasks.workunit.client.1.smithi141.stdout:0/914: mknod d4/d49/da1/df3/da3/c135 0 2023-12-16T20:11:47.236 INFO:tasks.workunit.client.1.smithi141.stdout:9/931: mknod d1/d10/d33/d47/d8d/ddf/de6/de9/c138 0 2023-12-16T20:11:47.238 INFO:tasks.workunit.client.1.smithi141.stdout:2/837: symlink d6/da/d33/d54/d73/d80/l115 0 2023-12-16T20:11:47.238 INFO:tasks.workunit.client.1.smithi141.stdout:0/915: mknod d4/d49/d73/d3b/d78/d7f/d80/c136 0 2023-12-16T20:11:47.238 INFO:tasks.workunit.client.1.smithi141.stdout:0/916: fdatasync d4/d49/d73/d3b/ded/f10d 0 2023-12-16T20:11:47.238 INFO:tasks.workunit.client.1.smithi141.stdout:2/838: mknod d6/da/d1b/c116 0 2023-12-16T20:11:47.239 INFO:tasks.workunit.client.1.smithi141.stdout:2/839: readlink d6/da/d33/l83 0 2023-12-16T20:11:47.239 INFO:tasks.workunit.client.1.smithi141.stdout:2/840: chown d6/l11 11792182 1 2023-12-16T20:11:47.239 INFO:tasks.workunit.client.1.smithi141.stdout:2/841: chown d6/da/d1b/f5d 1291555 1 2023-12-16T20:11:47.239 INFO:tasks.workunit.client.1.smithi141.stdout:0/917: unlink d4/d5c/f68 0 2023-12-16T20:11:47.241 INFO:tasks.workunit.client.1.smithi141.stdout:0/918: write d4/d49/db9/dcd/de8/f117 [17243,20770] 0 2023-12-16T20:11:47.249 INFO:tasks.workunit.client.1.smithi141.stdout:0/919: dread d4/d49/da1/df3/da3/fe2 [0,4194304] 0 2023-12-16T20:11:47.265 INFO:tasks.workunit.client.1.smithi141.stdout:2/842: read d6/d32/d7a/dad/ff7 [163569,97268] 0 2023-12-16T20:11:47.266 INFO:tasks.workunit.client.1.smithi141.stdout:2/843: mknod d6/d3a/d47/d58/d8c/c117 0 2023-12-16T20:11:47.274 INFO:tasks.workunit.client.1.smithi141.stdout:2/844: dread d6/da/d1b/d10f/d1f/d46/f63 [4194304,4194304] 0 2023-12-16T20:11:47.275 INFO:tasks.workunit.client.1.smithi141.stdout:2/845: mknod d6/da/d1b/d10f/d1f/c118 0 2023-12-16T20:11:47.284 INFO:tasks.workunit.client.1.smithi141.stdout:9/932: dwrite d1/d26/d4a/d73/fc5 [0,4194304] 0 2023-12-16T20:11:47.285 INFO:tasks.workunit.client.1.smithi141.stdout:4/967: dwrite d1a/d54/d87/f160 [0,4194304] 0 2023-12-16T20:11:47.285 INFO:tasks.workunit.client.1.smithi141.stdout:5/951: dwrite d0/d9/d99/d102/f112 [0,4194304] 0 2023-12-16T20:11:47.288 INFO:tasks.workunit.client.1.smithi141.stdout:9/933: symlink d1/d10/d14/d20/da/l139 0 2023-12-16T20:11:47.293 INFO:tasks.workunit.client.1.smithi141.stdout:4/968: mkdir d1a/d2a/dc2/d14b/d163 0 2023-12-16T20:11:47.297 INFO:tasks.workunit.client.1.smithi141.stdout:5/952: mknod d0/d9/d85/c140 0 2023-12-16T20:11:47.300 INFO:tasks.workunit.client.1.smithi141.stdout:4/969: symlink d1a/l164 0 2023-12-16T20:11:47.300 INFO:tasks.workunit.client.1.smithi141.stdout:4/970: creat d1a/d4e/d63/daa/f165 x:0 0 0 2023-12-16T20:11:47.300 INFO:tasks.workunit.client.1.smithi141.stdout:4/971: fsync d1a/d2a/f31 0 2023-12-16T20:11:47.300 INFO:tasks.workunit.client.1.smithi141.stdout:4/972: creat d1a/d4e/d63/dd1/f166 x:0 0 0 2023-12-16T20:11:47.300 INFO:tasks.workunit.client.1.smithi141.stdout:4/973: creat d1a/d54/d87/da8/f167 x:0 0 0 2023-12-16T20:11:47.301 INFO:tasks.workunit.client.1.smithi141.stdout:4/974: write d1a/d3c/d9b/fac [1106597,54076] 0 2023-12-16T20:11:47.302 INFO:tasks.workunit.client.1.smithi141.stdout:5/953: getdents d0/d14/d98 0 2023-12-16T20:11:47.302 INFO:tasks.workunit.client.1.smithi141.stdout:5/954: chown d0/d9/d16/d2a 180498 1 2023-12-16T20:11:47.302 INFO:tasks.workunit.client.1.smithi141.stdout:5/955: creat d0/d9/d16/d72/dc6/f141 x:0 0 0 2023-12-16T20:11:47.304 INFO:tasks.workunit.client.1.smithi141.stdout:9/934: dwrite d1/d10/d14/d20/da/d3f/d66/ffc [0,4194304] 0 2023-12-16T20:11:47.308 INFO:tasks.workunit.client.1.smithi141.stdout:4/975: truncate f14 4495412 0 2023-12-16T20:11:47.312 INFO:tasks.workunit.client.1.smithi141.stdout:5/956: rename d0/d14/d2c/d90/ff8 to d0/d14/f142 0 2023-12-16T20:11:47.315 INFO:tasks.workunit.client.1.smithi141.stdout:9/935: symlink d1/d10/d33/d47/d8d/ddf/de6/d124/l13a 0 2023-12-16T20:11:47.332 INFO:tasks.workunit.client.1.smithi141.stdout:5/957: dwrite d0/d9/d16/d2a/d35/d5e/d95/fd6 [0,4194304] 0 2023-12-16T20:11:47.332 INFO:tasks.workunit.client.1.smithi141.stdout:5/958: fdatasync d0/d9/d16/d2a/d35/d5e/f6b 0 2023-12-16T20:11:47.334 INFO:tasks.workunit.client.1.smithi141.stdout:4/976: dwrite d1a/f100 [0,4194304] 0 2023-12-16T20:11:47.335 INFO:tasks.workunit.client.1.smithi141.stdout:5/959: getdents d0/d9 0 2023-12-16T20:11:47.335 INFO:tasks.workunit.client.1.smithi141.stdout:5/960: write d0/f13d [49403,1550] 0 2023-12-16T20:11:47.335 INFO:tasks.workunit.client.1.smithi141.stdout:5/961: getdents d0/d25/d30/d8a/d11c/d139 0 2023-12-16T20:11:47.348 INFO:tasks.workunit.client.1.smithi141.stdout:5/962: dwrite d0/dd2/f127 [4194304,4194304] 0 2023-12-16T20:11:47.349 INFO:tasks.workunit.client.1.smithi141.stdout:5/963: dread - d0/d14/d98/f125 zero size 2023-12-16T20:11:47.365 INFO:tasks.workunit.client.1.smithi141.stdout:5/964: dwrite d0/d14/d75/f10d [0,4194304] 0 2023-12-16T20:11:47.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/965: dread d0/d25/f93 [0,4194304] 0 2023-12-16T20:11:47.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/966: fdatasync d0/d9/f8e 0 2023-12-16T20:11:47.372 INFO:tasks.workunit.client.1.smithi141.stdout:5/967: chown d0/l53 1877703 1 2023-12-16T20:11:47.373 INFO:tasks.workunit.client.1.smithi141.stdout:5/968: link d0/dd2/f6e d0/d9/d16/f143 0 2023-12-16T20:11:47.374 INFO:tasks.workunit.client.1.smithi141.stdout:5/969: mknod d0/d9/d16/d2a/d35/d91/c144 0 2023-12-16T20:11:47.374 INFO:tasks.workunit.client.1.smithi141.stdout:5/970: stat d0/dd2/l79 0 2023-12-16T20:11:47.374 INFO:tasks.workunit.client.1.smithi141.stdout:5/971: truncate d0/d9/f119 303382 0 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/972: unlink d0/d14/d2c/f68 0 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/973: chown d0/d9/f119 844 1 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/974: write d0/d9/d16/d2a/d35/d5e/dee/f132 [766402,110344] 0 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/975: dread - d0/d9/d99/d102/dc3/fbb zero size 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/976: creat d0/d25/f145 x:0 0 0 2023-12-16T20:11:47.375 INFO:tasks.workunit.client.1.smithi141.stdout:5/977: fdatasync d0/d9/d16/fac 0 2023-12-16T20:11:47.376 INFO:tasks.workunit.client.1.smithi141.stdout:5/978: symlink d0/d25/d30/d67/l146 0 2023-12-16T20:11:47.376 INFO:tasks.workunit.client.1.smithi141.stdout:5/979: write d0/d14/d2c/d90/f10c [505352,114632] 0 2023-12-16T20:11:47.376 INFO:tasks.workunit.client.1.smithi141.stdout:5/980: write d0/d12b/db3/fea [380239,126793] 0 2023-12-16T20:11:47.387 INFO:tasks.workunit.client.1.smithi141.stdout:7/949: sync 2023-12-16T20:11:47.388 INFO:tasks.workunit.client.1.smithi141.stdout:7/950: rename d5/d16/d30/d36/d8c/dfa/f11b to d5/f137 0 2023-12-16T20:11:47.391 INFO:tasks.workunit.client.1.smithi141.stdout:7/951: rmdir d5/d16/de3/d1e 39 2023-12-16T20:11:47.391 INFO:tasks.workunit.client.1.smithi141.stdout:7/952: write d5/d2a/d45/fd9 [948659,52598] 0 2023-12-16T20:11:47.393 INFO:tasks.workunit.client.1.smithi141.stdout:7/953: dread d5/d2a/f3d [4194304,4194304] 0 2023-12-16T20:11:47.408 INFO:tasks.workunit.client.1.smithi141.stdout:7/954: dwrite d5/d2a/d45/fd1 [0,4194304] 0 2023-12-16T20:11:47.408 INFO:tasks.workunit.client.1.smithi141.stdout:7/955: stat d5/d2a/f10a 0 2023-12-16T20:11:47.408 INFO:tasks.workunit.client.1.smithi141.stdout:7/956: fdatasync d5/d16/de3/d89/fa6 0 2023-12-16T20:11:47.409 INFO:tasks.workunit.client.1.smithi141.stdout:7/957: mknod d5/d16/d1a/d40/dab/c138 0 2023-12-16T20:11:47.410 INFO:tasks.workunit.client.1.smithi141.stdout:7/958: rmdir d5/d16/d30/d36/d8c/dfa 39 2023-12-16T20:11:47.410 INFO:tasks.workunit.client.1.smithi141.stdout:7/959: truncate d5/d16/de3/d1e/f98 412963 0 2023-12-16T20:11:47.412 INFO:tasks.workunit.client.1.smithi141.stdout:7/960: getdents d5/d2a 0 2023-12-16T20:11:47.413 INFO:tasks.workunit.client.1.smithi141.stdout:7/961: dread d5/d2a/faa [0,4194304] 0 2023-12-16T20:11:47.413 INFO:tasks.workunit.client.1.smithi141.stdout:7/962: creat d5/d2a/d45/f139 x:0 0 0 2023-12-16T20:11:47.413 INFO:tasks.workunit.client.1.smithi141.stdout:7/963: creat d5/d2a/d45/f13a x:0 0 0 2023-12-16T20:11:47.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/964: rename c4 to d5/d16/d30/d36/d8c/d122/c13b 0 2023-12-16T20:11:47.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/965: rename d5/d16/de3/d1e/l85 to d5/d16/d1a/d40/dab/dd5/l13c 0 2023-12-16T20:11:47.416 INFO:tasks.workunit.client.1.smithi141.stdout:7/966: stat d5/d16 0 2023-12-16T20:11:47.431 INFO:tasks.workunit.client.1.smithi141.stdout:7/967: dwrite d5/d16/d30/f12f [0,4194304] 0 2023-12-16T20:11:47.434 INFO:tasks.workunit.client.1.smithi141.stdout:7/968: rename d5/d16/de3/d1e/d71/ddf/dee/f127 to d5/d16/d1a/de7/f13d 0 2023-12-16T20:11:47.435 INFO:tasks.workunit.client.1.smithi141.stdout:7/969: mkdir d5/d16/d30/d36/d13e 0 2023-12-16T20:11:47.435 INFO:tasks.workunit.client.1.smithi141.stdout:7/970: write d5/d16/de3/d1e/f52 [57966,103140] 0 2023-12-16T20:11:47.448 INFO:tasks.workunit.client.1.smithi141.stdout:7/971: dwrite d5/d16/d30/d36/fc7 [0,4194304] 0 2023-12-16T20:11:47.448 INFO:tasks.workunit.client.1.smithi141.stdout:7/972: write d5/d16/d1a/f7f [290565,747] 0 2023-12-16T20:11:47.450 INFO:tasks.workunit.client.1.smithi141.stdout:7/973: creat d5/d2a/d45/dae/f13f x:0 0 0 2023-12-16T20:11:47.452 INFO:tasks.workunit.client.1.smithi141.stdout:7/974: mkdir d5/d140 0 2023-12-16T20:11:47.452 INFO:tasks.workunit.client.1.smithi141.stdout:7/975: fdatasync d5/d16/de3/d1e/d71/f91 0 2023-12-16T20:11:47.452 INFO:tasks.workunit.client.1.smithi141.stdout:7/976: readlink d5/d16/d1a/le0 0 2023-12-16T20:11:47.454 INFO:tasks.workunit.client.1.smithi141.stdout:7/977: symlink d5/d16/d46/l141 0 2023-12-16T20:11:47.454 INFO:tasks.workunit.client.1.smithi141.stdout:7/978: getdents d5/d16/d1a/d111 0 2023-12-16T20:11:47.455 INFO:tasks.workunit.client.1.smithi141.stdout:7/979: mknod d5/d16/d1a/d111/c142 0 2023-12-16T20:11:47.456 INFO:tasks.workunit.client.1.smithi141.stdout:7/980: mkdir d5/d16/d1a/d40/dab/dd5/d143 0 2023-12-16T20:11:47.456 INFO:tasks.workunit.client.1.smithi141.stdout:7/981: stat d5/d16/de3/c26 0 2023-12-16T20:11:47.457 INFO:tasks.workunit.client.1.smithi141.stdout:7/982: mkdir d5/d16/d1a/d111/d144 0 2023-12-16T20:11:47.458 INFO:tasks.workunit.client.1.smithi141.stdout:7/983: write d5/d16/de3/f7c [486987,42633] 0 2023-12-16T20:11:47.460 INFO:tasks.workunit.client.1.smithi141.stdout:7/984: rename d5/d2a/f113 to d5/d16/d1a/de7/f145 0 2023-12-16T20:11:47.460 INFO:tasks.workunit.client.1.smithi141.stdout:7/985: write d5/d2a/d45/f13a [1008833,90774] 0 2023-12-16T20:11:47.460 INFO:tasks.workunit.client.1.smithi141.stdout:7/986: truncate d5/d16/d30/d4e/fde 4912154 0 2023-12-16T20:11:47.460 INFO:tasks.workunit.client.1.smithi141.stdout:7/987: write d5/d16/d1a/d40/dab/f103 [767898,125620] 0 2023-12-16T20:11:47.461 INFO:tasks.workunit.client.1.smithi141.stdout:7/988: creat d5/d140/f146 x:0 0 0 2023-12-16T20:11:47.470 INFO:tasks.workunit.client.1.smithi141.stdout:7/989: read d5/d16/d30/d4e/f8f [2871694,5558] 0 2023-12-16T20:11:47.485 INFO:tasks.workunit.client.1.smithi141.stdout:7/990: dwrite d5/d16/d1a/d40/dcb/f130 [0,4194304] 0 2023-12-16T20:11:47.486 INFO:tasks.workunit.client.1.smithi141.stdout:7/991: stat d5/d16/d30/d36/d116 0 2023-12-16T20:11:47.486 INFO:tasks.workunit.client.1.smithi141.stdout:7/992: chown d5/d16/d30/d4e/d6e/f88 513854139 1 2023-12-16T20:11:47.487 INFO:tasks.workunit.client.1.smithi141.stdout:7/993: rmdir d5/d16/de3/d1e 39 2023-12-16T20:11:47.488 INFO:tasks.workunit.client.1.smithi141.stdout:7/994: rename d5/d16/de3/d89/f9d to d5/d16/d1a/d40/dab/f147 0 2023-12-16T20:11:47.489 INFO:tasks.workunit.client.1.smithi141.stdout:7/995: stat d5/d16/d46/d102/f128 0 2023-12-16T20:11:47.489 INFO:tasks.workunit.client.1.smithi141.stdout:7/996: readlink d5/d16/d1a/de7/le9 0 2023-12-16T20:11:47.490 INFO:tasks.workunit.client.1.smithi141.stdout:7/997: symlink d5/d16/d30/d36/d12b/l148 0 2023-12-16T20:11:47.491 INFO:tasks.workunit.client.1.smithi141.stdout:7/998: rename d5/d2a/d45/ffc to d5/d16/d46/f149 0 2023-12-16T20:11:47.492 INFO:tasks.workunit.client.1.smithi141.stdout:7/999: dread - d5/d16/d30/d4e/d6e/f88 zero size 2023-12-16T20:11:47.505 INFO:tasks.workunit.client.1.smithi141.stdout:6/982: sync 2023-12-16T20:11:47.506 INFO:tasks.workunit.client.1.smithi141.stdout:6/983: mknod d1/d12/d22/d25/de0/c140 0 2023-12-16T20:11:47.507 INFO:tasks.workunit.client.1.smithi141.stdout:6/984: mknod d1/d5e/d123/d4b/d60/db8/c141 0 2023-12-16T20:11:47.508 INFO:tasks.workunit.client.1.smithi141.stdout:6/985: mknod d1/dd/d2f/c142 0 2023-12-16T20:11:47.508 INFO:tasks.workunit.client.1.smithi141.stdout:6/986: fsync d1/fa 0 2023-12-16T20:11:47.509 INFO:tasks.workunit.client.1.smithi141.stdout:6/987: mkdir d1/d5e/d123/d4b/d60/def/d129/d143 0 2023-12-16T20:11:47.527 INFO:tasks.workunit.client.1.smithi141.stdout:6/988: dwrite d1/f9c [0,4194304] 0 2023-12-16T20:11:47.529 INFO:tasks.workunit.client.1.smithi141.stdout:6/989: symlink d1/d12/d22/d25/dc3/dc6/df9/l144 0 2023-12-16T20:11:47.529 INFO:tasks.workunit.client.1.smithi141.stdout:6/990: truncate d1/d12/d22/d25/d38/f13a 452221 0 2023-12-16T20:11:47.537 INFO:tasks.workunit.client.1.smithi141.stdout:6/991: dread d1/dd/d2f/d48/d127/d131/d44/f6b [0,4194304] 0 2023-12-16T20:11:47.539 INFO:tasks.workunit.client.1.smithi141.stdout:6/992: unlink d1/c9f 0 2023-12-16T20:11:47.540 INFO:tasks.workunit.client.1.smithi141.stdout:6/993: symlink d1/dbd/l145 0 2023-12-16T20:11:47.540 INFO:tasks.workunit.client.1.smithi141.stdout:6/994: write d1/dd/d2f/d48/f84 [823578,41540] 0 2023-12-16T20:11:47.542 INFO:tasks.workunit.client.1.smithi141.stdout:6/995: mknod d1/d12/d10d/d47/dfd/c146 0 2023-12-16T20:11:47.542 INFO:tasks.workunit.client.1.smithi141.stdout:6/996: chown d1/dd/d2f/d48/f84 32523 1 2023-12-16T20:11:47.548 INFO:tasks.workunit.client.1.smithi141.stdout:6/997: dread d1/dd/d2f/d48/d127/d131/d3a/f80 [0,4194304] 0 2023-12-16T20:11:47.550 INFO:tasks.workunit.client.1.smithi141.stdout:6/998: rename d1/fa to d1/dd/de/f147 0 2023-12-16T20:11:47.551 INFO:tasks.workunit.client.1.smithi141.stdout:6/999: creat d1/dd/d2f/de6/f148 x:0 0 0 2023-12-16T20:11:47.598 INFO:tasks.workunit.client.1.smithi141.stdout:0/920: sync 2023-12-16T20:11:47.598 INFO:tasks.workunit.client.1.smithi141.stdout:2/846: sync 2023-12-16T20:11:47.600 INFO:tasks.workunit.client.1.smithi141.stdout:2/847: mknod d6/d32/d7a/ddf/d98/df6/c119 0 2023-12-16T20:11:47.601 INFO:tasks.workunit.client.1.smithi141.stdout:2/848: truncate d6/d32/d7a/d5f/d92/fa4 7331862 0 2023-12-16T20:11:47.603 INFO:tasks.workunit.client.1.smithi141.stdout:2/849: symlink d6/da/d1b/d10f/d1f/d46/l11a 0 2023-12-16T20:11:47.604 INFO:tasks.workunit.client.1.smithi141.stdout:2/850: rmdir d6/da/d4a/d5e 39 2023-12-16T20:11:47.733 INFO:tasks.workunit.client.1.smithi141.stdout:2/851: truncate d6/da/d4a/fbe 668838 0 2023-12-16T20:11:47.733 INFO:tasks.workunit.client.1.smithi141.stdout:2/852: write d6/da/d1b/d5b/d6a/d85/f9c [97687,40918] 0 2023-12-16T20:11:47.734 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:47 smithi038 ceph-mon[80659]: pgmap v12: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 327 MiB/s rd, 422 MiB/s wr, 624 op/s 2023-12-16T20:11:47.738 INFO:tasks.workunit.client.1.smithi141.stdout:2/853: mkdir d6/d32/d7a/ddf/d11b 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/854: unlink d6/da/d1b/d10f/d1f/fc0 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:0/921: dread d4/d49/d8f/fac [0,4194304] 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/855: mknod d6/da/d33/d54/d7c/c11c 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/856: dread d6/da/d1b/d5b/d6a/d85/fe6 [0,4194304] 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/857: truncate d6/d32/d52/d53/f74 3271044 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/858: dread - d6/dd1/fed zero size 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/859: link d6/da/d1b/d10f/d15/f4c d6/d32/d7a/ddf/f11d 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/860: write d6/da/d1b/d5b/d6a/d85/fe6 [205426,89491] 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/861: truncate d6/d32/d52/fa2 468883 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/862: chown d6/d32/d101 0 1 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/863: fdatasync d6/da/d1b/d10f/d1f/d46/d5a/fd2 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/864: unlink d6/da/d1b/d5b/d6a/d85/fd7 0 2023-12-16T20:11:47.739 INFO:tasks.workunit.client.1.smithi141.stdout:2/865: mknod d6/d3a/d47/c11e 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/866: dread d6/da/d1b/d10f/d1f/f91 [0,4194304] 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/867: dread d6/da/d1b/f27 [0,4194304] 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/868: dread - d6/d32/d7a/fc1 zero size 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/869: truncate d6/da/d1b/d10f/d1f/d46/d5a/fb6 354708 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/870: unlink d6/d3a/c37 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/871: dwrite d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/872: fdatasync d6/f7 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/873: mknod d6/d32/d52/d53/c11f 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/874: mknod d6/d3a/d47/d58/d66/c120 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/875: symlink d6/d3a/l121 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/876: chown d6/da/l3f 49 1 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/877: creat d6/d3a/d47/f122 x:0 0 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/878: creat d6/da/d1b/d10f/d67/d10e/f123 x:0 0 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/879: mkdir d6/d3a/d47/d124 0 2023-12-16T20:11:47.740 INFO:tasks.workunit.client.1.smithi141.stdout:2/880: write d6/d3a/d47/d58/f71 [3780920,112400] 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/881: truncate d6/d3a/d47/d58/d8c/fe4 886953 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/882: dread d6/d32/f57 [0,4194304] 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/883: rmdir d6/d3a/d47/d58 39 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/884: getdents d6/d32/d101 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/885: mkdir d6/d3a/d125 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/886: write d6/da/d1b/d5b/d6a/d85/fdb [507476,19535] 0 2023-12-16T20:11:47.741 INFO:tasks.workunit.client.1.smithi141.stdout:2/887: mknod d6/d3a/d47/d124/c126 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/888: link d6/da/d1b/d5b/d6a/l6e d6/da/d33/d54/d7c/de8/l127 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/889: link d6/da/d1b/d10f/d1f/l25 d6/da/d4a/d5e/l128 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/890: getdents d6/d32/d52/d53/d104 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/891: truncate d6/da/d1b/d10f/d1f/f36 2323343 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/892: write d6/d3a/ff1 [919851,125937] 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/893: truncate d6/da/d1b/f27 1790565 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/894: dwrite d6/d32/d7a/ddf/d98/f108 [0,4194304] 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/895: fdatasync d6/f1d 0 2023-12-16T20:11:47.742 INFO:tasks.workunit.client.1.smithi141.stdout:2/896: dwrite d6/d3a/fea [0,4194304] 0 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/897: read d6/da/d4a/d5e/f88 [1877207,101739] 0 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/898: dread d6/da/d1b/d10f/d1f/f91 [0,4194304] 0 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/899: chown d6/d32/d7a/d5f/d92/f9f 897378954 1 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/900: chown d6/d32/d52/fc3 29 1 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/901: readlink d6/da/d1b/d10f/d1f/d46/d5a/l109 0 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/902: write d6/d32/f4e [1521923,54085] 0 2023-12-16T20:11:47.743 INFO:tasks.workunit.client.1.smithi141.stdout:2/903: fdatasync d6/da/f35 0 2023-12-16T20:11:47.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/904: creat d6/da/d33/d54/d73/d80/f129 x:0 0 0 2023-12-16T20:11:47.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/905: getdents d6/d32/d7a/ddf/d11b 0 2023-12-16T20:11:47.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/906: creat d6/dd1/f12a x:0 0 0 2023-12-16T20:11:47.744 INFO:tasks.workunit.client.1.smithi141.stdout:2/907: write d6/da/d4a/fbe [864008,27284] 0 2023-12-16T20:11:47.744 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:47 smithi141 ceph-mon[88165]: pgmap v12: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 327 MiB/s rd, 422 MiB/s wr, 624 op/s 2023-12-16T20:11:47.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/908: rename d6/da/d1b/d5b/d6a/cef to d6/dc4/c12b 0 2023-12-16T20:11:47.746 INFO:tasks.workunit.client.1.smithi141.stdout:2/909: fsync d6/d32/f34 0 2023-12-16T20:11:47.748 INFO:tasks.workunit.client.1.smithi141.stdout:2/910: creat d6/d32/d7a/ddf/d11b/f12c x:0 0 0 2023-12-16T20:11:47.748 INFO:tasks.workunit.client.1.smithi141.stdout:2/911: fsync d6/d32/f64 0 2023-12-16T20:11:47.750 INFO:tasks.workunit.client.1.smithi141.stdout:2/912: truncate d6/d32/d7a/ddf/d98/fe9 243393 0 2023-12-16T20:11:47.750 INFO:tasks.workunit.client.1.smithi141.stdout:2/913: read - d6/d32/d7a/ddf/d11b/f12c zero size 2023-12-16T20:11:47.750 INFO:tasks.workunit.client.1.smithi141.stdout:2/914: truncate d6/d32/f34 694492 0 2023-12-16T20:11:47.751 INFO:tasks.workunit.client.1.smithi141.stdout:2/915: creat d6/dc4/f12d x:0 0 0 2023-12-16T20:11:47.762 INFO:tasks.workunit.client.1.smithi141.stdout:2/916: symlink d6/d3a/l12e 0 2023-12-16T20:11:47.762 INFO:tasks.workunit.client.1.smithi141.stdout:2/917: write d6/d32/d7a/ddf/d98/fe9 [1088813,119934] 0 2023-12-16T20:11:47.762 INFO:tasks.workunit.client.1.smithi141.stdout:2/918: creat d6/da/d33/f12f x:0 0 0 2023-12-16T20:11:47.762 INFO:tasks.workunit.client.1.smithi141.stdout:2/919: readlink d6/da/d4a/lec 0 2023-12-16T20:11:47.774 INFO:tasks.workunit.client.1.smithi141.stdout:2/920: dwrite d6/da/d1b/d10f/dd8/f105 [0,4194304] 0 2023-12-16T20:11:47.774 INFO:tasks.workunit.client.1.smithi141.stdout:2/921: chown d6/da/d33/d54/f7f 173 1 2023-12-16T20:11:47.774 INFO:tasks.workunit.client.1.smithi141.stdout:2/922: truncate d6/da/d1b/d10f/d15/ffe 302142 0 2023-12-16T20:11:47.784 INFO:tasks.workunit.client.1.smithi141.stdout:2/923: dread d6/d32/d7a/d5f/d92/fa4 [0,4194304] 0 2023-12-16T20:11:47.785 INFO:tasks.workunit.client.1.smithi141.stdout:2/924: write d6/d32/f39 [706240,40420] 0 2023-12-16T20:11:47.786 INFO:tasks.workunit.client.1.smithi141.stdout:2/925: symlink d6/d32/d7a/d5f/l130 0 2023-12-16T20:11:47.786 INFO:tasks.workunit.client.1.smithi141.stdout:2/926: stat d6/d3a/d47/c11e 0 2023-12-16T20:11:47.786 INFO:tasks.workunit.client.1.smithi141.stdout:2/927: dread - d6/d3a/d47/d58/f10a zero size 2023-12-16T20:11:47.794 INFO:tasks.workunit.client.1.smithi141.stdout:2/928: dread d6/da/d1b/d10f/d15/f44 [0,4194304] 0 2023-12-16T20:11:47.794 INFO:tasks.workunit.client.1.smithi141.stdout:2/929: fdatasync d6/d3a/fea 0 2023-12-16T20:11:47.794 INFO:tasks.workunit.client.1.smithi141.stdout:2/930: symlink d6/da/d33/l131 0 2023-12-16T20:11:47.800 INFO:tasks.workunit.client.1.smithi141.stdout:2/931: read d6/d32/d52/d53/fa0 [5000766,53896] 0 2023-12-16T20:11:47.802 INFO:tasks.workunit.client.1.smithi141.stdout:2/932: creat d6/d32/d7a/d5f/f132 x:0 0 0 2023-12-16T20:11:47.806 INFO:tasks.workunit.client.1.smithi141.stdout:2/933: write d6/da/d1b/d10f/d15/f4c [141584,50446] 0 2023-12-16T20:11:47.806 INFO:tasks.workunit.client.1.smithi141.stdout:2/934: chown d6/d32/d7a/ddf/d98/df6 416882213 1 2023-12-16T20:11:47.806 INFO:tasks.workunit.client.1.smithi141.stdout:2/935: readlink d6/da/d1b/d10f/d1f/d46/lff 0 2023-12-16T20:11:47.807 INFO:tasks.workunit.client.1.smithi141.stdout:2/936: write d6/da/d1b/d10f/d15/ffe [300420,53446] 0 2023-12-16T20:11:47.807 INFO:tasks.workunit.client.1.smithi141.stdout:2/937: truncate d6/da/d33/d54/f7f 828559 0 2023-12-16T20:11:47.807 INFO:tasks.workunit.client.1.smithi141.stdout:2/938: mknod d6/d32/d7a/d5f/d92/c133 0 2023-12-16T20:11:47.814 INFO:tasks.workunit.client.1.smithi141.stdout:4/977: sync 2023-12-16T20:11:47.814 INFO:tasks.workunit.client.1.smithi141.stdout:5/981: sync 2023-12-16T20:11:47.814 INFO:tasks.workunit.client.1.smithi141.stdout:9/936: sync 2023-12-16T20:11:47.815 INFO:tasks.workunit.client.1.smithi141.stdout:2/939: dread d6/da/d1b/d10f/d1f/d46/f63 [0,4194304] 0 2023-12-16T20:11:47.816 INFO:tasks.workunit.client.1.smithi141.stdout:9/937: creat d1/d10/d14/d20/d90/dca/f13b x:0 0 0 2023-12-16T20:11:47.816 INFO:tasks.workunit.client.1.smithi141.stdout:9/938: chown d1/d10/d33/d47/d8d/ddf/dcd/dd9/l10e 7274008 1 2023-12-16T20:11:47.816 INFO:tasks.workunit.client.1.smithi141.stdout:9/939: chown d1/d10/d14/d20/da/f41 6144 1 2023-12-16T20:11:47.817 INFO:tasks.workunit.client.1.smithi141.stdout:5/982: getdents d0/d9/d16/d72/dc6 0 2023-12-16T20:11:47.819 INFO:tasks.workunit.client.1.smithi141.stdout:2/940: link d6/da/d1b/d5b/d6a/l6e d6/d32/d7a/d5f/l134 0 2023-12-16T20:11:47.821 INFO:tasks.workunit.client.1.smithi141.stdout:5/983: symlink d0/d25/d30/d8a/da0/l147 0 2023-12-16T20:11:47.821 INFO:tasks.workunit.client.1.smithi141.stdout:2/941: symlink d6/d32/d7a/d5f/l135 0 2023-12-16T20:11:47.824 INFO:tasks.workunit.client.1.smithi141.stdout:2/942: rename d6/d3a/d9d/cee to d6/da/d1b/d5b/d6a/c136 0 2023-12-16T20:11:47.824 INFO:tasks.workunit.client.1.smithi141.stdout:2/943: fsync d6/da/d33/f81 0 2023-12-16T20:11:47.829 INFO:tasks.workunit.client.1.smithi141.stdout:5/984: rmdir d0/d25 39 2023-12-16T20:11:47.829 INFO:tasks.workunit.client.1.smithi141.stdout:5/985: readlink d0/d14/d2c/d4a/l7d 0 2023-12-16T20:11:47.830 INFO:tasks.workunit.client.1.smithi141.stdout:2/944: rmdir d6/da/d33/d54/d73 39 2023-12-16T20:11:47.830 INFO:tasks.workunit.client.1.smithi141.stdout:2/945: write d6/da/d1b/d10f/d1f/fa6 [2686596,70003] 0 2023-12-16T20:11:47.830 INFO:tasks.workunit.client.1.smithi141.stdout:2/946: creat d6/d32/d7a/d5f/f137 x:0 0 0 2023-12-16T20:11:47.832 INFO:tasks.workunit.client.1.smithi141.stdout:5/986: rename d0/d12b/feb to d0/d14/d2c/f148 0 2023-12-16T20:11:47.834 INFO:tasks.workunit.client.1.smithi141.stdout:4/978: dwrite d1a/d3c/d9b/da1/dcf/f106 [0,4194304] 0 2023-12-16T20:11:47.834 INFO:tasks.workunit.client.1.smithi141.stdout:4/979: fsync d1a/d2a/d3b/d69/f84 0 2023-12-16T20:11:47.834 INFO:tasks.workunit.client.1.smithi141.stdout:4/980: creat d1a/d59/d89/d8a/f168 x:0 0 0 2023-12-16T20:11:47.835 INFO:tasks.workunit.client.1.smithi141.stdout:2/947: creat d6/da/d4a/d5e/f138 x:0 0 0 2023-12-16T20:11:47.835 INFO:tasks.workunit.client.1.smithi141.stdout:2/948: chown d6/da/d1b/d10f/d1f/d46/d5a/l6f 0 1 2023-12-16T20:11:47.836 INFO:tasks.workunit.client.1.smithi141.stdout:2/949: dread d6/f9e [0,4194304] 0 2023-12-16T20:11:47.837 INFO:tasks.workunit.client.1.smithi141.stdout:5/987: symlink d0/d9/d16/d2a/d35/d5e/dee/l149 0 2023-12-16T20:11:47.837 INFO:tasks.workunit.client.1.smithi141.stdout:2/950: chown d6/da/d1b/d10f/d1f/d46/la5 31 1 2023-12-16T20:11:47.837 INFO:tasks.workunit.client.1.smithi141.stdout:5/988: readlink d0/d9/d16/d2a/d35/d5e/dee/l12a 0 2023-12-16T20:11:47.837 INFO:tasks.workunit.client.1.smithi141.stdout:2/951: write d6/d32/da1/f103 [1897,114] 0 2023-12-16T20:11:47.839 INFO:tasks.workunit.client.1.smithi141.stdout:5/989: mknod d0/d25/d30/d8a/d11c/c14a 0 2023-12-16T20:11:47.841 INFO:tasks.workunit.client.1.smithi141.stdout:2/952: mknod d6/da/d1b/d10f/d1f/d46/d5a/c139 0 2023-12-16T20:11:47.843 INFO:tasks.workunit.client.1.smithi141.stdout:5/990: mknod d0/d9/d16/d2a/d35/dbe/dda/c14b 0 2023-12-16T20:11:47.845 INFO:tasks.workunit.client.1.smithi141.stdout:5/991: rename d0/d25/d30/f13f to d0/d9/d99/d102/dc3/f14c 0 2023-12-16T20:11:47.848 INFO:tasks.workunit.client.1.smithi141.stdout:9/940: dwrite d1/d10/d27/f79 [0,4194304] 0 2023-12-16T20:11:47.848 INFO:tasks.workunit.client.1.smithi141.stdout:5/992: rename d0/d9/d16/d2a/c80 to d0/c14d 0 2023-12-16T20:11:47.848 INFO:tasks.workunit.client.1.smithi141.stdout:5/993: fdatasync d0/d14/d2c/d4a/f4d 0 2023-12-16T20:11:47.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/941: creat d1/d10/d14/d20/da/d3f/dea/d107/d116/f13c x:0 0 0 2023-12-16T20:11:47.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/942: readlink d1/d10/d33/lb5 0 2023-12-16T20:11:47.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/943: truncate d1/d10/d33/d47/d8d/ddf/de6/de9/f112 303402 0 2023-12-16T20:11:47.852 INFO:tasks.workunit.client.1.smithi141.stdout:9/944: dread - d1/d10/d14/d20/dd6/f12c zero size 2023-12-16T20:11:47.853 INFO:tasks.workunit.client.1.smithi141.stdout:5/994: creat d0/d9/d16/d2a/d35/d5e/f14e x:0 0 0 2023-12-16T20:11:47.855 INFO:tasks.workunit.client.1.smithi141.stdout:9/945: dread d1/d10/d14/d20/da/f32 [0,4194304] 0 2023-12-16T20:11:47.855 INFO:tasks.workunit.client.1.smithi141.stdout:9/946: chown d1/d10 1830889 1 2023-12-16T20:11:47.855 INFO:tasks.workunit.client.1.smithi141.stdout:5/995: rmdir d0/dd2 39 2023-12-16T20:11:47.862 INFO:tasks.workunit.client.1.smithi141.stdout:5/996: dread d0/d14/fa7 [0,4194304] 0 2023-12-16T20:11:47.862 INFO:tasks.workunit.client.1.smithi141.stdout:4/981: dwrite d1a/d3c/f5d [0,4194304] 0 2023-12-16T20:11:47.866 INFO:tasks.workunit.client.1.smithi141.stdout:9/947: dread d1/d10/d14/f25 [0,4194304] 0 2023-12-16T20:11:47.867 INFO:tasks.workunit.client.1.smithi141.stdout:2/953: dwrite d6/da/d1b/d10f/d15/fa7 [0,4194304] 0 2023-12-16T20:11:47.867 INFO:tasks.workunit.client.1.smithi141.stdout:2/954: write d6/d32/d7a/d5f/f137 [601269,348] 0 2023-12-16T20:11:47.876 INFO:tasks.workunit.client.1.smithi141.stdout:9/948: write d1/d26/d4a/d73/f4e [1619222,66678] 0 2023-12-16T20:11:47.881 INFO:tasks.workunit.client.1.smithi141.stdout:9/949: dread d1/d10/d14/d20/d84/fb2 [0,4194304] 0 2023-12-16T20:11:47.935 INFO:tasks.workunit.client.1.smithi141.stdout:4/982: creat d1a/d3c/d9b/f169 x:0 0 0 2023-12-16T20:11:47.935 INFO:tasks.workunit.client.1.smithi141.stdout:4/983: chown d1a/d59/d89/d8a/f135 500 1 2023-12-16T20:11:47.935 INFO:tasks.workunit.client.1.smithi141.stdout:4/984: fdatasync d1a/d2a/d3b/db2/f118 0 2023-12-16T20:11:47.944 INFO:tasks.workunit.client.1.smithi141.stdout:2/955: mkdir d6/da/d1b/d10f/d13a 0 2023-12-16T20:11:47.962 INFO:tasks.workunit.client.1.smithi141.stdout:2/956: dwrite d6/da/d33/d54/d7c/fc7 [0,4194304] 0 2023-12-16T20:11:47.971 INFO:tasks.workunit.client.1.smithi141.stdout:2/957: write d6/da/d1b/d10f/d1f/d46/f9a [5076569,49184] 0 2023-12-16T20:11:47.981 INFO:tasks.workunit.client.1.smithi141.stdout:2/958: dread d6/d3a/d47/f65 [0,4194304] 0 2023-12-16T20:11:47.981 INFO:tasks.workunit.client.1.smithi141.stdout:2/959: write d6/d32/d7a/d5f/d92/fa4 [5504111,61114] 0 2023-12-16T20:11:47.985 INFO:tasks.workunit.client.1.smithi141.stdout:5/997: rename d0/d25/d30/d8a/da0 to d0/d14/d2c/d14f 0 2023-12-16T20:11:47.995 INFO:tasks.workunit.client.1.smithi141.stdout:5/998: dread d0/d14/d2c/f33 [0,4194304] 0 2023-12-16T20:11:47.995 INFO:tasks.workunit.client.1.smithi141.stdout:5/999: readlink d0/d25/d30/d67/l1f 0 2023-12-16T20:11:48.000 INFO:tasks.workunit.client.1.smithi141.stdout:2/960: dwrite d6/d32/d7a/ddf/d11b/f12c [0,4194304] 0 2023-12-16T20:11:48.000 INFO:tasks.workunit.client.1.smithi141.stdout:2/961: write d6/d32/d52/fba [462959,58034] 0 2023-12-16T20:11:48.000 INFO:tasks.workunit.client.1.smithi141.stdout:2/962: fsync d6/da/d33/d54/f7f 0 2023-12-16T20:11:48.000 INFO:tasks.workunit.client.1.smithi141.stdout:2/963: creat d6/da/d33/f13b x:0 0 0 2023-12-16T20:11:48.013 INFO:tasks.workunit.client.1.smithi141.stdout:4/985: mknod d1a/d2a/dc2/d14b/d163/c16a 0 2023-12-16T20:11:48.013 INFO:tasks.workunit.client.1.smithi141.stdout:4/986: truncate d1a/d4e/d63/daa/db9/df6/f107 728022 0 2023-12-16T20:11:48.019 INFO:tasks.workunit.client.1.smithi141.stdout:2/964: mknod d6/d3a/d47/d58/d8c/c13c 0 2023-12-16T20:11:48.019 INFO:tasks.workunit.client.1.smithi141.stdout:2/965: fsync d6/da/d1b/d10f/d1f/d46/f48 0 2023-12-16T20:11:48.019 INFO:tasks.workunit.client.1.smithi141.stdout:2/966: write d6/d32/d7a/dad/ff7 [614499,86103] 0 2023-12-16T20:11:48.020 INFO:tasks.workunit.client.1.smithi141.stdout:2/967: truncate d6/d32/d52/fc3 9125 0 2023-12-16T20:11:48.020 INFO:tasks.workunit.client.1.smithi141.stdout:2/968: write d6/da/d4a/d5e/f88 [6253467,77086] 0 2023-12-16T20:11:48.023 INFO:tasks.workunit.client.1.smithi141.stdout:2/969: mkdir d6/d32/d7a/ddf/d98/d13d 0 2023-12-16T20:11:48.023 INFO:tasks.workunit.client.1.smithi141.stdout:2/970: fsync d6/da/d1b/d10f/d1f/d46/d5a/fb6 0 2023-12-16T20:11:48.023 INFO:tasks.workunit.client.1.smithi141.stdout:2/971: symlink d6/d32/d7a/ddf/d11b/l13e 0 2023-12-16T20:11:48.024 INFO:tasks.workunit.client.1.smithi141.stdout:2/972: write d6/da/fb1 [7891264,14617] 0 2023-12-16T20:11:48.024 INFO:tasks.workunit.client.1.smithi141.stdout:2/973: write d6/da/d1b/d10f/d67/d10e/f123 [319343,21] 0 2023-12-16T20:11:48.042 INFO:tasks.workunit.client.1.smithi141.stdout:2/974: dwrite d6/d32/d52/ff3 [0,4194304] 0 2023-12-16T20:11:48.043 INFO:tasks.workunit.client.1.smithi141.stdout:9/950: rename d1/d26/fc1 to d1/d115/f13d 0 2023-12-16T20:11:48.046 INFO:tasks.workunit.client.1.smithi141.stdout:2/975: link d6/da/d4a/d5e/f88 d6/da/d1b/d5b/d6a/d85/f13f 0 2023-12-16T20:11:48.046 INFO:tasks.workunit.client.1.smithi141.stdout:2/976: write d6/da/d1b/d5b/faa [944197,15025] 0 2023-12-16T20:11:48.046 INFO:tasks.workunit.client.1.smithi141.stdout:2/977: stat d6/d3a/d47/d58/d8c/la3 0 2023-12-16T20:11:48.046 INFO:tasks.workunit.client.1.smithi141.stdout:2/978: stat d6/da/d1b/d10f/f29 0 2023-12-16T20:11:48.058 INFO:tasks.workunit.client.1.smithi141.stdout:0/922: sync 2023-12-16T20:11:48.058 INFO:tasks.workunit.client.1.smithi141.stdout:0/923: chown d4/d5c/daf 0 1 2023-12-16T20:11:48.059 INFO:tasks.workunit.client.1.smithi141.stdout:0/924: mknod d4/d49/d73/d3b/d78/d7f/c137 0 2023-12-16T20:11:48.061 INFO:tasks.workunit.client.1.smithi141.stdout:2/979: dwrite d6/da/d1b/d10f/dd8/f105 [0,4194304] 0 2023-12-16T20:11:48.061 INFO:tasks.workunit.client.1.smithi141.stdout:4/987: rename fa to d1a/d3c/d9b/da1/dcf/f16b 0 2023-12-16T20:11:48.061 INFO:tasks.workunit.client.1.smithi141.stdout:4/988: chown d1a/d2a/dc3/fea 0 1 2023-12-16T20:11:48.063 INFO:tasks.workunit.client.1.smithi141.stdout:9/951: rename d1/d26/da1 to d1/dce/d13e 0 2023-12-16T20:11:48.064 INFO:tasks.workunit.client.1.smithi141.stdout:4/989: stat d1a/d3c/d9b/da1/dcf/df1/l15e 0 2023-12-16T20:11:48.064 INFO:tasks.workunit.client.1.smithi141.stdout:4/990: dread - d1a/d54/f132 zero size 2023-12-16T20:11:48.065 INFO:tasks.workunit.client.1.smithi141.stdout:2/980: rename d6/d32/d7a/ddf/d98/df6/f113 to d6/d3a/d47/d124/f140 0 2023-12-16T20:11:48.066 INFO:tasks.workunit.client.1.smithi141.stdout:9/952: symlink d1/d10/d14/d20/d3b/l13f 0 2023-12-16T20:11:48.067 INFO:tasks.workunit.client.1.smithi141.stdout:4/991: rmdir d1a/d3c/d9b/da1/da6/d13d 0 2023-12-16T20:11:48.067 INFO:tasks.workunit.client.1.smithi141.stdout:4/992: stat d1a/d2a/f37 0 2023-12-16T20:11:48.070 INFO:tasks.workunit.client.1.smithi141.stdout:4/993: rename d1a/c36 to d1a/d54/d87/dbf/df3/c16c 0 2023-12-16T20:11:48.079 INFO:tasks.workunit.client.1.smithi141.stdout:0/925: dwrite d4/d49/d73/d3b/d78/d7f/f11a [4194304,4194304] 0 2023-12-16T20:11:48.080 INFO:tasks.workunit.client.1.smithi141.stdout:0/926: fdatasync d4/d7/f24 0 2023-12-16T20:11:48.093 INFO:tasks.workunit.client.1.smithi141.stdout:0/927: dread d4/d49/d73/d3b/d78/d7f/f90 [0,4194304] 0 2023-12-16T20:11:48.093 INFO:tasks.workunit.client.1.smithi141.stdout:0/928: read d4/d49/d73/d3b/f67 [977612,83509] 0 2023-12-16T20:11:48.093 INFO:tasks.workunit.client.1.smithi141.stdout:0/929: write d4/d7/f1e [1731778,31659] 0 2023-12-16T20:11:48.098 INFO:tasks.workunit.client.1.smithi141.stdout:2/981: dwrite d6/da/d1b/d10f/d1f/d46/f9a [0,4194304] 0 2023-12-16T20:11:48.099 INFO:tasks.workunit.client.1.smithi141.stdout:9/953: dwrite d1/d26/d4a/d73/d76/fcf [0,4194304] 0 2023-12-16T20:11:48.099 INFO:tasks.workunit.client.1.smithi141.stdout:9/954: write d1/d10/d33/d47/d8d/f102 [521258,31029] 0 2023-12-16T20:11:48.100 INFO:tasks.workunit.client.1.smithi141.stdout:2/982: truncate d6/d32/d52/ff3 342078 0 2023-12-16T20:11:48.106 INFO:tasks.workunit.client.1.smithi141.stdout:2/983: link d6/d3a/cce d6/da/d33/c141 0 2023-12-16T20:11:48.106 INFO:tasks.workunit.client.1.smithi141.stdout:2/984: chown d6/d3a/f2c 779 1 2023-12-16T20:11:48.106 INFO:tasks.workunit.client.1.smithi141.stdout:2/985: read d6/d32/d7a/ddf/f11d [685419,93642] 0 2023-12-16T20:11:48.106 INFO:tasks.workunit.client.1.smithi141.stdout:2/986: mknod d6/d32/d7a/ddf/c142 0 2023-12-16T20:11:48.108 INFO:tasks.workunit.client.1.smithi141.stdout:2/987: rename d6/da/d1b/d10f/d15/ffe to d6/da/d1b/d10f/dd8/f143 0 2023-12-16T20:11:48.108 INFO:tasks.workunit.client.1.smithi141.stdout:2/988: chown d6/da/d1b/d10f/d1f/l25 360390334 1 2023-12-16T20:11:48.109 INFO:tasks.workunit.client.1.smithi141.stdout:2/989: symlink d6/d32/d7a/ddf/d98/d13d/l144 0 2023-12-16T20:11:48.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/930: dwrite d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 [4194304,4194304] 0 2023-12-16T20:11:48.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/931: readlink d4/d49/d73/l47 0 2023-12-16T20:11:48.110 INFO:tasks.workunit.client.1.smithi141.stdout:0/932: read - d4/d49/d73/d8a/da4/dcc/d127/f131 zero size 2023-12-16T20:11:48.114 INFO:tasks.workunit.client.1.smithi141.stdout:9/955: dread d1/d10/d27/d36/f3a [0,4194304] 0 2023-12-16T20:11:48.123 INFO:tasks.workunit.client.1.smithi141.stdout:0/933: dread d4/d49/da1/fb8 [0,4194304] 0 2023-12-16T20:11:48.124 INFO:tasks.workunit.client.1.smithi141.stdout:0/934: readlink d4/d49/da1/df3/da3/d107/l112 0 2023-12-16T20:11:48.129 INFO:tasks.workunit.client.1.smithi141.stdout:2/990: dwrite d6/da/d33/f13b [0,4194304] 0 2023-12-16T20:11:48.134 INFO:tasks.workunit.client.1.smithi141.stdout:2/991: rename d6/f7 to d6/dc4/f145 0 2023-12-16T20:11:48.150 INFO:tasks.workunit.client.1.smithi141.stdout:0/935: read d4/d49/d73/d3b/f10b [398630,83190] 0 2023-12-16T20:11:48.150 INFO:tasks.workunit.client.1.smithi141.stdout:0/936: write d4/d5c/daf/fe3 [810533,21360] 0 2023-12-16T20:11:48.151 INFO:tasks.workunit.client.1.smithi141.stdout:0/937: symlink d4/d49/d73/d3b/d78/d7f/l138 0 2023-12-16T20:11:48.152 INFO:tasks.workunit.client.1.smithi141.stdout:0/938: chown d4/d5c/daf/cda 3 1 2023-12-16T20:11:48.152 INFO:tasks.workunit.client.1.smithi141.stdout:0/939: fdatasync d4/d49/d73/f46 0 2023-12-16T20:11:48.159 INFO:tasks.workunit.client.1.smithi141.stdout:0/940: dread d4/d49/d73/d3b/d78/d7f/d80/d83/db5/fc6 [0,4194304] 0 2023-12-16T20:11:48.162 INFO:tasks.workunit.client.1.smithi141.stdout:0/941: truncate d4/d49/da1/df3/da3/fe2 3986071 0 2023-12-16T20:11:48.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/942: dread d4/d49/d73/d3b/f84 [0,4194304] 0 2023-12-16T20:11:48.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/943: chown d4/d7/f24 315703 1 2023-12-16T20:11:48.172 INFO:tasks.workunit.client.1.smithi141.stdout:0/944: stat d4/d7/f24 0 2023-12-16T20:11:48.179 INFO:tasks.workunit.client.1.smithi141.stdout:0/945: dread d4/d49/d73/d3b/d78/f4f [0,4194304] 0 2023-12-16T20:11:48.180 INFO:tasks.workunit.client.1.smithi141.stdout:0/946: creat d4/d7/db0/ddb/dfc/f139 x:0 0 0 2023-12-16T20:11:48.181 INFO:tasks.workunit.client.1.smithi141.stdout:0/947: mkdir d4/d49/d73/d3b/d78/d7f/d80/d13a 0 2023-12-16T20:11:48.183 INFO:tasks.workunit.client.1.smithi141.stdout:0/948: unlink d4/d49/db9/dcd/de8/l118 0 2023-12-16T20:11:48.185 INFO:tasks.workunit.client.1.smithi141.stdout:0/949: creat d4/d49/da1/dbd/def/f13b x:0 0 0 2023-12-16T20:11:48.186 INFO:tasks.workunit.client.1.smithi141.stdout:0/950: getdents d4/d49/d73/d3b/ded 0 2023-12-16T20:11:48.186 INFO:tasks.workunit.client.1.smithi141.stdout:0/951: creat d4/d49/d73/d8a/da4/dcc/f13c x:0 0 0 2023-12-16T20:11:48.186 INFO:tasks.workunit.client.1.smithi141.stdout:0/952: dread - d4/d7/db0/ddb/dfc/f139 zero size 2023-12-16T20:11:48.190 INFO:tasks.workunit.client.1.smithi141.stdout:0/953: rename d4/d74/c9c to d4/d49/db9/dcd/de8/c13d 0 2023-12-16T20:11:48.884 INFO:tasks.workunit.client.1.smithi141.stdout:4/994: sync 2023-12-16T20:11:48.884 INFO:tasks.workunit.client.1.smithi141.stdout:4/995: stat d1a/d59/d89/d8a/f138 0 2023-12-16T20:11:48.884 INFO:tasks.workunit.client.1.smithi141.stdout:4/996: creat d1a/d2a/d3b/f16d x:0 0 0 2023-12-16T20:11:48.885 INFO:tasks.workunit.client.1.smithi141.stdout:2/992: sync 2023-12-16T20:11:48.885 INFO:tasks.workunit.client.1.smithi141.stdout:0/954: sync 2023-12-16T20:11:48.885 INFO:tasks.workunit.client.1.smithi141.stdout:9/956: sync 2023-12-16T20:11:48.887 INFO:tasks.workunit.client.1.smithi141.stdout:0/955: mkdir d4/d7/db0/ddb/dfc/d13e 0 2023-12-16T20:11:48.890 INFO:tasks.workunit.client.1.smithi141.stdout:2/993: rename d6/da/d1b/d10f/d1f/lb9 to d6/d3a/d47/d58/d8c/dfc/l146 0 2023-12-16T20:11:48.890 INFO:tasks.workunit.client.1.smithi141.stdout:2/994: write d6/d32/d7a/d5f/f137 [1446705,3319] 0 2023-12-16T20:11:48.890 INFO:tasks.workunit.client.1.smithi141.stdout:2/995: truncate d6/da/d1b/d10f/dd8/f143 1064324 0 2023-12-16T20:11:48.891 INFO:tasks.workunit.client.1.smithi141.stdout:0/956: symlink d4/d49/d73/d3b/d78/d7f/l13f 0 2023-12-16T20:11:48.892 INFO:tasks.workunit.client.1.smithi141.stdout:0/957: dread d4/d49/da1/df3/da3/f11c [0,4194304] 0 2023-12-16T20:11:48.893 INFO:tasks.workunit.client.1.smithi141.stdout:2/996: creat d6/d32/d7a/ddf/d98/df6/f147 x:0 0 0 2023-12-16T20:11:48.894 INFO:tasks.workunit.client.1.smithi141.stdout:2/997: write d6/d32/d52/fc3 [84923,20047] 0 2023-12-16T20:11:48.894 INFO:tasks.workunit.client.1.smithi141.stdout:2/998: read - d6/d32/d7a/ddf/d98/df6/f147 zero size 2023-12-16T20:11:48.894 INFO:tasks.workunit.client.1.smithi141.stdout:2/999: chown d6/dd1/fed 416803517 1 2023-12-16T20:11:48.894 INFO:tasks.workunit.client.1.smithi141.stdout:0/958: dread d4/d49/d73/d3b/f79 [0,4194304] 0 2023-12-16T20:11:48.894 INFO:tasks.workunit.client.1.smithi141.stdout:0/959: chown d4/d49/f71 101 1 2023-12-16T20:11:48.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/997: dwrite d1a/d3c/d9b/da1/dcf/f145 [0,4194304] 0 2023-12-16T20:11:48.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/998: fdatasync d1a/d2a/d3b/d69/f147 0 2023-12-16T20:11:48.901 INFO:tasks.workunit.client.1.smithi141.stdout:4/999: chown d1a/d4e/d63/daa/f165 102785517 1 2023-12-16T20:11:48.904 INFO:tasks.workunit.client.1.smithi141.stdout:0/960: write d4/d49/d73/fad [1784729,7703] 0 2023-12-16T20:11:48.905 INFO:tasks.workunit.client.1.smithi141.stdout:0/961: mkdir d4/d49/d73/d3b/d78/d7f/d80/d116/d140 0 2023-12-16T20:11:48.907 INFO:tasks.workunit.client.1.smithi141.stdout:0/962: rmdir d4/d49/d8f 39 2023-12-16T20:11:48.908 INFO:tasks.workunit.client.1.smithi141.stdout:0/963: truncate d4/d49/da1/fd3 4419774 0 2023-12-16T20:11:49.278 INFO:tasks.workunit.client.1.smithi141.stdout:9/957: sync 2023-12-16T20:11:49.281 INFO:tasks.workunit.client.1.smithi141.stdout:9/958: symlink d1/d10/d14/d20/d90/dca/de7/l140 0 2023-12-16T20:11:49.281 INFO:tasks.workunit.client.1.smithi141.stdout:9/959: fsync d1/d10/d33/d47/d83/ddd/ff0 0 2023-12-16T20:11:49.281 INFO:tasks.workunit.client.1.smithi141.stdout:9/960: write d1/d10/d33/d47/d8d/dc4/d11f/f131 [305202,57910] 0 2023-12-16T20:11:49.281 INFO:tasks.workunit.client.1.smithi141.stdout:9/961: creat d1/d10/d14/d20/d90/dca/f141 x:0 0 0 2023-12-16T20:11:49.282 INFO:tasks.workunit.client.1.smithi141.stdout:9/962: mknod d1/d10/d27/c142 0 2023-12-16T20:11:49.284 INFO:tasks.workunit.client.1.smithi141.stdout:9/963: rmdir d1/d10/d33/d47/d8d/dc4/d11f 39 2023-12-16T20:11:49.284 INFO:tasks.workunit.client.1.smithi141.stdout:9/964: dread - d1/d10/d33/d6a/fe2 zero size 2023-12-16T20:11:49.285 INFO:tasks.workunit.client.1.smithi141.stdout:9/965: mkdir d1/d10/d14/d20/dd6/d101/d143 0 2023-12-16T20:11:49.286 INFO:tasks.workunit.client.1.smithi141.stdout:9/966: creat d1/d10/d14/d20/f144 x:0 0 0 2023-12-16T20:11:49.295 INFO:tasks.workunit.client.1.smithi141.stdout:9/967: dread d1/d10/d33/d47/d8d/ddf/fbf [0,4194304] 0 2023-12-16T20:11:49.295 INFO:tasks.workunit.client.1.smithi141.stdout:9/968: creat d1/d10/d14/d20/d90/dca/f145 x:0 0 0 2023-12-16T20:11:49.296 INFO:tasks.workunit.client.1.smithi141.stdout:9/969: creat d1/d10/d14/d20/d90/dca/d119/f146 x:0 0 0 2023-12-16T20:11:49.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/970: truncate d1/d10/d33/d47/d8d/ddf/dcd/fda 580594 0 2023-12-16T20:11:49.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/971: readlink d1/d26/l96 0 2023-12-16T20:11:49.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/972: symlink d1/d10/d33/d47/l147 0 2023-12-16T20:11:49.299 INFO:tasks.workunit.client.1.smithi141.stdout:9/973: chown d1/d10/d27/d36 403680 1 2023-12-16T20:11:49.308 INFO:tasks.workunit.client.1.smithi141.stdout:9/974: write d1/d115/f13d [3254892,85808] 0 2023-12-16T20:11:49.310 INFO:tasks.workunit.client.1.smithi141.stdout:9/975: link d1/d10/d33/d47/d8d/ddf/de6/l136 d1/d10/d14/d20/dd6/d101/l148 0 2023-12-16T20:11:49.482 INFO:tasks.workunit.client.1.smithi141.stdout:0/964: sync 2023-12-16T20:11:49.500 INFO:tasks.workunit.client.1.smithi141.stdout:0/965: dwrite d4/d49/d73/d3b/d78/f4f [0,4194304] 0 2023-12-16T20:11:49.502 INFO:tasks.workunit.client.1.smithi141.stdout:9/976: sync 2023-12-16T20:11:49.511 INFO:tasks.workunit.client.1.smithi141.stdout:9/977: dread d1/d10/d33/d47/d8d/dc4/fd4 [0,4194304] 0 2023-12-16T20:11:49.513 INFO:tasks.workunit.client.1.smithi141.stdout:9/978: rename d1/d26/d4a/d73/fc5 to d1/d26/f149 0 2023-12-16T20:11:49.518 INFO:tasks.workunit.client.1.smithi141.stdout:0/966: dwrite d4/d49/da1/dbd/def/f13b [0,4194304] 0 2023-12-16T20:11:49.522 INFO:tasks.workunit.client.1.smithi141.stdout:9/979: dread d1/d10/d27/fa9 [0,4194304] 0 2023-12-16T20:11:49.523 INFO:tasks.workunit.client.1.smithi141.stdout:9/980: link d1/d10/d14/d20/d90/dca/f145 d1/d10/d14/f14a 0 2023-12-16T20:11:49.524 INFO:tasks.workunit.client.1.smithi141.stdout:9/981: mkdir d1/d26/d14b 0 2023-12-16T20:11:49.525 INFO:tasks.workunit.client.1.smithi141.stdout:9/982: readlink d1/d26/d3c/d9b/l125 0 2023-12-16T20:11:49.525 INFO:tasks.workunit.client.1.smithi141.stdout:9/983: chown d1/lf7 2028667 1 2023-12-16T20:11:49.526 INFO:tasks.workunit.client.1.smithi141.stdout:9/984: symlink d1/d26/d4a/dde/l14c 0 2023-12-16T20:11:49.526 INFO:tasks.workunit.client.1.smithi141.stdout:9/985: write d1/d10/d14/d20/da/d3f/f10d [939008,52093] 0 2023-12-16T20:11:49.526 INFO:tasks.workunit.client.1.smithi141.stdout:9/986: write d1/d10/d14/d20/d84/ffa [1356263,35437] 0 2023-12-16T20:11:49.527 INFO:tasks.workunit.client.1.smithi141.stdout:0/967: read d4/f33 [8192939,73876] 0 2023-12-16T20:11:49.527 INFO:tasks.workunit.client.1.smithi141.stdout:9/987: creat d1/d10/d14/d20/db3/f14d x:0 0 0 2023-12-16T20:11:49.527 INFO:tasks.workunit.client.1.smithi141.stdout:9/988: dread - d1/d26/f113 zero size 2023-12-16T20:11:49.527 INFO:tasks.workunit.client.1.smithi141.stdout:9/989: read d1/d10/d14/f31 [3755208,80891] 0 2023-12-16T20:11:49.529 INFO:tasks.workunit.client.1.smithi141.stdout:0/968: rename d4/d74/dc1/fa0 to d4/d7/db0/ddb/dfc/d11e/f141 0 2023-12-16T20:11:49.529 INFO:tasks.workunit.client.1.smithi141.stdout:0/969: write d4/d7/f10f [756358,13692] 0 2023-12-16T20:11:49.530 INFO:tasks.workunit.client.1.smithi141.stdout:0/970: creat d4/d7/db0/ddb/dfc/d11e/f142 x:0 0 0 2023-12-16T20:11:49.530 INFO:tasks.workunit.client.1.smithi141.stdout:0/971: write d4/d49/da1/df3/da3/fe2 [3535821,47115] 0 2023-12-16T20:11:49.531 INFO:tasks.workunit.client.1.smithi141.stdout:0/972: rmdir d4/d49 39 2023-12-16T20:11:49.533 INFO:tasks.workunit.client.1.smithi141.stdout:0/973: rename d4/d49/da1/dbd/def/f13b to d4/d49/da1/df3/da3/f143 0 2023-12-16T20:11:49.533 INFO:tasks.workunit.client.1.smithi141.stdout:0/974: readlink d4/d49/da1/df3/da3/d107/l112 0 2023-12-16T20:11:49.533 INFO:tasks.workunit.client.1.smithi141.stdout:0/975: dread - d4/d49/d73/fd9 zero size 2023-12-16T20:11:49.535 INFO:tasks.workunit.client.1.smithi141.stdout:0/976: symlink d4/d7/d12b/l144 0 2023-12-16T20:11:49.535 INFO:tasks.workunit.client.1.smithi141.stdout:0/977: stat d4/d49/d73/d8a/da4 0 2023-12-16T20:11:49.538 INFO:tasks.workunit.client.1.smithi141.stdout:0/978: link d4/d49/f71 d4/d74/dc1/dbe/f145 0 2023-12-16T20:11:49.538 INFO:tasks.workunit.client.1.smithi141.stdout:0/979: chown d4/d49/d73/d3b/d78/d7f/d80/d13a 110 1 2023-12-16T20:11:49.548 INFO:tasks.workunit.client.1.smithi141.stdout:9/990: dwrite d1/d10/d14/d20/d90/f9f [0,4194304] 0 2023-12-16T20:11:49.548 INFO:tasks.workunit.client.1.smithi141.stdout:9/991: chown d1/d10/d14/d20/d84/ffa 19 1 2023-12-16T20:11:49.550 INFO:tasks.workunit.client.1.smithi141.stdout:9/992: rename d1/d10/d33/d47/d8d/ddf/fc0 to d1/d10/d14/d20/d90/dca/d119/f14e 0 2023-12-16T20:11:49.555 INFO:tasks.workunit.client.1.smithi141.stdout:0/980: dwrite d4/d7/db0/f132 [0,4194304] 0 2023-12-16T20:11:49.560 INFO:tasks.workunit.client.1.smithi141.stdout:0/981: dread d4/d49/d73/d3b/f10b [0,4194304] 0 2023-12-16T20:11:49.562 INFO:tasks.workunit.client.1.smithi141.stdout:0/982: truncate d4/d49/d73/d3b/f10b 284897 0 2023-12-16T20:11:49.564 INFO:tasks.workunit.client.1.smithi141.stdout:0/983: rename d4/d7/f100 to d4/d49/d73/d3b/d78/d7f/d80/d116/d140/f146 0 2023-12-16T20:11:49.565 INFO:tasks.workunit.client.1.smithi141.stdout:0/984: truncate d4/d7/f24 2751785 0 2023-12-16T20:11:49.565 INFO:tasks.workunit.client.1.smithi141.stdout:0/985: chown d4/d7/lb 150897 1 2023-12-16T20:11:49.567 INFO:tasks.workunit.client.1.smithi141.stdout:0/986: mkdir d4/d49/d73/d8a/da4/dcc/d127/d147 0 2023-12-16T20:11:49.567 INFO:tasks.workunit.client.1.smithi141.stdout:0/987: dread - d4/d49/d73/d8a/da4/dcc/f13c zero size 2023-12-16T20:11:49.576 INFO:tasks.workunit.client.1.smithi141.stdout:9/993: dwrite d1/d10/d33/f8b [0,4194304] 0 2023-12-16T20:11:49.579 INFO:tasks.workunit.client.1.smithi141.stdout:9/994: unlink d1/d10/d33/d47/d8d/ddf/caa 0 2023-12-16T20:11:49.590 INFO:tasks.workunit.client.1.smithi141.stdout:0/988: dwrite d4/d49/d73/f115 [0,4194304] 0 2023-12-16T20:11:49.590 INFO:tasks.workunit.client.1.smithi141.stdout:0/989: read d4/d7/f10f [622245,108205] 0 2023-12-16T20:11:49.592 INFO:tasks.workunit.client.1.smithi141.stdout:0/990: stat d4/d7/lae 0 2023-12-16T20:11:49.594 INFO:tasks.workunit.client.1.smithi141.stdout:0/991: unlink d4/d7/cc 0 2023-12-16T20:11:49.596 INFO:tasks.workunit.client.1.smithi141.stdout:0/992: mkdir d4/d49/d73/d3b/d78/d7f/d80/d13a/d148 0 2023-12-16T20:11:49.597 INFO:tasks.workunit.client.1.smithi141.stdout:0/993: unlink d4/d49/da1/dbd/def/leb 0 2023-12-16T20:11:49.600 INFO:tasks.workunit.client.1.smithi141.stdout:0/994: dread d4/d49/d8f/f94 [0,4194304] 0 2023-12-16T20:11:49.602 INFO:tasks.workunit.client.1.smithi141.stdout:0/995: mkdir d4/d49/db9/dcd/de8/d149 0 2023-12-16T20:11:49.602 INFO:tasks.workunit.client.1.smithi141.stdout:0/996: getdents d4/d49/d73/d3b/d78/d7f/d80/d13a/d148 0 2023-12-16T20:11:49.602 INFO:tasks.workunit.client.1.smithi141.stdout:0/997: getdents d4/d49/d73/d3b/ded 0 2023-12-16T20:11:49.605 INFO:tasks.workunit.client.1.smithi141.stdout:9/995: dwrite d1/d10/d33/fc8 [0,4194304] 0 2023-12-16T20:11:49.613 INFO:tasks.workunit.client.1.smithi141.stdout:0/998: write d4/d74/dc1/dbe/fde [1073906,35869] 0 2023-12-16T20:11:49.616 INFO:tasks.workunit.client.1.smithi141.stdout:0/999: rename d4/d49/d73/d3b/d78/d7f/d80/d83/ddd/l11f to d4/d49/d73/d8a/da4/dcc/l14a 0 2023-12-16T20:11:49.858 INFO:tasks.workunit.client.1.smithi141.stdout:9/996: sync 2023-12-16T20:11:49.863 INFO:tasks.workunit.client.1.smithi141.stdout:9/997: dread d1/d10/d27/d36/f3a [0,4194304] 0 2023-12-16T20:11:49.863 INFO:tasks.workunit.client.1.smithi141.stdout:9/998: fsync d1/d10/d33/d47/d8d/ddf/dcd/fda 0 2023-12-16T20:11:49.864 INFO:tasks.workunit.client.1.smithi141.stdout:9/999: mkdir d1/d10/d33/d6a/d72/d14f 0 2023-12-16T20:11:49.868 INFO:tasks.workunit.client.1.smithi141.stderr:+ rm -rf -- ./tmp.4xHX90MwIG 2023-12-16T20:11:50.051 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:49 smithi141 ceph-mon[88165]: pgmap v13: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 217 MiB/s rd, 283 MiB/s wr, 402 op/s 2023-12-16T20:11:50.063 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:49 smithi038 ceph-mon[80659]: pgmap v13: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 217 MiB/s rd, 283 MiB/s wr, 402 op/s 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: Adjusting osd_memory_target on smithi141 to 2581M 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 275 MiB/s rd, 351 MiB/s wr, 568 op/s 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:11:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:51 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: Adjusting osd_memory_target on smithi141 to 2581M 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 275 MiB/s rd, 351 MiB/s wr, 568 op/s 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:11:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:51 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:11:52.567 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:11:52.567 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Reconfiguring node-exporter.smithi038 (dependencies changed)... 2023-12-16T20:11:52.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:52 smithi038 ceph-mon[80659]: Reconfiguring daemon node-exporter.smithi038 on smithi038 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Reconfiguring node-exporter.smithi038 (dependencies changed)... 2023-12-16T20:11:52.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:52 smithi141 ceph-mon[88165]: Reconfiguring daemon node-exporter.smithi038 on smithi038 2023-12-16T20:11:54.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:53 smithi038 ceph-mon[80659]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 191 MiB/s wr, 354 op/s 2023-12-16T20:11:54.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:53 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:54.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:53 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:54.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:53 smithi141 ceph-mon[88165]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 191 MiB/s wr, 354 op/s 2023-12-16T20:11:54.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:53 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:54.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:53 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:54.812 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:54 smithi038 ceph-mon[80659]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2023-12-16T20:11:54.812 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:54 smithi038 ceph-mon[80659]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2023-12-16T20:11:55.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:54 smithi141 ceph-mon[88165]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2023-12-16T20:11:55.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:54 smithi141 ceph-mon[88165]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2023-12-16T20:11:55.520 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T20:11:55.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T20:11:55.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:55 smithi038 ceph-mon[80659]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 191 MiB/s wr, 354 op/s 2023-12-16T20:11:56.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:55 smithi141 ceph-mon[88165]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 191 MiB/s wr, 354 op/s 2023-12-16T20:11:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:57 smithi038 ceph-mon[80659]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 194 MiB/s wr, 464 op/s 2023-12-16T20:11:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:57 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:57 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:57 smithi038 ceph-mon[80659]: Reconfiguring grafana.smithi038 (dependencies changed)... 2023-12-16T20:11:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:57 smithi038 ceph-mon[80659]: Reconfiguring daemon grafana.smithi038 on smithi038 2023-12-16T20:11:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:57 smithi141 ceph-mon[88165]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 194 MiB/s wr, 464 op/s 2023-12-16T20:11:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:57 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:57 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:11:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:57 smithi141 ceph-mon[88165]: Reconfiguring grafana.smithi038 (dependencies changed)... 2023-12-16T20:11:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:57 smithi141 ceph-mon[88165]: Reconfiguring daemon grafana.smithi038 on smithi038 2023-12-16T20:11:59.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:58 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:11:59.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:58 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:11:59 smithi038 ceph-mon[80659]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 61 MiB/s rd, 70 MiB/s wr, 276 op/s 2023-12-16T20:12:00.145 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:11:59 smithi141 ceph-mon[88165]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 61 MiB/s rd, 70 MiB/s wr, 276 op/s 2023-12-16T20:12:02.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:01 smithi038 ceph-mon[80659]: pgmap v19: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 71 MiB/s wr, 436 op/s 2023-12-16T20:12:02.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:01 smithi141 ceph-mon[88165]: pgmap v19: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 71 MiB/s wr, 436 op/s 2023-12-16T20:12:04.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:03 smithi038 ceph-mon[80659]: pgmap v20: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2023-12-16T20:12:04.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:03 smithi141 ceph-mon[88165]: pgmap v20: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2023-12-16T20:12:04.621 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T20:12:04.621 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-16T20:12:06.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:05 smithi038 ceph-mon[80659]: pgmap v21: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2023-12-16T20:12:06.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:05 smithi141 ceph-mon[88165]: pgmap v21: 65 pgs: 65 active+clean; 1005 MiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2023-12-16T20:12:08.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:07 smithi038 ceph-mon[80659]: pgmap v22: 65 pgs: 65 active+clean; 589 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 375 op/s 2023-12-16T20:12:08.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:07 smithi141 ceph-mon[88165]: pgmap v22: 65 pgs: 65 active+clean; 589 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 375 op/s 2023-12-16T20:12:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:09 smithi038 ceph-mon[80659]: pgmap v23: 65 pgs: 65 active+clean; 589 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-12-16T20:12:10.185 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:09 smithi141 ceph-mon[88165]: pgmap v23: 65 pgs: 65 active+clean; 589 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 -- 172.21.15.38:0/2241870919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fcbf0 msgr2=0x7f0f9c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/2241870919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c0fd000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c004940 tx=0x7f0f8c009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 -- 172.21.15.38:0/2241870919 shutdown_connections 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/2241870919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/2241870919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c0fd000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 -- 172.21.15.38:0/2241870919 >> 172.21.15.38:0/2241870919 conn(0x7f0f9c0f82d0 msgr2=0x7f0f9c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 -- 172.21.15.38:0/2241870919 shutdown_connections 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.708+0000 7f0fa1af3700 1 -- 172.21.15.38:0/2241870919 wait complete. 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 Processor -- start 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 -- start start 2023-12-16T20:12:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c10e010 con 0x7f0f9c0fde00 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0fa1af3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c10e8b0 con 0x7f0f9c0fcbf0 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53276/0 (socket says 172.21.15.38:53276) 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 -- 172.21.15.38:0/3348913987 learned_addr learned my addr 172.21.15.38:0/3348913987 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9b7fe700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 -- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fcbf0 msgr2=0x7f0f9c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.709+0000 7f0f9affd700 1 -- 172.21.15.38:0/3348913987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c005040 con 0x7f0f9c0fde00 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0f9affd700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f90002a80 tx=0x7f0f900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f90007cc0 con 0x7f0f9c0fde00 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c10eb90 con 0x7f0f9c0fde00 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f9000f040 con 0x7f0f9c0fde00 2023-12-16T20:12:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9000da60 con 0x7f0f9c0fde00 2023-12-16T20:12:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.710+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c10f0d0 con 0x7f0f9c0fde00 2023-12-16T20:12:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.711+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c04bb80 con 0x7f0f9c0fde00 2023-12-16T20:12:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.712+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f0f9000dbc0 con 0x7f0f9c0fde00 2023-12-16T20:12:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.712+0000 7f0f83fff700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 0x7f0f8406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.712+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0f900894a0 con 0x7f0f9c0fde00 2023-12-16T20:12:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.712+0000 7f0f9b7fe700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 0x7f0f8406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.713+0000 7f0f9b7fe700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 0x7f0f8406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c004890 tx=0x7f0f8c009e30 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.717+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0f900571d0 con 0x7f0f9c0fde00 2023-12-16T20:12:10.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.947+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f9c10f4e0 con 0x7f0f8406ae40 2023-12-16T20:12:10.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.949+0000 7f0f83fff700 1 -- 172.21.15.38:0/3348913987 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0f9c10f4e0 con 0x7f0f8406ae40 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 msgr2=0x7f0f8406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 0x7f0f8406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c004890 tx=0x7f0f8c009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 msgr2=0x7f0f9c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f90002a80 tx=0x7f0f900046b0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 shutdown_connections 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f0f8406ae40 0x7f0f8406d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f9c0fcbf0 0x7f0f9c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 --2- 172.21.15.38:0/3348913987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c0fde00 0x7f0f9c10da10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 >> 172.21.15.38:0/3348913987 conn(0x7f0f9c0f82d0 msgr2=0x7f0f9c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 shutdown_connections 2023-12-16T20:12:10.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:10.951+0000 7f0fa1af3700 1 -- 172.21.15.38:0/3348913987 wait complete. 2023-12-16T20:12:10.962 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:12:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 -- 172.21.15.38:0/1207770119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 msgr2=0x7fc3400fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 --2- 172.21.15.38:0/1207770119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc3400fb2e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc330009ce0 tx=0x7fc330004d10 comp rx=0 tx=0).stop 2023-12-16T20:12:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 -- 172.21.15.38:0/1207770119 shutdown_connections 2023-12-16T20:12:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 --2- 172.21.15.38:0/1207770119 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc3400fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 --2- 172.21.15.38:0/1207770119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc3400fb2e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 -- 172.21.15.38:0/1207770119 >> 172.21.15.38:0/1207770119 conn(0x7fc3400f6950 msgr2=0x7fc3400f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 -- 172.21.15.38:0/1207770119 shutdown_connections 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.063+0000 7fc344cef700 1 -- 172.21.15.38:0/1207770119 wait complete. 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 Processor -- start 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 -- start start 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc34010db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34010e140 con 0x7fc3400faed0 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc344cef700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34010e9e0 con 0x7fc3400fdf60 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53292/0 (socket says 172.21.15.38:53292) 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 -- 172.21.15.38:0/796494583 learned_addr learned my addr 172.21.15.38:0/796494583 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33dd9b700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc34010db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 -- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 msgr2=0x7fc34010db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc34010db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33e59c700 1 -- 172.21.15.38:0/796494583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330009940 con 0x7fc3400faed0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.064+0000 7fc33dd9b700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc34010db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc33e59c700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc330004f80 tx=0x7fc330004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33000e040 con 0x7fc3400faed0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc33001cce0 con 0x7fc3400faed0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34010ec60 con 0x7fc3400faed0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc330012a40 con 0x7fc3400faed0 2023-12-16T20:12:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.065+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34010f1a0 con 0x7fc3400faed0 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.066+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3401075f0 con 0x7fc3400faed0 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.066+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fc33001c830 con 0x7fc3400faed0 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.067+0000 7fc32effd700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 0x7fc32806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.067+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc33008bb60 con 0x7fc3400faed0 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.067+0000 7fc33dd9b700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 0x7fc32806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.067+0000 7fc33dd9b700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 0x7fc32806d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc334009b80 tx=0x7fc33400b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.072+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc330059910 con 0x7fc3400faed0 2023-12-16T20:12:11.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.304+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc34010f380 con 0x7fc32806ae40 2023-12-16T20:12:11.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.306+0000 7fc32effd700 1 -- 172.21.15.38:0/796494583 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc34010f380 con 0x7fc32806ae40 2023-12-16T20:12:11.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.307+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 msgr2=0x7fc32806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.307+0000 7fc344cef700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 0x7fc32806d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc334009b80 tx=0x7fc33400b040 comp rx=0 tx=0).stop 2023-12-16T20:12:11.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 msgr2=0x7fc34010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc330004f80 tx=0x7fc330004d10 comp rx=0 tx=0).stop 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 shutdown_connections 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7fc32806ae40 0x7fc32806d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3400faed0 0x7fc34010d600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 --2- 172.21.15.38:0/796494583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400fdf60 0x7fc34010db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 >> 172.21.15.38:0/796494583 conn(0x7fc3400f6950 msgr2=0x7fc3400f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 shutdown_connections 2023-12-16T20:12:11.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.308+0000 7fc344cef700 1 -- 172.21.15.38:0/796494583 wait complete. 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 -- 172.21.15.38:0/1686062499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 msgr2=0x7f22f81003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 --2- 172.21.15.38:0/1686062499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f81003e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004940 tx=0x7f22f4009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 -- 172.21.15.38:0/1686062499 shutdown_connections 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 --2- 172.21.15.38:0/1686062499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f81003e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 --2- 172.21.15.38:0/1686062499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 0x7f22f80ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 -- 172.21.15.38:0/1686062499 >> 172.21.15.38:0/1686062499 conn(0x7f22f80fa5d0 msgr2=0x7f22f80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 -- 172.21.15.38:0/1686062499 shutdown_connections 2023-12-16T20:12:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.420+0000 7f22fff37700 1 -- 172.21.15.38:0/1686062499 wait complete. 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 Processor -- start 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 -- start start 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 0x7f22f810f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8110230 con 0x7f22f80fff70 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.421+0000 7f22fff37700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8110ad0 con 0x7f22f80fee00 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53308/0 (socket says 172.21.15.38:53308) 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 -- 172.21.15.38:0/3287887496 learned_addr learned my addr 172.21.15.38:0/3287887496 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fdcd3700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 0x7f22f810f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 -- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 msgr2=0x7f22f810f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 0x7f22f810f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.422+0000 7f22fd4d2700 1 -- 172.21.15.38:0/3287887496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4005040 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22fd4d2700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009fd0 tx=0x7f22f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f4021070 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8110d50 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8111230 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f22f401c400 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.423+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f400e070 con 0x7f22f80fff70 2023-12-16T20:12:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.424+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f804bb80 con 0x7f22f80fff70 2023-12-16T20:12:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.426+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f22f401ca00 con 0x7f22f80fff70 2023-12-16T20:12:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.426+0000 7f22ee7fc700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 0x7f22e406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.426+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f22f408b0a0 con 0x7f22f80fff70 2023-12-16T20:12:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.427+0000 7f22fdcd3700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 0x7f22e406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.427+0000 7f22fdcd3700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 0x7f22e406d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009b80 tx=0x7f22e800b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.430+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f22f4058f10 con 0x7f22f80fff70 2023-12-16T20:12:11.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.705+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f8104950 con 0x7f22e406ae40 2023-12-16T20:12:11.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.716+0000 7f22ee7fc700 1 -- 172.21.15.38:0/3287887496 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f22f8104950 con 0x7f22e406ae40 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 starting - - - - 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (6m) 28s ago 6m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (5m) 29s ago 5m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (4m) 28s ago 5m 85.6M - 9.4.7 954c08fa6188 aef7cc507220 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (2m) 28s ago 2m 154M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (2m) 28s ago 2m 82.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (2m) 29s ago 2m 100M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:12:11.717 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (2m) 29s ago 2m 159M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:9283 running (6m) 28s ago 6m 405M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6c2471ed13fc 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 running (70s) 29s ago 5m 480M - 19.0.0-202-gc7586e95 e538bb48aa15 db85819a3703 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (6m) 28s ago 7m 49.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (5m) 29s ago 5m 41.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 starting - - - - 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (5m) 29s ago 5m 15.8M - 1.5.0 0da6a335fe13 0c4b9420e095 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (4m) 28s ago 4m 240M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (4m) 28s ago 4m 257M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 28s ago 4m 222M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (3m) 29s ago 3m 250M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (3m) 29s ago 3m 209M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:12:11.718 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (3m) 29s ago 3m 273M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:12:11.719 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 28s ago 5m 58.5M - 2.43.0 a07b618ecd1d aa5366916390 2023-12-16T20:12:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 msgr2=0x7f22e406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 0x7f22e406d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009b80 tx=0x7f22e800b040 comp rx=0 tx=0).stop 2023-12-16T20:12:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 msgr2=0x7f22f810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009fd0 tx=0x7f22f4009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 shutdown_connections 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f22e406ae40 0x7f22e406d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80fee00 0x7f22f810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 --2- 172.21.15.38:0/3287887496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f80fff70 0x7f22f810fc30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 >> 172.21.15.38:0/3287887496 conn(0x7f22f80fa5d0 msgr2=0x7f22f8103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 shutdown_connections 2023-12-16T20:12:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.718+0000 7f22fff37700 1 -- 172.21.15.38:0/3287887496 wait complete. 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- 172.21.15.38:0/526957167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fcbf0 msgr2=0x7f45680fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 --2- 172.21.15.38:0/526957167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fcbf0 0x7f45680fd000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4558004940 tx=0x7f4558009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- 172.21.15.38:0/526957167 shutdown_connections 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 --2- 172.21.15.38:0/526957167 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fde00 0x7f45680fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 --2- 172.21.15.38:0/526957167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fcbf0 0x7f45680fd000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- 172.21.15.38:0/526957167 >> 172.21.15.38:0/526957167 conn(0x7f45680f82d0 msgr2=0x7f45680fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- 172.21.15.38:0/526957167 shutdown_connections 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- 172.21.15.38:0/526957167 wait complete. 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 Processor -- start 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.824+0000 7f456e5c5700 1 -- start start 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f456e5c5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fcbf0 0x7f456810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f456e5c5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f456e5c5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456810e010 con 0x7f45680fde00 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f456e5c5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456810e8b0 con 0x7f45680fcbf0 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53328/0 (socket says 172.21.15.38:53328) 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 -- 172.21.15.38:0/3359450128 learned_addr learned my addr 172.21.15.38:0/3359450128 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f4567fff700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fcbf0 0x7f456810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 -- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fcbf0 msgr2=0x7f456810d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fcbf0 0x7f456810d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 -- 172.21.15.38:0/3359450128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4558005040 con 0x7f45680fde00 2023-12-16T20:12:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f45677fe700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f455c00eb40 tx=0x7f455c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455c007cc0 con 0x7f45680fde00 2023-12-16T20:12:11.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456810eb30 con 0x7f45680fde00 2023-12-16T20:12:11.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f455c00f040 con 0x7f45680fde00 2023-12-16T20:12:11.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.825+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455c00c990 con 0x7f45680fde00 2023-12-16T20:12:11.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.826+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456810f070 con 0x7f45680fde00 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.826+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456804bb80 con 0x7f45680fde00 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.827+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f455c00cc00 con 0x7f45680fde00 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.827+0000 7f4564ff9700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 0x7f455006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.828+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f455c0894b0 con 0x7f45680fde00 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.828+0000 7f4567fff700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 0x7f455006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.828+0000 7f4567fff700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 0x7f455006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4558013680 tx=0x7f4558009e30 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:11.832+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f455c04ece0 con 0x7f45680fde00 2023-12-16T20:12:12.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.125+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4568105590 con 0x7f45680fde00 2023-12-16T20:12:12.126 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:11 smithi038 ceph-mon[80659]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 439 op/s 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.126+0000 7f4564ff9700 1 -- 172.21.15.38:0/3359450128 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f455c057210 con 0x7f45680fde00 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:12:12.127 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:12:12.128 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 msgr2=0x7f455006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 0x7f455006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4558013680 tx=0x7f4558009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 msgr2=0x7f456810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f455c00eb40 tx=0x7f455c00b040 comp rx=0 tx=0).stop 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 shutdown_connections 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f455006ae40 0x7f455006d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45680fcbf0 0x7f456810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 --2- 172.21.15.38:0/3359450128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45680fde00 0x7f456810da10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 >> 172.21.15.38:0/3359450128 conn(0x7f45680f82d0 msgr2=0x7f4568101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 shutdown_connections 2023-12-16T20:12:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.128+0000 7f456e5c5700 1 -- 172.21.15.38:0/3359450128 wait complete. 2023-12-16T20:12:12.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 -- 172.21.15.38:0/3015783354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 msgr2=0x7f18e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3015783354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e40fe250 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18d8004940 tx=0x7f18d8009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 -- 172.21.15.38:0/3015783354 shutdown_connections 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3015783354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e40fe250 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3015783354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.238+0000 7f18e9eac700 1 -- 172.21.15.38:0/3015783354 >> 172.21.15.38:0/3015783354 conn(0x7f18e40f82d0 msgr2=0x7f18e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.239+0000 7f18e9eac700 1 -- 172.21.15.38:0/3015783354 shutdown_connections 2023-12-16T20:12:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.239+0000 7f18e9eac700 1 -- 172.21.15.38:0/3015783354 wait complete. 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.239+0000 7f18e9eac700 1 Processor -- start 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e9eac700 1 -- start start 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e9eac700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e9eac700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e9eac700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e410e010 con 0x7f18e40fde00 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e9eac700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e410e8b0 con 0x7f18e40fcbf0 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53354/0 (socket says 172.21.15.38:53354) 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e2ffd700 1 -- 172.21.15.38:0/3822312156 learned_addr learned my addr 172.21.15.38:0/3822312156 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e37fe700 1 -- 172.21.15.38:0/3822312156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 msgr2=0x7f18e410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e37fe700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e37fe700 1 -- 172.21.15.38:0/3822312156 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8005040 con 0x7f18e40fcbf0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e2ffd700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.240+0000 7f18e37fe700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e410d4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18e40fdc60 tx=0x7f18d400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.241+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d4004e90 con 0x7f18e40fcbf0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.241+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18d400f040 con 0x7f18e40fcbf0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.241+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e410eb30 con 0x7f18e40fcbf0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.241+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d400c890 con 0x7f18e40fcbf0 2023-12-16T20:12:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.241+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e410f070 con 0x7f18e40fcbf0 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.242+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e404bb80 con 0x7f18e40fcbf0 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.243+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f18d400cb00 con 0x7f18e40fcbf0 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.243+0000 7f18cbfff700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 0x7f18cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.243+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f18d4089260 con 0x7f18e40fcbf0 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.243+0000 7f18e2ffd700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 0x7f18cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.244+0000 7f18e2ffd700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 0x7f18cc06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b0d0 tx=0x7f18d8009e30 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:11 smithi141 ceph-mon[88165]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 439 op/s 2023-12-16T20:12:12.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.252+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f18d404ece0 con 0x7f18e40fcbf0 2023-12-16T20:12:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.538+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 --> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e410f4c0 con 0x7f18cc06ae40 2023-12-16T20:12:12.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.541+0000 7f18cbfff700 1 -- 172.21.15.38:0/3822312156 <== mgr.24359 v2:172.21.15.141:6828/1534563216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f18e410f4c0 con 0x7f18cc06ae40 2023-12-16T20:12:12.541 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:12:12.542 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 msgr2=0x7f18cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 0x7f18cc06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b0d0 tx=0x7f18d8009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 msgr2=0x7f18e410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e410d4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18e40fdc60 tx=0x7f18d400b040 comp rx=0 tx=0).stop 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 shutdown_connections 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:6828/1534563216,v1:172.21.15.141:6829/1534563216] conn(0x7f18cc06ae40 0x7f18cc06d2f0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b0d0 tx=0x7f18d8009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18e40fcbf0 0x7f18e410d4d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 --2- 172.21.15.38:0/3822312156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e40fde00 0x7f18e410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:12.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 >> 172.21.15.38:0/3822312156 conn(0x7f18e40f82d0 msgr2=0x7f18e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:12.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 shutdown_connections 2023-12-16T20:12:12.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:12.545+0000 7f18e9eac700 1 -- 172.21.15.38:0/3822312156 wait complete. 2023-12-16T20:12:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:12 smithi038 ceph-mon[80659]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:12 smithi038 ceph-mon[80659]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:12 smithi038 ceph-mon[80659]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:12 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3359450128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:12:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:12 smithi141 ceph-mon[88165]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:12 smithi141 ceph-mon[88165]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:12 smithi141 ceph-mon[88165]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:12 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3359450128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:12:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:13 smithi038 ceph-mon[80659]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2023-12-16T20:12:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:13 smithi038 ceph-mon[80659]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:13 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:13 smithi141 ceph-mon[88165]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2023-12-16T20:12:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:13 smithi141 ceph-mon[88165]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:13 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:15.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:14 smithi038 ceph-mon[80659]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2023-12-16T20:12:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:14 smithi141 ceph-mon[88165]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2023-12-16T20:12:17.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:17 smithi038 ceph-mon[80659]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 425 op/s 2023-12-16T20:12:17.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:17 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:17.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:17 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:17 smithi141 ceph-mon[88165]: pgmap v27: 65 pgs: 65 active+clean; 305 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 425 op/s 2023-12-16T20:12:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:17 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:17 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:18.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:18 smithi038 ceph-mon[80659]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:12:18.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:18 smithi038 ceph-mon[80659]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:12:19.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:18 smithi141 ceph-mon[88165]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:12:19.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:18 smithi141 ceph-mon[88165]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:12:19.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:19 smithi038 ceph-mon[80659]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2023-12-16T20:12:20.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:19 smithi141 ceph-mon[88165]: pgmap v28: 65 pgs: 65 active+clean; 305 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2023-12-16T20:12:21.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:21 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:21.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:21 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:21.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:21 smithi038 ceph-mon[80659]: Reconfiguring node-exporter.smithi141 (dependencies changed)... 2023-12-16T20:12:21.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:21 smithi038 ceph-mon[80659]: Reconfiguring daemon node-exporter.smithi141 on smithi141 2023-12-16T20:12:21.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:21 smithi038 ceph-mon[80659]: pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 492 op/s 2023-12-16T20:12:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:21 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:21 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:21 smithi141 ceph-mon[88165]: Reconfiguring node-exporter.smithi141 (dependencies changed)... 2023-12-16T20:12:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:21 smithi141 ceph-mon[88165]: Reconfiguring daemon node-exporter.smithi141 on smithi141 2023-12-16T20:12:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:21 smithi141 ceph-mon[88165]: pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 492 op/s 2023-12-16T20:12:24.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:23 smithi038 ceph-mon[80659]: pgmap v30: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 317 op/s 2023-12-16T20:12:24.174 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:23 smithi141 ceph-mon[88165]: pgmap v30: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 317 op/s 2023-12-16T20:12:26.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:25 smithi038 ceph-mon[80659]: pgmap v31: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 317 op/s 2023-12-16T20:12:26.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:25 smithi141 ceph-mon[88165]: pgmap v31: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 317 op/s 2023-12-16T20:12:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: Upgrade: Need to upgrade myself (mgr.smithi141.cycgjd) 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: Upgrade: Need to upgrade myself (mgr.smithi141.cycgjd) 2023-12-16T20:12:27.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:26 smithi038 ceph-mon[80659]: pgmap v32: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 414 op/s 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:12:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:27.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: Upgrade: Need to upgrade myself (mgr.smithi141.cycgjd) 2023-12-16T20:12:27.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: Upgrade: Need to upgrade myself (mgr.smithi141.cycgjd) 2023-12-16T20:12:27.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:26 smithi141 ceph-mon[88165]: pgmap v32: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 414 op/s 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: Upgrade: Updating mgr.smithi038.gdlrfj 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:28.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:28 smithi038 ceph-mon[80659]: Deploying daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:12:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: Upgrade: Updating mgr.smithi038.gdlrfj 2023-12-16T20:12:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:12:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:12:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:12:28.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:28.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:28 smithi141 ceph-mon[88165]: Deploying daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:12:29.410 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:29 smithi038 ceph-mon[80659]: pgmap v33: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 268 op/s 2023-12-16T20:12:29.410 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:29 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:29.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:29 smithi141 ceph-mon[88165]: pgmap v33: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 268 op/s 2023-12-16T20:12:29.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:29 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:31.258 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:31 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:31.258 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:31 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:31.258 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:31 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:31.258 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:31 smithi141 ceph-mon[88165]: pgmap v34: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 439 op/s 2023-12-16T20:12:31.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:31 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:31.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:31 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:31.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:31 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:31.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:31 smithi038 ceph-mon[80659]: pgmap v34: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 439 op/s 2023-12-16T20:12:34.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:33 smithi038 ceph-mon[80659]: pgmap v35: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2023-12-16T20:12:34.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:33 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:34.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:33 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:33 smithi141 ceph-mon[88165]: pgmap v35: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2023-12-16T20:12:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:33 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:34.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:33 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:34 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:34 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:34 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:34 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:35 smithi038 ceph-mon[80659]: pgmap v36: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2023-12-16T20:12:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:35 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:35 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:35 smithi141 ceph-mon[88165]: pgmap v36: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2023-12-16T20:12:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:35 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:36.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:35 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:37 smithi141 ceph-mon[88165]: pgmap v37: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2023-12-16T20:12:38.023 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:37 smithi038 ceph-mon[80659]: pgmap v37: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2023-12-16T20:12:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd='[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]': finished 2023-12-16T20:12:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:39 smithi141 ceph-mon[88165]: mgrmap e26: smithi038.gdlrfj(active, starting, since 0.00977985s) 2023-12-16T20:12:39.264 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.264 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 172.21.15.141:0/3348616683' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:39.265 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T20:12:39.266 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: from='mgr.24359 ' entity='mgr.smithi141.cycgjd' cmd='[{"prefix": "mgr fail", "who": "smithi141.cycgjd"}]': finished 2023-12-16T20:12:39.266 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:39 smithi038 ceph-mon[80659]: mgrmap e26: smithi038.gdlrfj(active, starting, since 0.00977985s) 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: mgrmap e27: smithi038.gdlrfj(active, starting, since 0.0114311s) 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:12:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/key"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:12:40.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:40.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:40.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:40.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:12:40.248 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:40 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:12:40.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: mgrmap e27: smithi038.gdlrfj(active, starting, since 0.0114311s) 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/crt"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:12:40.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.gdlrfj/key"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:40.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:12:40.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:40.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:12:40.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:40 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:12:41.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: [16/Dec/2023:20:12:39] ENGINE Bus STARTING 2023-12-16T20:12:41.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: [16/Dec/2023:20:12:40] ENGINE Serving on http://172.21.15.38:8765 2023-12-16T20:12:41.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: [16/Dec/2023:20:12:40] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:12:41.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: [16/Dec/2023:20:12:40] ENGINE Bus STARTED 2023-12-16T20:12:41.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: mgrmap e28: smithi038.gdlrfj(active, since 1.01303s) 2023-12-16T20:12:41.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:41 smithi141 ceph-mon[88165]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: [16/Dec/2023:20:12:39] ENGINE Bus STARTING 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: [16/Dec/2023:20:12:40] ENGINE Serving on http://172.21.15.38:8765 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: [16/Dec/2023:20:12:40] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: [16/Dec/2023:20:12:40] ENGINE Bus STARTED 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: mgrmap e28: smithi038.gdlrfj(active, since 1.01303s) 2023-12-16T20:12:41.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:41 smithi038 ceph-mon[80659]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:42 smithi038 ceph-mon[80659]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.734+0000 7f49d21f6700 1 -- 172.21.15.38:0/293309501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409c410 msgr2=0x7f49c409c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.734+0000 7f49ca7fc700 1 -- 172.21.15.38:0/293309501 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49cc078070 con 0x7f49c409c410 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.734+0000 7f49d21f6700 1 --2- 172.21.15.38:0/293309501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409c410 0x7f49c409c860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f49cc063650 tx=0x7f49cc063c20 comp rx=0 tx=0).stop 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 -- 172.21.15.38:0/293309501 shutdown_connections 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 --2- 172.21.15.38:0/293309501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409c410 0x7f49c409c860 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 --2- 172.21.15.38:0/293309501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409b2b0 0x7f49c409b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 -- 172.21.15.38:0/293309501 >> 172.21.15.38:0/293309501 conn(0x7f49c400a310 msgr2=0x7f49c400c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 -- 172.21.15.38:0/293309501 shutdown_connections 2023-12-16T20:12:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.735+0000 7f49d21f6700 1 -- 172.21.15.38:0/293309501 wait complete. 2023-12-16T20:12:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.736+0000 7f49d21f6700 1 Processor -- start 2023-12-16T20:12:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.737+0000 7f49d21f6700 1 -- start start 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.737+0000 7f49d21f6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 0x7f49c40aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.737+0000 7f49d21f6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.737+0000 7f49d21f6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40ac660 con 0x7f49c409b2b0 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.737+0000 7f49d21f6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b1050 con 0x7f49c409c410 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49caffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49caffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:53936/0 (socket says 172.21.15.38:53936) 2023-12-16T20:12:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49caffd700 1 -- 172.21.15.38:0/3065521990 learned_addr learned my addr 172.21.15.38:0/3065521990 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49cb7fe700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 0x7f49c40aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49cb7fe700 1 -- 172.21.15.38:0/3065521990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 msgr2=0x7f49c40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49cb7fe700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49cb7fe700 1 -- 172.21.15.38:0/3065521990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc04bbe0 con 0x7f49c409b2b0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.738+0000 7f49caffd700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49cb7fe700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 0x7f49c40aba90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f49c000b550 tx=0x7f49c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c000f6f0 con 0x7f49c409b2b0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40b12b0 con 0x7f49c409b2b0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40b1820 con 0x7f49c409b2b0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49c000fd00 con 0x7f49c409b2b0 2023-12-16T20:12:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.739+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c0011e90 con 0x7f49c409b2b0 2023-12-16T20:12:42.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.740+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b00052e0 con 0x7f49c409b2b0 2023-12-16T20:12:42.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.742+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 29) v1 ==== 45672+0+0 (secure 0 0 0) 0x7f49c000f850 con 0x7f49c409b2b0 2023-12-16T20:12:42.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.742+0000 7f49b7fff700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 0x7f49bc03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:42.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.742+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f49c004c9f0 con 0x7f49c409b2b0 2023-12-16T20:12:42.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.743+0000 7f49caffd700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 0x7f49bc03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:42.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.743+0000 7f49caffd700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 0x7f49bc03abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49cc063800 tx=0x7f49cc063c20 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:42.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:42 smithi141 ceph-mon[88165]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:42.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:42.749+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f49c0022d10 con 0x7f49c409b2b0 2023-12-16T20:12:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.072+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49b0000bf0 con 0x7f49bc038720 2023-12-16T20:12:43.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.074+0000 7f49b7fff700 1 -- 172.21.15.38:0/3065521990 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f49b0000bf0 con 0x7f49bc038720 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 msgr2=0x7f49bc03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 0x7f49bc03abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49cc063800 tx=0x7f49cc063c20 comp rx=0 tx=0).stop 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 msgr2=0x7f49c40aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 0x7f49c40aba90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f49c000b550 tx=0x7f49c00091a0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 shutdown_connections 2023-12-16T20:12:43.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f49bc038720 0x7f49bc03abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49c409b2b0 0x7f49c40aba90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 --2- 172.21.15.38:0/3065521990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49c409c410 0x7f49c40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.077+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 >> 172.21.15.38:0/3065521990 conn(0x7f49c400a310 msgr2=0x7f49c409f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:43.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.078+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 shutdown_connections 2023-12-16T20:12:43.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.078+0000 7f49d21f6700 1 -- 172.21.15.38:0/3065521990 wait complete. 2023-12-16T20:12:43.090 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 -- 172.21.15.38:0/3643571345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c103250 msgr2=0x7ff21c103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 --2- 172.21.15.38:0/3643571345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c103250 0x7ff21c103660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff214009ce0 tx=0x7ff214004d10 comp rx=0 tx=0).stop 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 -- 172.21.15.38:0/3643571345 shutdown_connections 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 --2- 172.21.15.38:0/3643571345 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c104410 0x7ff21c104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 --2- 172.21.15.38:0/3643571345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c103250 0x7ff21c103660 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.240+0000 7ff2240bc700 1 -- 172.21.15.38:0/3643571345 >> 172.21.15.38:0/3643571345 conn(0x7ff21c0665a0 msgr2=0x7ff21c0669c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:43.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.241+0000 7ff2240bc700 1 -- 172.21.15.38:0/3643571345 shutdown_connections 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.241+0000 7ff2240bc700 1 -- 172.21.15.38:0/3643571345 wait complete. 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.242+0000 7ff2240bc700 1 Processor -- start 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.242+0000 7ff2240bc700 1 -- start start 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.242+0000 7ff2240bc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff2240bc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c104410 0x7ff21c07e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff2240bc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c11d810 con 0x7ff21c104410 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff2240bc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c11d950 con 0x7ff21c103250 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:53954/0 (socket says 172.21.15.38:53954) 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 -- 172.21.15.38:0/1600381560 learned_addr learned my addr 172.21.15.38:0/1600381560 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221657700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c104410 0x7ff21c07e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 -- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c104410 msgr2=0x7ff21c07e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c104410 0x7ff21c07e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.243+0000 7ff221e58700 1 -- 172.21.15.38:0/1600381560 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009940 con 0x7ff21c103250 2023-12-16T20:12:43.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff221e58700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff214009380 tx=0x7ff214004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21400e050 con 0x7ff21c103250 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c11dbd0 con 0x7ff21c103250 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff21401d8f0 con 0x7ff21c103250 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c11e050 con 0x7ff21c103250 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.244+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff214012820 con 0x7ff21c103250 2023-12-16T20:12:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.246+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 29) v1 ==== 45672+0+0 (secure 0 0 0) 0x7ff214019040 con 0x7ff21c103250 2023-12-16T20:12:43.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.246+0000 7ff2127fc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 0x7ff20803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.246+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c077bf0 con 0x7ff21c103250 2023-12-16T20:12:43.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.246+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff21404de40 con 0x7ff21c103250 2023-12-16T20:12:43.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.247+0000 7ff221657700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 0x7ff20803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.248+0000 7ff221657700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 0x7ff20803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff21c07ea80 tx=0x7ff2180090f0 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.256+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff21402ebd0 con 0x7ff21c103250 2023-12-16T20:12:43.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:43 smithi141 ceph-mon[88165]: mgrmap e29: smithi038.gdlrfj(active, since 3s) 2023-12-16T20:12:43.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:43 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:43.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:43 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:43.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:43 smithi038 ceph-mon[80659]: mgrmap e29: smithi038.gdlrfj(active, since 3s) 2023-12-16T20:12:43.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:43 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:43.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:43 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:43.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.591+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff21c11e320 con 0x7ff208038770 2023-12-16T20:12:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.593+0000 7ff2127fc700 1 -- 172.21.15.38:0/1600381560 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff21c11e320 con 0x7ff208038770 2023-12-16T20:12:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 msgr2=0x7ff20803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 0x7ff20803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff21c07ea80 tx=0x7ff2180090f0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 msgr2=0x7ff21c07dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff214009380 tx=0x7ff214004d10 comp rx=0 tx=0).stop 2023-12-16T20:12:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 shutdown_connections 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ff208038770 0x7ff20803ac20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff21c103250 0x7ff21c07dc40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 --2- 172.21.15.38:0/1600381560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff21c104410 0x7ff21c07e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.596+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 >> 172.21.15.38:0/1600381560 conn(0x7ff21c0665a0 msgr2=0x7ff21c075bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.597+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 shutdown_connections 2023-12-16T20:12:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.597+0000 7ff2240bc700 1 -- 172.21.15.38:0/1600381560 wait complete. 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- 172.21.15.38:0/2847010815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fcbf0 msgr2=0x7fb10c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 --2- 172.21.15.38:0/2847010815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c0fd000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb100004940 tx=0x7fb100009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- 172.21.15.38:0/2847010815 shutdown_connections 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 --2- 172.21.15.38:0/2847010815 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fde00 0x7fb10c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 --2- 172.21.15.38:0/2847010815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c0fd000 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- 172.21.15.38:0/2847010815 >> 172.21.15.38:0/2847010815 conn(0x7fb10c0f82d0 msgr2=0x7fb10c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- 172.21.15.38:0/2847010815 shutdown_connections 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- 172.21.15.38:0/2847010815 wait complete. 2023-12-16T20:12:43.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 Processor -- start 2023-12-16T20:12:43.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.742+0000 7fb1130cd700 1 -- start start 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb1130cd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb1130cd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 0x7fb10c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb1130cd700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c10e010 con 0x7fb10c0fde00 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb1130cd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c10e8b0 con 0x7fb10c0fcbf0 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb110e69700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb10bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 0x7fb10c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb110e69700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:53974/0 (socket says 172.21.15.38:53974) 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb110e69700 1 -- 172.21.15.38:0/3542507277 learned_addr learned my addr 172.21.15.38:0/3542507277 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb10bfff700 1 -- 172.21.15.38:0/3542507277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 msgr2=0x7fb10c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb10bfff700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.743+0000 7fb10bfff700 1 -- 172.21.15.38:0/3542507277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100005040 con 0x7fb10c0fde00 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb10bfff700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 0x7fb10c10da10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009fd0 tx=0x7fb0f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f8007ea0 con 0x7fb10c0fde00 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0f800cd40 con 0x7fb10c0fde00 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f801b6a0 con 0x7fb10c0fde00 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c10eb30 con 0x7fb10c0fde00 2023-12-16T20:12:43.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.744+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c10efb0 con 0x7fb10c0fde00 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.745+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 29) v1 ==== 45672+0+0 (secure 0 0 0) 0x7fb0f801b800 con 0x7fb10c0fde00 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.746+0000 7fb1097fa700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 0x7fb0fc03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.746+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c04bb80 con 0x7fb10c0fde00 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.746+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb0f8051290 con 0x7fb10c0fde00 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.746+0000 7fb110e69700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 0x7fb0fc03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.747+0000 7fb110e69700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 0x7fb0fc03ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1000135e0 tx=0x7fb100009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:43.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:43.751+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb0f8018d70 con 0x7fb10c0fde00 2023-12-16T20:12:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.039+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb10c105740 con 0x7fb0fc038760 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.056+0000 7fb1097fa700 1 -- 172.21.15.38:0/3542507277 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb1000097a0 con 0x7fb0fc038760 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (47s) 10s ago 6m 17.8M - 0.25.0 c8568f914cd2 f4d60e39f079 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (6m) 10s ago 6m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (5m) 1s ago 5m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (27s) 10s ago 6m 75.8M - 9.4.7 954c08fa6188 38149a9c9447 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (3m) 10s ago 3m 169M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:12:44.058 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (3m) 10s ago 3m 96.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (3m) 1s ago 3m 76.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (3m) 1s ago 3m 139M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (14s) 10s ago 7m 58.5M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283 running (102s) 1s ago 5m 129M - 19.0.0-202-gc7586e95 e538bb48aa15 db85819a3703 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (7m) 10s ago 7m 49.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (5m) 1s ago 5m 44.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (50s) 10s ago 6m 17.5M - 1.5.0 0da6a335fe13 923109d37fcd 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (19s) 1s ago 5m 8690k - 1.5.0 0da6a335fe13 e739857f0bd2 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 10s ago 5m 199M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 10s ago 5m 216M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 10s ago 4m 176M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (4m) 1s ago 4m 258M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (4m) 1s ago 4m 223M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (3m) 1s ago 3m 222M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:12:44.059 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (24s) 10s ago 6m 39.6M - 2.43.0 a07b618ecd1d 147b5a6e6722 2023-12-16T20:12:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.058+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 msgr2=0x7fb0fc03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.058+0000 7fb1130cd700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 0x7fb0fc03ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1000135e0 tx=0x7fb100009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.058+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 msgr2=0x7fb10c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.058+0000 7fb1130cd700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 0x7fb10c10da10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009fd0 tx=0x7fb0f800b040 comp rx=0 tx=0).stop 2023-12-16T20:12:44.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 shutdown_connections 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fb0fc038760 0x7fb0fc03ac10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb10c0fcbf0 0x7fb10c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 --2- 172.21.15.38:0/3542507277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb10c0fde00 0x7fb10c10da10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 >> 172.21.15.38:0/3542507277 conn(0x7fb10c0f82d0 msgr2=0x7fb10c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 shutdown_connections 2023-12-16T20:12:44.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.059+0000 7fb1130cd700 1 -- 172.21.15.38:0/3542507277 wait complete. 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 -- 172.21.15.38:0/1579695324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 msgr2=0x7f04100fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 --2- 172.21.15.38:0/1579695324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f04100fbf00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0400004940 tx=0x7f0400009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 -- 172.21.15.38:0/1579695324 shutdown_connections 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 --2- 172.21.15.38:0/1579695324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 0x7f04100fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 --2- 172.21.15.38:0/1579695324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f04100fbf00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 -- 172.21.15.38:0/1579695324 >> 172.21.15.38:0/1579695324 conn(0x7f04100f7190 msgr2=0x7f04100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:44.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.183+0000 7f04184e0700 1 -- 172.21.15.38:0/1579695324 shutdown_connections 2023-12-16T20:12:44.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.184+0000 7f04184e0700 1 -- 172.21.15.38:0/1579695324 wait complete. 2023-12-16T20:12:44.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.184+0000 7f04184e0700 1 Processor -- start 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.184+0000 7f04184e0700 1 -- start start 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.184+0000 7f04184e0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f04184e0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 0x7f041010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f04184e0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041010cfc0 con 0x7f04100fbaf0 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f04184e0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041010d860 con 0x7f04100fcd00 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42044/0 (socket says 172.21.15.38:42044) 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f0415a7b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 0x7f041010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 -- 172.21.15.38:0/3661361243 learned_addr learned my addr 172.21.15.38:0/3661361243 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 -- 172.21.15.38:0/3661361243 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 msgr2=0x7f041010c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 0x7f041010c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 -- 172.21.15.38:0/3661361243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400005040 con 0x7f04100fbaf0 2023-12-16T20:12:44.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f041627c700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0400009380 tx=0x7f0400009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f040000e040 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.185+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f040000be60 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.186+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0400013660 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.186+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041010dae0 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.186+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041010dfc0 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.187+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041004bb80 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.187+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 29) v1 ==== 45672+0+0 (secure 0 0 0) 0x7f0400013890 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.187+0000 7f0406ffd700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 0x7f03fc03efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.187+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f040004db60 con 0x7f04100fbaf0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.187+0000 7f0415a7b700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 0x7f03fc03efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.188+0000 7f0415a7b700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 0x7f03fc03efa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f040c004f40 tx=0x7f040c00b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:44.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.192+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0400025310 con 0x7f04100fbaf0 2023-12-16T20:12:44.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.340+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 30) v1 ==== 45728+0+0 (secure 0 0 0) 0x7f040001ad70 con 0x7f04100fbaf0 2023-12-16T20:12:44.425 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:44 smithi141 ceph-mon[88165]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:44.425 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:44 smithi141 ceph-mon[88165]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:44.425 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:44 smithi141 ceph-mon[88165]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:44.425 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:44 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:44.425 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:44 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.642+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f041010e230 con 0x7f04100fbaf0 2023-12-16T20:12:44.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:44 smithi038 ceph-mon[80659]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:44.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:44 smithi038 ceph-mon[80659]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:12:44.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:44 smithi038 ceph-mon[80659]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:44.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:44 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:44.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:44 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:44.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.644+0000 7f0406ffd700 1 -- 172.21.15.38:0/3661361243 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f0400025310 con 0x7f04100fbaf0 2023-12-16T20:12:44.644 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:12:44.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T20:12:44.646 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:12:44.646 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:12:44.646 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:12:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 msgr2=0x7f03fc03efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 0x7f03fc03efa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f040c004f40 tx=0x7f040c00b040 comp rx=0 tx=0).stop 2023-12-16T20:12:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 msgr2=0x7f041010c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0400009380 tx=0x7f0400009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 shutdown_connections 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f03fc03caf0 0x7f03fc03efa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04100fbaf0 0x7f041010c480 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 --2- 172.21.15.38:0/3661361243 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04100fcd00 0x7f041010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.648+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 >> 172.21.15.38:0/3661361243 conn(0x7f04100f7190 msgr2=0x7f04100fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.649+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 shutdown_connections 2023-12-16T20:12:44.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.649+0000 7f04184e0700 1 -- 172.21.15.38:0/3661361243 wait complete. 2023-12-16T20:12:44.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 -- 172.21.15.38:0/1924319572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fde00 msgr2=0x7f10780fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 --2- 172.21.15.38:0/1924319572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fde00 0x7f10780fe250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f106c004940 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:44.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 -- 172.21.15.38:0/1924319572 shutdown_connections 2023-12-16T20:12:44.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 --2- 172.21.15.38:0/1924319572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fde00 0x7f10780fe250 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 --2- 172.21.15.38:0/1924319572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fcbf0 0x7f10780fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 -- 172.21.15.38:0/1924319572 >> 172.21.15.38:0/1924319572 conn(0x7f10780f82d0 msgr2=0x7f10780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:44.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 -- 172.21.15.38:0/1924319572 shutdown_connections 2023-12-16T20:12:44.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.822+0000 7f107d499700 1 -- 172.21.15.38:0/1924319572 wait complete. 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 Processor -- start 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 -- start start 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107810e000 con 0x7f10780fcbf0 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.823+0000 7f107d499700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107810e8a0 con 0x7f10780fde00 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f1076ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.38:54022/0 (socket says 172.21.15.38:54022) 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 -- 172.21.15.38:0/885124580 learned_addr learned my addr 172.21.15.38:0/885124580 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f1076ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42060/0 (socket says 172.21.15.38:42060) 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 -- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 msgr2=0x7f107810d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:44.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 -- 172.21.15.38:0/885124580 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10780fde00 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f1076ffd700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f10767fc700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c021070 con 0x7f10780fde00 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.824+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107810eb20 con 0x7f10780fde00 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.825+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107810f000 con 0x7f10780fde00 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.825+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f106c01c400 con 0x7f10780fde00 2023-12-16T20:12:44.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.825+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c00e070 con 0x7f10780fde00 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.826+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10640052e0 con 0x7f10780fde00 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.826+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 30) v1 ==== 45728+0+0 (secure 0 0 0) 0x7f106c013a30 con 0x7f10780fde00 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.826+0000 7f105f7fe700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 0x7f106003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.826+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f106c04d400 con 0x7f10780fde00 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.826+0000 7f1076ffd700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 0x7f106003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:12:44.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.827+0000 7f1076ffd700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 0x7f106003ac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1068009b80 tx=0x7f106800b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:12:44.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:44.831+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f106c011bf0 con 0x7f10780fde00 2023-12-16T20:12:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.148+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1064000bf0 con 0x7f1060038760 2023-12-16T20:12:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.150+0000 7f105f7fe700 1 -- 172.21.15.38:0/885124580 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f1064000bf0 con 0x7f1060038760 2023-12-16T20:12:45.150 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:12:45.150 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:12:45.150 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:12:45.151 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 msgr2=0x7f106003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 0x7f106003ac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1068009b80 tx=0x7f106800b040 comp rx=0 tx=0).stop 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 msgr2=0x7f107810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 shutdown_connections 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f1060038760 0x7f106003ac10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10780fcbf0 0x7f107810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 --2- 172.21.15.38:0/885124580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10780fde00 0x7f107810da00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 >> 172.21.15.38:0/885124580 conn(0x7f10780f82d0 msgr2=0x7f1078101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 shutdown_connections 2023-12-16T20:12:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:12:45.152+0000 7f107d499700 1 -- 172.21.15.38:0/885124580 wait complete. 2023-12-16T20:12:45.476 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:45 smithi141 ceph-mon[88165]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:45.476 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:45 smithi141 ceph-mon[88165]: mgrmap e30: smithi038.gdlrfj(active, since 5s) 2023-12-16T20:12:45.476 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:45 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3661361243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:12:45.639 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:45 smithi038 ceph-mon[80659]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:45.639 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:45 smithi038 ceph-mon[80659]: mgrmap e30: smithi038.gdlrfj(active, since 5s) 2023-12-16T20:12:45.639 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:45 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3661361243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:12:46.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:46 smithi038 ceph-mon[80659]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:46.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:46 smithi038 ceph-mon[80659]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 822 KiB/s rd, 967 KiB/s wr, 181 op/s 2023-12-16T20:12:46.667 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:46 smithi141 ceph-mon[88165]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:12:46.667 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:46 smithi141 ceph-mon[88165]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 822 KiB/s rd, 967 KiB/s wr, 181 op/s 2023-12-16T20:12:48.389 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2023-12-16T20:12:48.389 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:12:48.389 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:12:48.389 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:12:48.390 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:12:48.390 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:48 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:12:48.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2023-12-16T20:12:48.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:12:48.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:12:48.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:12:48.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:12:48.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:48 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/3989239844' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:12:49.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:49 smithi038 ceph-mon[80659]: mgrmap e31: smithi038.gdlrfj(active, since 9s), standbys: smithi141.cycgjd 2023-12-16T20:12:49.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:49.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:49.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:49 smithi141 ceph-mon[88165]: mgrmap e31: smithi038.gdlrfj(active, since 9s), standbys: smithi141.cycgjd 2023-12-16T20:12:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:12:49.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:49.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:50.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:50 smithi038 ceph-mon[80659]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-12-16T20:12:50.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:50 smithi141 ceph-mon[88165]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-12-16T20:12:51.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:51 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:51.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:51 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:52.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:51 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:52.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:51 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:53.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:52 smithi038 ceph-mon[80659]: pgmap v9: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 533 op/s 2023-12-16T20:12:53.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:52 smithi141 ceph-mon[88165]: pgmap v9: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 533 op/s 2023-12-16T20:12:55.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:54 smithi038 ceph-mon[80659]: pgmap v10: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 488 op/s 2023-12-16T20:12:55.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:54 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:55.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:54 smithi141 ceph-mon[88165]: pgmap v10: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 488 op/s 2023-12-16T20:12:55.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:54 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: pgmap v11: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 548 op/s 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:12:57.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:56 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:12:57.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: pgmap v11: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 548 op/s 2023-12-16T20:12:57.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:12:57.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:12:57.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:12:57.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:56 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:57.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:12:58.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:12:58.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:58 smithi038 ceph-mon[80659]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:12:58.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:58 smithi038 ceph-mon[80659]: pgmap v12: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 561 op/s 2023-12-16T20:12:58.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:58 smithi038 ceph-mon[80659]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:12:58.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:12:58 smithi038 ceph-mon[80659]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:12:59.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:58 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:12:59.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:58 smithi141 ceph-mon[88165]: pgmap v12: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 561 op/s 2023-12-16T20:12:59.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:58 smithi141 ceph-mon[88165]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2023-12-16T20:12:59.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:12:58 smithi141 ceph-mon[88165]: Reconfiguring daemon prometheus.smithi038 on smithi038 2023-12-16T20:13:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:00 smithi038 ceph-mon[80659]: pgmap v13: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 368 op/s 2023-12-16T20:13:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:01.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:01.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:00 smithi141 ceph-mon[88165]: pgmap v13: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 368 op/s 2023-12-16T20:13:01.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:01.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:01.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:01.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:02.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:01 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:02.151 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:01 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:03.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:02 smithi038 ceph-mon[80659]: pgmap v14: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 524 op/s 2023-12-16T20:13:03.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:02 smithi141 ceph-mon[88165]: pgmap v14: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 524 op/s 2023-12-16T20:13:04.974 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-16T20:13:04.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T20:13:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:04 smithi038 ceph-mon[80659]: pgmap v15: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 304 op/s 2023-12-16T20:13:05.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:04 smithi141 ceph-mon[88165]: pgmap v15: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 304 op/s 2023-12-16T20:13:05.335 DEBUG:teuthology.parallel:result is None 2023-12-16T20:13:06.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:05 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:13:06.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:05 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:13:06.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:05 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:06.182 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:05 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:13:06.182 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:05 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:13:06.182 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:05 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:07.088 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:06 smithi141 ceph-mon[88165]: Upgrade: Updating mgr.smithi141.cycgjd 2023-12-16T20:13:07.088 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:06 smithi141 ceph-mon[88165]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:13:07.088 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:06 smithi141 ceph-mon[88165]: pgmap v16: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 403 op/s 2023-12-16T20:13:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:06 smithi038 ceph-mon[80659]: Upgrade: Updating mgr.smithi141.cycgjd 2023-12-16T20:13:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:06 smithi038 ceph-mon[80659]: Deploying daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:13:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:06 smithi038 ceph-mon[80659]: pgmap v16: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 403 op/s 2023-12-16T20:13:09.007 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:08 smithi141 ceph-mon[88165]: pgmap v17: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2023-12-16T20:13:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:08 smithi038 ceph-mon[80659]: pgmap v17: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2023-12-16T20:13:09.275 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-16T20:13:09.275 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-16T20:13:09.567 DEBUG:teuthology.parallel:result is None 2023-12-16T20:13:09.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T20:13:09.607 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T20:13:09.607 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T20:13:09.654 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T20:13:09.654 DEBUG:teuthology.parallel:result is None 2023-12-16T20:13:10.562 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:10 smithi038 ceph-mon[80659]: pgmap v18: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 329 op/s 2023-12-16T20:13:10.562 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:10 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:10.562 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:10 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:10.562 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:10 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:10.562 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:10 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:10.666 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:10 smithi141 ceph-mon[88165]: pgmap v18: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 329 op/s 2023-12-16T20:13:10.666 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:10 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:10.666 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:10 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:10.666 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:10 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:10.667 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:10 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:13.073 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:12 smithi141 ceph-mon[88165]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 456 op/s 2023-12-16T20:13:13.073 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:12 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.073 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:12 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:12 smithi038 ceph-mon[80659]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 456 op/s 2023-12-16T20:13:13.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:12 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:12 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.871 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:13 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.871 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:13 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.871 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:13 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:13.872 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:13 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:13 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:13 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:13 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:14.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:13 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:14.882 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:14 smithi141 ceph-mon[88165]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-12-16T20:13:15.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:14 smithi038 ceph-mon[80659]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.276+0000 7f7c123b7700 1 -- 172.21.15.38:0/5844949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 msgr2=0x7f7c0c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.276+0000 7f7c123b7700 1 --2- 172.21.15.38:0/5844949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c1021d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7c00004940 tx=0x7f7c00009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 -- 172.21.15.38:0/5844949 shutdown_connections 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 --2- 172.21.15.38:0/5844949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c1021d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 --2- 172.21.15.38:0/5844949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 -- 172.21.15.38:0/5844949 >> 172.21.15.38:0/5844949 conn(0x7f7c0c0f71d0 msgr2=0x7f7c0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 -- 172.21.15.38:0/5844949 shutdown_connections 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 -- 172.21.15.38:0/5844949 wait complete. 2023-12-16T20:13:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.277+0000 7f7c123b7700 1 Processor -- start 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c123b7700 1 -- start start 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c123b7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c123b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c123b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c10e000 con 0x7f7c0c0ffd70 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c123b7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c10e8a0 con 0x7f7c0c066920 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0bfff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36528/0 (socket says 172.21.15.38:36528) 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0b7fe700 1 -- 172.21.15.38:0/131314102 learned_addr learned my addr 172.21.15.38:0/131314102 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0bfff700 1 -- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 msgr2=0x7f7c0c10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0bfff700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.278+0000 7f7c0bfff700 1 -- 172.21.15.38:0/131314102 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00005040 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c0bfff700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c10d4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fd0 tx=0x7f7bfc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc004e70 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bfc00f040 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c10eb20 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc00c930 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.279+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c10f060 con 0x7f7c0c066920 2023-12-16T20:13:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.280+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c1075e0 con 0x7f7c0c066920 2023-12-16T20:13:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.281+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f7bfc007cc0 con 0x7f7c0c066920 2023-12-16T20:13:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.282+0000 7f7c08ff9700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 0x7f7bf406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.282+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7bfc08bc40 con 0x7f7c0c066920 2023-12-16T20:13:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.282+0000 7f7c0b7fe700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 0x7f7bf406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.282+0000 7f7c0b7fe700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 0x7f7bf406f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c000135e0 tx=0x7f7c00009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:15.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.287+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7bfc059810 con 0x7f7c0c066920 2023-12-16T20:13:15.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.525+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c0c02b240 con 0x7f7bf406cc00 2023-12-16T20:13:15.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.526+0000 7f7c08ff9700 1 -- 172.21.15.38:0/131314102 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f7c0c02b240 con 0x7f7bf406cc00 2023-12-16T20:13:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 msgr2=0x7f7bf406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 0x7f7bf406f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c000135e0 tx=0x7f7c00009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 msgr2=0x7f7c0c10d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c10d4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fd0 tx=0x7f7bfc00b040 comp rx=0 tx=0).stop 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 shutdown_connections 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bf406cc00 0x7f7bf406f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c066920 0x7f7c0c10d4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 --2- 172.21.15.38:0/131314102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c0c0ffd70 0x7f7c0c10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 >> 172.21.15.38:0/131314102 conn(0x7f7c0c0f71d0 msgr2=0x7f7c0c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 shutdown_connections 2023-12-16T20:13:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.529+0000 7f7c123b7700 1 -- 172.21.15.38:0/131314102 wait complete. 2023-12-16T20:13:15.542 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 -- 172.21.15.38:0/24510251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fee20 msgr2=0x7f43c80ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 --2- 172.21.15.38:0/24510251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fee20 0x7f43c80ff230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f43bc004940 tx=0x7f43bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 -- 172.21.15.38:0/24510251 shutdown_connections 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 --2- 172.21.15.38:0/24510251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fff90 0x7f43c8100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 --2- 172.21.15.38:0/24510251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fee20 0x7f43c80ff230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 -- 172.21.15.38:0/24510251 >> 172.21.15.38:0/24510251 conn(0x7f43c80fa5d0 msgr2=0x7f43c80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:15.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 -- 172.21.15.38:0/24510251 shutdown_connections 2023-12-16T20:13:15.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.641+0000 7f43ceefb700 1 -- 172.21.15.38:0/24510251 wait complete. 2023-12-16T20:13:15.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 Processor -- start 2023-12-16T20:13:15.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 -- start start 2023-12-16T20:13:15.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fee20 0x7f43c810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c81102a0 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ceefb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8110b40 con 0x7f43c80fee20 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43c7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43c7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36558/0 (socket says 172.21.15.38:36558) 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43c7fff700 1 -- 172.21.15.38:0/2799219677 learned_addr learned my addr 172.21.15.38:0/2799219677 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.642+0000 7f43ccc97700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fee20 0x7f43c810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c7fff700 1 -- 172.21.15.38:0/2799219677 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fee20 msgr2=0x7f43c810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c7fff700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fee20 0x7f43c810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c7fff700 1 -- 172.21.15.38:0/2799219677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc005040 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c7fff700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f43b4002a50 tx=0x7f43b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b4007cc0 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8110e20 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43b400f040 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b400d9c0 con 0x7f43c80fff90 2023-12-16T20:13:15.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.643+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c8111360 con 0x7f43c80fff90 2023-12-16T20:13:15.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.644+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c804bb80 con 0x7f43c80fff90 2023-12-16T20:13:15.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.645+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f43b400db20 con 0x7f43c80fff90 2023-12-16T20:13:15.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.645+0000 7f43c57fa700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 0x7f43b806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.645+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f43b408bd80 con 0x7f43c80fff90 2023-12-16T20:13:15.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.645+0000 7f43ccc97700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 0x7f43b806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.646+0000 7f43ccc97700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 0x7f43b806f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43bc004890 tx=0x7f43bc009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:15.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.650+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f43b4059950 con 0x7f43c80fff90 2023-12-16T20:13:15.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.874+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c81117b0 con 0x7f43b806cc00 2023-12-16T20:13:15.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.875+0000 7f43c57fa700 1 -- 172.21.15.38:0/2799219677 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f43c81117b0 con 0x7f43b806cc00 2023-12-16T20:13:15.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 msgr2=0x7f43b806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 0x7f43b806f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43bc004890 tx=0x7f43bc009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 msgr2=0x7f43c810fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f43b4002a50 tx=0x7f43b40046b0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 shutdown_connections 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f43b806cc00 0x7f43b806f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43c80fee20 0x7f43c810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 --2- 172.21.15.38:0/2799219677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43c80fff90 0x7f43c810fca0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.877+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 >> 172.21.15.38:0/2799219677 conn(0x7f43c80fa5d0 msgr2=0x7f43c8103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.878+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 shutdown_connections 2023-12-16T20:13:15.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.878+0000 7f43ceefb700 1 -- 172.21.15.38:0/2799219677 wait complete. 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3061990958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 msgr2=0x7f0b140fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3061990958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fd150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b04004940 tx=0x7f0b04009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3061990958 shutdown_connections 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3061990958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fd150 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3061990958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3061990958 >> 172.21.15.38:0/3061990958 conn(0x7f0b140f7190 msgr2=0x7f0b140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:15.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3061990958 shutdown_connections 2023-12-16T20:13:15.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3061990958 wait complete. 2023-12-16T20:13:15.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.991+0000 7f0b1bcdf700 1 Processor -- start 2023-12-16T20:13:15.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1bcdf700 1 -- start start 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1bcdf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1bcdf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1bcdf700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140fe640 con 0x7f0b140fcd00 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1bcdf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140fe7b0 con 0x7f0b140fbaf0 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36580/0 (socket says 172.21.15.38:36580) 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 -- 172.21.15.38:0/3614629267 learned_addr learned my addr 172.21.15.38:0/3614629267 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b19a7b700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 -- 172.21.15.38:0/3614629267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 msgr2=0x7f0b140ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b1927a700 1 -- 172.21.15.38:0/3614629267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04005040 con 0x7f0b140fcd00 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.992+0000 7f0b19a7b700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b1927a700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b04021070 con 0x7f0b140fcd00 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140fea30 con 0x7f0b140fcd00 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b0401c400 con 0x7f0b140fcd00 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0400e070 con 0x7f0b140fcd00 2023-12-16T20:13:15.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.993+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b14115500 con 0x7f0b140fcd00 2023-12-16T20:13:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.994+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1404bb80 con 0x7f0b140fcd00 2023-12-16T20:13:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.995+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f0b04013a30 con 0x7f0b140fcd00 2023-12-16T20:13:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.995+0000 7f0b0a7fc700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 0x7f0b0006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.995+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0b0408d330 con 0x7f0b140fcd00 2023-12-16T20:13:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.995+0000 7f0b19a7b700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 0x7f0b0006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:15.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:15.996+0000 7f0b19a7b700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 0x7f0b0006f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b140ff950 tx=0x7f0b1000b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:16.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.000+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0b0405af80 con 0x7f0b140fcd00 2023-12-16T20:13:16.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.224+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b14065a80 con 0x7f0b0006cc00 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.237+0000 7f0b0a7fc700 1 -- 172.21.15.38:0/3614629267 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f0b14065a80 con 0x7f0b0006cc00 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (80s) 3s ago 7m 26.9M - 0.25.0 c8568f914cd2 f4d60e39f079 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (7m) 3s ago 7m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (6m) 4s ago 6m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (59s) 3s ago 6m 76.9M - 9.4.7 954c08fa6188 38149a9c9447 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (3m) 3s ago 3m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:13:16.239 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (3m) 3s ago 3m 63.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (3m) 4s ago 3m 71.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (3m) 4s ago 3m 125M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (46s) 3s ago 8m 486M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (7s) 4s ago 6m 60.5M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (8m) 3s ago 8m 52.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (6m) 4s ago 6m 44.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (82s) 3s ago 7m 17.3M - 1.5.0 0da6a335fe13 923109d37fcd 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (51s) 4s ago 6m 8464k - 1.5.0 0da6a335fe13 e739857f0bd2 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 3s ago 5m 225M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 3s ago 5m 240M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (5m) 3s ago 5m 194M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (5m) 4s ago 5m 273M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (4m) 4s ago 4m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:13:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (4m) 4s ago 4m 230M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:13:16.241 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (16s) 3s ago 6m 42.5M - 2.43.0 a07b618ecd1d 0c881dba6d61 2023-12-16T20:13:16.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.239+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 msgr2=0x7f0b0006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.239+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 0x7f0b0006f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b140ff950 tx=0x7f0b1000b040 comp rx=0 tx=0).stop 2023-12-16T20:13:16.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.239+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 msgr2=0x7f0b140fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.239+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 shutdown_connections 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f0b0006cc00 0x7f0b0006f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b140fbaf0 0x7f0b140ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 --2- 172.21.15.38:0/3614629267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b140fcd00 0x7f0b140fe040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 >> 172.21.15.38:0/3614629267 conn(0x7f0b140f7190 msgr2=0x7f0b14065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 shutdown_connections 2023-12-16T20:13:16.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.240+0000 7f0b1bcdf700 1 -- 172.21.15.38:0/3614629267 wait complete. 2023-12-16T20:13:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 -- 172.21.15.38:0/4054206324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 msgr2=0x7fd5d00facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 --2- 172.21.15.38:0/4054206324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d00facc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0004940 tx=0x7fd5c0009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 -- 172.21.15.38:0/4054206324 shutdown_connections 2023-12-16T20:13:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 --2- 172.21.15.38:0/4054206324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d00facc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 --2- 172.21.15.38:0/4054206324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 0x7fd5d00fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.351+0000 7fd5d8414700 1 -- 172.21.15.38:0/4054206324 >> 172.21.15.38:0/4054206324 conn(0x7fd5d00f69d0 msgr2=0x7fd5d00f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 -- 172.21.15.38:0/4054206324 shutdown_connections 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 -- 172.21.15.38:0/4054206324 wait complete. 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 Processor -- start 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 -- start start 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 0x7fd5d010d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d010e300 con 0x7fd5d00feb80 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d8414700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d010eba0 con 0x7fd5d00fe230 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d59af700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d59af700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36592/0 (socket says 172.21.15.38:36592) 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d61b0700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 0x7fd5d010d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.352+0000 7fd5d59af700 1 -- 172.21.15.38:0/3997011134 learned_addr learned my addr 172.21.15.38:0/3997011134 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d59af700 1 -- 172.21.15.38:0/3997011134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 msgr2=0x7fd5d010d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d59af700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 0x7fd5d010d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d59af700 1 -- 172.21.15.38:0/3997011134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0005040 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d59af700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009380 tx=0x7fd5c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c000e040 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d010ee20 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5c000bd20 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d010f360 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.353+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c001c630 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.354+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d01075e0 con 0x7fd5d00feb80 2023-12-16T20:13:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.355+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fd5c0013420 con 0x7fd5d00feb80 2023-12-16T20:13:16.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.355+0000 7fd5c6ffd700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 0x7fd5bc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.355+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd5c008d340 con 0x7fd5d00feb80 2023-12-16T20:13:16.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.355+0000 7fd5d61b0700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 0x7fd5bc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.356+0000 7fd5d61b0700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 0x7fd5bc06f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009fd0 tx=0x7fd5cc00b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:16.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.359+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd5c005b030 con 0x7fd5d00feb80 2023-12-16T20:13:16.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:16.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 306 op/s 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all mgr 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.gdlrfj"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.gdlrfj"}]': finished 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi141.cycgjd"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi141.cycgjd"}]': finished 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all rgw 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all iscsi 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all nfs 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all nvmeof 2023-12-16T20:13:16.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:16.397 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:16 smithi038 ceph-mon[80659]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:16.590 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.590 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.590 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:16.590 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:16.590 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 306 op/s 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all mgr 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.gdlrfj"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.gdlrfj"}]': finished 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi141.cycgjd"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi141.cycgjd"}]': finished 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all rgw 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T20:13:16.591 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all iscsi 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all nfs 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:16.592 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all nvmeof 2023-12-16T20:13:16.593 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:16.593 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:16.593 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:16 smithi141 ceph-mon[88165]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:16.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.657+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd5d004bb80 con 0x7fd5d00feb80 2023-12-16T20:13:16.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.657+0000 7fd5c6ffd700 1 -- 172.21.15.38:0/3997011134 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fd5c005abc0 con 0x7fd5d00feb80 2023-12-16T20:13:16.659 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:13:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T20:13:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:13:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:13:16.661 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:13:16.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 msgr2=0x7fd5bc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 0x7fd5bc06f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009fd0 tx=0x7fd5cc00b040 comp rx=0 tx=0).stop 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 msgr2=0x7fd5d010dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009380 tx=0x7fd5c0009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 shutdown_connections 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd5bc06cc00 0x7fd5bc06f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5d00fe230 0x7fd5d010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 --2- 172.21.15.38:0/3997011134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d00feb80 0x7fd5d010dd00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 >> 172.21.15.38:0/3997011134 conn(0x7fd5d00f69d0 msgr2=0x7fd5d0101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 shutdown_connections 2023-12-16T20:13:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.660+0000 7fd5d8414700 1 -- 172.21.15.38:0/3997011134 wait complete. 2023-12-16T20:13:16.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 -- 172.21.15.38:0/209756559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fcd00 msgr2=0x7f77040fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 --2- 172.21.15.38:0/209756559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fcd00 0x7f77040fd150 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f76f8004940 tx=0x7f76f8009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:16.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 -- 172.21.15.38:0/209756559 shutdown_connections 2023-12-16T20:13:16.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 --2- 172.21.15.38:0/209756559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fcd00 0x7f77040fd150 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 --2- 172.21.15.38:0/209756559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fbaf0 0x7f77040fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 -- 172.21.15.38:0/209756559 >> 172.21.15.38:0/209756559 conn(0x7f77040f71d0 msgr2=0x7f77040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:16.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 -- 172.21.15.38:0/209756559 shutdown_connections 2023-12-16T20:13:16.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.769+0000 7f7708872700 1 -- 172.21.15.38:0/209756559 wait complete. 2023-12-16T20:13:16.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 Processor -- start 2023-12-16T20:13:16.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 -- start start 2023-12-16T20:13:16.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fcd00 0x7f770410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770410cfa0 con 0x7f77040fbaf0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f7708872700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770410d840 con 0x7f77040fcd00 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.770+0000 7f770259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36610/0 (socket says 172.21.15.38:36610) 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 -- 172.21.15.38:0/3366588396 learned_addr learned my addr 172.21.15.38:0/3366588396 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f7701d9b700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fcd00 0x7f770410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 -- 172.21.15.38:0/3366588396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fcd00 msgr2=0x7f770410c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fcd00 0x7f770410c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 -- 172.21.15.38:0/3366588396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8005040 con 0x7f77040fbaf0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f770259c700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f76f400fd10 tx=0x7f76f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76f400dcf0 con 0x7f77040fbaf0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770410dac0 con 0x7f77040fbaf0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76f400de50 con 0x7f77040fbaf0 2023-12-16T20:13:16.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76f40126a0 con 0x7f77040fbaf0 2023-12-16T20:13:16.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.771+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770410e000 con 0x7f77040fbaf0 2023-12-16T20:13:16.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.773+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770404bb80 con 0x7f77040fbaf0 2023-12-16T20:13:16.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.773+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f76f4007ab0 con 0x7f77040fbaf0 2023-12-16T20:13:16.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.774+0000 7f76f2ffd700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 0x7f76ec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:16.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.774+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f76f408e620 con 0x7f77040fbaf0 2023-12-16T20:13:16.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.774+0000 7f7701d9b700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 0x7f76ec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:16.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.774+0000 7f7701d9b700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 0x7f76ec06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76f800b3b0 tx=0x7f76f8009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:16.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:16.778+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f76f405c270 con 0x7f77040fbaf0 2023-12-16T20:13:17.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.001+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f770410e510 con 0x7f76ec06cc00 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.002+0000 7f76f2ffd700 1 -- 172.21.15.38:0/3366588396 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f770410e510 con 0x7f76ec06cc00 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T20:13:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading node-exporter daemons", 2023-12-16T20:13:17.005 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:13:17.005 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:13:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 msgr2=0x7f76ec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 0x7f76ec06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76f800b3b0 tx=0x7f76f8009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 msgr2=0x7f770410c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f76f400fd10 tx=0x7f76f4004600 comp rx=0 tx=0).stop 2023-12-16T20:13:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 shutdown_connections 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f76ec06cc00 0x7f76ec06f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77040fbaf0 0x7f770410c460 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.004+0000 7f7708872700 1 --2- 172.21.15.38:0/3366588396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77040fcd00 0x7f770410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.005+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 >> 172.21.15.38:0/3366588396 conn(0x7f77040f71d0 msgr2=0x7f77040fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.005+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 shutdown_connections 2023-12-16T20:13:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:17.005+0000 7f7708872700 1 -- 172.21.15.38:0/3366588396 wait complete. 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: Upgrade: Updating node-exporter.smithi038 (1/2) 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: Deploying daemon node-exporter.smithi038 on smithi038 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:13:17.329 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:13:17.330 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:17 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3997011134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: Upgrade: Updating node-exporter.smithi038 (1/2) 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: Deploying daemon node-exporter.smithi038 on smithi038 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:13:17.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:13:17.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:13:17.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/4198344700' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:13:17.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:17 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3997011134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:18.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:18 smithi038 ceph-mon[80659]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:18.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:18 smithi038 ceph-mon[80659]: mgrmap e32: smithi038.gdlrfj(active, since 38s), standbys: smithi141.cycgjd 2023-12-16T20:13:18.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:18 smithi038 ceph-mon[80659]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 515 KiB/s rd, 503 KiB/s wr, 209 op/s 2023-12-16T20:13:18.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:18 smithi141 ceph-mon[88165]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:18.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:18 smithi141 ceph-mon[88165]: mgrmap e32: smithi038.gdlrfj(active, since 38s), standbys: smithi141.cycgjd 2023-12-16T20:13:18.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:18 smithi141 ceph-mon[88165]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 515 KiB/s rd, 503 KiB/s wr, 209 op/s 2023-12-16T20:13:19.852 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:19 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:19.852 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:19 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:19 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:19 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:20.814 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:20 smithi141 ceph-mon[88165]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 470 KiB/s rd, 455 KiB/s wr, 136 op/s 2023-12-16T20:13:20.815 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:20 smithi141 ceph-mon[88165]: Upgrade: Updating node-exporter.smithi141 (2/2) 2023-12-16T20:13:20.815 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:20 smithi141 ceph-mon[88165]: Deploying daemon node-exporter.smithi141 on smithi141 2023-12-16T20:13:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:20 smithi038 ceph-mon[80659]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 470 KiB/s rd, 455 KiB/s wr, 136 op/s 2023-12-16T20:13:20.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:20 smithi038 ceph-mon[80659]: Upgrade: Updating node-exporter.smithi141 (2/2) 2023-12-16T20:13:20.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:20 smithi038 ceph-mon[80659]: Deploying daemon node-exporter.smithi141 on smithi141 2023-12-16T20:13:22.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:22 smithi141 ceph-mon[88165]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 471 KiB/s rd, 456 KiB/s wr, 138 op/s 2023-12-16T20:13:22.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:22 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:22.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:22 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:22.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:22 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:22.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:22 smithi038 ceph-mon[80659]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 471 KiB/s rd, 456 KiB/s wr, 138 op/s 2023-12-16T20:13:22.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:22 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:22.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:22 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:22.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:22 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:24.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:24 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:24.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:24 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:24.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:24 smithi038 ceph-mon[80659]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 13 KiB/s wr, 12 op/s 2023-12-16T20:13:24.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:24 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:24.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:24 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:24.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:24 smithi141 ceph-mon[88165]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 13 KiB/s wr, 12 op/s 2023-12-16T20:13:25.538 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:25 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.539 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:25 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.539 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:25 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:25.539 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:25 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.539 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:25 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:25 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:25 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:25 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:25 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:25 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:26 smithi038 ceph-mon[80659]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 13 KiB/s wr, 14 op/s 2023-12-16T20:13:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:26 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:26 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:26 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:26 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:26 smithi141 ceph-mon[88165]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 13 KiB/s wr, 14 op/s 2023-12-16T20:13:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:26 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:26 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:26 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:27.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:26 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.108 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-16T20:13:29.108 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.108 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:28 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-16T20:13:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:29.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:28 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:31.048 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:30 smithi141 ceph-mon[88165]: Upgrade: Updating prometheus.smithi038 2023-12-16T20:13:31.048 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:30 smithi141 ceph-mon[88165]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2023-12-16T20:13:31.048 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:30 smithi141 ceph-mon[88165]: Deploying daemon prometheus.smithi038 on smithi038 2023-12-16T20:13:31.079 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:30 smithi038 ceph-mon[80659]: Upgrade: Updating prometheus.smithi038 2023-12-16T20:13:31.079 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:30 smithi038 ceph-mon[80659]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2023-12-16T20:13:31.079 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:30 smithi038 ceph-mon[80659]: Deploying daemon prometheus.smithi038 on smithi038 2023-12-16T20:13:33.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:32 smithi038 ceph-mon[80659]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-16T20:13:33.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:32 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:33.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:32 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:33.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:32 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:33.224 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:32 smithi141 ceph-mon[88165]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-16T20:13:33.224 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:32 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:33.224 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:32 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:33.225 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:32 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:34.930 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:34 smithi038 ceph-mon[80659]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 3 op/s 2023-12-16T20:13:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:34 smithi141 ceph-mon[88165]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 3 op/s 2023-12-16T20:13:36.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:36.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:36.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:36 smithi038 ceph-mon[80659]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-16T20:13:36.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:36.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:36.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:36 smithi141 ceph-mon[88165]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-16T20:13:37.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:37 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:37.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:37 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:37.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:37 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:37.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:37 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:38.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:38.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:38.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:38.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:38.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:38.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:38.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:38.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:40.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:40.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:40.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:40 smithi038 ceph-mon[80659]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:40.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:40 smithi038 ceph-mon[80659]: Upgrade: Updating alertmanager.smithi038 2023-12-16T20:13:40.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:40 smithi038 ceph-mon[80659]: Deploying daemon alertmanager.smithi038 on smithi038 2023-12-16T20:13:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:40 smithi141 ceph-mon[88165]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:40 smithi141 ceph-mon[88165]: Upgrade: Updating alertmanager.smithi038 2023-12-16T20:13:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:40 smithi141 ceph-mon[88165]: Deploying daemon alertmanager.smithi038 on smithi038 2023-12-16T20:13:42.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:42 smithi038 ceph-mon[80659]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:42.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:42 smithi141 ceph-mon[88165]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:43 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:43 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:43 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:44.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:43 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:44.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:43 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:44.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:43 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:45.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:44 smithi038 ceph-mon[80659]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:45.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:44 smithi141 ceph-mon[88165]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:46.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:46 smithi141 ceph-mon[88165]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:46.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:46 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:46.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:46 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 -- 172.21.15.38:0/882226804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 msgr2=0x7f31540fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 --2- 172.21.15.38:0/882226804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540fbf00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3150004940 tx=0x7f3150009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 -- 172.21.15.38:0/882226804 shutdown_connections 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 --2- 172.21.15.38:0/882226804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 --2- 172.21.15.38:0/882226804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540fbf00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 -- 172.21.15.38:0/882226804 >> 172.21.15.38:0/882226804 conn(0x7f31540f71d0 msgr2=0x7f31540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:47.118 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:46 smithi038 ceph-mon[80659]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:47.118 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:46 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:47.119 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:46 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 -- 172.21.15.38:0/882226804 shutdown_connections 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 -- 172.21.15.38:0/882226804 wait complete. 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.117+0000 7f315b8f3700 1 Processor -- start 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315b8f3700 1 -- start start 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315b8f3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315b8f3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315b8f3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540fe6d0 con 0x7f31540fbaf0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315b8f3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540fe840 con 0x7f31540fcd00 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35108/0 (socket says 172.21.15.38:35108) 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 -- 172.21.15.38:0/1567467880 learned_addr learned my addr 172.21.15.38:0/1567467880 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f3158e8e700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 -- 172.21.15.38:0/1567467880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 msgr2=0x7f31540fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 -- 172.21.15.38:0/1567467880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150005040 con 0x7f31540fbaf0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f3158e8e700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.118+0000 7f315968f700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3150000c00 tx=0x7f3150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.119+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315000e040 con 0x7f31540fbaf0 2023-12-16T20:13:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.119+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540feac0 con 0x7f31540fbaf0 2023-12-16T20:13:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.119+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3150009af0 con 0x7f31540fbaf0 2023-12-16T20:13:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.119+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315001c630 con 0x7f31540fbaf0 2023-12-16T20:13:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.119+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3154115570 con 0x7f31540fbaf0 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.120+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315404bb80 con 0x7f31540fbaf0 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.120+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f315000bcd0 con 0x7f31540fbaf0 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.121+0000 7f3149ffb700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 0x7f314006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.121+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f315008d4d0 con 0x7f31540fbaf0 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.121+0000 7f3158e8e700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 0x7f314006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.121+0000 7f3158e8e700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 0x7f314006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.126+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f315005b1d0 con 0x7f31540fbaf0 2023-12-16T20:13:47.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.354+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3154066310 con 0x7f314006cc00 2023-12-16T20:13:47.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.355+0000 7f3149ffb700 1 -- 172.21.15.38:0/1567467880 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3154066310 con 0x7f314006cc00 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 msgr2=0x7f314006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 0x7f314006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).stop 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 msgr2=0x7f31540ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3150000c00 tx=0x7f3150009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 shutdown_connections 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f314006cc00 0x7f314006f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31540fbaf0 0x7f31540ffbc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 --2- 172.21.15.38:0/1567467880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31540fcd00 0x7f31540fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 >> 172.21.15.38:0/1567467880 conn(0x7f31540f71d0 msgr2=0x7f3154065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 shutdown_connections 2023-12-16T20:13:47.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.357+0000 7f315b8f3700 1 -- 172.21.15.38:0/1567467880 wait complete. 2023-12-16T20:13:47.368 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:13:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 -- 172.21.15.38:0/714377870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c0fd730 msgr2=0x7fac0c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 --2- 172.21.15.38:0/714377870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c0fd730 0x7fac0c0ffb10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fabfc004940 tx=0x7fabfc009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 -- 172.21.15.38:0/714377870 shutdown_connections 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 --2- 172.21.15.38:0/714377870 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c100050 0x7fac0c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 --2- 172.21.15.38:0/714377870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c0fd730 0x7fac0c0ffb10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 -- 172.21.15.38:0/714377870 >> 172.21.15.38:0/714377870 conn(0x7fac0c0f7190 msgr2=0x7fac0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 -- 172.21.15.38:0/714377870 shutdown_connections 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.469+0000 7fac1183b700 1 -- 172.21.15.38:0/714377870 wait complete. 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 Processor -- start 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 -- start start 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c0fd730 0x7fac0c10f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1102c0 con 0x7fac0c100050 2023-12-16T20:13:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac1183b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c110b00 con 0x7fac0c0fd730 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac0a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac0a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35122/0 (socket says 172.21.15.38:35122) 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac0a7fc700 1 -- 172.21.15.38:0/735117313 learned_addr learned my addr 172.21.15.38:0/735117313 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.470+0000 7fac0affd700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c0fd730 0x7fac0c10f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac0a7fc700 1 -- 172.21.15.38:0/735117313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c0fd730 msgr2=0x7fac0c10f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac0a7fc700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c0fd730 0x7fac0c10f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac0a7fc700 1 -- 172.21.15.38:0/735117313 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc005040 con 0x7fac0c100050 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac0a7fc700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabf400b790 tx=0x7fabf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf400f6f0 con 0x7fac0c100050 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c110de0 con 0x7fac0c100050 2023-12-16T20:13:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabf400fd00 con 0x7fac0c100050 2023-12-16T20:13:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf40103a0 con 0x7fac0c100050 2023-12-16T20:13:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.471+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c111320 con 0x7fac0c100050 2023-12-16T20:13:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.472+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0f8d30 con 0x7fac0c100050 2023-12-16T20:13:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.473+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fabf400f850 con 0x7fac0c100050 2023-12-16T20:13:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.473+0000 7fac037fe700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 0x7fabf806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.473+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fabf408bd20 con 0x7fac0c100050 2023-12-16T20:13:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.473+0000 7fac0affd700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 0x7fabf806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.474+0000 7fac0affd700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 0x7fabf806f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00b3b0 tx=0x7fabfc009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.478+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fabf4059a80 con 0x7fac0c100050 2023-12-16T20:13:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.706+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac0c111660 con 0x7fabf806cc00 2023-12-16T20:13:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.707+0000 7fac037fe700 1 -- 172.21.15.38:0/735117313 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fac0c111660 con 0x7fabf806cc00 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 msgr2=0x7fabf806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 0x7fabf806f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00b3b0 tx=0x7fabfc009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 msgr2=0x7fac0c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabf400b790 tx=0x7fabf4009250 comp rx=0 tx=0).stop 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 shutdown_connections 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fabf806cc00 0x7fabf806f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac0c0fd730 0x7fac0c10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 --2- 172.21.15.38:0/735117313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac0c100050 0x7fac0c10fc30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 >> 172.21.15.38:0/735117313 conn(0x7fac0c0f7190 msgr2=0x7fac0c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 shutdown_connections 2023-12-16T20:13:47.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.710+0000 7fac1183b700 1 -- 172.21.15.38:0/735117313 wait complete. 2023-12-16T20:13:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.825+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/3903745370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 msgr2=0x7f8bcc0fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.825+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/3903745370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc0fd160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0004940 tx=0x7f8bc0009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/3903745370 shutdown_connections 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/3903745370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc0fd160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/3903745370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc0fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/3903745370 >> 172.21.15.38:0/3903745370 conn(0x7f8bcc0f71c0 msgr2=0x7f8bcc0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/3903745370 shutdown_connections 2023-12-16T20:13:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/3903745370 wait complete. 2023-12-16T20:13:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 Processor -- start 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- start start 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc10e040 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.826+0000 7f8bd2c4e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc10e8e0 con 0x7f8bcc0fbb00 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35138/0 (socket says 172.21.15.38:35138) 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 -- 172.21.15.38:0/45905948 learned_addr learned my addr 172.21.15.38:0/45905948 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 -- 172.21.15.38:0/45905948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 msgr2=0x7f8bcc10d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bd09ea700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc10d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 -- 172.21.15.38:0/45905948 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0005040 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bd09ea700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bcbfff700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009380 tx=0x7f8bc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc000e040 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc10eb60 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bc000bda0 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc001c630 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.827+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc10f0a0 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.828+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc04bb80 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.829+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f8bc00139d0 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.829+0000 7f8bc97fa700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 0x7f8bb406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.829+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8bc008d4e0 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.829+0000 7f8bd09ea700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 0x7f8bb406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.830+0000 7f8bd09ea700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 0x7f8bb406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc007fd0 tx=0x7f8bbc009040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:47.834+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8bc005b130 con 0x7f8bcc0fcd10 2023-12-16T20:13:47.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:47 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:47.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:47 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.064+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bcc10f460 con 0x7f8bb406cc00 2023-12-16T20:13:48.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.075+0000 7f8bc97fa700 1 -- 172.21.15.38:0/45905948 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8bcc10f460 con 0x7f8bb406cc00 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (5s) 2s ago 7m 15.8M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (7m) 2s ago 7m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (6m) 24s ago 6m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (91s) 2s ago 7m 77.5M - 9.4.7 954c08fa6188 38149a9c9447 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (4m) 2s ago 4m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (4m) 2s ago 4m 63.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (4m) 24s ago 4m 67.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (4m) 24s ago 4m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (78s) 2s ago 8m 491M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (38s) 24s ago 6m 439M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (8m) 2s ago 8m 53.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:13:48.076 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (6m) 24s ago 6m 45.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (29s) 2s ago 7m 8648k - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (26s) 24s ago 6m 3670k - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (6m) 2s ago 6m 225M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (6m) 2s ago 6m 240M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (5m) 2s ago 5m 193M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (5m) 24s ago 5m 272M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (5m) 24s ago 5m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (5m) 24s ago 5m 231M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:13:48.077 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (16s) 2s ago 7m 43.6M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:13:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 msgr2=0x7f8bb406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 0x7f8bb406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc007fd0 tx=0x7f8bbc009040 comp rx=0 tx=0).stop 2023-12-16T20:13:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 msgr2=0x7f8bcc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009380 tx=0x7f8bc0009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 shutdown_connections 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f8bb406cc00 0x7f8bb406f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bcc0fbb00 0x7f8bcc10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 --2- 172.21.15.38:0/45905948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bcc0fcd10 0x7f8bcc10da40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.077+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 >> 172.21.15.38:0/45905948 conn(0x7f8bcc0f71c0 msgr2=0x7f8bcc065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.078+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 shutdown_connections 2023-12-16T20:13:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.078+0000 7f8bd2c4e700 1 -- 172.21.15.38:0/45905948 wait complete. 2023-12-16T20:13:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 -- 172.21.15.38:0/2131189613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fbaf0 msgr2=0x7f99780fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 --2- 172.21.15.38:0/2131189613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fbaf0 0x7f99780fbf00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9974004940 tx=0x7f9974009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 -- 172.21.15.38:0/2131189613 shutdown_connections 2023-12-16T20:13:48.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 --2- 172.21.15.38:0/2131189613 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fcd00 0x7f99780fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 --2- 172.21.15.38:0/2131189613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fbaf0 0x7f99780fbf00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 -- 172.21.15.38:0/2131189613 >> 172.21.15.38:0/2131189613 conn(0x7f99780f7190 msgr2=0x7f99780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 -- 172.21.15.38:0/2131189613 shutdown_connections 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.182+0000 7f997ffbe700 1 -- 172.21.15.38:0/2131189613 wait complete. 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 Processor -- start 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 -- start start 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fbaf0 0x7f99780ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780fe640 con 0x7f99780fcd00 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997ffbe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780fe7b0 con 0x7f99780fbaf0 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35162/0 (socket says 172.21.15.38:35162) 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 -- 172.21.15.38:0/1696832876 learned_addr learned my addr 172.21.15.38:0/1696832876 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997dd5a700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fbaf0 0x7f99780ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 -- 172.21.15.38:0/1696832876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fbaf0 msgr2=0x7f99780ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fbaf0 0x7f99780ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.183+0000 7f997d559700 1 -- 172.21.15.38:0/1696832876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974005040 con 0x7f99780fcd00 2023-12-16T20:13:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f997d559700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f996800eb40 tx=0x7f996800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9968007cc0 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f996800f040 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99780fea30 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996800c990 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.184+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9978115520 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.185+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997804bb80 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.185+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f996800cc00 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.186+0000 7f996e7fc700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 0x7f996406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.186+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f996808bc50 con 0x7f99780fcd00 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.186+0000 7f997dd5a700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 0x7f996406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.187+0000 7f997dd5a700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 0x7f996406f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9974009fd0 tx=0x7f9974009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.191+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f99680598d0 con 0x7f99780fcd00 2023-12-16T20:13:48.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:47 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:48.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:47 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.488+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9978104490 con 0x7f99780fcd00 2023-12-16T20:13:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.489+0000 7f996e7fc700 1 -- 172.21.15.38:0/1696832876 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f9968059460 con 0x7f99780fcd00 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:13:48.490 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:13:48.491 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:13:48.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 msgr2=0x7f996406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 0x7f996406f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9974009fd0 tx=0x7f9974009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 msgr2=0x7f99780fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f996800eb40 tx=0x7f996800b040 comp rx=0 tx=0).stop 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 shutdown_connections 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f996406cc00 0x7f996406f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99780fbaf0 0x7f99780ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 --2- 172.21.15.38:0/1696832876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99780fcd00 0x7f99780fe040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 >> 172.21.15.38:0/1696832876 conn(0x7f99780f7190 msgr2=0x7f9978065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 shutdown_connections 2023-12-16T20:13:48.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.491+0000 7f997ffbe700 1 -- 172.21.15.38:0/1696832876 wait complete. 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 -- 172.21.15.38:0/540932504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 msgr2=0x7fd7401021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 --2- 172.21.15.38:0/540932504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7401021d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd734004940 tx=0x7fd734009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 -- 172.21.15.38:0/540932504 shutdown_connections 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 --2- 172.21.15.38:0/540932504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7401021d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 --2- 172.21.15.38:0/540932504 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 0x7fd7400ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 -- 172.21.15.38:0/540932504 >> 172.21.15.38:0/540932504 conn(0x7fd7400f7190 msgr2=0x7fd7400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:48.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.599+0000 7fd746334700 1 -- 172.21.15.38:0/540932504 shutdown_connections 2023-12-16T20:13:48.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 -- 172.21.15.38:0/540932504 wait complete. 2023-12-16T20:13:48.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 Processor -- start 2023-12-16T20:13:48.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 -- start start 2023-12-16T20:13:48.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 0x7fd7400fd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400fbc80 con 0x7fd7400ffd50 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.600+0000 7fd746334700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400fbdf0 con 0x7fd7400660b0 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35170/0 (socket says 172.21.15.38:35170) 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 -- 172.21.15.38:0/938538343 learned_addr learned my addr 172.21.15.38:0/938538343 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73ffff700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 0x7fd7400fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 -- 172.21.15.38:0/938538343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 msgr2=0x7fd7400fd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 0x7fd7400fd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 -- 172.21.15.38:0/938538343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734005040 con 0x7fd7400ffd50 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73f7fe700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd734009360 tx=0x7fd734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73400e040 con 0x7fd7400ffd50 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7400fc070 con 0x7fd7400ffd50 2023-12-16T20:13:48.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.601+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd73400bc50 con 0x7fd7400ffd50 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.602+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73401c3f0 con 0x7fd7400ffd50 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.602+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd740115540 con 0x7fd7400ffd50 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.603+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7401075c0 con 0x7fd7400ffd50 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.603+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fd734013420 con 0x7fd7400ffd50 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.604+0000 7fd73cff9700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 0x7fd72806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:13:48.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.604+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd73408d3e0 con 0x7fd7400ffd50 2023-12-16T20:13:48.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.604+0000 7fd73ffff700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 0x7fd72806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:13:48.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.604+0000 7fd73ffff700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 0x7fd72806f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7400fcf90 tx=0x7fd73000b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:13:48.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.608+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd73405afb0 con 0x7fd7400ffd50 2023-12-16T20:13:48.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.887+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd74005e080 con 0x7fd72806cc00 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.888+0000 7fd73cff9700 1 -- 172.21.15.38:0/938538343 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd74005e080 con 0x7fd72806cc00 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T20:13:48.889 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading alertmanager daemons", 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:13:48.890 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 msgr2=0x7fd72806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 0x7fd72806f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7400fcf90 tx=0x7fd73000b040 comp rx=0 tx=0).stop 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 msgr2=0x7fd7400fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd734009360 tx=0x7fd734009e30 comp rx=0 tx=0).stop 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 shutdown_connections 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fd72806cc00 0x7fd72806f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7400660b0 0x7fd7400fd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 --2- 172.21.15.38:0/938538343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7400ffd50 0x7fd7400fb680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:13:48.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 >> 172.21.15.38:0/938538343 conn(0x7fd7400f7190 msgr2=0x7fd7400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:13:48.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 shutdown_connections 2023-12-16T20:13:48.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:13:48.891+0000 7fd746334700 1 -- 172.21.15.38:0/938538343 wait complete. 2023-12-16T20:13:48.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:48 smithi038 ceph-mon[80659]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:48.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:48 smithi038 ceph-mon[80659]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:48.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:48 smithi038 ceph-mon[80659]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:48.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:48 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1696832876' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:49.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:48 smithi141 ceph-mon[88165]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:49.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:48 smithi141 ceph-mon[88165]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:48 smithi141 ceph-mon[88165]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:48 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1696832876' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:50.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:49 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:50.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:49 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:13:51.130 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:50 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:13:51.130 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:50 smithi038 ceph-mon[80659]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:51.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:50 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T20:13:51.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:50 smithi141 ceph-mon[88165]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2023-12-16T20:13:52.124 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:51 smithi038 ceph-mon[80659]: Upgrade: Updating grafana.smithi038 2023-12-16T20:13:52.124 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:51 smithi038 ceph-mon[80659]: Deploying daemon grafana.smithi038 on smithi038 2023-12-16T20:13:52.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:51 smithi141 ceph-mon[88165]: Upgrade: Updating grafana.smithi038 2023-12-16T20:13:52.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:51 smithi141 ceph-mon[88165]: Deploying daemon grafana.smithi038 on smithi038 2023-12-16T20:13:53.127 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:52 smithi038 ceph-mon[80659]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:53.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:52 smithi141 ceph-mon[88165]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-16T20:13:54.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:54 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:54.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:54 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:54.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:54 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:54.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:54 smithi038 ceph-mon[80659]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:54.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:54 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:54.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:54 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:54.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:54 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:13:54.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:54 smithi141 ceph-mon[88165]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:55.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:55 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:55.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:55 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:13:56.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:56 smithi038 ceph-mon[80659]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:13:56.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:56 smithi141 ceph-mon[88165]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:13:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:57 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:57 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:58.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:58 smithi038 ceph-mon[80659]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:58.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:58 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:58.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:13:58 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:58.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:58 smithi141 ceph-mon[88165]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:13:58.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:58 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:13:58.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:13:58 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: Upgrade: Finalizing container_image settings 2023-12-16T20:14:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T20:14:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: Upgrade: Complete! 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T20:14:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:00 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T20:14:01.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:01.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.147 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: Upgrade: Finalizing container_image settings 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T20:14:01.148 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.149 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: Upgrade: Complete! 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:01.150 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:00 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:02.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:02 smithi141 ceph-mon[88165]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:03.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:02 smithi038 ceph-mon[80659]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:04 smithi038 ceph-mon[80659]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:05.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:04 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:05.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:04 smithi141 ceph-mon[88165]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:05.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:04 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:07.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:06 smithi038 ceph-mon[80659]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:07.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:06 smithi141 ceph-mon[88165]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:08.946 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:08 smithi038 ceph-mon[80659]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:09.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:08 smithi141 ceph-mon[88165]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:09 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:09 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:11.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:10 smithi038 ceph-mon[80659]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:11.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:10 smithi141 ceph-mon[88165]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:12.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:11 smithi038 ceph-mon[80659]: mgrmap e33: smithi038.gdlrfj(active, since 91s), standbys: smithi141.cycgjd 2023-12-16T20:14:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:11 smithi141 ceph-mon[88165]: mgrmap e33: smithi038.gdlrfj(active, since 91s), standbys: smithi141.cycgjd 2023-12-16T20:14:13.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:12 smithi038 ceph-mon[80659]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:12 smithi141 ceph-mon[88165]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:15.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:14 smithi038 ceph-mon[80659]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:14 smithi141 ceph-mon[88165]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:17.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:16 smithi038 ceph-mon[80659]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:17.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:16 smithi141 ceph-mon[88165]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:19.012 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:18 smithi038 ceph-mon[80659]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 -- 172.21.15.38:0/1383684413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 msgr2=0x7f26e80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 --2- 172.21.15.38:0/1383684413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e80fd150 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f26d4004940 tx=0x7f26d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 -- 172.21.15.38:0/1383684413 shutdown_connections 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 --2- 172.21.15.38:0/1383684413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e80fd150 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 --2- 172.21.15.38:0/1383684413 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 0x7f26e80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 -- 172.21.15.38:0/1383684413 >> 172.21.15.38:0/1383684413 conn(0x7f26e80f71d0 msgr2=0x7f26e80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 -- 172.21.15.38:0/1383684413 shutdown_connections 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.011+0000 7f26ef10a700 1 -- 172.21.15.38:0/1383684413 wait complete. 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 Processor -- start 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 -- start start 2023-12-16T20:14:19.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 0x7f26e810c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e810cf30 con 0x7f26e80fcd00 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ef10a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e810d7d0 con 0x7f26e80fbaf0 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26e7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26e7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41250/0 (socket says 172.21.15.38:41250) 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26e7fff700 1 -- 172.21.15.38:0/3080123900 learned_addr learned my addr 172.21.15.38:0/3080123900 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.012+0000 7f26ecea6700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 0x7f26e810c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e7fff700 1 -- 172.21.15.38:0/3080123900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 msgr2=0x7f26e810c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e7fff700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 0x7f26e810c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e7fff700 1 -- 172.21.15.38:0/3080123900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4005040 con 0x7f26e80fcd00 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e7fff700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009360 tx=0x7f26d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d400e040 con 0x7f26e80fcd00 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26d400bc50 con 0x7f26e80fcd00 2023-12-16T20:14:19.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e810da50 con 0x7f26e80fcd00 2023-12-16T20:14:19.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d401c3f0 con 0x7f26e80fcd00 2023-12-16T20:14:19.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.013+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e810df90 con 0x7f26e80fcd00 2023-12-16T20:14:19.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.014+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e804bb80 con 0x7f26e80fcd00 2023-12-16T20:14:19.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.015+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f26d4013420 con 0x7f26e80fcd00 2023-12-16T20:14:19.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.015+0000 7f26e57fa700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 0x7f26d806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:19.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.015+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f26d408d170 con 0x7f26e80fcd00 2023-12-16T20:14:19.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.015+0000 7f26ecea6700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 0x7f26d806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:19.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.016+0000 7f26ecea6700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 0x7f26d806ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26e80fcb60 tx=0x7f26dc009040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:19.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.020+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f26d405af60 con 0x7f26e80fcd00 2023-12-16T20:14:19.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.243+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26e810e360 con 0x7f26d806cae0 2023-12-16T20:14:19.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:18 smithi141 ceph-mon[88165]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:19.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.245+0000 7f26e57fa700 1 -- 172.21.15.38:0/3080123900 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f26e810e360 con 0x7f26d806cae0 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 msgr2=0x7f26d806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 0x7f26d806ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26e80fcb60 tx=0x7f26dc009040 comp rx=0 tx=0).stop 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 msgr2=0x7f26e810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009360 tx=0x7f26d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 shutdown_connections 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f26d806cae0 0x7f26d806ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26e80fbaf0 0x7f26e810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 --2- 172.21.15.38:0/3080123900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26e80fcd00 0x7f26e810c930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 >> 172.21.15.38:0/3080123900 conn(0x7f26e80f71d0 msgr2=0x7f26e80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 shutdown_connections 2023-12-16T20:14:19.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:19.247+0000 7f26ef10a700 1 -- 172.21.15.38:0/3080123900 wait complete. 2023-12-16T20:14:19.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-16T20:14:19.865 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.592+0000 7f7f18d37700 1 -- 172.21.15.38:0/351124897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 msgr2=0x7f7f14102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.592+0000 7f7f18d37700 1 --2- 172.21.15.38:0/351124897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f14102fd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f04004940 tx=0x7f7f04009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- 172.21.15.38:0/351124897 shutdown_connections 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 --2- 172.21.15.38:0/351124897 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 0x7f7f140fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 --2- 172.21.15.38:0/351124897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f14102fd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- 172.21.15.38:0/351124897 >> 172.21.15.38:0/351124897 conn(0x7f7f140f8790 msgr2=0x7f7f140faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- 172.21.15.38:0/351124897 shutdown_connections 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- 172.21.15.38:0/351124897 wait complete. 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 Processor -- start 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- start start 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 0x7f7f14070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14070b10 con 0x7f7f14102c00 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f18d37700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14070c80 con 0x7f7f141035a0 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f1259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f1259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49496/0 (socket says 172.21.15.38:49496) 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.593+0000 7f7f1259c700 1 -- 172.21.15.38:0/2422221880 learned_addr learned my addr 172.21.15.38:0/2422221880 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f11d9b700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 0x7f7f14070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f1259c700 1 -- 172.21.15.38:0/2422221880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 msgr2=0x7f7f14070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f1259c700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 0x7f7f14070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f1259c700 1 -- 172.21.15.38:0/2422221880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04005040 con 0x7f7f14102c00 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f1259c700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b3b0 tx=0x7f7f04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f0400e040 con 0x7f7f14102c00 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f0400bc50 con 0x7f7f14102c00 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f14119890 con 0x7f7f14102c00 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f04013420 con 0x7f7f14102c00 2023-12-16T20:14:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.594+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f14119d80 con 0x7f7f14102c00 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.595+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f140fc390 con 0x7f7f14102c00 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.596+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f7f0401c430 con 0x7f7f14102c00 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.596+0000 7f7f02ffd700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 0x7f7efc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.596+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7f0408caa0 con 0x7f7f14102c00 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.596+0000 7f7f11d9b700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 0x7f7efc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.597+0000 7f7f11d9b700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 0x7f7efc06ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006fd0 tx=0x7f7f08008040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.601+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7f04056fd0 con 0x7f7f14102c00 2023-12-16T20:14:20.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.888+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f14071720 con 0x7f7f14102c00 2023-12-16T20:14:20.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.888+0000 7f7f02ffd700 1 -- 172.21.15.38:0/2422221880 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f7f0405a5f0 con 0x7f7f14102c00 2023-12-16T20:14:20.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 msgr2=0x7f7efc06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:20.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 0x7f7efc06ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006fd0 tx=0x7f7f08008040 comp rx=0 tx=0).stop 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 msgr2=0x7f7f1406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b3b0 tx=0x7f7f04009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 shutdown_connections 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7efc06cae0 0x7f7efc06ef90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f14102c00 0x7f7f1406ff40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 --2- 172.21.15.38:0/2422221880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f141035a0 0x7f7f14070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 >> 172.21.15.38:0/2422221880 conn(0x7f7f140f8790 msgr2=0x7f7f140fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 shutdown_connections 2023-12-16T20:14:20.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:20.890+0000 7f7f18d37700 1 -- 172.21.15.38:0/2422221880 wait complete. 2023-12-16T20:14:20.902 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:14:21.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:20 smithi038 ceph-mon[80659]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:21.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:20 smithi038 ceph-mon[80659]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:21.161 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-16T20:14:21.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:20 smithi141 ceph-mon[88165]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:21.265 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:20 smithi141 ceph-mon[88165]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T20:14:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:22.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:21 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2422221880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:22.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- 172.21.15.38:0/3222248849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fe590 msgr2=0x7f447c106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:22.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 --2- 172.21.15.38:0/3222248849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fe590 0x7f447c106c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f446c004940 tx=0x7f446c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:22.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- 172.21.15.38:0/3222248849 shutdown_connections 2023-12-16T20:14:22.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 --2- 172.21.15.38:0/3222248849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fe590 0x7f447c106c60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 --2- 172.21.15.38:0/3222248849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fdbf0 0x7f447c0fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- 172.21.15.38:0/3222248849 >> 172.21.15.38:0/3222248849 conn(0x7f447c0f7690 msgr2=0x7f447c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- 172.21.15.38:0/3222248849 shutdown_connections 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- 172.21.15.38:0/3222248849 wait complete. 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 Processor -- start 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 -- start start 2023-12-16T20:14:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.211+0000 7f4483bc2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:22.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f4483bc2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fe590 0x7f447c115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:22.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f4483bc2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c116390 con 0x7f447c0fdbf0 2023-12-16T20:14:22.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f4483bc2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c10f6c0 con 0x7f447c0fe590 2023-12-16T20:14:22.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:22.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49506/0 (socket says 172.21.15.38:49506) 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 -- 172.21.15.38:0/445791916 learned_addr learned my addr 172.21.15.38:0/445791916 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448115d700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fe590 0x7f447c115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 -- 172.21.15.38:0/445791916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fe590 msgr2=0x7f447c115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fe590 0x7f447c115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 -- 172.21.15.38:0/445791916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c005040 con 0x7f447c0fdbf0 2023-12-16T20:14:22.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f448195e700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4478002a50 tx=0x7f44780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4478007cc0 con 0x7f447c0fdbf0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f447800f040 con 0x7f447c0fdbf0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c10f9a0 con 0x7f447c0fdbf0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f447800d9c0 con 0x7f447c0fdbf0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.212+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c10feb0 con 0x7f447c0fdbf0 2023-12-16T20:14:22.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.214+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c106720 con 0x7f447c0fdbf0 2023-12-16T20:14:22.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.214+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f4478009070 con 0x7f447c0fdbf0 2023-12-16T20:14:22.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.214+0000 7f44727fc700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 0x7f446806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:22.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.214+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f447808ba30 con 0x7f447c0fdbf0 2023-12-16T20:14:22.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.214+0000 7f448115d700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 0x7f446806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:22.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.215+0000 7f448115d700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 0x7f446806ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f447c1109f0 tx=0x7f446c009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:22.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.219+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f44780598a0 con 0x7f447c0fdbf0 2023-12-16T20:14:22.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:21 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2422221880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.514+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f447c04bb80 con 0x7f447c0fdbf0 2023-12-16T20:14:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.514+0000 7f44727fc700 1 -- 172.21.15.38:0/445791916 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f4478059430 con 0x7f447c0fdbf0 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 msgr2=0x7f446806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 0x7f446806ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f447c1109f0 tx=0x7f446c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 msgr2=0x7f447c115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4478002a50 tx=0x7f44780046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 shutdown_connections 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f446806cae0 0x7f446806ef90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f447c0fdbf0 0x7f447c115800 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 --2- 172.21.15.38:0/445791916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f447c0fe590 0x7f447c115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.516+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 >> 172.21.15.38:0/445791916 conn(0x7f447c0f7690 msgr2=0x7f447c0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.517+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 shutdown_connections 2023-12-16T20:14:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:22.517+0000 7f4483bc2700 1 -- 172.21.15.38:0/445791916 wait complete. 2023-12-16T20:14:22.528 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)" 2023-12-16T20:14:22.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-16T20:14:23.107 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:22 smithi038 ceph-mon[80659]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:22 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/445791916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:22 smithi141 ceph-mon[88165]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:14:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:22 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/445791916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 -- 172.21.15.38:0/2993517415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55241035a0 msgr2=0x7f55240fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 --2- 172.21.15.38:0/2993517415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55241035a0 0x7f55240fcc10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f550c004940 tx=0x7f550c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 -- 172.21.15.38:0/2993517415 shutdown_connections 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 --2- 172.21.15.38:0/2993517415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55241035a0 0x7f55240fcc10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 --2- 172.21.15.38:0/2993517415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5524102c00 0x7f5524102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 -- 172.21.15.38:0/2993517415 >> 172.21.15.38:0/2993517415 conn(0x7f55240f8790 msgr2=0x7f55240faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 -- 172.21.15.38:0/2993517415 shutdown_connections 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.822+0000 7f5529163700 1 -- 172.21.15.38:0/2993517415 wait complete. 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 Processor -- start 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 -- start start 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55241035a0 0x7f5524113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524114160 con 0x7f5524102c00 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5529163700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552410d490 con 0x7f55241035a0 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5522d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5522d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49518/0 (socket says 172.21.15.38:49518) 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f5522d9d700 1 -- 172.21.15.38:0/3447564749 learned_addr learned my addr 172.21.15.38:0/3447564749 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.823+0000 7f552259c700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55241035a0 0x7f5524113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5522d9d700 1 -- 172.21.15.38:0/3447564749 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55241035a0 msgr2=0x7f5524113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5522d9d700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55241035a0 0x7f5524113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5522d9d700 1 -- 172.21.15.38:0/3447564749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c005040 con 0x7f5524102c00 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5522d9d700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f551c002a80 tx=0x7f551c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f551c007cc0 con 0x7f5524102c00 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f551c00f040 con 0x7f5524102c00 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552410d770 con 0x7f5524102c00 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f551c00da60 con 0x7f5524102c00 2023-12-16T20:14:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.824+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552410dc80 con 0x7f5524102c00 2023-12-16T20:14:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.825+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240fc390 con 0x7f5524102c00 2023-12-16T20:14:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.826+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f551c00dbc0 con 0x7f5524102c00 2023-12-16T20:14:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.826+0000 7f551b7fe700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 0x7f551006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.826+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f551c08bb60 con 0x7f5524102c00 2023-12-16T20:14:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.826+0000 7f552259c700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 0x7f551006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.827+0000 7f552259c700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 0x7f551006efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f552410e7c0 tx=0x7f550c009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:23.831+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f551c059950 con 0x7f5524102c00 2023-12-16T20:14:24.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.118+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f552410ebb0 con 0x7f5524102c00 2023-12-16T20:14:24.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.118+0000 7f551b7fe700 1 -- 172.21.15.38:0/3447564749 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f551c0594e0 con 0x7f5524102c00 2023-12-16T20:14:24.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 msgr2=0x7f551006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:24.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 0x7f551006efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f552410e7c0 tx=0x7f550c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:24.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 msgr2=0x7f55241135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:24.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f551c002a80 tx=0x7f551c0046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 shutdown_connections 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f551006caf0 0x7f551006efa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5524102c00 0x7f55241135d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 --2- 172.21.15.38:0/3447564749 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55241035a0 0x7f5524113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.120+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 >> 172.21.15.38:0/3447564749 conn(0x7f55240f8790 msgr2=0x7f55240fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.121+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 shutdown_connections 2023-12-16T20:14:24.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:24.121+0000 7f5529163700 1 -- 172.21.15.38:0/3447564749 wait complete. 2023-12-16T20:14:24.132 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:14:24.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-16T20:14:24.710 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:25.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:24 smithi038 ceph-mon[80659]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:25.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:24 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3447564749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:25.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:24 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:25.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:24 smithi141 ceph-mon[88165]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:25.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:24 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3447564749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:25.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:24 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:25.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 -- 172.21.15.38:0/3542146526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd40fbb00 msgr2=0x7f7bd40fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3542146526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd40fbb00 0x7f7bd40fbf70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0004940 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 -- 172.21.15.38:0/3542146526 shutdown_connections 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3542146526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd40fbb00 0x7f7bd40fbf70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3542146526 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd4101b60 0x7f7bd4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 -- 172.21.15.38:0/3542146526 >> 172.21.15.38:0/3542146526 conn(0x7f7bd40f7680 msgr2=0x7f7bd40f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 -- 172.21.15.38:0/3542146526 shutdown_connections 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.396+0000 7f7bdace7700 1 -- 172.21.15.38:0/3542146526 wait complete. 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 Processor -- start 2023-12-16T20:14:25.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 -- start start 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 0x7f7bd4112510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd41130a0 con 0x7f7bd4101b60 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bdace7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd410c3d0 con 0x7f7bd40fbb00 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49546/0 (socket says 172.21.15.38:49546) 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.397+0000 7f7bd3fff700 1 -- 172.21.15.38:0/3712116819 learned_addr learned my addr 172.21.15.38:0/3712116819 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd8a83700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 0x7f7bd4112510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd3fff700 1 -- 172.21.15.38:0/3712116819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 msgr2=0x7f7bd4112510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd3fff700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 0x7f7bd4112510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd3fff700 1 -- 172.21.15.38:0/3712116819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bd4101b60 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd8a83700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 0x7f7bd4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:14:25.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd3fff700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b3b0 tx=0x7f7bc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc000e040 con 0x7f7bd4101b60 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bc000bc50 con 0x7f7bd4101b60 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd410c650 con 0x7f7bd4101b60 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc0013420 con 0x7f7bd4101b60 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.398+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd410cb90 con 0x7f7bd4101b60 2023-12-16T20:14:25.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.399+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd4103f40 con 0x7f7bd4101b60 2023-12-16T20:14:25.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.400+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f7bc001c430 con 0x7f7bd4101b60 2023-12-16T20:14:25.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.400+0000 7f7bd17fa700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 0x7f7bc406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:25.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.400+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7bc008cb60 con 0x7f7bd4101b60 2023-12-16T20:14:25.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.400+0000 7f7bd8a83700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 0x7f7bc406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:25.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.401+0000 7f7bd8a83700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 0x7f7bc406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80041d0 tx=0x7f7bc8009040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:25.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.405+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7bc005aa80 con 0x7f7bd4101b60 2023-12-16T20:14:25.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:25.627+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd404bb80 con 0x7f7bc406cae0 2023-12-16T20:14:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:26 smithi038 ceph-mon[80659]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T20:14:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:26 smithi038 ceph-mon[80659]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:26 smithi141 ceph-mon[88165]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T20:14:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:26 smithi141 ceph-mon[88165]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.296+0000 7f7bd17fa700 1 -- 172.21.15.38:0/3712116819 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5090 (secure 0 0 0) 0x7f7bd404bb80 con 0x7f7bc406cae0 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 msgr2=0x7f7bc406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 0x7f7bc406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80041d0 tx=0x7f7bc8009040 comp rx=0 tx=0).stop 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 msgr2=0x7f7bd4112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b3b0 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 shutdown_connections 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f7bc406cae0 0x7f7bc406ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd40fbb00 0x7f7bd4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 --2- 172.21.15.38:0/3712116819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bd4101b60 0x7f7bd4112a50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 >> 172.21.15.38:0/3712116819 conn(0x7f7bd40f7680 msgr2=0x7f7bd40f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 shutdown_connections 2023-12-16T20:14:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:27.299+0000 7f7bdace7700 1 -- 172.21.15.38:0/3712116819 wait complete. 2023-12-16T20:14:27.310 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:14:27.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch ps' 2023-12-16T20:14:27.838 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 -- 172.21.15.38:0/2134451477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae141035a0 msgr2=0x7fae140fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 --2- 172.21.15.38:0/2134451477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae141035a0 0x7fae140fcc10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae04004940 tx=0x7fae04009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 -- 172.21.15.38:0/2134451477 shutdown_connections 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 --2- 172.21.15.38:0/2134451477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae141035a0 0x7fae140fcc10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 --2- 172.21.15.38:0/2134451477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae14102c00 0x7fae14102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 -- 172.21.15.38:0/2134451477 >> 172.21.15.38:0/2134451477 conn(0x7fae140f8790 msgr2=0x7fae140faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 -- 172.21.15.38:0/2134451477 shutdown_connections 2023-12-16T20:14:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 -- 172.21.15.38:0/2134451477 wait complete. 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.559+0000 7fae1bec4700 1 Processor -- start 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae1bec4700 1 -- start start 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae1bec4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae1bec4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae141035a0 0x7fae14070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae1bec4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14070a80 con 0x7fae14102c00 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae1bec4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14070bf0 con 0x7fae141035a0 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49558/0 (socket says 172.21.15.38:49558) 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 -- 172.21.15.38:0/976283921 learned_addr learned my addr 172.21.15.38:0/976283921 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 -- 172.21.15.38:0/976283921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae141035a0 msgr2=0x7fae14070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae141035a0 0x7fae14070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 -- 172.21.15.38:0/976283921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04005040 con 0x7fae14102c00 2023-12-16T20:14:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae19c60700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fae10002a50 tx=0x7fae100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:28.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae10007cc0 con 0x7fae14102c00 2023-12-16T20:14:28.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae1000f040 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.560+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae10009540 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.561+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae14119850 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.561+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae14119ce0 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.561+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae141050d0 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.562+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fae100096a0 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.562+0000 7fae0a7fc700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 0x7fae0006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.563+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fae1008b9a0 con 0x7fae14102c00 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.563+0000 7fae1945f700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 0x7fae0006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:28.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.563+0000 7fae1945f700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 0x7fae0006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae04004f90 tx=0x7fae04009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:28.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.567+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fae10055d00 con 0x7fae14102c00 2023-12-16T20:14:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.778+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae14071680 con 0x7fae0006cae0 2023-12-16T20:14:28.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.788+0000 7fae0a7fc700 1 -- 172.21.15.38:0/976283921 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fae14071680 con 0x7fae0006cae0 2023-12-16T20:14:28.789 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:14:28.789 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (46s) 32s ago 8m 15.8M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:14:28.789 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (8m) 32s ago 8m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:14:28.789 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (7m) 65s ago 7m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (35s) 32s ago 8m 53.0M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (4m) 32s ago 4m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (4m) 32s ago 4m 63.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (4m) 65s ago 4m 67.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (4m) 65s ago 4m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (119s) 32s ago 9m 492M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (79s) 65s ago 7m 439M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (9m) 32s ago 9m 53.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (7m) 65s ago 7m 45.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (70s) 32s ago 8m 8762k - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (67s) 65s ago 7m 3670k - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 32s ago 7m 225M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (6m) 32s ago 6m 240M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (6m) 32s ago 6m 193M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:14:28.790 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (6m) 65s ago 6m 272M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:14:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (5m) 65s ago 5m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:14:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (5m) 65s ago 5m 231M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:14:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (56s) 32s ago 7m 46.4M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:14:28.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 msgr2=0x7fae0006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:28.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 0x7fae0006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae04004f90 tx=0x7fae04009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 msgr2=0x7fae1406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fae10002a50 tx=0x7fae100046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 shutdown_connections 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fae0006cae0 0x7fae0006ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14102c00 0x7fae1406ff40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 --2- 172.21.15.38:0/976283921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae141035a0 0x7fae14070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 >> 172.21.15.38:0/976283921 conn(0x7fae140f8790 msgr2=0x7fae140fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 shutdown_connections 2023-12-16T20:14:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:28.790+0000 7fae1bec4700 1 -- 172.21.15.38:0/976283921 wait complete. 2023-12-16T20:14:29.041 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:28 smithi038 ceph-mon[80659]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:29.068 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T20:14:29.068 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:14:29.069 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-16T20:14:29.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:28 smithi141 ceph-mon[88165]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:29.339 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.000+0000 7f1937590700 1 -- 172.21.15.38:0/2137277620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19300fbb40 msgr2=0x7f19300fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.000+0000 7f1937590700 1 --2- 172.21.15.38:0/2137277620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19300fbb40 0x7f19300fbfb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f192c004940 tx=0x7f192c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 -- 172.21.15.38:0/2137277620 shutdown_connections 2023-12-16T20:14:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 --2- 172.21.15.38:0/2137277620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19300fbb40 0x7f19300fbfb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 --2- 172.21.15.38:0/2137277620 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1930101b00 0x7f1930101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 -- 172.21.15.38:0/2137277620 >> 172.21.15.38:0/2137277620 conn(0x7f19300f76c0 msgr2=0x7f19300f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 -- 172.21.15.38:0/2137277620 shutdown_connections 2023-12-16T20:14:30.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 -- 172.21.15.38:0/2137277620 wait complete. 2023-12-16T20:14:30.003 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:29 smithi038 ceph-mon[80659]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 Processor -- start 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 -- start start 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19300fbb40 0x7f193010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.001+0000 7f1937590700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1937590700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193010f1d0 con 0x7f1930101b00 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1937590700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193010f340 con 0x7f19300fbb40 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49576/0 (socket says 172.21.15.38:49576) 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 -- 172.21.15.38:0/2891058373 learned_addr learned my addr 172.21.15.38:0/2891058373 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f193532c700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19300fbb40 0x7f193010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:30.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 -- 172.21.15.38:0/2891058373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19300fbb40 msgr2=0x7f193010e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19300fbb40 0x7f193010e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 -- 172.21.15.38:0/2891058373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c005040 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1934b2b700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f192c009fd0 tx=0x7f192c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c00e040 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f192c013420 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1930117670 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.002+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c01c630 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.003+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1930117b60 con 0x7f1930101b00 2023-12-16T20:14:30.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.004+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1930103fb0 con 0x7f1930101b00 2023-12-16T20:14:30.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.004+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f192c013590 con 0x7f1930101b00 2023-12-16T20:14:30.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.005+0000 7f1925ffb700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 0x7f191c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:30.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.005+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f192c08cf70 con 0x7f1930101b00 2023-12-16T20:14:30.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.005+0000 7f193532c700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 0x7f191c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:30.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.005+0000 7f193532c700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 0x7f191c06efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19200041d0 tx=0x7f19200043c0 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:30.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.009+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f192c0bfce0 con 0x7f1930101b00 2023-12-16T20:14:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.213+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f193004bbf0 con 0x7f1930101b00 2023-12-16T20:14:30.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.222+0000 7f1925ffb700 1 -- 172.21.15.38:0/2891058373 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f192c0573f0 con 0x7f1930101b00 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 msgr2=0x7f191c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 0x7f191c06efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19200041d0 tx=0x7f19200043c0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 msgr2=0x7f193010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f192c009fd0 tx=0x7f192c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 shutdown_connections 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f191c06caf0 0x7f191c06efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19300fbb40 0x7f193010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 --2- 172.21.15.38:0/2891058373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1930101b00 0x7f193010ec40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 >> 172.21.15.38:0/2891058373 conn(0x7f19300f76c0 msgr2=0x7f19300f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 shutdown_connections 2023-12-16T20:14:30.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:30.225+0000 7f1937590700 1 -- 172.21.15.38:0/2891058373 wait complete. 2023-12-16T20:14:30.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:29 smithi141 ceph-mon[88165]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:30.519 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T20:14:30.519 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:14:30.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T20:14:30.789 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:31.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:31.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/2891058373' entity='client.admin' 2023-12-16T20:14:31.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:31.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:31.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:31.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:30 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/2891058373' entity='client.admin' 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:31.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:30 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:31.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- 172.21.15.38:0/541628973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc0fbb40 msgr2=0x7efffc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:31.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 --2- 172.21.15.38:0/541628973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc0fbb40 0x7efffc0fbfb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7effe8004940 tx=0x7effe8009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:31.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- 172.21.15.38:0/541628973 shutdown_connections 2023-12-16T20:14:31.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 --2- 172.21.15.38:0/541628973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc0fbb40 0x7efffc0fbfb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 --2- 172.21.15.38:0/541628973 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc101b00 0x7efffc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- 172.21.15.38:0/541628973 >> 172.21.15.38:0/541628973 conn(0x7efffc0f76c0 msgr2=0x7efffc0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- 172.21.15.38:0/541628973 shutdown_connections 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- 172.21.15.38:0/541628973 wait complete. 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 Processor -- start 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.705+0000 7f0002e6e700 1 -- start start 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0002e6e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc0fbb40 0x7efffc0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0002e6e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0002e6e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0fe260 con 0x7efffc101b00 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0002e6e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0fe3d0 con 0x7efffc0fbb40 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50020/0 (socket says 172.21.15.38:50020) 2023-12-16T20:14:31.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 -- 172.21.15.38:0/161824585 learned_addr learned my addr 172.21.15.38:0/161824585 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0000c0a700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc0fbb40 0x7efffc0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 -- 172.21.15.38:0/161824585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc0fbb40 msgr2=0x7efffc0fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc0fbb40 0x7efffc0fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 -- 172.21.15.38:0/161824585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8005040 con 0x7efffc101b00 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efffbfff700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7effe800b3b0 tx=0x7effe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe800e040 con 0x7efffc101b00 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effe800bc50 con 0x7efffc101b00 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc1198c0 con 0x7efffc101b00 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.706+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe8013420 con 0x7efffc101b00 2023-12-16T20:14:31.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.707+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc119d20 con 0x7efffc101b00 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.707+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc0fb2c0 con 0x7efffc101b00 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.708+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7effe801c430 con 0x7efffc101b00 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.708+0000 7efff97fa700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 0x7effec06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.709+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7effe808cb60 con 0x7efffc101b00 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.709+0000 7f0000c0a700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 0x7effec06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:31.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.709+0000 7f0000c0a700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 0x7effec06ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efff0007fd0 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:31.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.713+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7effe8056ff0 con 0x7efffc101b00 2023-12-16T20:14:31.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.917+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7efffc0fef00 con 0x7efffc101b00 2023-12-16T20:14:31.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.918+0000 7efff97fa700 1 -- 172.21.15.38:0/161824585 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7effe805a610 con 0x7efffc101b00 2023-12-16T20:14:31.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 msgr2=0x7effec06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:31.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 0x7effec06ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efff0007fd0 tx=0x7efff0009040 comp rx=0 tx=0).stop 2023-12-16T20:14:31.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 msgr2=0x7efffc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:31.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7effe800b3b0 tx=0x7effe8009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:31.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 shutdown_connections 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7effec06cae0 0x7effec06ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efffc0fbb40 0x7efffc0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 --2- 172.21.15.38:0/161824585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efffc101b00 0x7efffc0fdc60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 >> 172.21.15.38:0/161824585 conn(0x7efffc0f76c0 msgr2=0x7efffc065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 shutdown_connections 2023-12-16T20:14:31.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:31.920+0000 7f0002e6e700 1 -- 172.21.15.38:0/161824585 wait complete. 2023-12-16T20:14:32.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T20:14:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:33.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:32 smithi038 ceph-mon[80659]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:33.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 -- 172.21.15.38:0/2964176763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 msgr2=0x7f545c0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 --2- 172.21.15.38:0/2964176763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c0fb630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f544c004940 tx=0x7f544c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 -- 172.21.15.38:0/2964176763 shutdown_connections 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 --2- 172.21.15.38:0/2964176763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c0fb630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 --2- 172.21.15.38:0/2964176763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 -- 172.21.15.38:0/2964176763 >> 172.21.15.38:0/2964176763 conn(0x7f545c0711a0 msgr2=0x7f545c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 -- 172.21.15.38:0/2964176763 shutdown_connections 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.162+0000 7f54644ab700 1 -- 172.21.15.38:0/2964176763 wait complete. 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 Processor -- start 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 -- start start 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:33.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1141d0 con 0x7f545c0fb1e0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f54644ab700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c10d4c0 con 0x7f545c102c70 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50036/0 (socket says 172.21.15.38:50036) 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 -- 172.21.15.38:0/3684149539 learned_addr learned my addr 172.21.15.38:0/3684149539 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5461a46700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 -- 172.21.15.38:0/3684149539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 msgr2=0x7f545c113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5462247700 1 -- 172.21.15.38:0/3684149539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c005040 con 0x7f545c0fb1e0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.163+0000 7f5461a46700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f5462247700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f545800c8c0 tx=0x7f54580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545800a980 con 0x7f545c0fb1e0 2023-12-16T20:14:33.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f545800ce60 con 0x7f545c0fb1e0 2023-12-16T20:14:33.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c10d750 con 0x7f545c0fb1e0 2023-12-16T20:14:33.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54580113a0 con 0x7f545c0fb1e0 2023-12-16T20:14:33.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.164+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c10dc90 con 0x7f545c0fb1e0 2023-12-16T20:14:33.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.165+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c105050 con 0x7f545c0fb1e0 2023-12-16T20:14:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.165+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f5458012400 con 0x7f545c0fb1e0 2023-12-16T20:14:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.166+0000 7f5452ffd700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 0x7f544806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.166+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f545808bed0 con 0x7f545c0fb1e0 2023-12-16T20:14:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.166+0000 7f5461a46700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 0x7f544806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.166+0000 7f5461a46700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 0x7f544806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f544c004560 tx=0x7f544c009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:33.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.170+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5458059d40 con 0x7f545c0fb1e0 2023-12-16T20:14:33.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:32 smithi141 ceph-mon[88165]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.373+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f545c10ebe0 con 0x7f545c0fb1e0 2023-12-16T20:14:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.373+0000 7f5452ffd700 1 -- 172.21.15.38:0/3684149539 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f54580598d0 con 0x7f545c0fb1e0 2023-12-16T20:14:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 msgr2=0x7f544806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 0x7f544806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f544c004560 tx=0x7f544c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 msgr2=0x7f545c113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f545800c8c0 tx=0x7f54580044c0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 shutdown_connections 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f544806cae0 0x7f544806ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f545c0fb1e0 0x7f545c113600 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 --2- 172.21.15.38:0/3684149539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f545c102c70 0x7f545c113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.375+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 >> 172.21.15.38:0/3684149539 conn(0x7f545c0711a0 msgr2=0x7f545c0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.376+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 shutdown_connections 2023-12-16T20:14:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:33.376+0000 7f54644ab700 1 -- 172.21.15.38:0/3684149539 wait complete. 2023-12-16T20:14:33.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T20:14:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 -- 172.21.15.38:0/829617998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c101b00 msgr2=0x7fe11c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 --2- 172.21.15.38:0/829617998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c101b00 0x7fe11c101ed0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe10c004940 tx=0x7fe10c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 -- 172.21.15.38:0/829617998 shutdown_connections 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 --2- 172.21.15.38:0/829617998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 --2- 172.21.15.38:0/829617998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c101b00 0x7fe11c101ed0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 -- 172.21.15.38:0/829617998 >> 172.21.15.38:0/829617998 conn(0x7fe11c0719b0 msgr2=0x7fe11c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 -- 172.21.15.38:0/829617998 shutdown_connections 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.692+0000 7fe12222e700 1 -- 172.21.15.38:0/829617998 wait complete. 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 Processor -- start 2023-12-16T20:14:34.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 -- start start 2023-12-16T20:14:34.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c101b00 0x7fe11c0fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0fe2f0 con 0x7fe11c0fbb40 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe12222e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0fe460 con 0x7fe11c101b00 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe11b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe11b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50052/0 (socket says 172.21.15.38:50052) 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.693+0000 7fe11b7fe700 1 -- 172.21.15.38:0/2940135533 learned_addr learned my addr 172.21.15.38:0/2940135533 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe11affd700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c101b00 0x7fe11c0fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe11b7fe700 1 -- 172.21.15.38:0/2940135533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c101b00 msgr2=0x7fe11c0fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe11b7fe700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c101b00 0x7fe11c0fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe11b7fe700 1 -- 172.21.15.38:0/2940135533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c005040 con 0x7fe11c0fbb40 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe11b7fe700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00b3b0 tx=0x7fe10c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10c00e040 con 0x7fe11c0fbb40 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe10c00bc50 con 0x7fe11c0fbb40 2023-12-16T20:14:34.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c119880 con 0x7fe11c0fbb40 2023-12-16T20:14:34.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10c013420 con 0x7fe11c0fbb40 2023-12-16T20:14:34.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.694+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c119d70 con 0x7fe11c0fbb40 2023-12-16T20:14:34.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.695+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c0734d0 con 0x7fe11c0fbb40 2023-12-16T20:14:34.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.696+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fe10c01c430 con 0x7fe11c0fbb40 2023-12-16T20:14:34.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.696+0000 7fe103fff700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 0x7fe10406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:34.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.696+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe10c08caa0 con 0x7fe11c0fbb40 2023-12-16T20:14:34.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.696+0000 7fe11affd700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 0x7fe10406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:34.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.697+0000 7fe11affd700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 0x7fe10406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe110006fd0 tx=0x7fe110008040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:34.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.701+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe10c056fd0 con 0x7fe11c0fbb40 2023-12-16T20:14:34.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.900+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe11c108b30 con 0x7fe11c0fbb40 2023-12-16T20:14:34.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.901+0000 7fe103fff700 1 -- 172.21.15.38:0/2940135533 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe10c05a5f0 con 0x7fe11c0fbb40 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 msgr2=0x7fe10406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 0x7fe10406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe110006fd0 tx=0x7fe110008040 comp rx=0 tx=0).stop 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 msgr2=0x7fe11c0fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00b3b0 tx=0x7fe10c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 shutdown_connections 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fe10406cae0 0x7fe10406ef90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe11c0fbb40 0x7fe11c0fd720 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 --2- 172.21.15.38:0/2940135533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe11c101b00 0x7fe11c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 >> 172.21.15.38:0/2940135533 conn(0x7fe11c0719b0 msgr2=0x7fe11c0653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:34.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 shutdown_connections 2023-12-16T20:14:34.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:34.903+0000 7fe12222e700 1 -- 172.21.15.38:0/2940135533 wait complete. 2023-12-16T20:14:35.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:34 smithi038 ceph-mon[80659]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:35.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-16T20:14:35.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:34 smithi141 ceph-mon[88165]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 -- 172.21.15.38:0/1193313745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 msgr2=0x7f75800fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 --2- 172.21.15.38:0/1193313745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f75800fbfb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7570004940 tx=0x7f7570009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 -- 172.21.15.38:0/1193313745 shutdown_connections 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 --2- 172.21.15.38:0/1193313745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f75800fbfb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 --2- 172.21.15.38:0/1193313745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 0x7f7580101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 -- 172.21.15.38:0/1193313745 >> 172.21.15.38:0/1193313745 conn(0x7f75800f76c0 msgr2=0x7f75800f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 -- 172.21.15.38:0/1193313745 shutdown_connections 2023-12-16T20:14:36.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 -- 172.21.15.38:0/1193313745 wait complete. 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.200+0000 7f758608f700 1 Processor -- start 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f758608f700 1 -- start start 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f758608f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f758608f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 0x7f758010eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f758608f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758010f230 con 0x7f75800fbb40 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f758608f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758010f370 con 0x7f7580101b00 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50070/0 (socket says 172.21.15.38:50070) 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 -- 172.21.15.38:0/937176670 learned_addr learned my addr 172.21.15.38:0/937176670 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757effd700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 0x7f758010eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 -- 172.21.15.38:0/937176670 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 msgr2=0x7f758010eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 0x7f758010eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.201+0000 7f757f7fe700 1 -- 172.21.15.38:0/937176670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570005040 con 0x7f75800fbb40 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f757f7fe700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7568002a50 tx=0x7f75680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7568007cc0 con 0x7f75800fbb40 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f756800f040 con 0x7f75800fbb40 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75801176d0 con 0x7f75800fbb40 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756800d9c0 con 0x7f75800fbb40 2023-12-16T20:14:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.202+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7580117be0 con 0x7f75800fbb40 2023-12-16T20:14:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.203+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580103fb0 con 0x7f75800fbb40 2023-12-16T20:14:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.204+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f756800db20 con 0x7f75800fbb40 2023-12-16T20:14:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.204+0000 7f7577fff700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 0x7f756c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.204+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f756808bad0 con 0x7f75800fbb40 2023-12-16T20:14:36.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.204+0000 7f757effd700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 0x7f756c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:36.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.204+0000 7f757effd700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 0x7f756c06ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75800666c0 tx=0x7f7570009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:36.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.209+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7568055e30 con 0x7f75800fbb40 2023-12-16T20:14:36.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.435+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}) v1 -- 0x7f7580066400 con 0x7f756c06cae0 2023-12-16T20:14:36.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.442+0000 7f7577fff700 1 -- 172.21.15.38:0/937176670 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7580066400 con 0x7f756c06cae0 2023-12-16T20:14:36.443 INFO:teuthology.orchestra.run.smithi038.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 msgr2=0x7f756c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 0x7f756c06ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75800666c0 tx=0x7f7570009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 msgr2=0x7f758010e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7568002a50 tx=0x7f75680046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 shutdown_connections 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f756c06cae0 0x7f756c06ef90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75800fbb40 0x7f758010e760 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 --2- 172.21.15.38:0/937176670 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580101b00 0x7f758010eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:36.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 >> 172.21.15.38:0/937176670 conn(0x7f75800f76c0 msgr2=0x7f75800f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:36.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 shutdown_connections 2023-12-16T20:14:36.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:36.445+0000 7f758608f700 1 -- 172.21.15.38:0/937176670 wait complete. 2023-12-16T20:14:36.709 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T20:14:36.709 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:14:36.710 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-16T20:14:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:14:37.065 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:37.065 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:37.065 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:37.066 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:37.066 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:37.066 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:36 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:37.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:37.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:37.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:37.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:37.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:37.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:36 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 -- 172.21.15.38:0/712328001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba41035a0 msgr2=0x7ffba40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 --2- 172.21.15.38:0/712328001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba41035a0 0x7ffba40fcc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb98004940 tx=0x7ffb98009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 -- 172.21.15.38:0/712328001 shutdown_connections 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 --2- 172.21.15.38:0/712328001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba41035a0 0x7ffba40fcc10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 --2- 172.21.15.38:0/712328001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba4102c00 0x7ffba4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 -- 172.21.15.38:0/712328001 >> 172.21.15.38:0/712328001 conn(0x7ffba40f8790 msgr2=0x7ffba40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 -- 172.21.15.38:0/712328001 shutdown_connections 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.786+0000 7ffba9533700 1 -- 172.21.15.38:0/712328001 wait complete. 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 Processor -- start 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 -- start start 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba41035a0 0x7ffba4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4070a80 con 0x7ffba4102c00 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba9533700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4070bf0 con 0x7ffba41035a0 2023-12-16T20:14:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50080/0 (socket says 172.21.15.38:50080) 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 -- 172.21.15.38:0/2513666169 learned_addr learned my addr 172.21.15.38:0/2513666169 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba27fc700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba41035a0 0x7ffba4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 -- 172.21.15.38:0/2513666169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba41035a0 msgr2=0x7ffba4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba41035a0 0x7ffba4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.787+0000 7ffba2ffd700 1 -- 172.21.15.38:0/2513666169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98005040 con 0x7ffba4102c00 2023-12-16T20:14:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffba2ffd700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c8c0 tx=0x7ffb940044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb9400a980 con 0x7ffba4102c00 2023-12-16T20:14:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba4119850 con 0x7ffba4102c00 2023-12-16T20:14:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb9400ce60 con 0x7ffba4102c00 2023-12-16T20:14:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb940113a0 con 0x7ffba4102c00 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.788+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba4119d30 con 0x7ffba4102c00 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.789+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba41050d0 con 0x7ffba4102c00 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.790+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7ffb9400aae0 con 0x7ffba4102c00 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.790+0000 7ffb8b7fe700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 0x7ffb8c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.790+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ffb9408bec0 con 0x7ffba4102c00 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.790+0000 7ffba27fc700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 0x7ffb8c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.791+0000 7ffba27fc700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 0x7ffb8c06ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffba4071940 tx=0x7ffb98009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:37.795+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ffb940562a0 con 0x7ffba4102c00 2023-12-16T20:14:38.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.015+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffba4071680 con 0x7ffb8c06cae0 2023-12-16T20:14:38.016 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:37 smithi038 ceph-mon[80659]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:38.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:37 smithi038 ceph-mon[80659]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:14:38.017 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:37 smithi038 ceph-mon[80659]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:14:38.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.016+0000 7ffb8b7fe700 1 -- 172.21.15.38:0/2513666169 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ffba4071680 con 0x7ffb8c06cae0 2023-12-16T20:14:38.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.018+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 msgr2=0x7ffb8c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.018+0000 7ffba9533700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 0x7ffb8c06ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffba4071940 tx=0x7ffb98009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.018+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 msgr2=0x7ffba406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.018+0000 7ffba9533700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c8c0 tx=0x7ffb940044c0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 shutdown_connections 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7ffb8c06cae0 0x7ffb8c06ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffba4102c00 0x7ffba406ff40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 --2- 172.21.15.38:0/2513666169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffba41035a0 0x7ffba4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 >> 172.21.15.38:0/2513666169 conn(0x7ffba40f8790 msgr2=0x7ffba40fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 shutdown_connections 2023-12-16T20:14:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.019+0000 7ffba9533700 1 -- 172.21.15.38:0/2513666169 wait complete. 2023-12-16T20:14:38.030 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:14:38.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 -- 172.21.15.38:0/688285078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fe5a0 msgr2=0x7fc29c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 --2- 172.21.15.38:0/688285078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c106be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc28c004940 tx=0x7fc28c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 -- 172.21.15.38:0/688285078 shutdown_connections 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 --2- 172.21.15.38:0/688285078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c106be0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 --2- 172.21.15.38:0/688285078 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 -- 172.21.15.38:0/688285078 >> 172.21.15.38:0/688285078 conn(0x7fc29c0f7690 msgr2=0x7fc29c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 -- 172.21.15.38:0/688285078 shutdown_connections 2023-12-16T20:14:38.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.128+0000 7fc2a1375700 1 -- 172.21.15.38:0/688285078 wait complete. 2023-12-16T20:14:38.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 Processor -- start 2023-12-16T20:14:38.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 -- start start 2023-12-16T20:14:38.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c0fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0fc570 con 0x7fc29c0fdc00 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.129+0000 7fc2a1375700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0fc6e0 con 0x7fc29c0fe5a0 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50094/0 (socket says 172.21.15.38:50094) 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 -- 172.21.15.38:0/2201841127 learned_addr learned my addr 172.21.15.38:0/2201841127 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29a7fc700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c0fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 -- 172.21.15.38:0/2201841127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fe5a0 msgr2=0x7fc29c0fbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c0fbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 -- 172.21.15.38:0/2201841127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c005040 con 0x7fc29c0fdc00 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc29affd700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc290002a50 tx=0x7fc2900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc290007cc0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c119920 con 0x7fc29c0fdc00 2023-12-16T20:14:38.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.130+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc29000f040 con 0x7fc29c0fdc00 2023-12-16T20:14:38.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.131+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc29000d9c0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.131+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c119dd0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.132+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fc29000db40 con 0x7fc29c0fdc00 2023-12-16T20:14:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.132+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c1041f0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.132+0000 7fc2837fe700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 0x7fc28406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.133+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc29008bac0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.133+0000 7fc29a7fc700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 0x7fc28406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.133+0000 7fc29a7fc700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 0x7fc28406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0fdb40 tx=0x7fc28c009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.137+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc290055ed0 con 0x7fc29c0fdc00 2023-12-16T20:14:38.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:37 smithi141 ceph-mon[88165]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:38.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:37 smithi141 ceph-mon[88165]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:14:38.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:37 smithi141 ceph-mon[88165]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:14:38.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.361+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc29c0fc8a0 con 0x7fc28406cae0 2023-12-16T20:14:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.362+0000 7fc2837fe700 1 -- 172.21.15.38:0/2201841127 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc29c0fc8a0 con 0x7fc28406cae0 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 msgr2=0x7fc28406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 0x7fc28406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0fdb40 tx=0x7fc28c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 msgr2=0x7fc29c0fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc290002a50 tx=0x7fc2900046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 shutdown_connections 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7fc28406cae0 0x7fc28406ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc29c0fdc00 0x7fc29c0fba30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 --2- 172.21.15.38:0/2201841127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc29c0fe5a0 0x7fc29c0fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 >> 172.21.15.38:0/2201841127 conn(0x7fc29c0f7690 msgr2=0x7fc29c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 shutdown_connections 2023-12-16T20:14:38.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.364+0000 7fc2a1375700 1 -- 172.21.15.38:0/2201841127 wait complete. 2023-12-16T20:14:38.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 -- 172.21.15.38:0/528775192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32680fbb00 msgr2=0x7f32680fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 --2- 172.21.15.38:0/528775192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32680fbb00 0x7f32680fbf70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f325c004940 tx=0x7f325c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 -- 172.21.15.38:0/528775192 shutdown_connections 2023-12-16T20:14:38.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 --2- 172.21.15.38:0/528775192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32680fbb00 0x7f32680fbf70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 --2- 172.21.15.38:0/528775192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3268101b60 0x7f3268101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 -- 172.21.15.38:0/528775192 >> 172.21.15.38:0/528775192 conn(0x7f32680f7680 msgr2=0x7f32680f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 -- 172.21.15.38:0/528775192 shutdown_connections 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 -- 172.21.15.38:0/528775192 wait complete. 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.474+0000 7f326c9b7700 1 Processor -- start 2023-12-16T20:14:38.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326c9b7700 1 -- start start 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326c9b7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32680fbb00 0x7f3268112510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326c9b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326c9b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681130a0 con 0x7f3268101b60 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326c9b7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326810c3d0 con 0x7f32680fbb00 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50102/0 (socket says 172.21.15.38:50102) 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 -- 172.21.15.38:0/3835982661 learned_addr learned my addr 172.21.15.38:0/3835982661 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f326659c700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32680fbb00 0x7f3268112510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 -- 172.21.15.38:0/3835982661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32680fbb00 msgr2=0x7f3268112510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32680fbb00 0x7f3268112510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.475+0000 7f3265d9b700 1 -- 172.21.15.38:0/3835982661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c005040 con 0x7f3268101b60 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f3265d9b700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b3b0 tx=0x7f325c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325c00e040 con 0x7f3268101b60 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f325c01c430 con 0x7f3268101b60 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326810c650 con 0x7f3268101b60 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325c013640 con 0x7f3268101b60 2023-12-16T20:14:38.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.476+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326810cb90 con 0x7f3268101b60 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.477+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3268103f40 con 0x7f3268101b60 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.477+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f325c01c5a0 con 0x7f3268101b60 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.478+0000 7f3256ffd700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 0x7f325006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.478+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f325c08c8d0 con 0x7f3268101b60 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.478+0000 7f326659c700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 0x7f325006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.478+0000 7f326659c700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 0x7f325006ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3258004f40 tx=0x7f325800b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.483+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f325c05a7f0 con 0x7f3268101b60 2023-12-16T20:14:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.697+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32681121e0 con 0x7f325006cae0 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.709+0000 7f3256ffd700 1 -- 172.21.15.38:0/3835982661 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f32681121e0 con 0x7f325006cae0 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (56s) 42s ago 8m 15.8M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (8m) 42s ago 8m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (7m) 75s ago 7m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (45s) 42s ago 8m 53.0M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (5m) 42s ago 5m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (5m) 42s ago 5m 63.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:14:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (4m) 75s ago 4m 67.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (5m) 75s ago 5m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (2m) 42s ago 9m 492M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (89s) 75s ago 7m 439M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (9m) 42s ago 9m 53.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 55c426f73667 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (7m) 75s ago 7m 45.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 803e3bc3f24c 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (80s) 42s ago 8m 8762k - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (77s) 75s ago 7m 3670k - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 42s ago 7m 225M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (6m) 42s ago 6m 240M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (6m) 42s ago 6m 193M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (6m) 75s ago 6m 272M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (6m) 75s ago 6m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (5m) 75s ago 5m 231M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:14:38.711 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (66s) 42s ago 8m 46.4M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:14:38.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 msgr2=0x7f325006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 0x7f325006ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3258004f40 tx=0x7f325800b040 comp rx=0 tx=0).stop 2023-12-16T20:14:38.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 msgr2=0x7f3268112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f325c00b3b0 tx=0x7f325c009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 shutdown_connections 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f325006cae0 0x7f325006ef90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32680fbb00 0x7f3268112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 --2- 172.21.15.38:0/3835982661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3268101b60 0x7f3268112a50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 >> 172.21.15.38:0/3835982661 conn(0x7f32680f7680 msgr2=0x7f32680f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 shutdown_connections 2023-12-16T20:14:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.711+0000 7f326c9b7700 1 -- 172.21.15.38:0/3835982661 wait complete. 2023-12-16T20:14:38.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 -- 172.21.15.38:0/189604193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd40fbb40 msgr2=0x7f4dd40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 --2- 172.21.15.38:0/189604193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd40fbb40 0x7f4dd40fbfb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8004940 tx=0x7f4dc8009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 -- 172.21.15.38:0/189604193 shutdown_connections 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 --2- 172.21.15.38:0/189604193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd40fbb40 0x7f4dd40fbfb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 --2- 172.21.15.38:0/189604193 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd4101b00 0x7f4dd4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 -- 172.21.15.38:0/189604193 >> 172.21.15.38:0/189604193 conn(0x7f4dd40719b0 msgr2=0x7f4dd4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 -- 172.21.15.38:0/189604193 shutdown_connections 2023-12-16T20:14:38.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.819+0000 7f4dda707700 1 -- 172.21.15.38:0/189604193 wait complete. 2023-12-16T20:14:38.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 Processor -- start 2023-12-16T20:14:38.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 -- start start 2023-12-16T20:14:38.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd40fbb40 0x7f4dd410e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd410f240 con 0x7f4dd4101b00 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.820+0000 7f4dda707700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd410f3b0 con 0x7f4dd40fbb40 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50118/0 (socket says 172.21.15.38:50118) 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 -- 172.21.15.38:0/1113309373 learned_addr learned my addr 172.21.15.38:0/1113309373 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd3fff700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd40fbb40 0x7f4dd410e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 -- 172.21.15.38:0/1113309373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd40fbb40 msgr2=0x7f4dd410e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd40fbb40 0x7f4dd410e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 -- 172.21.15.38:0/1113309373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8005040 con 0x7f4dd4101b00 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd37fe700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009380 tx=0x7f4dc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc800e040 con 0x7f4dd4101b00 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dc800bc50 con 0x7f4dd4101b00 2023-12-16T20:14:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd41176a0 con 0x7f4dd4101b00 2023-12-16T20:14:38.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc8013660 con 0x7f4dd4101b00 2023-12-16T20:14:38.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.821+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd4117bb0 con 0x7f4dd4101b00 2023-12-16T20:14:38.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.822+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4103fb0 con 0x7f4dd4101b00 2023-12-16T20:14:38.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.823+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f4dc80138d0 con 0x7f4dd4101b00 2023-12-16T20:14:38.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.823+0000 7f4dd0ff9700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 0x7f4dbc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:38.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.824+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4dc808cad0 con 0x7f4dd4101b00 2023-12-16T20:14:38.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.824+0000 7f4dd3fff700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 0x7f4dbc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:38.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.824+0000 7f4dd3fff700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 0x7f4dbc06ef90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4008040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:38.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:38.832+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4dc8056f60 con 0x7f4dd4101b00 2023-12-16T20:14:39.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.127+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4dd404bb80 con 0x7f4dd4101b00 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.128+0000 7f4dd0ff9700 1 -- 172.21.15.38:0/1113309373 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f4dc805a580 con 0x7f4dd4101b00 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:14:39.129 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:14:39.130 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.131+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 msgr2=0x7f4dbc06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.131+0000 7f4dda707700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 0x7f4dbc06ef90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4008040 comp rx=0 tx=0).stop 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 msgr2=0x7f4dd410ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009380 tx=0x7f4dc8009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 shutdown_connections 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f4dbc06cae0 0x7f4dbc06ef90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4dd40fbb40 0x7f4dd410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 --2- 172.21.15.38:0/1113309373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dd4101b00 0x7f4dd410ec20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 >> 172.21.15.38:0/1113309373 conn(0x7f4dd40719b0 msgr2=0x7f4dd40faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 shutdown_connections 2023-12-16T20:14:39.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.132+0000 7f4dda707700 1 -- 172.21.15.38:0/1113309373 wait complete. 2023-12-16T20:14:39.223 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:39.223 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:39.223 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:39.223 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:39.223 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:39.224 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:38 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T20:14:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:39.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:39.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:38 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 -- 172.21.15.38:0/1501491336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 msgr2=0x7f278c1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 --2- 172.21.15.38:0/1501491336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c1051f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2788004940 tx=0x7f2788009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 -- 172.21.15.38:0/1501491336 shutdown_connections 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 --2- 172.21.15.38:0/1501491336 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 --2- 172.21.15.38:0/1501491336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c1051f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 -- 172.21.15.38:0/1501491336 >> 172.21.15.38:0/1501491336 conn(0x7f278c0fa990 msgr2=0x7f278c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 -- 172.21.15.38:0/1501491336 shutdown_connections 2023-12-16T20:14:39.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.245+0000 7f27946f5700 1 -- 172.21.15.38:0/1501491336 wait complete. 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 Processor -- start 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 -- start start 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c1163f0 con 0x7f278c104e20 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f27946f5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c10f720 con 0x7f278c1057c0 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f2792491700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f2792491700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50128/0 (socket says 172.21.15.38:50128) 2023-12-16T20:14:39.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.246+0000 7f2792491700 1 -- 172.21.15.38:0/3005773484 learned_addr learned my addr 172.21.15.38:0/3005773484 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:39.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2791c90700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2792491700 1 -- 172.21.15.38:0/3005773484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 msgr2=0x7f278c115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2792491700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2792491700 1 -- 172.21.15.38:0/3005773484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788005040 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2791c90700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f2792491700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f278800b3b0 tx=0x7f2788009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278800e040 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c10f9a0 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f278800bc50 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2788013420 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.247+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c10fee0 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.248+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c102130 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.249+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f278801c430 con 0x7f278c104e20 2023-12-16T20:14:39.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.249+0000 7f277effd700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 0x7f277806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.249+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f278808cb60 con 0x7f278c104e20 2023-12-16T20:14:39.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.249+0000 7f2791c90700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 0x7f277806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.250+0000 7f2791c90700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 0x7f277806ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2780007fd0 tx=0x7f2780009040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.254+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f278805aa80 con 0x7f278c104e20 2023-12-16T20:14:39.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.509+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f278c04bb80 con 0x7f278c104e20 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.509+0000 7f277effd700 1 -- 172.21.15.38:0/3005773484 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1860 (secure 0 0 0) 0x7f278805a610 con 0x7f278c104e20 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stdout:e21 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:14:39.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 21 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:11:36.344081+0000 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:14:39.511 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:39.512 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:39.513 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:39.513 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:14:39.513 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:14:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 msgr2=0x7f277806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 0x7f277806ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2780007fd0 tx=0x7f2780009040 comp rx=0 tx=0).stop 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 msgr2=0x7f278c115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f278800b3b0 tx=0x7f2788009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 shutdown_connections 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f277806cae0 0x7f277806ef90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c104e20 0x7f278c115860 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 --2- 172.21.15.38:0/3005773484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f278c1057c0 0x7f278c115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 >> 172.21.15.38:0/3005773484 conn(0x7f278c0fa990 msgr2=0x7f278c0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 shutdown_connections 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.512+0000 7f27946f5700 1 -- 172.21.15.38:0/3005773484 wait complete. 2023-12-16T20:14:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 21 2023-12-16T20:14:39.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 -- 172.21.15.38:0/1286391935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 msgr2=0x7f68f80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 --2- 172.21.15.38:0/1286391935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f80fcc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f68ec004940 tx=0x7f68ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 -- 172.21.15.38:0/1286391935 shutdown_connections 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 --2- 172.21.15.38:0/1286391935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f80fcc10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 --2- 172.21.15.38:0/1286391935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 0x7f68f8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 -- 172.21.15.38:0/1286391935 >> 172.21.15.38:0/1286391935 conn(0x7f68f80f8790 msgr2=0x7f68f80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 -- 172.21.15.38:0/1286391935 shutdown_connections 2023-12-16T20:14:39.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.625+0000 7f68fd629700 1 -- 172.21.15.38:0/1286391935 wait complete. 2023-12-16T20:14:39.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.626+0000 7f68fd629700 1 Processor -- start 2023-12-16T20:14:39.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.626+0000 7f68fd629700 1 -- start start 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68fd629700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 0x7f68f8113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68fd629700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68fd629700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81141e0 con 0x7f68f81035a0 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68fd629700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f810d4d0 con 0x7f68f8102c00 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50156/0 (socket says 172.21.15.38:50156) 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 -- 172.21.15.38:0/1582138461 learned_addr learned my addr 172.21.15.38:0/1582138461 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f6ffd700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 0x7f68f8113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 -- 172.21.15.38:0/1582138461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 msgr2=0x7f68f8113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 0x7f68f8113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 -- 172.21.15.38:0/1582138461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec005040 con 0x7f68f81035a0 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68f67fc700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009fd0 tx=0x7f68ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ec00e040 con 0x7f68f81035a0 2023-12-16T20:14:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.627+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68ec013420 con 0x7f68f81035a0 2023-12-16T20:14:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.628+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f810d700 con 0x7f68f81035a0 2023-12-16T20:14:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.628+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ec01c630 con 0x7f68f81035a0 2023-12-16T20:14:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.628+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f810dc40 con 0x7f68f81035a0 2023-12-16T20:14:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.629+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f81050d0 con 0x7f68f81035a0 2023-12-16T20:14:39.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.629+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f68ec013a00 con 0x7f68f81035a0 2023-12-16T20:14:39.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.630+0000 7f68df7fe700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 0x7f68e006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.630+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f68ec08d010 con 0x7f68f81035a0 2023-12-16T20:14:39.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.630+0000 7f68f6ffd700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 0x7f68e006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.630+0000 7f68f6ffd700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 0x7f68e006ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68f80f9a10 tx=0x7f68e800b040 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.634+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f68ec05ae80 con 0x7f68f81035a0 2023-12-16T20:14:39.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.868+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 --> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68f810ebf0 con 0x7f68e006cae0 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.870+0000 7f68df7fe700 1 -- 172.21.15.38:0/1582138461 <== mgr.24441 v2:172.21.15.38:6800/4126814688 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f68f810ebf0 con 0x7f68e006cae0 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/21 daemons upgraded", 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:14:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 msgr2=0x7f68e006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 0x7f68e006ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68f80f9a10 tx=0x7f68e800b040 comp rx=0 tx=0).stop 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 msgr2=0x7f68f8113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009fd0 tx=0x7f68ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 shutdown_connections 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f68e006cae0 0x7f68e006ef90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f8102c00 0x7f68f8113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 --2- 172.21.15.38:0/1582138461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68f81035a0 0x7f68f8113b90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 >> 172.21.15.38:0/1582138461 conn(0x7f68f80f8790 msgr2=0x7f68f80fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 shutdown_connections 2023-12-16T20:14:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.872+0000 7f68fd629700 1 -- 172.21.15.38:0/1582138461 wait complete. 2023-12-16T20:14:39.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 -- 172.21.15.38:0/1047646989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 msgr2=0x7f2b2c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/1047646989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c065800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2b18004940 tx=0x7f2b18009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 -- 172.21.15.38:0/1047646989 shutdown_connections 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/1047646989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c065800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/1047646989 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 0x7f2b2c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 -- 172.21.15.38:0/1047646989 >> 172.21.15.38:0/1047646989 conn(0x7f2b2c0719b0 msgr2=0x7f2b2c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 -- 172.21.15.38:0/1047646989 shutdown_connections 2023-12-16T20:14:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.984+0000 7f2b32ecf700 1 -- 172.21.15.38:0/1047646989 wait complete. 2023-12-16T20:14:39.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.985+0000 7f2b32ecf700 1 Processor -- start 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.985+0000 7f2b32ecf700 1 -- start start 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b32ecf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b32ecf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 0x7f2b2c113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b32ecf700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c114170 con 0x7f2b2c065390 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b32ecf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c10d4a0 con 0x7f2b2c102c20 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50176/0 (socket says 172.21.15.38:50176) 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 -- 172.21.15.38:0/4014835644 learned_addr learned my addr 172.21.15.38:0/4014835644 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b2bfff700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 0x7f2b2c113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 -- 172.21.15.38:0/4014835644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 msgr2=0x7f2b2c113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 0x7f2b2c113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 -- 172.21.15.38:0/4014835644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18005040 con 0x7f2b2c065390 2023-12-16T20:14:39.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.986+0000 7f2b30c6b700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b20002a80 tx=0x7f2b200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.987+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b20007cc0 con 0x7f2b2c065390 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.987+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c10d780 con 0x7f2b2c065390 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.987+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c10dcc0 con 0x7f2b2c065390 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.987+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b2000f040 con 0x7f2b2c065390 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.987+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2000da60 con 0x7f2b2c065390 2023-12-16T20:14:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.988+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c0fff40 con 0x7f2b2c065390 2023-12-16T20:14:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.989+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f2b2000dc60 con 0x7f2b2c065390 2023-12-16T20:14:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.990+0000 7f2b297fa700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 0x7f2b1c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:14:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.990+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2b2008bab0 con 0x7f2b2c065390 2023-12-16T20:14:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.990+0000 7f2b2bfff700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 0x7f2b1c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:14:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.990+0000 7f2b2bfff700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 0x7f2b1c06ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c10ee80 tx=0x7f2b18009e30 comp rx=0 tx=0).ready entity=mgr.24441 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:14:39.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:39.998+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2b20059920 con 0x7f2b2c065390 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: Upgrade: Target is version 19.0.0-202-gc7586e95 (unknown) 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5'] 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: Upgrade: Setting container_image for all mgr 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/1113309373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/3005773484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:14:40.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:14:40.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:39 smithi038 ceph-mon[80659]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: Upgrade: Target is version 19.0.0-202-gc7586e95 (unknown) 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5'] 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: Upgrade: Setting container_image for all mgr 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/1113309373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/3005773484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:14:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:39 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.308+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2b2c04bb80 con 0x7f2b2c065390 2023-12-16T20:14:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.309+0000 7f2b297fa700 1 -- 172.21.15.38:0/4014835644 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2b200594b0 con 0x7f2b2c065390 2023-12-16T20:14:40.310 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2023-12-16T20:14:40.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 msgr2=0x7f2b1c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:40.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 0x7f2b1c06ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c10ee80 tx=0x7f2b18009e30 comp rx=0 tx=0).stop 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 msgr2=0x7f2b2c1135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b20002a80 tx=0x7f2b200046b0 comp rx=0 tx=0).stop 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 shutdown_connections 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:6800/4126814688,v1:172.21.15.38:6801/4126814688] conn(0x7f2b1c06cae0 0x7f2b1c06ef90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b2c065390 0x7f2b2c1135e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 --2- 172.21.15.38:0/4014835644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c102c20 0x7f2b2c113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 >> 172.21.15.38:0/4014835644 conn(0x7f2b2c0719b0 msgr2=0x7f2b2c0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:14:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 shutdown_connections 2023-12-16T20:14:40.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:14:40.311+0000 7f2b32ecf700 1 -- 172.21.15.38:0/4014835644 wait complete. 2023-12-16T20:14:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:40 smithi141 ceph-mon[88165]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:40 smithi141 ceph-mon[88165]: Upgrade: Updating mon.smithi038 2023-12-16T20:14:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:40 smithi141 ceph-mon[88165]: Deploying daemon mon.smithi038 on smithi038 2023-12-16T20:14:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:40 smithi141 ceph-mon[88165]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:41.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:40 smithi141 ceph-mon[88165]: from='client.? 172.21.15.38:0/4014835644' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:14:41.292 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 ceph-mon[80659]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 ceph-mon[80659]: Upgrade: Updating mon.smithi038 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 ceph-mon[80659]: Deploying daemon mon.smithi038 on smithi038 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 ceph-mon[80659]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 ceph-mon[80659]: from='client.? 172.21.15.38:0/4014835644' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:40 smithi038 systemd[1]: Stopping Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[80655]: 2023-12-16T20:14:41.167+0000 7f911579c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi038 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:14:41.293 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[80655]: 2023-12-16T20:14:41.167+0000 7f911579c700 -1 mon.smithi038@0(leader) e2 *** Got Signal Terminated *** 2023-12-16T20:14:41.640 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 podman[163820]: 2023-12-16 20:14:41.412803645 +0000 UTC m=+0.290405724 container died 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=quincy-1f2f551, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2023-12-16T20:14:41.640 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 podman[163820]: 2023-12-16 20:14:41.506301616 +0000 UTC m=+0.383903696 container cleanup 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=quincy-1f2f551) 2023-12-16T20:14:41.640 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 bash[163820]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038 2023-12-16T20:14:41.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 podman[163845]: 2023-12-16 20:14:41.639700218 +0000 UTC m=+0.220648526 container remove 55c426f7366727d1ca0a3634b5e890908ab43dc8b21369d8327269d2df2d75bb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, RELEASE=quincy-1f2f551, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2023-12-16T20:14:41.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service: Deactivated successfully. 2023-12-16T20:14:41.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 systemd[1]: Stopped Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:14:41.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service: Consumed 12.903s CPU time. 2023-12-16T20:14:42.241 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:41 smithi038 systemd[1]: Starting Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:14:42.241 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 podman[163974]: 2023-12-16 20:14:42.139545464 +0000 UTC m=+0.058369744 container create 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2023-12-16T20:14:42.241 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 podman[163974]: 2023-12-16 20:14:42.099416155 +0000 UTC m=+0.018240389 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:14:42.241 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 podman[163974]: 2023-12-16 20:14:42.240594109 +0000 UTC m=+0.159418336 container init 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=) 2023-12-16T20:14:42.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 podman[163974]: 2023-12-16 20:14:42.24401656 +0000 UTC m=+0.162840794 container start 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, GIT_CLEAN=True) 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev), process ceph-mon, pid 2 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: pidfile_write: ignore empty --pid-file 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: load: jerasure load: lrc 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: RocksDB version: 7.9.2 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Git sha 0 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Compile date 2023-12-15 17:47:11 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: DB SUMMARY 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: DB Session ID: MV7P1LO24BIMH5C93Q1F 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: CURRENT file: CURRENT 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: MANIFEST file: MANIFEST-000015 size: 785 Bytes 2023-12-16T20:14:42.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi038/store.db dir, Total Num: 1, files: 000027.sst 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi038/store.db: 000025.log size: 2906031 ; 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.error_if_exists: 0 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.create_if_missing: 0 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.paranoid_checks: 1 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 bash[163974]: 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.env: 0x564271af2a60 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.info_log: 0x564273c5b620 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.statistics: (nil) 2023-12-16T20:14:42.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.use_fsync: 0 2023-12-16T20:14:42.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_log_file_size: 0 2023-12-16T20:14:42.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T20:14:42.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T20:14:42.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T20:14:42.648 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T20:14:42.648 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_fallocate: 1 2023-12-16T20:14:42.648 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T20:14:42.648 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T20:14:42.648 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.use_direct_reads: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.db_log_dir: 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.wal_dir: 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.write_buffer_manager: 0x564273c2f2c0 2023-12-16T20:14:42.649 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.unordered_write: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.row_cache: None 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.wal_filter: None 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T20:14:42.650 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.two_write_queues: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.wal_compression: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.atomic_flush: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T20:14:42.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.log_readahead_size: 0 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_background_jobs: 2 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_background_compactions: -1 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_subcompactions: 1 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T20:14:42.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_open_files: -1 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_background_flushes: -1 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Compression algorithms supported: 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kZSTD supported: 0 2023-12-16T20:14:42.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kXpressCompression supported: 0 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kZlibCompression supported: 1 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kSnappyCompression supported: 1 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kLZ4Compression supported: 1 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: kBZip2Compression supported: 0 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000015 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.merge_operator: 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_filter: None 2023-12-16T20:14:42.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564273c5b720) 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks: 1 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_top_level_index_and_filter: 1 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_type: 0 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_index_type: 0 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_shortening: 1 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: checksum: 4 2023-12-16T20:14:42.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: no_block_cache: 0 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache: 0x564273cb1090 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_name: BinnedLRUCache 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_options: 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: capacity : 536870912 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_shard_bits : 4 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: strict_capacity_limit : 0 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: high_pri_pool_ratio: 0.000 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_compressed: (nil) 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: persistent_cache: (nil) 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size: 4096 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size_deviation: 10 2023-12-16T20:14:42.656 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_restart_interval: 16 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_block_restart_interval: 1 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_block_size: 4096 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: partition_filters: 0 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: use_delta_encoding: 1 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: filter_policy: bloomfilter 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: whole_key_filtering: 1 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: verify_compression: 0 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: read_amp_bytes_per_bit: 0 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: format_version: 5 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_index_compression: 1 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_align: 0 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_auto_readahead_size: 262144 2023-12-16T20:14:42.657 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: prepopulate_block_cache: 0 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: initial_auto_readahead_size: 8192 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression: NoCompression 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.num_levels: 7 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T20:14:42.658 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T20:14:42.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T20:14:42.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T20:14:42.661 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T20:14:42.662 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.table_properties_collectors: 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.inplace_update_support: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.bloom_locality: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.max_successive_merges: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.ttl: 2592000 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T20:14:42.663 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enable_blob_files: false 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.min_blob_size: 0 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T20:14:42.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 29, last_sequence is 9802, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7ad71174-7a83-4a7d-bfea-4e79799359de 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757682273780, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 systemd[1]: Started Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757682283725, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2509814, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9803, "largest_seqno": 11940, "table_properties": {"data_size": 2501043, "index_size": 5447, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2309, "raw_key_size": 21986, "raw_average_key_size": 24, "raw_value_size": 2481945, "raw_average_value_size": 2709, "num_data_blocks": 249, "num_entries": 916, "num_filter_entries": 916, "num_deletions": 9, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702757682, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7ad71174-7a83-4a7d-bfea-4e79799359de", "db_session_id": "MV7P1LO24BIMH5C93Q1F", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757682283831, "job": 1, "event": "recovery_finished"} 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi038/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564273d4c000 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: DB pointer 0x564273d3a000 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T20:14:42.665 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** DB Stats ** 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L0 1/0 2.39 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 579.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-16T20:14:42.666 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L6 1/0 6.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Sum 2/0 8.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 579.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 579.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 579.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:14:42.667 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative compaction: 0.00 GB write, 156.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval compaction: 0.00 GB write, 156.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache BinnedLRUCache@0x564273cb1090#2 capacity: 512.00 MB usage: 8.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: starting mon.smithi038 rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi038 fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???) e2 preinit fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).mds e21 new map 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).mds e21 print_map 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: e21 2023-12-16T20:14:42.668 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: legacy client fscid: 1 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Filesystem 'cephfs' (1) 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: fs_name cephfs 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: epoch 21 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: modified 2023-12-16T20:11:36.344081+0000 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: tableserver 0 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: root 0 2023-12-16T20:14:42.669 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: session_timeout 60 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: session_autoclose 300 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_file_size 1099511627776 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_xattr_size 65536 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: required_client_features {} 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: last_failure 0 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: last_failure_osd_epoch 44 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_mds 2 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: in 0,1 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: up {0=14498,1=24271} 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: failed 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: damaged 2023-12-16T20:14:42.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: stopped 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_pools [3] 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_pool 2 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: inline_data disabled 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: balancer 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: bal_rank_mask -1 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: standby_count_wanted 1 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:14:42.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:14:42.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:14:42.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-16T20:14:43.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:14:43.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:14:43.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: mon.smithi038 calling monitor election 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: mgrmap e33: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: from='mgr.24441 ' entity='' 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: mgrmap e34: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:43.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:42 smithi141 ceph-mon[88165]: overall HEALTH_OK 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: from='mgr.24441 172.21.15.38:0/755762246' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038 calling monitor election 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:14:43.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T20:14:43.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mgrmap e33: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:43.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: from='mgr.24441 ' entity='' 2023-12-16T20:14:43.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: mgrmap e34: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:43.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:42 smithi038 ceph-mon[163993]: overall HEALTH_OK 2023-12-16T20:14:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:14:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:14:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:14:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:14:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:14:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:49 smithi141 ceph-mon[88165]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:14:50.023 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: Standby manager daemon smithi141.cycgjd restarted 2023-12-16T20:14:50.023 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: Standby manager daemon smithi141.cycgjd started 2023-12-16T20:14:50.024 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/crt"}]: dispatch 2023-12-16T20:14:50.024 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T20:14:50.024 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi141.cycgjd/key"}]: dispatch 2023-12-16T20:14:50.024 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:49 smithi038 ceph-mon[163993]: from='mgr.? 172.21.15.141:0/2318517400' entity='mgr.smithi141.cycgjd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T20:14:50.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141[88161]: 2023-12-16T20:14:50.027+0000 7f526c4cf700 -1 mon.smithi141@1(peon).osd e48 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-16T20:14:51.035 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: mgrmap e35: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:51.035 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: mgrmap e36: smithi038.gdlrfj(active, starting, since 0.0112326s), standbys: smithi141.cycgjd 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:14:51.036 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:14:51.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:14:51.038 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.038 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.038 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:50 smithi038 ceph-mon[163993]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: mgrmap e35: smithi038.gdlrfj(active, since 2m), standbys: smithi141.cycgjd 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: Active manager daemon smithi038.gdlrfj restarted 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: Activating manager daemon smithi038.gdlrfj 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: mgrmap e36: smithi038.gdlrfj(active, starting, since 0.0112326s), standbys: smithi141.cycgjd 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.aofkae"}]: dispatch 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dbcjir"}]: dispatch 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.xhutny"}]: dispatch 2023-12-16T20:14:51.132 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi141.eyrunj"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi038.gdlrfj", "id": "smithi038.gdlrfj"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr metadata", "who": "smithi141.cycgjd", "id": "smithi141.cycgjd"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T20:14:51.133 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: Manager daemon smithi038.gdlrfj is now available 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/mirror_snapshot_schedule"}]: dispatch 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.gdlrfj/trash_purge_schedule"}]: dispatch 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: failed to encode map e48 with expected crc 2023-12-16T20:14:51.134 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:50 smithi141 ceph-mon[88165]: failed to encode map e48 with expected crc 2023-12-16T20:14:52.372 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:52 smithi038 ceph-mon[163993]: mgrmap e37: smithi038.gdlrfj(active, since 1.00856s), standbys: smithi141.cycgjd 2023-12-16T20:14:52.372 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:52 smithi038 ceph-mon[163993]: [16/Dec/2023:20:14:51] ENGINE Bus STARTING 2023-12-16T20:14:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:52 smithi141 ceph-mon[88165]: mgrmap e37: smithi038.gdlrfj(active, since 1.00856s), standbys: smithi141.cycgjd 2023-12-16T20:14:52.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:52 smithi141 ceph-mon[88165]: [16/Dec/2023:20:14:51] ENGINE Bus STARTING 2023-12-16T20:14:53.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: [16/Dec/2023:20:14:52] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:14:53.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:14:53.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: [16/Dec/2023:20:14:52] ENGINE Serving on http://172.21.15.38:8765 2023-12-16T20:14:53.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: [16/Dec/2023:20:14:52] ENGINE Bus STARTED 2023-12-16T20:14:53.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: mgrmap e38: smithi038.gdlrfj(active, since 3s), standbys: smithi141.cycgjd 2023-12-16T20:14:53.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:53 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: [16/Dec/2023:20:14:52] ENGINE Serving on https://172.21.15.38:7150 2023-12-16T20:14:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:14:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: [16/Dec/2023:20:14:52] ENGINE Serving on http://172.21.15.38:8765 2023-12-16T20:14:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: [16/Dec/2023:20:14:52] ENGINE Bus STARTED 2023-12-16T20:14:53.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: mgrmap e38: smithi038.gdlrfj(active, since 3s), standbys: smithi141.cycgjd 2023-12-16T20:14:53.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:53.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:53 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:54.481 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:54 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:54.481 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:54 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:54 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:54 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:55.406 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:55 smithi141 ceph-mon[88165]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:14:55.406 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:55 smithi141 ceph-mon[88165]: mgrmap e39: smithi038.gdlrfj(active, since 4s), standbys: smithi141.cycgjd 2023-12-16T20:14:55.406 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:55 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:55.406 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:55 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:55 smithi038 ceph-mon[163993]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:14:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:55 smithi038 ceph-mon[163993]: mgrmap e39: smithi038.gdlrfj(active, since 4s), standbys: smithi141.cycgjd 2023-12-16T20:14:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:55 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:55 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: Detected new or changed devices on smithi141 2023-12-16T20:14:56.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:56.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:56 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:56.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi141 2023-12-16T20:14:56.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:56 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:14:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Detected new or changed devices on smithi038 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:14:57.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:57 smithi038 ceph-mon[163993]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:14:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2023-12-16T20:14:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Detected new or changed devices on smithi038 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.conf 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.conf 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi141:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:14:57.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:57 smithi141 ceph-mon[88165]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2023-12-16T20:14:58.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:14:58.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:14:58.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:58.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T20:14:58.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: Updating smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:14:58.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: Updating smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T20:14:58.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:14:58.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:58 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T20:14:59.719 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: Upgrade: Updating mon.smithi141 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-mon[88165]: Deploying daemon mon.smithi141 on smithi141 2023-12-16T20:14:59.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 systemd[1]: Stopping Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:14:59.854 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: Upgrade: Updating mon.smithi141 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:14:59.855 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:14:59 smithi038 ceph-mon[163993]: Deploying daemon mon.smithi141 on smithi141 2023-12-16T20:14:59.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141[88161]: 2023-12-16T20:14:59.906+0000 7f5271cda700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi141 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:14:59.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141[88161]: 2023-12-16T20:14:59.906+0000 7f5271cda700 -1 mon.smithi141@1(peon) e2 *** Got Signal Terminated *** 2023-12-16T20:15:00.352 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:14:59 smithi141 podman[137424]: 2023-12-16 20:14:59.999454401 +0000 UTC m=+0.139658327 container died 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-1f2f551, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, io.buildah.version=1.31.3, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2023-12-16T20:15:00.353 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137424]: 2023-12-16 20:15:00.096747491 +0000 UTC m=+0.236951403 container cleanup 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=quincy-1f2f551, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2023-12-16T20:15:00.353 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 bash[137424]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141 2023-12-16T20:15:00.353 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137438]: 2023-12-16 20:15:00.221640283 +0000 UTC m=+0.214293775 container remove 803e3bc3f24cb54ce41de0bc9b4d3ef861cbbc0329ab7579901065c18bec912f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2023-12-16T20:15:00.721 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi141.service: Deactivated successfully. 2023-12-16T20:15:00.722 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 systemd[1]: Stopped Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:15:00.722 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi141.service: Consumed 6.132s CPU time. 2023-12-16T20:15:00.722 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 systemd[1]: Starting Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:15:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137568]: 2023-12-16 20:15:00.721498664 +0000 UTC m=+0.077238764 container create 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:15:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137568]: 2023-12-16 20:15:00.662264177 +0000 UTC m=+0.018004288 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:15:00.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137568]: 2023-12-16 20:15:00.805298267 +0000 UTC m=+0.161038376 container init 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 podman[137568]: 2023-12-16 20:15:00.820768984 +0000 UTC m=+0.176509095 container start 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev), process ceph-mon, pid 2 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: pidfile_write: ignore empty --pid-file 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 bash[137568]: 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: load: jerasure load: lrc 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 systemd[1]: Started Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:15:00.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: RocksDB version: 7.9.2 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Git sha 0 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Compile date 2023-12-15 17:47:11 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: DB SUMMARY 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: DB Session ID: R3XTSGVZCWTP9V8NGXQM 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: CURRENT file: CURRENT 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: MANIFEST file: MANIFEST-000009 size: 897 Bytes 2023-12-16T20:15:00.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi141/store.db dir, Total Num: 1, files: 000024.sst 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi141/store.db: 000022.log size: 2550919 ; 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.error_if_exists: 0 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.create_if_missing: 0 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.paranoid_checks: 1 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T20:15:00.999 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.env: 0x5634496b5a60 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.info_log: 0x56344a1eb620 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.statistics: (nil) 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.use_fsync: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_log_file_size: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_fallocate: 1 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T20:15:01.000 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.use_direct_reads: 0 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.db_log_dir: 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.wal_dir: 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T20:15:01.001 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.write_buffer_manager: 0x56344a1bf2c0 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T20:15:01.002 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.unordered_write: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.row_cache: None 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.wal_filter: None 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.two_write_queues: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T20:15:01.003 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.wal_compression: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.atomic_flush: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.log_readahead_size: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T20:15:01.004 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_background_jobs: 2 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_background_compactions: -1 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_subcompactions: 1 2023-12-16T20:15:01.005 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T20:15:01.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T20:15:01.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T20:15:01.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T20:15:01.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T20:15:01.006 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T20:15:01.008 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T20:15:01.008 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_open_files: -1 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_background_flushes: -1 2023-12-16T20:15:01.009 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Compression algorithms supported: 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kZSTD supported: 0 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kXpressCompression supported: 0 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kZlibCompression supported: 1 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kSnappyCompression supported: 1 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kLZ4Compression supported: 1 2023-12-16T20:15:01.010 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: kBZip2Compression supported: 0 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi141/store.db/MANIFEST-000009 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.merge_operator: 2023-12-16T20:15:01.011 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_filter: None 2023-12-16T20:15:01.012 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T20:15:01.012 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T20:15:01.012 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T20:15:01.012 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T20:15:01.012 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56344a1eb720) 2023-12-16T20:15:01.013 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: cache_index_and_filter_blocks: 1 2023-12-16T20:15:01.013 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T20:15:01.013 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T20:15:01.013 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: pin_top_level_index_and_filter: 1 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_type: 0 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: data_block_index_type: 0 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_shortening: 1 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: checksum: 4 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: no_block_cache: 0 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache: 0x56344a241090 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_name: BinnedLRUCache 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_options: 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: capacity : 536870912 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: num_shard_bits : 4 2023-12-16T20:15:01.014 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: strict_capacity_limit : 0 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: high_pri_pool_ratio: 0.000 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_cache_compressed: (nil) 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: persistent_cache: (nil) 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_size: 4096 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_size_deviation: 10 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_restart_interval: 16 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: index_block_restart_interval: 1 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: metadata_block_size: 4096 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: partition_filters: 0 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: use_delta_encoding: 1 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: filter_policy: bloomfilter 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: whole_key_filtering: 1 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: verify_compression: 0 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: read_amp_bytes_per_bit: 0 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: format_version: 5 2023-12-16T20:15:01.015 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: enable_index_compression: 1 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: block_align: 0 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: max_auto_readahead_size: 262144 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: prepopulate_block_cache: 0 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: initial_auto_readahead_size: 8192 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression: NoCompression 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T20:15:01.016 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.num_levels: 7 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T20:15:01.017 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T20:15:01.018 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T20:15:01.019 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.table_properties_collectors: 2023-12-16T20:15:01.020 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.inplace_update_support: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.bloom_locality: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.max_successive_merges: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.ttl: 2592000 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T20:15:01.021 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enable_blob_files: false 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.min_blob_size: 0 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi141/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 12560, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2023-12-16T20:15:01.022 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a2a97017-0360-4f40-99e5-d63807664ec7 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757700849866, "job": 1, "event": "recovery_started", "wal_files": [22]} 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757700856350, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 1618977, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12546, "largest_seqno": 12999, "table_properties": {"data_size": 1616001, "index_size": 1386, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 5307, "raw_average_key_size": 24, "raw_value_size": 1611186, "raw_average_value_size": 7390, "num_data_blocks": 62, "num_entries": 218, "num_filter_entries": 218, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702757700, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a2a97017-0360-4f40-99e5-d63807664ec7", "db_session_id": "R3XTSGVZCWTP9V8NGXQM", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702757700856454, "job": 1, "event": "recovery_finished"} 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi141/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56344a2dc000 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: DB pointer 0x56344a2ca000 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** DB Stats ** 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:15:01.023 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: L0 1/0 1.54 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: L6 1/0 8.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Sum 2/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.024 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** Compaction Stats [default] ** 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 552.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T20:15:01.025 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Cumulative compaction: 0.00 GB write, 174.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Interval compaction: 0.00 GB write, 174.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Block cache BinnedLRUCache@0x56344a241090#2 capacity: 512.00 MB usage: 2.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012517%) IndexBlock(1,1.45 KB,0.000277162%) Misc(1,0.00 KB,0%) 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: starting mon.smithi141 rank 1 at public addrs [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] at bind addrs [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi141 fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???) e2 preinit fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).mds e21 new map 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).mds e21 print_map 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: e21 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: legacy client fscid: 1 2023-12-16T20:15:01.026 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: Filesystem 'cephfs' (1) 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: fs_name cephfs 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: epoch 21 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: modified 2023-12-16T20:11:36.344081+0000 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: tableserver 0 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: root 0 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: session_timeout 60 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: session_autoclose 300 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: max_file_size 1099511627776 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: max_xattr_size 65536 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: required_client_features {} 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: last_failure 0 2023-12-16T20:15:01.027 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: last_failure_osd_epoch 44 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: max_mds 2 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: in 0,1 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: up {0=14498,1=24271} 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: failed 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: damaged 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: stopped 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: data_pools [3] 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: metadata_pool 2 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: inline_data disabled 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: balancer 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: bal_rank_mask -1 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: standby_count_wanted 1 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: [mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:01.028 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: [mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: [mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: [mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout: 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T20:15:01.029 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:00 smithi141 ceph-mon[137587]: mon.smithi141@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-16T20:15:02.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: overall HEALTH_OK 2023-12-16T20:15:02.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: mon.smithi141 calling monitor election 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: mon.smithi038 calling monitor election 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: monmap e3: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: mgrmap e39: smithi038.gdlrfj(active, since 11s), standbys: smithi141.cycgjd 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: overall HEALTH_OK 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:02.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:02 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:02.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: overall HEALTH_OK 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: mon.smithi141 calling monitor election 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: mon.smithi038 calling monitor election 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mon metadata", "id": "smithi141"}]: dispatch 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: mon.smithi038 is new leader, mons smithi038,smithi141 in quorum (ranks 0,1) 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: monmap e3: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi141=[v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: mgrmap e39: smithi038.gdlrfj(active, since 11s), standbys: smithi141.cycgjd 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: overall HEALTH_OK 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:02.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:02 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:03 smithi038 ceph-mon[163993]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T20:15:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:03 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:03 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:03.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:03 smithi141 ceph-mon[137587]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T20:15:03.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:03 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:03.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:03 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:05.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:05 smithi141 ceph-mon[137587]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T20:15:05.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:05.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:05.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:05.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:05 smithi038 ceph-mon[163993]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T20:15:05.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:05.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:05.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:07.458 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: pgmap v11: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T20:15:07.458 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.458 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.458 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: Reconfiguring mon.smithi038 (monmap changed)... 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:07.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:07 smithi038 ceph-mon[163993]: Reconfiguring daemon mon.smithi038 on smithi038 2023-12-16T20:15:07.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: pgmap v11: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T20:15:07.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: Reconfiguring mon.smithi038 (monmap changed)... 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:07.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:07 smithi141 ceph-mon[137587]: Reconfiguring daemon mon.smithi038 on smithi038 2023-12-16T20:15:08.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: Reconfiguring mgr.smithi038.gdlrfj (monmap changed)... 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:08.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:08 smithi141 ceph-mon[137587]: Reconfiguring daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:15:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: Reconfiguring mgr.smithi038.gdlrfj (monmap changed)... 2023-12-16T20:15:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.gdlrfj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:15:09.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:15:09.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:09.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:08 smithi038 ceph-mon[163993]: Reconfiguring daemon mgr.smithi038.gdlrfj on smithi038 2023-12-16T20:15:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: Reconfiguring crash.smithi038 (monmap changed)... 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: Reconfiguring daemon crash.smithi038 on smithi038 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:15:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: Reconfiguring crash.smithi038 (monmap changed)... 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: Reconfiguring daemon crash.smithi038 on smithi038 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:15:10.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:10.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 -- 172.21.15.38:0/113818609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101c10 msgr2=0x7fba440fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 --2- 172.21.15.38:0/113818609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101c10 0x7fba440fb2d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba2c004a50 tx=0x7fba2c00af40 comp rx=0 tx=0).stop 2023-12-16T20:15:10.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 -- 172.21.15.38:0/113818609 shutdown_connections 2023-12-16T20:15:10.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 --2- 172.21.15.38:0/113818609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101c10 0x7fba440fb2d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 --2- 172.21.15.38:0/113818609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101270 0x7fba44101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 -- 172.21.15.38:0/113818609 >> 172.21.15.38:0/113818609 conn(0x7fba440711a0 msgr2=0x7fba440715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:10.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 -- 172.21.15.38:0/113818609 shutdown_connections 2023-12-16T20:15:10.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.424+0000 7fba49821700 1 -- 172.21.15.38:0/113818609 wait complete. 2023-12-16T20:15:10.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 Processor -- start 2023-12-16T20:15:10.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 -- start start 2023-12-16T20:15:10.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 0x7fba44113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba441141e0 con 0x7fba44101270 2023-12-16T20:15:10.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba49821700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4410d4d0 con 0x7fba44101c10 2023-12-16T20:15:10.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba42ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba42ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42510/0 (socket says 172.21.15.38:42510) 2023-12-16T20:15:10.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.425+0000 7fba42ffd700 1 -- 172.21.15.38:0/2558949207 learned_addr learned my addr 172.21.15.38:0/2558949207 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:10.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba427fc700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 0x7fba44113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba42ffd700 1 -- 172.21.15.38:0/2558949207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 msgr2=0x7fba44113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba42ffd700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 0x7fba44113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba42ffd700 1 -- 172.21.15.38:0/2558949207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c005040 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba427fc700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 0x7fba44113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba42ffd700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba3400bbb0 tx=0x7fba34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba340092e0 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba3400cbb0 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4410d7b0 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba34015d70 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.426+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4410dcf0 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.427+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44113300 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.428+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fba34012070 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.428+0000 7fba3b7fe700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 0x7fba3006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.428+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fba3408bfc0 con 0x7fba44101270 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.428+0000 7fba427fc700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 0x7fba3006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.429+0000 7fba427fc700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 0x7fba3006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba4410eeb0 tx=0x7fba2c00af40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:10.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.433+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fba340598a0 con 0x7fba44101270 2023-12-16T20:15:10.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.661+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba4404bc20 con 0x7fba3006cf80 2023-12-16T20:15:10.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.662+0000 7fba3b7fe700 1 -- 172.21.15.38:0/2558949207 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fba2c00a7e0 con 0x7fba3006cf80 2023-12-16T20:15:10.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 msgr2=0x7fba3006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 0x7fba3006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba4410eeb0 tx=0x7fba2c00af40 comp rx=0 tx=0).stop 2023-12-16T20:15:10.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 msgr2=0x7fba44113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba3400bbb0 tx=0x7fba34009840 comp rx=0 tx=0).stop 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 shutdown_connections 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fba3006cf80 0x7fba3006f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba44101270 0x7fba44113650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 --2- 172.21.15.38:0/2558949207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba44101c10 0x7fba44113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 >> 172.21.15.38:0/2558949207 conn(0x7fba440711a0 msgr2=0x7fba44104820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 shutdown_connections 2023-12-16T20:15:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.664+0000 7fba49821700 1 -- 172.21.15.38:0/2558949207 wait complete. 2023-12-16T20:15:10.676 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:15:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 -- 172.21.15.38:0/1465487617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290102bf0 msgr2=0x7f3290102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 --2- 172.21.15.38:0/1465487617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290102bf0 0x7f3290102fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f328c004940 tx=0x7f328c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 -- 172.21.15.38:0/1465487617 shutdown_connections 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 --2- 172.21.15.38:0/1465487617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290103590 0x7f32900fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 --2- 172.21.15.38:0/1465487617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290102bf0 0x7f3290102fc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 -- 172.21.15.38:0/1465487617 >> 172.21.15.38:0/1465487617 conn(0x7f32900f87a0 msgr2=0x7f32900fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 -- 172.21.15.38:0/1465487617 shutdown_connections 2023-12-16T20:15:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.777+0000 7f32978c3700 1 -- 172.21.15.38:0/1465487617 wait complete. 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.778+0000 7f32978c3700 1 Processor -- start 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.778+0000 7f32978c3700 1 -- start start 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f32978c3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290102bf0 0x7f32901136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f32978c3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f32978c3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290114290 con 0x7f3290103590 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58224/0 (socket says 172.21.15.38:58224) 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 -- 172.21.15.38:0/3135461929 learned_addr learned my addr 172.21.15.38:0/3135461929 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f32978c3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329010d580 con 0x7f3290102bf0 2023-12-16T20:15:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f329565f700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290102bf0 0x7f32901136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 -- 172.21.15.38:0/3135461929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290102bf0 msgr2=0x7f32901136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290102bf0 0x7f32901136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.779+0000 7f3294e5e700 1 -- 172.21.15.38:0/3135461929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c005040 con 0x7f3290103590 2023-12-16T20:15:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.780+0000 7f3294e5e700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3280010e50 tx=0x7f328000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:10.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.781+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3280015070 con 0x7f3290103590 2023-12-16T20:15:10.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.781+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f328000bde0 con 0x7f3290103590 2023-12-16T20:15:10.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.781+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329010d7b0 con 0x7f3290103590 2023-12-16T20:15:10.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.781+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328001b470 con 0x7f3290103590 2023-12-16T20:15:10.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.781+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329010dcf0 con 0x7f3290103590 2023-12-16T20:15:10.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.783+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32900fc3a0 con 0x7f3290103590 2023-12-16T20:15:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.784+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f328000b930 con 0x7f3290103590 2023-12-16T20:15:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.785+0000 7f3285ffb700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 0x7f327c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.785+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f32800906c0 con 0x7f3290103590 2023-12-16T20:15:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.785+0000 7f329565f700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 0x7f327c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.786+0000 7f329565f700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 0x7f327c06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:10.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:10.792+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f328005de90 con 0x7f3290103590 2023-12-16T20:15:11.040 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:10 smithi038 ceph-mon[163993]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T20:15:11.040 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:10 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.0 on smithi038 2023-12-16T20:15:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.038+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f329010ed60 con 0x7f327c06cf80 2023-12-16T20:15:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.040+0000 7f3285ffb700 1 -- 172.21.15.38:0/3135461929 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f329010ed60 con 0x7f327c06cf80 2023-12-16T20:15:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 msgr2=0x7f327c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 0x7f327c06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 msgr2=0x7f3290113c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3280010e50 tx=0x7f328000b040 comp rx=0 tx=0).stop 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 shutdown_connections 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f327c06cf80 0x7f327c06f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3290102bf0 0x7f32901136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 --2- 172.21.15.38:0/3135461929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3290103590 0x7f3290113c40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.042+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 >> 172.21.15.38:0/3135461929 conn(0x7f32900f87a0 msgr2=0x7f32900fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.043+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 shutdown_connections 2023-12-16T20:15:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.043+0000 7f32978c3700 1 -- 172.21.15.38:0/3135461929 wait complete. 2023-12-16T20:15:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/3260794118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 msgr2=0x7f0e98065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/3260794118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98065800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c004940 tx=0x7f0e8c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/3260794118 shutdown_connections 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/3260794118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98065800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/3260794118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 0x7f0e98102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/3260794118 >> 172.21.15.38:0/3260794118 conn(0x7f0e980719b0 msgr2=0x7f0e98071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/3260794118 shutdown_connections 2023-12-16T20:15:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.152+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/3260794118 wait complete. 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.153+0000 7f0e9e6b8700 1 Processor -- start 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.153+0000 7f0e9e6b8700 1 -- start start 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e9e6b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e9e6b8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 0x7f0e98113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e9e6b8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98114200 con 0x7f0e98065390 2023-12-16T20:15:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e9e6b8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9810d4f0 con 0x7f0e98102c20 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58242/0 (socket says 172.21.15.38:58242) 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 -- 172.21.15.38:0/1260585745 learned_addr learned my addr 172.21.15.38:0/1260585745 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e977fe700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 0x7f0e98113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 -- 172.21.15.38:0/1260585745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 msgr2=0x7f0e98113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 0x7f0e98113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 -- 172.21.15.38:0/1260585745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c005040 con 0x7f0e98065390 2023-12-16T20:15:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.154+0000 7f0e97fff700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800eb70 tx=0x7f0e8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.155+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e88007cc0 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.155+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9810d720 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.155+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9810dc60 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.155+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e8800f040 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.155+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e8800c9f0 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.156+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980fff40 con 0x7f0e98065390 2023-12-16T20:15:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.156+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f0e8800cb50 con 0x7f0e98065390 2023-12-16T20:15:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.157+0000 7f0e94ff9700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 0x7f0e8006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.157+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0e8808bff0 con 0x7f0e98065390 2023-12-16T20:15:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.157+0000 7f0e977fe700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 0x7f0e8006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.158+0000 7f0e977fe700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 0x7f0e8006f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e9810eed0 tx=0x7f0e8c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.162+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0e880597c0 con 0x7f0e98065390 2023-12-16T20:15:11.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:10 smithi141 ceph-mon[137587]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T20:15:11.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:10 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.0 on smithi038 2023-12-16T20:15:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.403+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e9810ec10 con 0x7f0e8006cf80 2023-12-16T20:15:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.420+0000 7f0e94ff9700 1 -- 172.21.15.38:0/1260585745 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0e9810ec10 con 0x7f0e8006cf80 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (88s) 18s ago 8m 18.4M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (9m) 18s ago 9m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 934e81a1536f 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (8m) 8s ago 8m 6660k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 52f9f981a25f 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (78s) 18s ago 8m 77.0M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (5m) 18s ago 5m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (5m) 18s ago 5m 63.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (5m) 8s ago 5m 67.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (5m) 8s ago 5m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:15:11.421 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (2m) 18s ago 9m 462M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (2m) 8s ago 8m 439M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (29s) 18s ago 10m 32.8M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (10s) 8s ago 8m 20.1M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (113s) 18s ago 9m 16.8M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (110s) 8s ago 8m 15.7M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 18s ago 7m 226M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 daa01951591c 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (7m) 18s ago 7m 241M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (7m) 18s ago 7m 194M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (6m) 8s ago 6m 274M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (6m) 8s ago 6m 244M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (6m) 8s ago 6m 232M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:15:11.422 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (99s) 18s ago 8m 51.9M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:15:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 msgr2=0x7f0e8006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 0x7f0e8006f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e9810eed0 tx=0x7f0e8c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 msgr2=0x7f0e98113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800eb70 tx=0x7f0e8800b040 comp rx=0 tx=0).stop 2023-12-16T20:15:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 shutdown_connections 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0e8006cf80 0x7f0e8006f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98065390 0x7f0e98113630 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 --2- 172.21.15.38:0/1260585745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e98102c20 0x7f0e98113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 >> 172.21.15.38:0/1260585745 conn(0x7f0e980719b0 msgr2=0x7f0e980fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 shutdown_connections 2023-12-16T20:15:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.422+0000 7f0e9e6b8700 1 -- 172.21.15.38:0/1260585745 wait complete. 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 -- 172.21.15.38:0/1217856827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 msgr2=0x7fbab8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1217856827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab8065800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8004940 tx=0x7fbaa8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 -- 172.21.15.38:0/1217856827 shutdown_connections 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1217856827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab8065800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1217856827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 0x7fbab8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 -- 172.21.15.38:0/1217856827 >> 172.21.15.38:0/1217856827 conn(0x7fbab80719b0 msgr2=0x7fbab8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 -- 172.21.15.38:0/1217856827 shutdown_connections 2023-12-16T20:15:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.527+0000 7fbabf41e700 1 -- 172.21.15.38:0/1217856827 wait complete. 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 Processor -- start 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 -- start start 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 0x7fbab8113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8114170 con 0x7fbab8065390 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabf41e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab810d4a0 con 0x7fbab8102c20 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58266/0 (socket says 172.21.15.38:58266) 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 -- 172.21.15.38:0/1613990434 learned_addr learned my addr 172.21.15.38:0/1613990434 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabc9b9700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 0x7fbab8113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 -- 172.21.15.38:0/1613990434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 msgr2=0x7fbab8113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 0x7fbab8113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.528+0000 7fbabd1ba700 1 -- 172.21.15.38:0/1613990434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa8005040 con 0x7fbab8065390 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbabd1ba700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbab400eb40 tx=0x7fbab400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4007cc0 con 0x7fbab8065390 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbab400f040 con 0x7fbab8065390 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab810d720 con 0x7fbab8065390 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab400c990 con 0x7fbab8065390 2023-12-16T20:15:11.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.529+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab810dc60 con 0x7fbab8065390 2023-12-16T20:15:11.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.530+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab80fff40 con 0x7fbab8065390 2023-12-16T20:15:11.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.531+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fbab400cc00 con 0x7fbab8065390 2023-12-16T20:15:11.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.531+0000 7fbaadffb700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 0x7fbaa4073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.532+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbab408c0f0 con 0x7fbab8065390 2023-12-16T20:15:11.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.532+0000 7fbabc9b9700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 0x7fbaa4073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.532+0000 7fbabc9b9700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 0x7fbaa4073840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbab810ee80 tx=0x7fbaa8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.540+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbab40598f0 con 0x7fbab8065390 2023-12-16T20:15:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.844+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbab80734d0 con 0x7fbab8065390 2023-12-16T20:15:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.844+0000 7fbaadffb700 1 -- 172.21.15.38:0/1613990434 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7fbab4059480 con 0x7fbab8065390 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:15:11.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:11.847 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:15:11.847 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-16T20:15:11.847 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 4 2023-12-16T20:15:11.847 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:15:11.847 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 msgr2=0x7fbaa4073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 0x7fbaa4073840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbab810ee80 tx=0x7fbaa8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 msgr2=0x7fbab81135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbab400eb40 tx=0x7fbab400b040 comp rx=0 tx=0).stop 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 shutdown_connections 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbaa4071390 0x7fbaa4073840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8065390 0x7fbab81135e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 --2- 172.21.15.38:0/1613990434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbab8102c20 0x7fbab8113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 >> 172.21.15.38:0/1613990434 conn(0x7fbab80719b0 msgr2=0x7fbab80fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 shutdown_connections 2023-12-16T20:15:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.847+0000 7fbabf41e700 1 -- 172.21.15.38:0/1613990434 wait complete. 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 -- 172.21.15.38:0/2908264433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 msgr2=0x7f88b4103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 --2- 172.21.15.38:0/2908264433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b4103040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f88a8004940 tx=0x7f88a8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 -- 172.21.15.38:0/2908264433 shutdown_connections 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 --2- 172.21.15.38:0/2908264433 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 0x7f88b40fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 --2- 172.21.15.38:0/2908264433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b4103040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 -- 172.21.15.38:0/2908264433 >> 172.21.15.38:0/2908264433 conn(0x7f88b40711a0 msgr2=0x7f88b40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:11.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:11 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.1 on smithi038 2023-12-16T20:15:11.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 -- 172.21.15.38:0/2908264433 shutdown_connections 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.953+0000 7f88bb021700 1 -- 172.21.15.38:0/2908264433 wait complete. 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 Processor -- start 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 -- start start 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 0x7f88b40fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b40fcf00 con 0x7f88b4102c70 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88bb021700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b40fd070 con 0x7f88b40fb1e0 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58286/0 (socket says 172.21.15.38:58286) 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88b3fff700 1 -- 172.21.15.38:0/1378620388 learned_addr learned my addr 172.21.15.38:0/1378620388 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.954+0000 7f88b8dbd700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 0x7f88b40fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b3fff700 1 -- 172.21.15.38:0/1378620388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 msgr2=0x7f88b40fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b3fff700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 0x7f88b40fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b3fff700 1 -- 172.21.15.38:0/1378620388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8005040 con 0x7f88b4102c70 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b3fff700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c830 tx=0x7f88a0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a00106f0 con 0x7f88b4102c70 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88a0010d00 con 0x7f88b4102c70 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b4119870 con 0x7f88b4102c70 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a0012e90 con 0x7f88b4102c70 2023-12-16T20:15:11.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.955+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b4119d50 con 0x7f88b4102c70 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.956+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b40fff10 con 0x7f88b4102c70 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.957+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f88a0010850 con 0x7f88b4102c70 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.957+0000 7f88b17fa700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 0x7f88a406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.958+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f88a008c370 con 0x7f88b4102c70 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.958+0000 7f88b8dbd700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 0x7f88a406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:11.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.958+0000 7f88b8dbd700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 0x7f88a406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88a800b3b0 tx=0x7f88a8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:11.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:11.963+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f88a0056260 con 0x7f88b4102c70 2023-12-16T20:15:12.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.213+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f88b4072cc0 con 0x7f88b4102c70 2023-12-16T20:15:12.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.213+0000 7f88b17fa700 1 -- 172.21.15.38:0/1378620388 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f88a0059880 con 0x7f88b4102c70 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:e21 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 21 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:11:36.344081+0000 2023-12-16T20:15:12.215 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:15:12.216 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:12.217 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:12.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 msgr2=0x7f88a406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 0x7f88a406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88a800b3b0 tx=0x7f88a8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:12.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 msgr2=0x7f88b40fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c830 tx=0x7f88a0004470 comp rx=0 tx=0).stop 2023-12-16T20:15:12.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 shutdown_connections 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.216+0000 7f88bb021700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f88a406cf80 0x7f88a406f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.217+0000 7f88bb021700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88b40fb1e0 0x7f88b40fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.217+0000 7f88bb021700 1 --2- 172.21.15.38:0/1378620388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88b4102c70 0x7f88b40fc900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.217+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 >> 172.21.15.38:0/1378620388 conn(0x7f88b40711a0 msgr2=0x7f88b40fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.217+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 shutdown_connections 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.217+0000 7f88bb021700 1 -- 172.21.15.38:0/1378620388 wait complete. 2023-12-16T20:15:12.219 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 21 2023-12-16T20:15:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:12.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:12.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T20:15:12.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:15:12.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:12.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:11 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.1 on smithi038 2023-12-16T20:15:12.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 -- 172.21.15.38:0/4078655354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c102c00 msgr2=0x7f799c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 --2- 172.21.15.38:0/4078655354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c102c00 0x7f799c102fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7990004940 tx=0x7f7990009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 -- 172.21.15.38:0/4078655354 shutdown_connections 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 --2- 172.21.15.38:0/4078655354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c1035a0 0x7f799c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 --2- 172.21.15.38:0/4078655354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c102c00 0x7f799c102fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 -- 172.21.15.38:0/4078655354 >> 172.21.15.38:0/4078655354 conn(0x7f799c0f8790 msgr2=0x7f799c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 -- 172.21.15.38:0/4078655354 shutdown_connections 2023-12-16T20:15:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.326+0000 7f79a14a0700 1 -- 172.21.15.38:0/4078655354 wait complete. 2023-12-16T20:15:12.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 Processor -- start 2023-12-16T20:15:12.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 -- start start 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c102c00 0x7f799c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c070b10 con 0x7f799c1035a0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f79a14a0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c070c80 con 0x7f799c102c00 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f799a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f799a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58310/0 (socket says 172.21.15.38:58310) 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f799a7fc700 1 -- 172.21.15.38:0/1845216777 learned_addr learned my addr 172.21.15.38:0/1845216777 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.327+0000 7f799affd700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c102c00 0x7f799c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f799a7fc700 1 -- 172.21.15.38:0/1845216777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c102c00 msgr2=0x7f799c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f799a7fc700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c102c00 0x7f799c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f799a7fc700 1 -- 172.21.15.38:0/1845216777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990005040 con 0x7f799c1035a0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f799a7fc700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b790 tx=0x7f798c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c00f6f0 con 0x7f799c1035a0 2023-12-16T20:15:12.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f798c00fd00 con 0x7f799c1035a0 2023-12-16T20:15:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c0103a0 con 0x7f799c1035a0 2023-12-16T20:15:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c1198f0 con 0x7f799c1035a0 2023-12-16T20:15:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.328+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c119de0 con 0x7f799c1035a0 2023-12-16T20:15:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.329+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0fc390 con 0x7f799c1035a0 2023-12-16T20:15:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.330+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f798c00f850 con 0x7f799c1035a0 2023-12-16T20:15:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.330+0000 7f79837fe700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 0x7f798406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.330+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f798c08c1f0 con 0x7f799c1035a0 2023-12-16T20:15:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.330+0000 7f799affd700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 0x7f798406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.331+0000 7f799affd700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 0x7f798406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7990004f90 tx=0x7f7990009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.335+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f798c056040 con 0x7f799c1035a0 2023-12-16T20:15:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.570+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f799c071770 con 0x7f798406cf80 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.571+0000 7f79837fe700 1 -- 172.21.15.38:0/1845216777 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f799c071770 con 0x7f798406cf80 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:15:12.572 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "4/21 daemons upgraded", 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:15:12.573 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:15:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.573+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 msgr2=0x7f798406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.573+0000 7f79a14a0700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 0x7f798406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7990004f90 tx=0x7f7990009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.573+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 msgr2=0x7f799c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.573+0000 7f79a14a0700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b790 tx=0x7f798c009220 comp rx=0 tx=0).stop 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 shutdown_connections 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f798406cf80 0x7f798406f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f799c102c00 0x7f799c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 --2- 172.21.15.38:0/1845216777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f799c1035a0 0x7f799c070480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 >> 172.21.15.38:0/1845216777 conn(0x7f799c0f8790 msgr2=0x7f799c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 shutdown_connections 2023-12-16T20:15:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.574+0000 7f79a14a0700 1 -- 172.21.15.38:0/1845216777 wait complete. 2023-12-16T20:15:12.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/3606652320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58065390 msgr2=0x7fbf58065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/3606652320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58065390 0x7fbf58065800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf48004940 tx=0x7fbf48009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/3606652320 shutdown_connections 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/3606652320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58065390 0x7fbf58065800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/3606652320 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58102c20 0x7fbf58102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.678+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/3606652320 >> 172.21.15.38:0/3606652320 conn(0x7fbf580719b0 msgr2=0x7fbf58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/3606652320 shutdown_connections 2023-12-16T20:15:12.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/3606652320 wait complete. 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 Processor -- start 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 -- start start 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58065390 0x7fbf580fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580fc730 con 0x7fbf58102c20 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5fc0a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580fc8a0 con 0x7fbf58065390 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.679+0000 7fbf5d1a5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58324/0 (socket says 172.21.15.38:58324) 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 -- 172.21.15.38:0/4219771555 learned_addr learned my addr 172.21.15.38:0/4219771555 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d9a6700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58065390 0x7fbf580fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 -- 172.21.15.38:0/4219771555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58065390 msgr2=0x7fbf580fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58065390 0x7fbf580fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 -- 172.21.15.38:0/4219771555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48005040 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5d1a5700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009360 tx=0x7fbf48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4800e040 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf4800bc50 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf58119970 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4801c630 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.680+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf58119dd0 con 0x7fbf58102c20 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.681+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf580fff40 con 0x7fbf58102c20 2023-12-16T20:15:12.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.682+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fbf48013420 con 0x7fbf58102c20 2023-12-16T20:15:12.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.682+0000 7fbf4e7fc700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 0x7fbf4406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:12.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.682+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbf4808d890 con 0x7fbf58102c20 2023-12-16T20:15:12.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.682+0000 7fbf5d9a6700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 0x7fbf4406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:12.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.682+0000 7fbf5d9a6700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 0x7fbf4406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf54004990 tx=0x7fbf54009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:12.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.687+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbf480575d0 con 0x7fbf58102c20 2023-12-16T20:15:12.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.983+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbf580734d0 con 0x7fbf58102c20 2023-12-16T20:15:12.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.984+0000 7fbf4e7fc700 1 -- 172.21.15.38:0/4219771555 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbf4805abf0 con 0x7fbf58102c20 2023-12-16T20:15:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 msgr2=0x7fbf4406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 0x7fbf4406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf54004990 tx=0x7fbf54009ee0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 msgr2=0x7fbf580fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009360 tx=0x7fbf48009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 shutdown_connections 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf4406cf80 0x7fbf4406f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf58065390 0x7fbf580fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 --2- 172.21.15.38:0/4219771555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf58102c20 0x7fbf580fc130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 >> 172.21.15.38:0/4219771555 conn(0x7fbf580719b0 msgr2=0x7fbf580fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:12.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 shutdown_connections 2023-12-16T20:15:12.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:12.986+0000 7fbf5fc0a700 1 -- 172.21.15.38:0/4219771555 wait complete. 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1613990434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:13.111 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:12 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1378620388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:15:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1613990434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:13.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:12 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1378620388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.2 on smithi038 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/4219771555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:14.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T20:15:14.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.2 on smithi038 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/4219771555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dbcjir", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: Reconfiguring mds.cephfs.smithi038.dbcjir (monmap changed)... 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: Reconfiguring daemon mds.cephfs.smithi038.dbcjir on smithi038 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:14 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: Reconfiguring mds.cephfs.smithi038.dbcjir (monmap changed)... 2023-12-16T20:15:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: Reconfiguring daemon mds.cephfs.smithi038.dbcjir on smithi038 2023-12-16T20:15:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:15.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:15.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.aofkae", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:15.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:14 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:16.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: Reconfiguring mds.cephfs.smithi038.aofkae (monmap changed)... 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: Reconfiguring daemon mds.cephfs.smithi038.aofkae on smithi038 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:15:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:16.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: Reconfiguring mds.cephfs.smithi038.aofkae (monmap changed)... 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: Reconfiguring daemon mds.cephfs.smithi038.aofkae on smithi038 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi141.cycgjd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T20:15:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T20:15:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring crash.smithi141 (monmap changed)... 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring daemon crash.smithi141 on smithi141 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring mgr.smithi141.cycgjd (monmap changed)... 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring mon.smithi141 (monmap changed)... 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:17.344 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:17 smithi141 ceph-mon[137587]: Reconfiguring daemon mon.smithi141 on smithi141 2023-12-16T20:15:17.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring crash.smithi141 (monmap changed)... 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring daemon crash.smithi141 on smithi141 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring mgr.smithi141.cycgjd (monmap changed)... 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring daemon mgr.smithi141.cycgjd on smithi141 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring mon.smithi141 (monmap changed)... 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:17 smithi038 ceph-mon[163993]: Reconfiguring daemon mon.smithi141 on smithi141 2023-12-16T20:15:18.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.3 on smithi141 2023-12-16T20:15:18.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:18.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:18.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:15:18.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:19.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.3 on smithi141 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:15:19.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T20:15:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.4 on smithi141 2023-12-16T20:15:19.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:19.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:15:19.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.4 on smithi141 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:15:20.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T20:15:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: Reconfiguring daemon osd.5 on smithi141 2023-12-16T20:15:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:21.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:21.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:21.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:21.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:21.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T20:15:21.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: Reconfiguring daemon osd.5 on smithi141 2023-12-16T20:15:21.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:21.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:21.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:21.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.xhutny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:21.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:22.139 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: Reconfiguring mds.cephfs.smithi141.xhutny (monmap changed)... 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: Reconfiguring daemon mds.cephfs.smithi141.xhutny on smithi141 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:22.140 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: Reconfiguring mds.cephfs.smithi141.xhutny (monmap changed)... 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: Reconfiguring daemon mds.cephfs.smithi141.xhutny on smithi141 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi141.eyrunj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T20:15:22.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: Reconfiguring mds.cephfs.smithi141.eyrunj (monmap changed)... 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: Reconfiguring daemon mds.cephfs.smithi141.eyrunj on smithi141 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:23.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]: dispatch 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]': finished 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi141"}]: dispatch 2023-12-16T20:15:23.135 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:22 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi141"}]': finished 2023-12-16T20:15:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: Reconfiguring mds.cephfs.smithi141.eyrunj (monmap changed)... 2023-12-16T20:15:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: Reconfiguring daemon mds.cephfs.smithi141.eyrunj on smithi141 2023-12-16T20:15:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]: dispatch 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]': finished 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi141"}]: dispatch 2023-12-16T20:15:23.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:22 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi141"}]': finished 2023-12-16T20:15:24.067 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:23 smithi038 ceph-mon[163993]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:24.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:23 smithi038 ceph-mon[163993]: Upgrade: Setting container_image for all mon 2023-12-16T20:15:24.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:23 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:24.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:23 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:24.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:23 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:23 smithi141 ceph-mon[137587]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:23 smithi141 ceph-mon[137587]: Upgrade: Setting container_image for all mon 2023-12-16T20:15:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:23 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:23 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:24.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:23 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:24.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:24 smithi038 ceph-mon[163993]: Upgrade: Updating crash.smithi038 (1/2) 2023-12-16T20:15:24.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:24 smithi038 ceph-mon[163993]: Deploying daemon crash.smithi038 on smithi038 2023-12-16T20:15:25.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:24 smithi141 ceph-mon[137587]: Upgrade: Updating crash.smithi038 (1/2) 2023-12-16T20:15:25.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:24 smithi141 ceph-mon[137587]: Deploying daemon crash.smithi038 on smithi038 2023-12-16T20:15:26.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:25 smithi038 ceph-mon[163993]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:26.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:25 smithi141 ceph-mon[137587]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:26 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:26 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:26 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:26 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:26 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:26 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:27.968 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:27 smithi141 ceph-mon[137587]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:27.968 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:27 smithi141 ceph-mon[137587]: Upgrade: Updating crash.smithi141 (2/2) 2023-12-16T20:15:27.968 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:27 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:27.968 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:27 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:27.968 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:27 smithi141 ceph-mon[137587]: Deploying daemon crash.smithi141 on smithi141 2023-12-16T20:15:28.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:27 smithi038 ceph-mon[163993]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:28.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:27 smithi038 ceph-mon[163993]: Upgrade: Updating crash.smithi141 (2/2) 2023-12-16T20:15:28.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:27 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi141", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T20:15:28.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:27 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:28.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:27 smithi038 ceph-mon[163993]: Deploying daemon crash.smithi141 on smithi141 2023-12-16T20:15:30.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:29 smithi038 ceph-mon[163993]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:30.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:29 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:30.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:29 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:30.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:29 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:30.209 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:29 smithi141 ceph-mon[137587]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:30.209 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:29 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:30.209 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:29 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:30.210 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:29 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:32.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:31 smithi038 ceph-mon[163993]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:32.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:31 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:32.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:31 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:31 smithi141 ceph-mon[137587]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:31 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:32.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:31 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.366 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:33 smithi141 ceph-mon[137587]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:33.366 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:33 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.366 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:33 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.366 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:33 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.366 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:33 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:33 smithi038 ceph-mon[163993]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:33 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:33 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:33 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:33.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:33 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:34 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:34.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:34 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:34.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:34 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:34.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:34 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:35.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:35 smithi038 ceph-mon[163993]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:35.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:35.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:35.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:35.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:35 smithi141 ceph-mon[137587]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:35.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:35.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:35.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:36.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: Upgrade: Setting container_image for all crash 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]: dispatch 2023-12-16T20:15:36.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]': finished 2023-12-16T20:15:36.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi141"}]: dispatch 2023-12-16T20:15:36.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi141"}]': finished 2023-12-16T20:15:36.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T20:15:36.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T20:15:36.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:36 smithi038 ceph-mon[163993]: Upgrade: osd.0 is safe to restart 2023-12-16T20:15:36.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: Upgrade: Setting container_image for all crash 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:36.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]: dispatch 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]': finished 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi141"}]: dispatch 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi141"}]': finished 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T20:15:36.747 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:36 smithi141 ceph-mon[137587]: Upgrade: osd.0 is safe to restart 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: Upgrade: Updating osd.0 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:37.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:37 smithi038 ceph-mon[163993]: Deploying daemon osd.0 on smithi038 2023-12-16T20:15:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:15:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: Upgrade: Updating osd.0 2023-12-16T20:15:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T20:15:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:37 smithi141 ceph-mon[137587]: Deploying daemon osd.0 on smithi038 2023-12-16T20:15:38.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:38 smithi038 systemd[1]: Stopping Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:15:38.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:38 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:15:38.651+0000 7f37b26c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:15:38.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:38 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:15:38.651+0000 7f37b26c5700 -1 osd.0 48 *** Got signal Terminated *** 2023-12-16T20:15:38.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:38 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[99685]: 2023-12-16T20:15:38.651+0000 7f37b26c5700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:15:39.743 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:39 smithi038 ceph-mon[163993]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:39.743 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:39 smithi038 ceph-mon[163993]: osd.0 marked itself down and dead 2023-12-16T20:15:39.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:39 smithi141 ceph-mon[137587]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:15:39.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:39 smithi141 ceph-mon[137587]: osd.0 marked itself down and dead 2023-12-16T20:15:40.394 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174721]: 2023-12-16 20:15:40.008412563 +0000 UTC m=+1.400463966 container died daa01951591c34dbf36874c8db4f2623fe7a1e438e2af68ca54d1ae286e97e65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, RELEASE=quincy-1f2f551, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:15:40.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174721]: 2023-12-16 20:15:40.106761202 +0000 UTC m=+1.498812581 container cleanup daa01951591c34dbf36874c8db4f2623fe7a1e438e2af68ca54d1ae286e97e65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:15:40.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 bash[174721]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0 2023-12-16T20:15:40.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174746]: 2023-12-16 20:15:40.215012478 +0000 UTC m=+0.199464647 container remove daa01951591c34dbf36874c8db4f2623fe7a1e438e2af68ca54d1ae286e97e65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, RELEASE=quincy-1f2f551, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2023-12-16T20:15:40.775 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:40 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:15:40.775 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:40 smithi038 ceph-mon[163993]: failed to encode map e49 with expected crc 2023-12-16T20:15:40.775 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:40 smithi038 ceph-mon[163993]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T20:15:40.775 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174838]: 2023-12-16 20:15:40.639963816 +0000 UTC m=+0.073285727 container create 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212) 2023-12-16T20:15:40.775 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174838]: 2023-12-16 20:15:40.5863573 +0000 UTC m=+0.019679235 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:15:40.775 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174838]: 2023-12-16 20:15:40.723949993 +0000 UTC m=+0.157271904 container init 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2023-12-16T20:15:40.775 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174838]: 2023-12-16 20:15:40.741834993 +0000 UTC m=+0.175156894 container start 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2023-12-16T20:15:40.776 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:40 smithi038 podman[174838]: 2023-12-16 20:15:40.764965978 +0000 UTC m=+0.198287888 container attach 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2023-12-16T20:15:40.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:40 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:15:40.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:40 smithi141 ceph-mon[137587]: failed to encode map e49 with expected crc 2023-12-16T20:15:40.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:40 smithi141 ceph-mon[137587]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T20:15:41.394 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174838]: 2023-12-16 20:15:41.038025801 +0000 UTC m=+0.471347732 container died 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212) 2023-12-16T20:15:41.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174864]: 2023-12-16 20:15:41.256594056 +0000 UTC m=+0.213467983 container remove 9baa085fb360664bbbc4c1e4c44c041e7b266fcb755ca99c25bc06f82c45a645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2023-12-16T20:15:41.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service: Deactivated successfully. 2023-12-16T20:15:41.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 systemd[1]: Stopped Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:15:41.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service: Consumed 59.603s CPU time. 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: pgmap v29: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.724 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.725 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.725 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:41 smithi038 ceph-mon[163993]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.725 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 systemd[1]: Starting Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:15:41.725 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174969]: 2023-12-16 20:15:41.682128512 +0000 UTC m=+0.104656596 container create 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux ) 2023-12-16T20:15:41.725 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174969]: 2023-12-16 20:15:41.596249054 +0000 UTC m=+0.018777151 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:15:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: pgmap v29: 65 pgs: 9 stale+active+clean, 56 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:15:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:41 smithi141 ceph-mon[137587]: failed to encode map e50 with expected crc 2023-12-16T20:15:42.144 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174969]: 2023-12-16 20:15:41.756988601 +0000 UTC m=+0.179516686 container init 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20231212) 2023-12-16T20:15:42.144 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174969]: 2023-12-16 20:15:41.764149402 +0000 UTC m=+0.186677488 container start 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2023-12-16T20:15:42.145 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:41 smithi038 podman[174969]: 2023-12-16 20:15:41.781495944 +0000 UTC m=+0.204024028 container attach 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:15:42.632 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T20:15:42.632 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T20:15:42.632 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T20:15:42.632 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T20:15:42.632 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[174969]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate[174985]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[174969]: 2023-12-16 20:15:42.242147578 +0000 UTC m=+0.664675674 container died 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, io.buildah.version=1.31.3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[175124]: 2023-12-16 20:15:42.464801646 +0000 UTC m=+0.213541759 container remove 5c7f45ff2bfde46dbaae3815c0446e32ba380b32576e5f85e7e87c556eaea6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2) 2023-12-16T20:15:42.633 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[175190]: 2023-12-16 20:15:42.631439452 +0000 UTC m=+0.066985571 container create 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3) 2023-12-16T20:15:42.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[175190]: 2023-12-16 20:15:42.583379759 +0000 UTC m=+0.018925858 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:15:42.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[175190]: 2023-12-16 20:15:42.724118219 +0000 UTC m=+0.159664301 container init 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2023-12-16T20:15:42.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 podman[175190]: 2023-12-16 20:15:42.741836549 +0000 UTC m=+0.177382625 container start 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2023-12-16T20:15:42.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 ceph-osd[175209]: -- 172.21.15.38:0/3187566570 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fe3ee476c0 con 0x55fe3ee18c00 2023-12-16T20:15:42.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 bash[175190]: 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 2023-12-16T20:15:42.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:42 smithi038 systemd[1]: Started Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:15:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 -- 172.21.15.38:0/3614829297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fe5a0 msgr2=0x7f3e88106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/3614829297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fe5a0 0x7f3e88106be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e74004940 tx=0x7f3e74009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 -- 172.21.15.38:0/3614829297 shutdown_connections 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/3614829297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fe5a0 0x7f3e88106be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/3614829297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fdc00 0x7f3e880fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 -- 172.21.15.38:0/3614829297 >> 172.21.15.38:0/3614829297 conn(0x7f3e880f7690 msgr2=0x7f3e880f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 -- 172.21.15.38:0/3614829297 shutdown_connections 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.098+0000 7f3e8eb31700 1 -- 172.21.15.38:0/3614829297 wait complete. 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 Processor -- start 2023-12-16T20:15:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 -- start start 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fe5a0 0x7f3e88113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88114230 con 0x7f3e880fdc00 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8eb31700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8810d580 con 0x7f3e880fe5a0 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.099+0000 7f3e8c8cd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37326/0 (socket says 172.21.15.38:37326) 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 -- 172.21.15.38:0/2375328508 learned_addr learned my addr 172.21.15.38:0/2375328508 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e87fff700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fe5a0 0x7f3e88113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 -- 172.21.15.38:0/2375328508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fe5a0 msgr2=0x7f3e88113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fe5a0 0x7f3e88113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 -- 172.21.15.38:0/2375328508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74005040 con 0x7f3e880fdc00 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8c8cd700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c002a50 tx=0x7f3e7c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e7c007cc0 con 0x7f3e880fdc00 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e7c00f040 con 0x7f3e880fdc00 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8810d860 con 0x7f3e880fdc00 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8810dda0 con 0x7f3e880fdc00 2023-12-16T20:15:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.100+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e7c00d9c0 con 0x7f3e880fdc00 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.101+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c0052e0 con 0x7f3e880fdc00 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.102+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f3e7c00dc00 con 0x7f3e880fdc00 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.102+0000 7f3e857fa700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 0x7f3e7806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.103+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3e7c08c210 con 0x7f3e880fdc00 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.103+0000 7f3e87fff700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 0x7f3e7806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.103+0000 7f3e87fff700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 0x7f3e7806f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e8810ef80 tx=0x7f3e74009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.107+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3e7c059960 con 0x7f3e880fdc00 2023-12-16T20:15:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.341+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e6c000bf0 con 0x7f3e7806cf80 2023-12-16T20:15:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.343+0000 7f3e857fa700 1 -- 172.21.15.38:0/2375328508 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3e6c000bf0 con 0x7f3e7806cf80 2023-12-16T20:15:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 msgr2=0x7f3e7806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 0x7f3e7806f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e8810ef80 tx=0x7f3e74009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 msgr2=0x7f3e881136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c002a50 tx=0x7f3e7c0046b0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 shutdown_connections 2023-12-16T20:15:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3e7806cf80 0x7f3e7806f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e880fdc00 0x7f3e881136a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 --2- 172.21.15.38:0/2375328508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e880fe5a0 0x7f3e88113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 >> 172.21.15.38:0/2375328508 conn(0x7f3e880f7690 msgr2=0x7f3e88101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 shutdown_connections 2023-12-16T20:15:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.345+0000 7f3e8eb31700 1 -- 172.21.15.38:0/2375328508 wait complete. 2023-12-16T20:15:43.358 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:15:43.358 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:15:43.289+0000 7ff7aeb4e640 -1 Falling back to public interface 2023-12-16T20:15:43.358 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-mon[163993]: pgmap v31: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:43.359 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T20:15:43.359 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:43.359 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:43.359 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:43.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 -- 172.21.15.38:0/1143849072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf300fc2d0 msgr2=0x7fcf300fc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 --2- 172.21.15.38:0/1143849072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf300fc2d0 0x7fcf300fc740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c004940 tx=0x7fcf2c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:43.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 -- 172.21.15.38:0/1143849072 shutdown_connections 2023-12-16T20:15:43.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 --2- 172.21.15.38:0/1143849072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf300fc2d0 0x7fcf300fc740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 --2- 172.21.15.38:0/1143849072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf30101b00 0x7fcf30101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 -- 172.21.15.38:0/1143849072 >> 172.21.15.38:0/1143849072 conn(0x7fcf30071140 msgr2=0x7fcf30071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 -- 172.21.15.38:0/1143849072 shutdown_connections 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.456+0000 7fcf3741b700 1 -- 172.21.15.38:0/1143849072 wait complete. 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 Processor -- start 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 -- start start 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf300fc2d0 0x7fcf3010e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3010f0c0 con 0x7fcf30101b00 2023-12-16T20:15:43.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf3741b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3010f200 con 0x7fcf300fc2d0 2023-12-16T20:15:43.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf349b6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf349b6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37348/0 (socket says 172.21.15.38:37348) 2023-12-16T20:15:43.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf349b6700 1 -- 172.21.15.38:0/2318936857 learned_addr learned my addr 172.21.15.38:0/2318936857 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.457+0000 7fcf351b7700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf300fc2d0 0x7fcf3010e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf349b6700 1 -- 172.21.15.38:0/2318936857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf300fc2d0 msgr2=0x7fcf3010e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf349b6700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf300fc2d0 0x7fcf3010e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf349b6700 1 -- 172.21.15.38:0/2318936857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c005040 con 0x7fcf30101b00 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf349b6700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009360 tx=0x7fcf2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2c00e040 con 0x7fcf30101b00 2023-12-16T20:15:43.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf2c013420 con 0x7fcf30101b00 2023-12-16T20:15:43.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2c01c610 con 0x7fcf30101b00 2023-12-16T20:15:43.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30117500 con 0x7fcf30101b00 2023-12-16T20:15:43.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.458+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30117a40 con 0x7fcf30101b00 2023-12-16T20:15:43.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.459+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30103ee0 con 0x7fcf30101b00 2023-12-16T20:15:43.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.460+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fcf2c013590 con 0x7fcf30101b00 2023-12-16T20:15:43.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.461+0000 7fcf25ffb700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 0x7fcf1c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.461+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcf2c08d720 con 0x7fcf30101b00 2023-12-16T20:15:43.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.461+0000 7fcf351b7700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 0x7fcf1c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.461+0000 7fcf351b7700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 0x7fcf1c06f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf30064d90 tx=0x7fcf2000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.465+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fcf2c057460 con 0x7fcf30101b00 2023-12-16T20:15:43.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.695+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf3004bbf0 con 0x7fcf1c06cf80 2023-12-16T20:15:43.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.696+0000 7fcf25ffb700 1 -- 172.21.15.38:0/2318936857 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcf3004bbf0 con 0x7fcf1c06cf80 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.698+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 msgr2=0x7fcf1c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.698+0000 7fcf3741b700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 0x7fcf1c06f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf30064d90 tx=0x7fcf2000b040 comp rx=0 tx=0).stop 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.698+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 msgr2=0x7fcf3010eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.698+0000 7fcf3741b700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009360 tx=0x7fcf2c009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 shutdown_connections 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcf1c06cf80 0x7fcf1c06f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf300fc2d0 0x7fcf3010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 --2- 172.21.15.38:0/2318936857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf30101b00 0x7fcf3010eb30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 >> 172.21.15.38:0/2318936857 conn(0x7fcf30071140 msgr2=0x7fcf300fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 shutdown_connections 2023-12-16T20:15:43.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.699+0000 7fcf3741b700 1 -- 172.21.15.38:0/2318936857 wait complete. 2023-12-16T20:15:43.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:43 smithi141 ceph-mon[137587]: pgmap v31: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:43.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:43 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T20:15:43.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:43.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:43.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 -- 172.21.15.38:0/2060871639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc103590 msgr2=0x7f37fc0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 --2- 172.21.15.38:0/2060871639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc103590 0x7f37fc0fcc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f37e4004940 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 -- 172.21.15.38:0/2060871639 shutdown_connections 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 --2- 172.21.15.38:0/2060871639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc103590 0x7f37fc0fcc00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 --2- 172.21.15.38:0/2060871639 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc102bf0 0x7f37fc102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 -- 172.21.15.38:0/2060871639 >> 172.21.15.38:0/2060871639 conn(0x7f37fc0f87a0 msgr2=0x7f37fc0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 -- 172.21.15.38:0/2060871639 shutdown_connections 2023-12-16T20:15:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.807+0000 7f380299b700 1 -- 172.21.15.38:0/2060871639 wait complete. 2023-12-16T20:15:43.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 Processor -- start 2023-12-16T20:15:43.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 -- start start 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc103590 0x7f37fc070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc070a80 con 0x7f37fc102bf0 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.808+0000 7f380299b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc070bf0 con 0x7f37fc103590 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37372/0 (socket says 172.21.15.38:37372) 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 -- 172.21.15.38:0/500681485 learned_addr learned my addr 172.21.15.38:0/500681485 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fb7fe700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc103590 0x7f37fc070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 -- 172.21.15.38:0/500681485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc103590 msgr2=0x7f37fc070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc103590 0x7f37fc070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 -- 172.21.15.38:0/500681485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4005040 con 0x7f37fc102bf0 2023-12-16T20:15:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37fbfff700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00eb40 tx=0x7f37ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ec007cc0 con 0x7f37fc102bf0 2023-12-16T20:15:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc119800 con 0x7f37fc102bf0 2023-12-16T20:15:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37ec00f040 con 0x7f37fc102bf0 2023-12-16T20:15:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ec00c990 con 0x7f37fc102bf0 2023-12-16T20:15:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.809+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc119c60 con 0x7f37fc102bf0 2023-12-16T20:15:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.810+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc1050c0 con 0x7f37fc102bf0 2023-12-16T20:15:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.811+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f37ec00cc00 con 0x7f37fc102bf0 2023-12-16T20:15:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.812+0000 7f37f8ff9700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 0x7f37e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.812+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f37ec08c0d0 con 0x7f37fc102bf0 2023-12-16T20:15:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.812+0000 7f37fb7fe700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 0x7f37e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.813+0000 7f37fb7fe700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 0x7f37e806f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37fc072050 tx=0x7f37e4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:43.817+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f37ec055e40 con 0x7f37fc102bf0 2023-12-16T20:15:44.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.079+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37fc071680 con 0x7f37e806cf80 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.089+0000 7f37f8ff9700 1 -- 172.21.15.38:0/500681485 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f37fc071680 con 0x7f37e806cf80 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (2m) 11s ago 9m 23.8M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (18s) 11s ago 9m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (15s) 12s ago 8m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:15:44.090 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (111s) 11s ago 9m 79.1M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (6m) 11s ago 6m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (6m) 11s ago 6m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (6m) 12s ago 6m 67.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (6m) 12s ago 6m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (3m) 11s ago 10m 487M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (2m) 12s ago 8m 440M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (61s) 11s ago 10m 42.5M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (43s) 12s ago 8m 33.7M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (2m) 11s ago 9m 16.6M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (2m) 12s ago 8m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 starting - - - 1559M 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (8m) 11s ago 8m 242M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 835eef3eb86d 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (7m) 11s ago 7m 195M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:15:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (7m) 12s ago 7m 274M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:15:44.092 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (7m) 12s ago 7m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:15:44.092 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (6m) 12s ago 6m 232M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:15:44.092 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 11s ago 9m 58.4M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 msgr2=0x7f37e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 0x7f37e806f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37fc072050 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 msgr2=0x7f37fc06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00eb40 tx=0x7f37ec00b040 comp rx=0 tx=0).stop 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 shutdown_connections 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f37e806cf80 0x7f37e806f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37fc102bf0 0x7f37fc06ff40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 --2- 172.21.15.38:0/500681485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37fc103590 0x7f37fc070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 >> 172.21.15.38:0/500681485 conn(0x7f37fc0f87a0 msgr2=0x7f37fc0fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 shutdown_connections 2023-12-16T20:15:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.092+0000 7f380299b700 1 -- 172.21.15.38:0/500681485 wait complete. 2023-12-16T20:15:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 -- 172.21.15.38:0/3493643050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a90101b00 msgr2=0x7f5a90101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 --2- 172.21.15.38:0/3493643050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a90101b00 0x7f5a90101ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a80004940 tx=0x7f5a80009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 -- 172.21.15.38:0/3493643050 shutdown_connections 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 --2- 172.21.15.38:0/3493643050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a900fbb40 0x7f5a900fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 --2- 172.21.15.38:0/3493643050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a90101b00 0x7f5a90101ed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 -- 172.21.15.38:0/3493643050 >> 172.21.15.38:0/3493643050 conn(0x7f5a900719b0 msgr2=0x7f5a90071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 -- 172.21.15.38:0/3493643050 shutdown_connections 2023-12-16T20:15:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.207+0000 7f5a972c4700 1 -- 172.21.15.38:0/3493643050 wait complete. 2023-12-16T20:15:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 Processor -- start 2023-12-16T20:15:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 -- start start 2023-12-16T20:15:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a90101b00 0x7f5a9010ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9010f1c0 con 0x7f5a900fbb40 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a972c4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9010f300 con 0x7f5a90101b00 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a95060700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a95060700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37380/0 (socket says 172.21.15.38:37380) 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a95060700 1 -- 172.21.15.38:0/4023601297 learned_addr learned my addr 172.21.15.38:0/4023601297 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.208+0000 7f5a9485f700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a90101b00 0x7f5a9010ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a95060700 1 -- 172.21.15.38:0/4023601297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a90101b00 msgr2=0x7f5a9010ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a95060700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a90101b00 0x7f5a9010ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a95060700 1 -- 172.21.15.38:0/4023601297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80005040 con 0x7f5a900fbb40 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a95060700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009360 tx=0x7f5a80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a8000e040 con 0x7f5a900fbb40 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a90117600 con 0x7f5a900fbb40 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a80013420 con 0x7f5a900fbb40 2023-12-16T20:15:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a8001c610 con 0x7f5a900fbb40 2023-12-16T20:15:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.209+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a90117b10 con 0x7f5a900fbb40 2023-12-16T20:15:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.210+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a90103fb0 con 0x7f5a900fbb40 2023-12-16T20:15:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.211+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f5a80013590 con 0x7f5a900fbb40 2023-12-16T20:15:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.211+0000 7f5a85ffb700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 0x7f5a7c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.211+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5a8008d790 con 0x7f5a900fbb40 2023-12-16T20:15:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.211+0000 7f5a9485f700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 0x7f5a7c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.212+0000 7f5a9485f700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 0x7f5a7c06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5a90065e30 tx=0x7f5a8c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:44.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.216+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5a80057450 con 0x7f5a900fbb40 2023-12-16T20:15:44.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.524+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a9004bbe0 con 0x7f5a900fbb40 2023-12-16T20:15:44.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.525+0000 7f5a85ffb700 1 -- 172.21.15.38:0/4023601297 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f5a8005aa70 con 0x7f5a900fbb40 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:15:44.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:15:44.528 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:15:44.529 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 9, 2023-12-16T20:15:44.529 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 4 2023-12-16T20:15:44.529 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:15:44.529 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:15:44.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 msgr2=0x7f5a7c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 0x7f5a7c06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5a90065e30 tx=0x7f5a8c00b040 comp rx=0 tx=0).stop 2023-12-16T20:15:44.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 msgr2=0x7f5a9010e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009360 tx=0x7f5a80009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 shutdown_connections 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f5a7c06cf80 0x7f5a7c06f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a900fbb40 0x7f5a9010e6f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 --2- 172.21.15.38:0/4023601297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5a90101b00 0x7f5a9010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 >> 172.21.15.38:0/4023601297 conn(0x7f5a900719b0 msgr2=0x7f5a900fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:44.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 shutdown_connections 2023-12-16T20:15:44.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.527+0000 7f5a972c4700 1 -- 172.21.15.38:0/4023601297 wait complete. 2023-12-16T20:15:44.626 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:44 smithi038 ceph-mon[163993]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:44.626 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:44 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:44.626 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:44 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:44.626 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:44 smithi038 ceph-mon[163993]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/4086970961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 msgr2=0x7ff6c80fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/4086970961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c80fc9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8004940 tx=0x7ff6b8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/4086970961 shutdown_connections 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/4086970961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 0x7ff6c8109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/4086970961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c80fc9a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.636+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/4086970961 >> 172.21.15.38:0/4086970961 conn(0x7ff6c80719b0 msgr2=0x7ff6c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.637+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/4086970961 shutdown_connections 2023-12-16T20:15:44.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.637+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/4086970961 wait complete. 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.637+0000 7ff6cdfbe700 1 Processor -- start 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6cdfbe700 1 -- start start 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6cdfbe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6cdfbe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 0x7ff6c8115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6cdfbe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8116450 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6cdfbe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c810f780 con 0x7ff6c80fcee0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37400/0 (socket says 172.21.15.38:37400) 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 -- 172.21.15.38:0/1023256714 learned_addr learned my addr 172.21.15.38:0/1023256714 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c6ffd700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 0x7ff6c8115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 -- 172.21.15.38:0/1023256714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 msgr2=0x7ff6c8115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 0x7ff6c8115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.638+0000 7ff6c77fe700 1 -- 172.21.15.38:0/1023256714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8005040 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6c77fe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fd0 tx=0x7ff6b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b800e040 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff6b8013420 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c810fa00 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b801c630 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.639+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c810ff40 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.640+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c81068c0 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.641+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff6b8013590 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.641+0000 7ff6affff700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 0x7ff6b006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.641+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff6b808d790 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.641+0000 7ff6c6ffd700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 0x7ff6b006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.642+0000 7ff6c6ffd700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 0x7ff6b006f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6c81110f0 tx=0x7ff6bc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:44.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.646+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff6b805af40 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:44 smithi141 ceph-mon[137587]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:44 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:44 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:44 smithi141 ceph-mon[137587]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:44.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.915+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6c810bdf0 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.916+0000 7ff6affff700 1 -- 172.21.15.38:0/1023256714 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1898 (secure 0 0 0) 0x7ff6b805aad0 con 0x7ff6c80fc5d0 2023-12-16T20:15:44.918 INFO:teuthology.orchestra.run.smithi038.stdout:e21 2023-12-16T20:15:44.918 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:15:44.918 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:44.918 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:15:44.918 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 21 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:15:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:11:36.344081+0000 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:15:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:15:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:15:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:44.924 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:15:44.924 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:44.924 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 msgr2=0x7ff6b006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 0x7ff6b006f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6c81110f0 tx=0x7ff6bc00b040 comp rx=0 tx=0).stop 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 msgr2=0x7ff6c81158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fd0 tx=0x7ff6b8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 shutdown_connections 2023-12-16T20:15:44.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff6b006cf80 0x7ff6b006f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6c80fc5d0 0x7ff6c81158c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 --2- 172.21.15.38:0/1023256714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80fcee0 0x7ff6c8115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 >> 172.21.15.38:0/1023256714 conn(0x7ff6c80719b0 msgr2=0x7ff6c80fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 shutdown_connections 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:44.919+0000 7ff6cdfbe700 1 -- 172.21.15.38:0/1023256714 wait complete. 2023-12-16T20:15:44.926 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 21 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.029+0000 7fd3b2a65700 1 -- 172.21.15.38:0/1146012531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 msgr2=0x7fd3ac0fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.029+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/1146012531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac0fb2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd398004a50 tx=0x7fd39800af40 comp rx=0 tx=0).stop 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 -- 172.21.15.38:0/1146012531 shutdown_connections 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/1146012531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac0fb2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/1146012531 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 -- 172.21.15.38:0/1146012531 >> 172.21.15.38:0/1146012531 conn(0x7fd3ac0711a0 msgr2=0x7fd3ac0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 -- 172.21.15.38:0/1146012531 shutdown_connections 2023-12-16T20:15:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 -- 172.21.15.38:0/1146012531 wait complete. 2023-12-16T20:15:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 Processor -- start 2023-12-16T20:15:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.030+0000 7fd3b2a65700 1 -- start start 2023-12-16T20:15:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b2a65700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac1135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b2a65700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b2a65700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac1141c0 con 0x7fd3ac101c10 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b2a65700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac10d4b0 con 0x7fd3ac101270 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37426/0 (socket says 172.21.15.38:37426) 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 -- 172.21.15.38:0/2560162514 learned_addr learned my addr 172.21.15.38:0/2560162514 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b0801700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac1135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 -- 172.21.15.38:0/2560162514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 msgr2=0x7fd3ac1135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac1135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3abfff700 1 -- 172.21.15.38:0/2560162514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398005040 con 0x7fd3ac101c10 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.031+0000 7fd3b0801700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac1135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3abfff700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c8a0 tx=0x7fd39800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39800f030 con 0x7fd3ac101c10 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd39800cdc0 con 0x7fd3ac101c10 2023-12-16T20:15:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac10d6e0 con 0x7fd3ac101c10 2023-12-16T20:15:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39801d480 con 0x7fd3ac101c10 2023-12-16T20:15:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.032+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac10dc20 con 0x7fd3ac101c10 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.033+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac105750 con 0x7fd3ac101c10 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.034+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fd398027440 con 0x7fd3ac101c10 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.034+0000 7fd3a97fa700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 0x7fd39c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.034+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd39808d770 con 0x7fd3ac101c10 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.034+0000 7fd3b0801700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 0x7fd39c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.035+0000 7fd3b0801700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 0x7fd39c06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0f99b0 tx=0x7fd3a000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.039+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd39805afe0 con 0x7fd3ac101c10 2023-12-16T20:15:45.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.282+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3ac1132c0 con 0x7fd39c06cf80 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.283+0000 7fd3a97fa700 1 -- 172.21.15.38:0/2560162514 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd3ac1132c0 con 0x7fd39c06cf80 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:15:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "6/21 daemons upgraded", 2023-12-16T20:15:45.285 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T20:15:45.285 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:15:45.285 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:15:45.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 msgr2=0x7fd39c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 0x7fd39c06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0f99b0 tx=0x7fd3a000b040 comp rx=0 tx=0).stop 2023-12-16T20:15:45.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 msgr2=0x7fd3ac113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c8a0 tx=0x7fd39800af40 comp rx=0 tx=0).stop 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 shutdown_connections 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fd39c06cf80 0x7fd39c06f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3ac101270 0x7fd3ac1135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 --2- 172.21.15.38:0/2560162514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3ac101c10 0x7fd3ac113b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 >> 172.21.15.38:0/2560162514 conn(0x7fd3ac0711a0 msgr2=0x7fd3ac0fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 shutdown_connections 2023-12-16T20:15:45.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.285+0000 7fd3b2a65700 1 -- 172.21.15.38:0/2560162514 wait complete. 2023-12-16T20:15:45.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.404+0000 7f06fae51700 1 -- 172.21.15.38:0/3712562635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fdc10 msgr2=0x7f06f40fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.404+0000 7f06fae51700 1 --2- 172.21.15.38:0/3712562635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fdc10 0x7f06f40fdfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004940 tx=0x7f06e8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:45.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 -- 172.21.15.38:0/3712562635 shutdown_connections 2023-12-16T20:15:45.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 --2- 172.21.15.38:0/3712562635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fe5b0 0x7f06f4106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 --2- 172.21.15.38:0/3712562635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fdc10 0x7f06f40fdfe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 -- 172.21.15.38:0/3712562635 >> 172.21.15.38:0/3712562635 conn(0x7f06f40f76c0 msgr2=0x7f06f40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 -- 172.21.15.38:0/3712562635 shutdown_connections 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 -- 172.21.15.38:0/3712562635 wait complete. 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 Processor -- start 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 -- start start 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fdc10 0x7f06f4113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.405+0000 7f06fae51700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06fae51700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4114200 con 0x7f06f40fe5b0 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06fae51700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f410d4f0 con 0x7f06f40fdc10 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37450/0 (socket says 172.21.15.38:37450) 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 -- 172.21.15.38:0/1668777293 learned_addr learned my addr 172.21.15.38:0/1668777293 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:15:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f8bed700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fdc10 0x7f06f4113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 -- 172.21.15.38:0/1668777293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fdc10 msgr2=0x7f06f4113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fdc10 0x7f06f4113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 -- 172.21.15.38:0/1668777293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8005040 con 0x7f06f40fe5b0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f3fff700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06e0002a50 tx=0x7f06e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e0007cc0 con 0x7f06f40fe5b0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06e000f040 con 0x7f06f40fe5b0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f410d780 con 0x7f06f40fe5b0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e000d9c0 con 0x7f06f40fe5b0 2023-12-16T20:15:45.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.406+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f410dcc0 con 0x7f06f40fe5b0 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.407+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f4104200 con 0x7f06f40fe5b0 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.408+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f06e000db20 con 0x7f06f40fe5b0 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.409+0000 7f06f17fa700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 0x7f06e406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.409+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f06e008c7e0 con 0x7f06f40fe5b0 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.409+0000 7f06f8bed700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 0x7f06e406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:15:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.409+0000 7f06f8bed700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 0x7f06e406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009fd0 tx=0x7f06e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:15:45.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.413+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f06e005a100 con 0x7f06f40fe5b0 2023-12-16T20:15:45.623 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:45 smithi038 ceph-mon[163993]: pgmap v32: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:45.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:45 smithi038 ceph-mon[163993]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:45.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:45 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/4023601297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:45.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:45 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1023256714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:15:45.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.730+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06f40fb2c0 con 0x7f06f40fe5b0 2023-12-16T20:15:45.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.730+0000 7f06f17fa700 1 -- 172.21.15.38:0/1668777293 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f06e0059c90 con 0x7f06f40fe5b0 2023-12-16T20:15:45.731 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: osd.0 (root=default,host=smithi038) is down 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 71/360 objects degraded (19.722%), 19 pgs degraded 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2023-12-16T20:15:45.732 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2023-12-16T20:15:45.733 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 msgr2=0x7f06e406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 0x7f06e406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009fd0 tx=0x7f06e8009e30 comp rx=0 tx=0).stop 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 msgr2=0x7f06f4113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06e0002a50 tx=0x7f06e00046b0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 shutdown_connections 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06e406cf80 0x7f06e406f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06f40fdc10 0x7f06f4113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 --2- 172.21.15.38:0/1668777293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f40fe5b0 0x7f06f4113bb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.732+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 >> 172.21.15.38:0/1668777293 conn(0x7f06f40f76c0 msgr2=0x7f06f4101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.733+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 shutdown_connections 2023-12-16T20:15:45.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:15:45.733+0000 7f06fae51700 1 -- 172.21.15.38:0/1668777293 wait complete. 2023-12-16T20:15:45.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:45 smithi141 ceph-mon[137587]: pgmap v32: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:45.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:45 smithi141 ceph-mon[137587]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:45.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:45 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/4023601297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:45.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:45 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1023256714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:15:46.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:46 smithi038 ceph-mon[163993]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:46.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:46 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1668777293' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:15:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:46 smithi141 ceph-mon[137587]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:15:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:46 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1668777293' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:15:47.894 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:15:47.482+0000 7ff7aeb4e640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-16T20:15:47.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:47 smithi038 ceph-mon[163993]: pgmap v33: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:47.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:47.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:47.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:47 smithi141 ceph-mon[137587]: pgmap v33: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:47.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:47.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:48.289 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:15:47.970+0000 7ff7aeb4e640 -1 osd.0 48 log_to_monitors true 2023-12-16T20:15:48.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:48 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:48.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:48 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:48.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:48 smithi038 ceph-mon[163993]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T20:15:48.895 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:15:48 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:15:48.675+0000 7ff79c7b8700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:15:48.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:48 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:48.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:48 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:48.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:48 smithi141 ceph-mon[137587]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: pgmap v34: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: failed to encode map e51 with expected crc 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: osdmap e51: 6 total, 5 up, 6 in 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:15:49.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:49 smithi038 ceph-mon[163993]: failed to encode map e51 with expected crc 2023-12-16T20:15:49.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: pgmap v34: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 71/360 objects degraded (19.722%) 2023-12-16T20:15:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T20:15:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: failed to encode map e51 with expected crc 2023-12-16T20:15:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: osdmap e51: 6 total, 5 up, 6 in 2023-12-16T20:15:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: from='osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:15:49.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:49 smithi141 ceph-mon[137587]: failed to encode map e51 with expected crc 2023-12-16T20:15:50.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:15:50.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: failed to encode map e51 with expected crc 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758] boot 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:15:50.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T20:15:50.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:50.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: failed to encode map e51 with expected crc 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: osd.0 [v2:172.21.15.38:6802/3568061758,v1:172.21.15.38:6803/3568061758] boot 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:15:51.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:15:51.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:15:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: pgmap v37: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 71/360 objects degraded (19.722%) 2023-12-16T20:15:51.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: osdmap e53: 6 total, 6 up, 6 in 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:51.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:51 smithi141 ceph-mon[137587]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: pgmap v37: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 71/360 objects degraded (19.722%) 2023-12-16T20:15:52.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: osdmap e53: 6 total, 6 up, 6 in 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:52.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:51 smithi038 ceph-mon[163993]: failed to encode map e53 with expected crc 2023-12-16T20:15:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:53 smithi038 ceph-mon[163993]: pgmap v39: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 13/360 objects degraded (3.611%) 2023-12-16T20:15:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:53 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 13/360 objects degraded (3.611%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T20:15:53.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:53 smithi141 ceph-mon[137587]: pgmap v39: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 13/360 objects degraded (3.611%) 2023-12-16T20:15:53.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:53 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 13/360 objects degraded (3.611%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T20:15:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:54 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/360 objects degraded (3.611%), 3 pgs degraded) 2023-12-16T20:15:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:54 smithi038 ceph-mon[163993]: Cluster is now healthy 2023-12-16T20:15:54.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:54 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/360 objects degraded (3.611%), 3 pgs degraded) 2023-12-16T20:15:54.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:54 smithi141 ceph-mon[137587]: Cluster is now healthy 2023-12-16T20:15:55.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:55 smithi038 ceph-mon[163993]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2023-12-16T20:15:55.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:55 smithi141 ceph-mon[137587]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2023-12-16T20:15:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:57 smithi038 ceph-mon[163993]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-16T20:15:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:57 smithi141 ceph-mon[137587]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-16T20:15:59.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:15:59 smithi038 ceph-mon[163993]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-16T20:15:59.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:15:59 smithi141 ceph-mon[137587]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-16T20:16:01.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:01 smithi038 ceph-mon[163993]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:16:01.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:01 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:01.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:01 smithi141 ceph-mon[137587]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:16:01.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:01 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:03.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:03 smithi038 ceph-mon[163993]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T20:16:03.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:03 smithi141 ceph-mon[137587]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T20:16:05.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:16:05.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:16:05.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:16:05.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: Upgrade: osd.1 is safe to restart 2023-12-16T20:16:05.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:05.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:05.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:16:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:16:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T20:16:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: Upgrade: osd.1 is safe to restart 2023-12-16T20:16:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:07.245 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: Upgrade: Updating osd.1 2023-12-16T20:16:07.245 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:07.246 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:16:07.246 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:07.246 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: Deploying daemon osd.1 on smithi038 2023-12-16T20:16:07.246 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:07 smithi038 ceph-mon[163993]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:16:07.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: Upgrade: Updating osd.1 2023-12-16T20:16:07.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:07.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T20:16:07.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:07.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: Deploying daemon osd.1 on smithi038 2023-12-16T20:16:07.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:07 smithi141 ceph-mon[137587]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:16:08.144 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 systemd[1]: Stopping Ceph osd.1 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:16:08.494 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:08 smithi038 ceph-mon[163993]: osd.1 marked itself down and dead 2023-12-16T20:16:08.494 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:16:08.280+0000 7f9be74cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:16:08.495 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:16:08.280+0000 7f9be74cd700 -1 osd.1 53 *** Got signal Terminated *** 2023-12-16T20:16:08.495 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[107196]: 2023-12-16T20:16:08.280+0000 7f9be74cd700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:16:08.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:08 smithi141 ceph-mon[137587]: osd.1 marked itself down and dead 2023-12-16T20:16:09.144 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 podman[180613]: 2023-12-16 20:16:08.799155279 +0000 UTC m=+0.591850486 container died 835eef3eb86d08e3fe6984f4c1f27f31f0ca4382d63565a5773afc2704097f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, ceph=True, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=quincy-1f2f551, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:09.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 podman[180613]: 2023-12-16 20:16:08.894610053 +0000 UTC m=+0.687305249 container cleanup 835eef3eb86d08e3fe6984f4c1f27f31f0ca4382d63565a5773afc2704097f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3) 2023-12-16T20:16:09.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:08 smithi038 bash[180613]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1 2023-12-16T20:16:09.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180640]: 2023-12-16 20:16:09.011117096 +0000 UTC m=+0.208822065 container remove 835eef3eb86d08e3fe6984f4c1f27f31f0ca4382d63565a5773afc2704097f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, org.label-schema.license=GPLv2, RELEASE=quincy-1f2f551, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:16:09.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:16:09.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:16:09.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:09 smithi038 ceph-mon[163993]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T20:16:09.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.39447747 +0000 UTC m=+0.069027658 container create b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2023-12-16T20:16:09.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.359386491 +0000 UTC m=+0.033936633 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:09.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.511713779 +0000 UTC m=+0.186263922 container init b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2023-12-16T20:16:09.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.515719083 +0000 UTC m=+0.190269219 container start b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:16:09.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.544431112 +0000 UTC m=+0.218981267 container attach b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:16:09.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: failed to encode map e54 with expected crc 2023-12-16T20:16:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:09 smithi141 ceph-mon[137587]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T20:16:10.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:09 smithi038 podman[180729]: 2023-12-16 20:16:09.82441703 +0000 UTC m=+0.498967188 container died b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, ceph=True) 2023-12-16T20:16:10.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180755]: 2023-12-16 20:16:10.044419806 +0000 UTC m=+0.210882723 container remove b5f5876222adce7ca25f9011b6dda3649feb9ee82ab23b621124ed59926e7797 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2023-12-16T20:16:10.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.1.service: Deactivated successfully. 2023-12-16T20:16:10.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 systemd[1]: Stopped Ceph osd.1 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:16:10.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.1.service: Consumed 1min 5.234s CPU time. 2023-12-16T20:16:10.520 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 systemd[1]: Starting Ceph osd.1 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:16:10.521 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180860]: 2023-12-16 20:16:10.411018911 +0000 UTC m=+0.053933462 container create c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:10.521 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180860]: 2023-12-16 20:16:10.375401221 +0000 UTC m=+0.018315743 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-mon[163993]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:10 smithi141 ceph-mon[137587]: failed to encode map e55 with expected crc 2023-12-16T20:16:10.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180860]: 2023-12-16 20:16:10.520355631 +0000 UTC m=+0.163270149 container init c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:16:10.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180860]: 2023-12-16 20:16:10.524171446 +0000 UTC m=+0.167085959 container start c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:10.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 podman[180860]: 2023-12-16 20:16:10.560981396 +0000 UTC m=+0.203895904 container attach c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 bash[180860]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-16T20:16:11.338 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:10 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate[180875]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[180860]: 2023-12-16 20:16:11.002883944 +0000 UTC m=+0.645798467 container died c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2023-12-16T20:16:11.339 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[180998]: 2023-12-16 20:16:11.227490044 +0000 UTC m=+0.214740648 container remove c45858b14f3d1caed5764d486af8afb070f6d68c085fba65776eb10ef819441a (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212) 2023-12-16T20:16:11.636 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:11 smithi038 ceph-mon[163993]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:16:11.636 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:11 smithi038 ceph-mon[163993]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T20:16:11.636 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[181062]: 2023-12-16 20:16:11.385956576 +0000 UTC m=+0.061100019 container create 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:16:11.636 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[181062]: 2023-12-16 20:16:11.343556905 +0000 UTC m=+0.018700321 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:11.636 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[181062]: 2023-12-16 20:16:11.495411291 +0000 UTC m=+0.170554693 container init 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:11.636 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 podman[181062]: 2023-12-16 20:16:11.498492026 +0000 UTC m=+0.173635428 container start 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2023-12-16T20:16:11.637 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 ceph-osd[181081]: -- 172.21.15.38:0/3511684260 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ecb25d6c0 con 0x556ecb22f000 2023-12-16T20:16:11.637 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 bash[181062]: 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 2023-12-16T20:16:11.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:11 smithi141 ceph-mon[137587]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T20:16:11.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:11 smithi141 ceph-mon[137587]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T20:16:11.894 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:11 smithi038 systemd[1]: Started Ceph osd.1 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:16:12.349 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:12 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:16:12.047+0000 7fbcacab6640 -1 Falling back to public interface 2023-12-16T20:16:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:12 smithi038 ceph-mon[163993]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:16:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:12.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:12.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:12.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:12 smithi141 ceph-mon[137587]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:16:12.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:12.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:12.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:13.502 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:13 smithi038 ceph-mon[163993]: pgmap v51: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-16T20:16:13.503 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:13 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 48/360 objects degraded (13.333%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:13.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:13 smithi141 ceph-mon[137587]: pgmap v51: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-16T20:16:13.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:13 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 48/360 objects degraded (13.333%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:14.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:14 smithi141 ceph-mon[137587]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:16:15.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:14 smithi038 ceph-mon[163993]: fsmap cephfs:2 {0=cephfs.smithi038.aofkae=up:active,1=cephfs.smithi141.xhutny=up:active} 2 up:standby-replay 2023-12-16T20:16:15.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 -- 172.21.15.38:0/2212332906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 msgr2=0x7fdc140fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:15.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/2212332906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc140fbfa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc00004940 tx=0x7fdc00009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:15.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 -- 172.21.15.38:0/2212332906 shutdown_connections 2023-12-16T20:16:15.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/2212332906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc140fbfa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:15.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/2212332906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:15.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.851+0000 7fdc1ab99700 1 -- 172.21.15.38:0/2212332906 >> 172.21.15.38:0/2212332906 conn(0x7fdc140f7690 msgr2=0x7fdc140f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:15.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.852+0000 7fdc1ab99700 1 -- 172.21.15.38:0/2212332906 shutdown_connections 2023-12-16T20:16:15.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.852+0000 7fdc1ab99700 1 -- 172.21.15.38:0/2212332906 wait complete. 2023-12-16T20:16:15.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.852+0000 7fdc1ab99700 1 Processor -- start 2023-12-16T20:16:15.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.852+0000 7fdc1ab99700 1 -- start start 2023-12-16T20:16:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc1ab99700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc1ab99700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc1ab99700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14114140 con 0x7fdc140fbb30 2023-12-16T20:16:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc1ab99700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1410d470 con 0x7fdc14101af0 2023-12-16T20:16:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:15.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33640/0 (socket says 172.21.15.38:33640) 2023-12-16T20:16:15.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 -- 172.21.15.38:0/1518640804 learned_addr learned my addr 172.21.15.38:0/1518640804 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:15.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc13fff700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:15.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 -- 172.21.15.38:0/1518640804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 msgr2=0x7fdc14113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:15.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 -- 172.21.15.38:0/1518640804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00005040 con 0x7fdc140fbb30 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc13fff700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.853+0000 7fdc18935700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc08002a80 tx=0x7fdc080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.854+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc08007cc0 con 0x7fdc140fbb30 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.854+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc0800f040 con 0x7fdc140fbb30 2023-12-16T20:16:15.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.854+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1410d750 con 0x7fdc140fbb30 2023-12-16T20:16:15.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.854+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc08009640 con 0x7fdc140fbb30 2023-12-16T20:16:15.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.854+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1410dc90 con 0x7fdc140fbb30 2023-12-16T20:16:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.855+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140647b0 con 0x7fdc140fbb30 2023-12-16T20:16:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.855+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fdc080097a0 con 0x7fdc140fbb30 2023-12-16T20:16:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.856+0000 7fdc117fa700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 0x7fdc0406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.856+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdc0808bc30 con 0x7fdc140fbb30 2023-12-16T20:16:15.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.856+0000 7fdc13fff700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 0x7fdc0406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:15.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.857+0000 7fdc13fff700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 0x7fdc0406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc1410ee50 tx=0x7fdc00009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:15.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:15.861+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdc08059400 con 0x7fdc140fbb30 2023-12-16T20:16:15.988 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:15 smithi141 ceph-mon[137587]: pgmap v52: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-16T20:16:15.988 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:15 smithi141 ceph-mon[137587]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T20:16:15.988 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:15.988 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:16.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.107+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc1410eca0 con 0x7fdc0406cf80 2023-12-16T20:16:16.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:15 smithi038 ceph-mon[163993]: pgmap v52: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-16T20:16:16.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:15 smithi038 ceph-mon[163993]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T20:16:16.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:16.109 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:16.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.109+0000 7fdc117fa700 1 -- 172.21.15.38:0/1518640804 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdc1410eca0 con 0x7fdc0406cf80 2023-12-16T20:16:16.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 msgr2=0x7fdc0406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 0x7fdc0406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc1410ee50 tx=0x7fdc00009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:16.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 msgr2=0x7fdc141135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc08002a80 tx=0x7fdc080046b0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 shutdown_connections 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fdc0406cf80 0x7fdc0406f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc140fbb30 0x7fdc141135b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 --2- 172.21.15.38:0/1518640804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc14101af0 0x7fdc14113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 >> 172.21.15.38:0/1518640804 conn(0x7fdc140f7690 msgr2=0x7fdc14065ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 shutdown_connections 2023-12-16T20:16:16.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.111+0000 7fdc1ab99700 1 -- 172.21.15.38:0/1518640804 wait complete. 2023-12-16T20:16:16.123 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:16:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.219+0000 7fb87a564700 1 -- 172.21.15.38:0/3526042516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 msgr2=0x7fb874102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.219+0000 7fb87a564700 1 --2- 172.21.15.38:0/3526042516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874102ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb864004940 tx=0x7fb864009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 -- 172.21.15.38:0/3526042516 shutdown_connections 2023-12-16T20:16:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 --2- 172.21.15.38:0/3526042516 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 --2- 172.21.15.38:0/3526042516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874102ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 -- 172.21.15.38:0/3526042516 >> 172.21.15.38:0/3526042516 conn(0x7fb8740719b0 msgr2=0x7fb874071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:16.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 -- 172.21.15.38:0/3526042516 shutdown_connections 2023-12-16T20:16:16.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 -- 172.21.15.38:0/3526042516 wait complete. 2023-12-16T20:16:16.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.220+0000 7fb87a564700 1 Processor -- start 2023-12-16T20:16:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb87a564700 1 -- start start 2023-12-16T20:16:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb87a564700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb87a564700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb87a564700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741141e0 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb87a564700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87410d4d0 con 0x7fb874065390 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33670/0 (socket says 172.21.15.38:33670) 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 -- 172.21.15.38:0/3115429474 learned_addr learned my addr 172.21.15.38:0/3115429474 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb873fff700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 -- 172.21.15.38:0/3115429474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 msgr2=0x7fb874113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb8737fe700 1 -- 172.21.15.38:0/3115429474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864005040 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.221+0000 7fb873fff700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb8737fe700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb86800eb40 tx=0x7fb86800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb868007cc0 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb86800f040 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87410d700 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86800c990 con 0x7fb874102c20 2023-12-16T20:16:16.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.222+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87410dc40 con 0x7fb874102c20 2023-12-16T20:16:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.223+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740fff40 con 0x7fb874102c20 2023-12-16T20:16:16.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.223+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fb86800caf0 con 0x7fb874102c20 2023-12-16T20:16:16.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.224+0000 7fb870ff9700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 0x7fb85c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.224+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb86808c030 con 0x7fb874102c20 2023-12-16T20:16:16.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.224+0000 7fb873fff700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 0x7fb85c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.224+0000 7fb873fff700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 0x7fb85c06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb864009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:16.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.233+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb8680598b0 con 0x7fb874102c20 2023-12-16T20:16:16.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.478+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87410ebf0 con 0x7fb85c06cf80 2023-12-16T20:16:16.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.479+0000 7fb870ff9700 1 -- 172.21.15.38:0/3115429474 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb87410ebf0 con 0x7fb85c06cf80 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 msgr2=0x7fb85c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 0x7fb85c06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb864009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 msgr2=0x7fb874113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb86800eb40 tx=0x7fb86800b040 comp rx=0 tx=0).stop 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 shutdown_connections 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb85c06cf80 0x7fb85c06f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb874065390 0x7fb874113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 --2- 172.21.15.38:0/3115429474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb874102c20 0x7fb874113b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.483+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 >> 172.21.15.38:0/3115429474 conn(0x7fb8740719b0 msgr2=0x7fb8740fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.484+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 shutdown_connections 2023-12-16T20:16:16.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.484+0000 7fb87a564700 1 -- 172.21.15.38:0/3115429474 wait complete. 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 -- 172.21.15.38:0/1916591885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 msgr2=0x7f94280fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 --2- 172.21.15.38:0/1916591885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94280fbfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9410004940 tx=0x7f9410009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 -- 172.21.15.38:0/1916591885 shutdown_connections 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 --2- 172.21.15.38:0/1916591885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94280fbfb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 --2- 172.21.15.38:0/1916591885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 0x7f9428101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 -- 172.21.15.38:0/1916591885 >> 172.21.15.38:0/1916591885 conn(0x7f94280719b0 msgr2=0x7f9428071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 -- 172.21.15.38:0/1916591885 shutdown_connections 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.619+0000 7f942dc39700 1 -- 172.21.15.38:0/1916591885 wait complete. 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 Processor -- start 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 -- start start 2023-12-16T20:16:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 0x7f9428113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428114280 con 0x7f94280fbb40 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f942dc39700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942810d570 con 0x7f9428101b00 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f94277fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f94277fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33688/0 (socket says 172.21.15.38:33688) 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f94277fe700 1 -- 172.21.15.38:0/1009644875 learned_addr learned my addr 172.21.15.38:0/1009644875 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.620+0000 7f9426ffd700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 0x7f9428113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f94277fe700 1 -- 172.21.15.38:0/1009644875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 msgr2=0x7f9428113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f94277fe700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 0x7f9428113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f94277fe700 1 -- 172.21.15.38:0/1009644875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410005040 con 0x7f94280fbb40 2023-12-16T20:16:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f94277fe700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9418002a50 tx=0x7f94180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9418007cc0 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942810d850 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f941800f040 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941800d9c0 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.621+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942810dd90 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.622+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94281133a0 con 0x7f94280fbb40 2023-12-16T20:16:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.623+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f941800db20 con 0x7f94280fbb40 2023-12-16T20:16:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.623+0000 7f941ffff700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 0x7f941406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.624+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f941808c2a0 con 0x7f94280fbb40 2023-12-16T20:16:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.624+0000 7f9426ffd700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 0x7f941406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.624+0000 7f9426ffd700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 0x7f941406f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9410004f90 tx=0x7f9410009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:16.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.628+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9418059b10 con 0x7f94280fbb40 2023-12-16T20:16:16.763 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:16 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:16:16.667+0000 7fbcacab6640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-16T20:16:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.881+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f942810ed00 con 0x7f941406cf80 2023-12-16T20:16:16.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.902+0000 7f941ffff700 1 -- 172.21.15.38:0/1009644875 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f942810ed00 con 0x7f941406cf80 2023-12-16T20:16:16.903 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:16:16.903 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (2m) 2s ago 10m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:16:16.903 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (51s) 2s ago 10m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (47s) 45s ago 9m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (2m) 2s ago 9m 81.5M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (6m) 2s ago 6m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (6m) 2s ago 6m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (6m) 45s ago 6m 67.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (6m) 45s ago 6m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (3m) 2s ago 11m 491M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (3m) 45s ago 9m 440M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (94s) 2s ago 11m 45.6M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (76s) 45s ago 9m 33.7M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (2m) 2s ago 10m 16.3M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (2m) 45s ago 9m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (34s) 2s ago 8m 85.5M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:16:16.904 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5s) 2s ago 8m 12.4M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:16:16.905 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (8m) 2s ago 8m 196M 1559M 17.2.7-125-g1f2f5510 60cc83a9c8f1 76f4ce7047e5 2023-12-16T20:16:16.905 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (8m) 45s ago 8m 274M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:16:16.905 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (7m) 45s ago 7m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:16:16.905 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (7m) 45s ago 7m 232M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:16:16.905 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 2s ago 9m 58.8M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 msgr2=0x7f941406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 0x7f941406f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9410004f90 tx=0x7f9410009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 msgr2=0x7f94281136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9418002a50 tx=0x7f94180046b0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 shutdown_connections 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f941406cf80 0x7f941406f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94280fbb40 0x7f94281136f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 --2- 172.21.15.38:0/1009644875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9428101b00 0x7f9428113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 >> 172.21.15.38:0/1009644875 conn(0x7f94280719b0 msgr2=0x7f94280654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 shutdown_connections 2023-12-16T20:16:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:16.906+0000 7f942dc39700 1 -- 172.21.15.38:0/1009644875 wait complete. 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 -- 172.21.15.38:0/2685572537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 msgr2=0x7fb510102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 --2- 172.21.15.38:0/2685572537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510102ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb500004940 tx=0x7fb500009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 -- 172.21.15.38:0/2685572537 shutdown_connections 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 --2- 172.21.15.38:0/2685572537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 --2- 172.21.15.38:0/2685572537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510102ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.032+0000 7fb516a55700 1 -- 172.21.15.38:0/2685572537 >> 172.21.15.38:0/2685572537 conn(0x7fb5100719b0 msgr2=0x7fb510071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:17.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:17.034 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.033+0000 7fb516a55700 1 -- 172.21.15.38:0/2685572537 shutdown_connections 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.033+0000 7fb516a55700 1 -- 172.21.15.38:0/2685572537 wait complete. 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.033+0000 7fb516a55700 1 Processor -- start 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb516a55700 1 -- start start 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb516a55700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb516a55700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb516a55700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51010d540 con 0x7fb510102c20 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb50f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb50f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33702/0 (socket says 172.21.15.38:33702) 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb50f7fe700 1 -- 172.21.15.38:0/114192919 learned_addr learned my addr 172.21.15.38:0/114192919 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51010d6b0 con 0x7fb510065390 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.034+0000 7fb50ffff700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50ffff700 1 -- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 msgr2=0x7fb510113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50ffff700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50ffff700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500005040 con 0x7fb510065390 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50f7fe700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50ffff700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510113680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb500000c00 tx=0x7fb500009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.035+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50000e040 con 0x7fb510065390 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.036+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb500013420 con 0x7fb510065390 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.036+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51010d930 con 0x7fb510065390 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.036+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51010de70 con 0x7fb510065390 2023-12-16T20:16:17.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.037+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50001c630 con 0x7fb510065390 2023-12-16T20:16:17.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.038+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fb500026440 con 0x7fb510065390 2023-12-16T20:16:17.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.038+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5100fff40 con 0x7fb510065390 2023-12-16T20:16:17.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.038+0000 7fb50cff9700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 0x7fb4f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.039+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb50008cff0 con 0x7fb510065390 2023-12-16T20:16:17.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.039+0000 7fb50f7fe700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 0x7fb4f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.039+0000 7fb50f7fe700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 0x7fb4f806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb51010ef20 tx=0x7fb504009250 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.043+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb50005a860 con 0x7fb510065390 2023-12-16T20:16:17.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:17.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:17.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.372+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb51004bb80 con 0x7fb510065390 2023-12-16T20:16:17.374 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:17 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:16:17.266+0000 7fbcacab6640 -1 osd.1 53 log_to_monitors true 2023-12-16T20:16:17.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.373+0000 7fb50cff9700 1 -- 172.21.15.38:0/114192919 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7fb50005a3f0 con 0x7fb510065390 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 1 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:16:17.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 8, 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 5 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 msgr2=0x7fb4f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 0x7fb4f806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb51010ef20 tx=0x7fb504009250 comp rx=0 tx=0).stop 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 msgr2=0x7fb510113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510113680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb500000c00 tx=0x7fb500009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 shutdown_connections 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb4f806cf80 0x7fb4f806f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb510065390 0x7fb510113680 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 --2- 172.21.15.38:0/114192919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb510102c20 0x7fb510113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.375+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 >> 172.21.15.38:0/114192919 conn(0x7fb5100719b0 msgr2=0x7fb5100faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.376+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 shutdown_connections 2023-12-16T20:16:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.376+0000 7fb516a55700 1 -- 172.21.15.38:0/114192919 wait complete. 2023-12-16T20:16:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 -- 172.21.15.38:0/948977887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 msgr2=0x7f05480fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 --2- 172.21.15.38:0/948977887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fdfe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0538004940 tx=0x7f0538009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 -- 172.21.15.38:0/948977887 shutdown_connections 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 --2- 172.21.15.38:0/948977887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 0x7f0548106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 --2- 172.21.15.38:0/948977887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fdfe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 -- 172.21.15.38:0/948977887 >> 172.21.15.38:0/948977887 conn(0x7f05480f76c0 msgr2=0x7f05480f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 -- 172.21.15.38:0/948977887 shutdown_connections 2023-12-16T20:16:17.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.482+0000 7f054f7c6700 1 -- 172.21.15.38:0/948977887 wait complete. 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 Processor -- start 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 -- start start 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 0x7f05480fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480fc580 con 0x7f05480fdc10 2023-12-16T20:16:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054f7c6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480fc6f0 con 0x7f05480fe5b0 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054d562700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054d562700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33708/0 (socket says 172.21.15.38:33708) 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054d562700 1 -- 172.21.15.38:0/1564478351 learned_addr learned my addr 172.21.15.38:0/1564478351 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.483+0000 7f054cd61700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 0x7f05480fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054d562700 1 -- 172.21.15.38:0/1564478351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 msgr2=0x7f05480fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054d562700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 0x7f05480fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054d562700 1 -- 172.21.15.38:0/1564478351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538005040 con 0x7f05480fdc10 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054d562700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f053800b3b0 tx=0x7f0538009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053800e040 con 0x7f05480fdc10 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0538004290 con 0x7f05480fdc10 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0548119870 con 0x7f05480fdc10 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053801c3f0 con 0x7f05480fdc10 2023-12-16T20:16:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.484+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0548119cd0 con 0x7f05480fdc10 2023-12-16T20:16:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.485+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0548104200 con 0x7f05480fdc10 2023-12-16T20:16:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.486+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f053800bc50 con 0x7f05480fdc10 2023-12-16T20:16:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.486+0000 7f053dffb700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 0x7f053406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.486+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f053808d8a0 con 0x7f05480fdc10 2023-12-16T20:16:17.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.486+0000 7f054cd61700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 0x7f053406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.487+0000 7f054cd61700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 0x7f053406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0544007fd0 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.491+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0538057680 con 0x7f05480fdc10 2023-12-16T20:16:17.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.745+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f05480fb2c0 con 0x7f05480fdc10 2023-12-16T20:16:17.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.745+0000 7f053dffb700 1 -- 172.21.15.38:0/1564478351 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f053805aca0 con 0x7f05480fdc10 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:e23 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 23 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:16:17.747 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:16:12.868692+0000 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:16:17.748 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:17.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 msgr2=0x7f053406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 0x7f053406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0544007fd0 tx=0x7f0544009040 comp rx=0 tx=0).stop 2023-12-16T20:16:17.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 msgr2=0x7f05480fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f053800b3b0 tx=0x7f0538009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 shutdown_connections 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f053406cf80 0x7f053406f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05480fdc10 0x7f05480fba40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 --2- 172.21.15.38:0/1564478351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05480fe5b0 0x7f05480fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 >> 172.21.15.38:0/1564478351 conn(0x7f05480f76c0 msgr2=0x7f0548101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 shutdown_connections 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.749+0000 7f054f7c6700 1 -- 172.21.15.38:0/1564478351 wait complete. 2023-12-16T20:16:17.751 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 -- 172.21.15.38:0/585127493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d80fbb40 msgr2=0x7f40d80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/585127493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d80fbb40 0x7f40d80fbfb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40cc004940 tx=0x7f40cc009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 -- 172.21.15.38:0/585127493 shutdown_connections 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/585127493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d80fbb40 0x7f40d80fbfb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/585127493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d8101b00 0x7f40d8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 -- 172.21.15.38:0/585127493 >> 172.21.15.38:0/585127493 conn(0x7f40d80719b0 msgr2=0x7f40d8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 -- 172.21.15.38:0/585127493 shutdown_connections 2023-12-16T20:16:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 -- 172.21.15.38:0/585127493 wait complete. 2023-12-16T20:16:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.857+0000 7f40dd0c0700 1 Processor -- start 2023-12-16T20:16:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40dd0c0700 1 -- start start 2023-12-16T20:16:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40dd0c0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d80fbb40 0x7f40d8113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40dd0c0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40dd0c0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8114260 con 0x7f40d8101b00 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40dd0c0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d810d550 con 0x7f40d80fbb40 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33718/0 (socket says 172.21.15.38:33718) 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 -- 172.21.15.38:0/1798345323 learned_addr learned my addr 172.21.15.38:0/1798345323 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d6d9d700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d80fbb40 0x7f40d8113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 -- 172.21.15.38:0/1798345323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d80fbb40 msgr2=0x7f40d8113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d80fbb40 0x7f40d8113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.858+0000 7f40d659c700 1 -- 172.21.15.38:0/1798345323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc005040 con 0x7f40d8101b00 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40d659c700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009fd0 tx=0x7f40cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40cc00e040 con 0x7f40d8101b00 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40cc013420 con 0x7f40d8101b00 2023-12-16T20:16:17.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40cc01c630 con 0x7f40d8101b00 2023-12-16T20:16:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d810d780 con 0x7f40d8101b00 2023-12-16T20:16:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.859+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d810dcc0 con 0x7f40d8101b00 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.860+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d80734d0 con 0x7f40d8101b00 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.860+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f40cc013590 con 0x7f40d8101b00 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.861+0000 7f40bf7fe700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 0x7f40c006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.861+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f40cc08d6d0 con 0x7f40d8101b00 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.861+0000 7f40d6d9d700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 0x7f40c006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.862+0000 7f40d6d9d700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 0x7f40c006f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d80f9cf0 tx=0x7f40c800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:17.866+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f40cc05af40 con 0x7f40d8101b00 2023-12-16T20:16:18.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.120+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40d810ec70 con 0x7f40c006cf80 2023-12-16T20:16:18.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.121+0000 7f40bf7fe700 1 -- 172.21.15.38:0/1798345323 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f40d810ec70 con 0x7f40c006cf80 2023-12-16T20:16:18.122 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:16:18.122 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "8/21 daemons upgraded", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:16:18.123 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:16:18.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 msgr2=0x7f40c006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 0x7f40c006f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d80f9cf0 tx=0x7f40c800b040 comp rx=0 tx=0).stop 2023-12-16T20:16:18.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 msgr2=0x7f40d8113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009fd0 tx=0x7f40cc009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 shutdown_connections 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f40c006cf80 0x7f40c006f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f40d80fbb40 0x7f40d8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 --2- 172.21.15.38:0/1798345323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40d8101b00 0x7f40d8113c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 >> 172.21.15.38:0/1798345323 conn(0x7f40d80719b0 msgr2=0x7f40d80654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 shutdown_connections 2023-12-16T20:16:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.124+0000 7f40dd0c0700 1 -- 172.21.15.38:0/1798345323 wait complete. 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 -- 172.21.15.38:0/779829835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d41035a0 msgr2=0x7f77d40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 --2- 172.21.15.38:0/779829835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d41035a0 0x7f77d40fcc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f77c0004940 tx=0x7f77c0009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 -- 172.21.15.38:0/779829835 shutdown_connections 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 --2- 172.21.15.38:0/779829835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d41035a0 0x7f77d40fcc10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 --2- 172.21.15.38:0/779829835 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d4102c00 0x7f77d4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.231+0000 7f77dafa9700 1 -- 172.21.15.38:0/779829835 >> 172.21.15.38:0/779829835 conn(0x7f77d40f8790 msgr2=0x7f77d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 -- 172.21.15.38:0/779829835 shutdown_connections 2023-12-16T20:16:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 -- 172.21.15.38:0/779829835 wait complete. 2023-12-16T20:16:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 Processor -- start 2023-12-16T20:16:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 -- start start 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d41035a0 0x7f77d4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41141e0 con 0x7f77d4102c00 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.232+0000 7f77dafa9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d410d4d0 con 0x7f77d41035a0 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33742/0 (socket says 172.21.15.38:33742) 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 -- 172.21.15.38:0/2478196323 learned_addr learned my addr 172.21.15.38:0/2478196323 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d3fff700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d41035a0 0x7f77d4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 -- 172.21.15.38:0/2478196323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d41035a0 msgr2=0x7f77d4113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d41035a0 0x7f77d4113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 -- 172.21.15.38:0/2478196323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0005040 con 0x7f77d4102c00 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d8d45700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77c8002a50 tx=0x7f77c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c8007cc0 con 0x7f77d4102c00 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77c800f040 con 0x7f77d4102c00 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d410d760 con 0x7f77d4102c00 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c8009540 con 0x7f77d4102c00 2023-12-16T20:16:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.233+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d410dca0 con 0x7f77d4102c00 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.234+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d41050d0 con 0x7f77d4102c00 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.235+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f77c80096c0 con 0x7f77d4102c00 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.235+0000 7f77d17fa700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 0x7f77c406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.235+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f77c808c350 con 0x7f77d4102c00 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.235+0000 7f77d3fff700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 0x7f77c406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.236+0000 7f77d3fff700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 0x7f77c406f430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77d410eeb0 tx=0x7f77c0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.240+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f77c8059aa0 con 0x7f77d4102c00 2023-12-16T20:16:18.241 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:16:18.016+0000 7fbc9bf23700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:17 smithi038 ceph-mon[163993]: pgmap v53: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/114192919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:18.242 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:18 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1564478351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:16:18.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: pgmap v53: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-16T20:16:18.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T20:16:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/114192919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:18 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1564478351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:16:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.537+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f77d410ebf0 con 0x7f77d4102c00 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.537+0000 7f77d17fa700 1 -- 172.21.15.38:0/2478196323 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f77c8009970 con 0x7f77d4102c00 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout: osd.1 (root=default,host=smithi038) is down 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-16T20:16:18.539 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-16T20:16:18.540 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 msgr2=0x7f77c406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 0x7f77c406f430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77d410eeb0 tx=0x7f77c0009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 msgr2=0x7f77d4113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77c8002a50 tx=0x7f77c80046b0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 shutdown_connections 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f77c406cf80 0x7f77c406f430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77d4102c00 0x7f77d4113610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 --2- 172.21.15.38:0/2478196323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77d41035a0 0x7f77d4113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:18.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 >> 172.21.15.38:0/2478196323 conn(0x7f77d40f8790 msgr2=0x7f77d40fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:18.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 shutdown_connections 2023-12-16T20:16:18.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:18.540+0000 7f77dafa9700 1 -- 172.21.15.38:0/2478196323 wait complete. 2023-12-16T20:16:19.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: osdmap e56: 6 total, 5 up, 6 in 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2478196323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:16:19.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:19.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:19 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:19.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: osdmap e56: 6 total, 5 up, 6 in 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: failed to encode map e56 with expected crc 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2478196323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:19.497 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:19 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:20.114 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2023-12-16T20:16:20.114 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: failed to encode map e57 with expected crc 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261] boot 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T20:16:20.115 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:16:20.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: failed to encode map e57 with expected crc 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: osd.1 [v2:172.21.15.38:6810/3130410261,v1:172.21.15.38:6811/3130410261] boot 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T20:16:20.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: osdmap e58: 6 total, 6 up, 6 in 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: pgmap v58: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/360 objects degraded (15.556%) 2023-12-16T20:16:21.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:21.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: osdmap e58: 6 total, 6 up, 6 in 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: failed to encode map e58 with expected crc 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: pgmap v58: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/360 objects degraded (15.556%) 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:22.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:22 smithi038 ceph-mon[163993]: mgrmap e40: smithi038.gdlrfj(active, since 91s), standbys: smithi141.cycgjd 2023-12-16T20:16:22.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:22 smithi141 ceph-mon[137587]: mgrmap e40: smithi038.gdlrfj(active, since 91s), standbys: smithi141.cycgjd 2023-12-16T20:16:23.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:23 smithi038 ceph-mon[163993]: pgmap v59: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s; 24/360 objects degraded (6.667%) 2023-12-16T20:16:23.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:23 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 24/360 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:23.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:23 smithi141 ceph-mon[137587]: pgmap v59: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s; 24/360 objects degraded (6.667%) 2023-12-16T20:16:23.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:23 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 24/360 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:24.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:24 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/360 objects degraded (6.667%), 7 pgs degraded) 2023-12-16T20:16:24.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:24 smithi141 ceph-mon[137587]: Cluster is now healthy 2023-12-16T20:16:24.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:24 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/360 objects degraded (6.667%), 7 pgs degraded) 2023-12-16T20:16:24.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:24 smithi038 ceph-mon[163993]: Cluster is now healthy 2023-12-16T20:16:25.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:25 smithi141 ceph-mon[137587]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1012 B/s wr, 3 op/s 2023-12-16T20:16:25.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:25 smithi038 ceph-mon[163993]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1012 B/s wr, 3 op/s 2023-12-16T20:16:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:27 smithi141 ceph-mon[137587]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-16T20:16:27.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:27 smithi038 ceph-mon[163993]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-16T20:16:29.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:29 smithi038 ceph-mon[163993]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 678 B/s wr, 4 op/s 2023-12-16T20:16:29.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:29 smithi141 ceph-mon[137587]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 678 B/s wr, 4 op/s 2023-12-16T20:16:31.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:31 smithi038 ceph-mon[163993]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 612 B/s wr, 4 op/s 2023-12-16T20:16:31.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:31 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:31.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:31 smithi141 ceph-mon[137587]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 612 B/s wr, 4 op/s 2023-12-16T20:16:31.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:31 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:33.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:33 smithi038 ceph-mon[163993]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:16:33.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:33 smithi141 ceph-mon[137587]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T20:16:34.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:34 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:34.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:34 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:34.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:34 smithi038 ceph-mon[163993]: Upgrade: osd.2 is safe to restart 2023-12-16T20:16:34.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:34 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:34.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:34 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T20:16:34.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:34 smithi141 ceph-mon[137587]: Upgrade: osd.2 is safe to restart 2023-12-16T20:16:35.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: Upgrade: Updating osd.2 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: Deploying daemon osd.2 on smithi038 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:35.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:35.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: Upgrade: Updating osd.2 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: Deploying daemon osd.2 on smithi038 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:36.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:36 smithi038 systemd[1]: Stopping Ceph osd.2 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:16:36.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:36 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:16:36.651+0000 7f9f30127700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:16:36.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:36 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:16:36.651+0000 7f9f30127700 -1 osd.2 58 *** Got signal Terminated *** 2023-12-16T20:16:36.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:36 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[114590]: 2023-12-16T20:16:36.651+0000 7f9f30127700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:16:37.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:37 smithi038 ceph-mon[163993]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-16T20:16:37.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:37 smithi038 ceph-mon[163993]: osd.2 marked itself down and dead 2023-12-16T20:16:37.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:37 smithi141 ceph-mon[137587]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2023-12-16T20:16:37.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:37 smithi141 ceph-mon[137587]: osd.2 marked itself down and dead 2023-12-16T20:16:38.274 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186140]: 2023-12-16 20:16:38.001514578 +0000 UTC m=+1.413279451 container died 76f4ce7047e54fc3fd1a4c442c7caa75bb061208e87ead6a6bf44c2831c5c3be (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2023-12-16T20:16:38.274 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186140]: 2023-12-16 20:16:38.124096552 +0000 UTC m=+1.535861409 container cleanup 76f4ce7047e54fc3fd1a4c442c7caa75bb061208e87ead6a6bf44c2831c5c3be (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:16:38.274 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 bash[186140]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2 2023-12-16T20:16:38.549 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186157]: 2023-12-16 20:16:38.27394878 +0000 UTC m=+0.269444096 container remove 76f4ce7047e54fc3fd1a4c442c7caa75bb061208e87ead6a6bf44c2831c5c3be (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2023-12-16T20:16:38.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:38 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:16:38.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:38 smithi038 ceph-mon[163993]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T20:16:38.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:38 smithi038 ceph-mon[163993]: failed to encode map e59 with expected crc 2023-12-16T20:16:38.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:38 smithi038 ceph-mon[163993]: failed to encode map e59 with expected crc 2023-12-16T20:16:38.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:38 smithi038 ceph-mon[163993]: failed to encode map e59 with expected crc 2023-12-16T20:16:38.896 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.54895199 +0000 UTC m=+0.061496294 container create 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux ) 2023-12-16T20:16:38.896 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.505808532 +0000 UTC m=+0.018352799 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:38.897 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.633020071 +0000 UTC m=+0.145564344 container init 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:16:38.897 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.63919022 +0000 UTC m=+0.151734484 container start 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2023-12-16T20:16:38.897 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.657140868 +0000 UTC m=+0.169685141 container attach 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:16:38.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:38 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:16:38.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:38 smithi141 ceph-mon[137587]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T20:16:38.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:38 smithi141 ceph-mon[137587]: failed to encode map e59 with expected crc 2023-12-16T20:16:38.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:38 smithi141 ceph-mon[137587]: failed to encode map e59 with expected crc 2023-12-16T20:16:38.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:38 smithi141 ceph-mon[137587]: failed to encode map e59 with expected crc 2023-12-16T20:16:39.183 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:38 smithi038 podman[186246]: 2023-12-16 20:16:38.942199234 +0000 UTC m=+0.454743502 container died 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, ceph=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2023-12-16T20:16:39.557 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186272]: 2023-12-16 20:16:39.182208557 +0000 UTC m=+0.230920414 container remove 3245aeb26b56594f75cb26968c88cca4ab4a4cd66040d66fd7b1dc6213869404 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2023-12-16T20:16:39.558 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.2.service: Deactivated successfully. 2023-12-16T20:16:39.558 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 systemd[1]: Stopped Ceph osd.2 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:16:39.558 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.2.service: Consumed 52.065s CPU time. 2023-12-16T20:16:39.558 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 systemd[1]: Starting Ceph osd.2 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: pgmap v68: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.853 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:39 smithi038 ceph-mon[163993]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.854 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186378]: 2023-12-16 20:16:39.557037607 +0000 UTC m=+0.070153403 container create e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux ) 2023-12-16T20:16:39.854 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186378]: 2023-12-16 20:16:39.505643183 +0000 UTC m=+0.018758947 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:39.854 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186378]: 2023-12-16 20:16:39.640920939 +0000 UTC m=+0.154036693 container init e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:39.854 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186378]: 2023-12-16 20:16:39.657791467 +0000 UTC m=+0.170907223 container start e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:16:39.854 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:39 smithi038 podman[186378]: 2023-12-16 20:16:39.682026856 +0000 UTC m=+0.195142629 container attach e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2023-12-16T20:16:39.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: pgmap v68: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:39 smithi141 ceph-mon[137587]: failed to encode map e60 with expected crc 2023-12-16T20:16:40.395 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186378]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate[186393]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-16T20:16:40.396 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186378]: 2023-12-16 20:16:40.135468096 +0000 UTC m=+0.648583867 container died e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2023-12-16T20:16:40.397 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186517]: 2023-12-16 20:16:40.34864313 +0000 UTC m=+0.207468332 container remove e70b96783b900dc0e9cccb24084fc994b82f82be4d25f677f57f07282e9af18f (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-activate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2023-12-16T20:16:40.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 15/360 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:40.894 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186586]: 2023-12-16 20:16:40.523573158 +0000 UTC m=+0.065934993 container create 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:16:40.894 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186586]: 2023-12-16 20:16:40.476982323 +0000 UTC m=+0.019344175 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:16:40.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186586]: 2023-12-16 20:16:40.582383775 +0000 UTC m=+0.124745618 container init 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:16:40.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 podman[186586]: 2023-12-16 20:16:40.604469433 +0000 UTC m=+0.146831275 container start 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:16:40.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 bash[186586]: 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 2023-12-16T20:16:40.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 systemd[1]: Started Ceph osd.2 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:16:40.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:40 smithi038 ceph-osd[186610]: -- 172.21.15.38:0/1251937186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d2b24bf6c0 con 0x55d2b2491000 2023-12-16T20:16:40.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:40 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 15/360 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:41.428 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:41 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:16:41.146+0000 7f3efe916640 -1 Falling back to public interface 2023-12-16T20:16:41.858 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:41 smithi038 ceph-mon[163993]: pgmap v70: 65 pgs: 4 active+undersized+degraded, 7 peering, 2 stale+active+clean, 4 active+undersized, 48 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 15/360 objects degraded (4.167%) 2023-12-16T20:16:41.858 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:41 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:41.858 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:41 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:41.859 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:41 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:41 smithi141 ceph-mon[137587]: pgmap v70: 65 pgs: 4 active+undersized+degraded, 7 peering, 2 stale+active+clean, 4 active+undersized, 48 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 15/360 objects degraded (4.167%) 2023-12-16T20:16:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:41 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:41 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:41 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:43 smithi141 ceph-mon[137587]: pgmap v71: 65 pgs: 9 active+undersized+degraded, 7 peering, 11 active+undersized, 38 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/360 objects degraded (8.611%) 2023-12-16T20:16:43.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:43.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:43 smithi038 ceph-mon[163993]: pgmap v71: 65 pgs: 9 active+undersized+degraded, 7 peering, 11 active+undersized, 38 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/360 objects degraded (8.611%) 2023-12-16T20:16:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:44.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:44.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:44 smithi141 ceph-mon[137587]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-16T20:16:45.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:44 smithi038 ceph-mon[163993]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-16T20:16:45.394 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:16:45.066+0000 7f3efe916640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-16T20:16:45.798 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:16:45.509+0000 7f3efe916640 -1 osd.2 58 log_to_monitors true 2023-12-16T20:16:46.145 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:16:45.884+0000 7f3eee584700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:16:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-mon[163993]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2023-12-16T20:16:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:46.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:46.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:45 smithi038 ceph-mon[163993]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T20:16:46.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:45 smithi141 ceph-mon[137587]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2023-12-16T20:16:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:45 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:45 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:45 smithi141 ceph-mon[137587]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T20:16:47.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:46 smithi038 ceph-mon[163993]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T20:16:47.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:46 smithi038 ceph-mon[163993]: osdmap e61: 6 total, 5 up, 6 in 2023-12-16T20:16:47.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:46 smithi038 ceph-mon[163993]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:16:47.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:46 smithi038 ceph-mon[163993]: failed to encode map e61 with expected crc 2023-12-16T20:16:47.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:46 smithi038 ceph-mon[163993]: failed to encode map e61 with expected crc 2023-12-16T20:16:47.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:46 smithi141 ceph-mon[137587]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T20:16:47.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:46 smithi141 ceph-mon[137587]: osdmap e61: 6 total, 5 up, 6 in 2023-12-16T20:16:47.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:46 smithi141 ceph-mon[137587]: from='osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2023-12-16T20:16:47.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:46 smithi141 ceph-mon[137587]: failed to encode map e61 with expected crc 2023-12-16T20:16:47.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:46 smithi141 ceph-mon[137587]: failed to encode map e61 with expected crc 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 44/360 objects degraded (12.222%) 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: failed to encode map e61 with expected crc 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231] boot 2023-12-16T20:16:48.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:16:48.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:47 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:48.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 44/360 objects degraded (12.222%) 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: failed to encode map e61 with expected crc 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: osd.2 [v2:172.21.15.38:6818/2661634231,v1:172.21.15.38:6819/2661634231] boot 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: failed to encode map e62 with expected crc 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:16:48.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:16:48.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:47 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 44/360 objects degraded (12.222%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/1931310505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc88101b00 msgr2=0x7fcc88101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/1931310505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc88101b00 0x7fcc88101ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc70004940 tx=0x7fcc70009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/1931310505 shutdown_connections 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/1931310505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc880fbb40 0x7fcc880fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/1931310505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc88101b00 0x7fcc88101ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/1931310505 >> 172.21.15.38:0/1931310505 conn(0x7fcc880719b0 msgr2=0x7fcc88071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/1931310505 shutdown_connections 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.660+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/1931310505 wait complete. 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 Processor -- start 2023-12-16T20:16:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 -- start start 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc88101b00 0x7fcc8810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8810f1c0 con 0x7fcc880fbb40 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.661+0000 7fcc8e0d5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8810f300 con 0x7fcc88101b00 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42742/0 (socket says 172.21.15.38:42742) 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 -- 172.21.15.38:0/3459919826 learned_addr learned my addr 172.21.15.38:0/3459919826 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc86ffd700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc88101b00 0x7fcc8810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 -- 172.21.15.38:0/3459919826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc88101b00 msgr2=0x7fcc8810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc88101b00 0x7fcc8810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 -- 172.21.15.38:0/3459919826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70005040 con 0x7fcc880fbb40 2023-12-16T20:16:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc877fe700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009360 tx=0x7fcc70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7000e040 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc70013420 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc88117600 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7001c610 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.662+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc88117b10 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.664+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc88103fb0 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.664+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fcc7000bb80 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.664+0000 7fcc7ffff700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 0x7fcc7406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.664+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcc7008d4f0 con 0x7fcc880fbb40 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.665+0000 7fcc86ffd700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 0x7fcc7406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.665+0000 7fcc86ffd700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 0x7fcc7406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc88065e30 tx=0x7fcc7800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:48.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.669+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fcc70057450 con 0x7fcc880fbb40 2023-12-16T20:16:48.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.891+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc88065b70 con 0x7fcc7406ce70 2023-12-16T20:16:48.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.893+0000 7fcc7ffff700 1 -- 172.21.15.38:0/3459919826 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcc88065b70 con 0x7fcc7406ce70 2023-12-16T20:16:48.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 msgr2=0x7fcc7406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 0x7fcc7406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc88065e30 tx=0x7fcc7800b040 comp rx=0 tx=0).stop 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 msgr2=0x7fcc8810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009360 tx=0x7fcc70009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 shutdown_connections 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fcc7406ce70 0x7fcc7406f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc880fbb40 0x7fcc8810e6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 --2- 172.21.15.38:0/3459919826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc88101b00 0x7fcc8810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:48.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 >> 172.21.15.38:0/3459919826 conn(0x7fcc880719b0 msgr2=0x7fcc880fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:48.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 shutdown_connections 2023-12-16T20:16:48.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:48.895+0000 7fcc8e0d5700 1 -- 172.21.15.38:0/3459919826 wait complete. 2023-12-16T20:16:48.909 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: failed to encode map e63 with expected crc 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: osdmap e63: 6 total, 6 up, 6 in 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: failed to encode map e63 with expected crc 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: failed to encode map e63 with expected crc 2023-12-16T20:16:48.909 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:48 smithi038 ceph-mon[163993]: failed to encode map e63 with expected crc 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 -- 172.21.15.38:0/2643442818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c102c90 msgr2=0x7f001c103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 --2- 172.21.15.38:0/2643442818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c102c90 0x7f001c103060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0018004940 tx=0x7f0018009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 -- 172.21.15.38:0/2643442818 shutdown_connections 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 --2- 172.21.15.38:0/2643442818 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c0fb210 0x7f001c0fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 --2- 172.21.15.38:0/2643442818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c102c90 0x7f001c103060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 -- 172.21.15.38:0/2643442818 >> 172.21.15.38:0/2643442818 conn(0x7f001c0711b0 msgr2=0x7f001c0715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 -- 172.21.15.38:0/2643442818 shutdown_connections 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.003+0000 7f00242b5700 1 -- 172.21.15.38:0/2643442818 wait complete. 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 Processor -- start 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 -- start start 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 0x7f001c0fc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0fcf30 con 0x7f001c0fb210 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f00242b5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0fd0a0 con 0x7f001c102c90 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42760/0 (socket says 172.21.15.38:42760) 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 -- 172.21.15.38:0/4101262830 learned_addr learned my addr 172.21.15.38:0/4101262830 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 -- 172.21.15.38:0/4101262830 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 msgr2=0x7f001c0fc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0021850700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 0x7f001c0fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 0x7f001c0fc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0022051700 1 -- 172.21.15.38:0/4101262830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018005040 con 0x7f001c0fb210 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.004+0000 7f0021850700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 0x7f001c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f0022051700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0018009360 tx=0x7f0018009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f001800e040 con 0x7f001c0fb210 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c119890 con 0x7f001c0fb210 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f001800bc50 con 0x7f001c0fb210 2023-12-16T20:16:49.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f001801c630 con 0x7f001c0fb210 2023-12-16T20:16:49.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.005+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c119cf0 con 0x7f001c0fb210 2023-12-16T20:16:49.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.006+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c0fff40 con 0x7f001c0fb210 2023-12-16T20:16:49.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.006+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0018013420 con 0x7f001c0fb210 2023-12-16T20:16:49.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.007+0000 7f0012ffd700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 0x7f000806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.007+0000 7f0021850700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 0x7f000806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.007+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f001808d7a0 con 0x7f001c0fb210 2023-12-16T20:16:49.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.007+0000 7f0021850700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 0x7f000806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f000c009fd0 tx=0x7f000c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.012+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0018057700 con 0x7f001c0fb210 2023-12-16T20:16:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.232+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f001c0fdb30 con 0x7f000806ce70 2023-12-16T20:16:49.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.234+0000 7f0012ffd700 1 -- 172.21.15.38:0/4101262830 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f001c0fdb30 con 0x7f000806ce70 2023-12-16T20:16:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 msgr2=0x7f000806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 0x7f000806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f000c009fd0 tx=0x7f000c00b040 comp rx=0 tx=0).stop 2023-12-16T20:16:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 msgr2=0x7f001c0fc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0018009360 tx=0x7f0018009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 shutdown_connections 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f000806ce70 0x7f000806f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f001c0fb210 0x7f001c0fc3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 --2- 172.21.15.38:0/4101262830 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f001c102c90 0x7f001c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 >> 172.21.15.38:0/4101262830 conn(0x7f001c0711b0 msgr2=0x7f001c0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 shutdown_connections 2023-12-16T20:16:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.236+0000 7f00242b5700 1 -- 172.21.15.38:0/4101262830 wait complete. 2023-12-16T20:16:49.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:16:49.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T20:16:49.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: failed to encode map e63 with expected crc 2023-12-16T20:16:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: osdmap e63: 6 total, 6 up, 6 in 2023-12-16T20:16:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: failed to encode map e63 with expected crc 2023-12-16T20:16:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: failed to encode map e63 with expected crc 2023-12-16T20:16:49.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:48 smithi141 ceph-mon[137587]: failed to encode map e63 with expected crc 2023-12-16T20:16:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 -- 172.21.15.38:0/1836427089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 msgr2=0x7f70800fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 --2- 172.21.15.38:0/1836427089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f70800fcc10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7074004940 tx=0x7f7074009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 -- 172.21.15.38:0/1836427089 shutdown_connections 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 --2- 172.21.15.38:0/1836427089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f70800fcc10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 --2- 172.21.15.38:0/1836427089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 0x7f7080102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 -- 172.21.15.38:0/1836427089 >> 172.21.15.38:0/1836427089 conn(0x7f70800f8790 msgr2=0x7f70800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 -- 172.21.15.38:0/1836427089 shutdown_connections 2023-12-16T20:16:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.341+0000 7f7085779700 1 -- 172.21.15.38:0/1836427089 wait complete. 2023-12-16T20:16:49.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 Processor -- start 2023-12-16T20:16:49.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 -- start start 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 0x7f70801135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080114140 con 0x7f70801035a0 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f7085779700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708010d470 con 0x7f7080102c00 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f707e7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f707e7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42778/0 (socket says 172.21.15.38:42778) 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f707e7fc700 1 -- 172.21.15.38:0/10127520 learned_addr learned my addr 172.21.15.38:0/10127520 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.342+0000 7f707effd700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 0x7f70801135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f707e7fc700 1 -- 172.21.15.38:0/10127520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 msgr2=0x7f70801135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f707e7fc700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 0x7f70801135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f707e7fc700 1 -- 172.21.15.38:0/10127520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074005040 con 0x7f70801035a0 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f707e7fc700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7074009380 tx=0x7f7074009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f707400e040 con 0x7f70801035a0 2023-12-16T20:16:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708010d6f0 con 0x7f70801035a0 2023-12-16T20:16:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7074013420 con 0x7f70801035a0 2023-12-16T20:16:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f707401c630 con 0x7f70801035a0 2023-12-16T20:16:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.343+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708010dc30 con 0x7f70801035a0 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.344+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70801050d0 con 0x7f70801035a0 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.345+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7074013590 con 0x7f70801035a0 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.345+0000 7f70677fe700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 0x7f706806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.345+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f707408d510 con 0x7f70801035a0 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.345+0000 7f707effd700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 0x7f706806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.345+0000 7f707effd700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 0x7f706806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7070009fd0 tx=0x7f707000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.350+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f707405af00 con 0x7f70801035a0 2023-12-16T20:16:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.564+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f708004bb80 con 0x7f706806ce60 2023-12-16T20:16:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.574+0000 7f70677fe700 1 -- 172.21.15.38:0/10127520 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f708004bb80 con 0x7f706806ce60 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (3m) 5s ago 10m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (83s) 5s ago 10m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (80s) 78s ago 10m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (2m) 5s ago 10m 78.6M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (7m) 5s ago 7m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (7m) 5s ago 7m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (7m) 78s ago 7m 67.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (7m) 78s ago 7m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (4m) 5s ago 11m 493M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:16:49.577 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (3m) 78s ago 9m 440M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (2m) 5s ago 11m 47.2M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (108s) 78s ago 9m 33.7M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (3m) 5s ago 10m 16.7M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (3m) 78s ago 9m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (66s) 5s ago 9m 85.8M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (38s) 5s ago 9m 93.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (9s) 5s ago 8m 12.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 2407bc0d39ec 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (8m) 78s ago 8m 274M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 689a0c453e68 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (8m) 78s ago 8m 245M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (8m) 78s ago 8m 232M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:16:49.578 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 5s ago 10m 59.0M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:16:49.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 msgr2=0x7f706806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 0x7f706806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7070009fd0 tx=0x7f707000b040 comp rx=0 tx=0).stop 2023-12-16T20:16:49.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 msgr2=0x7f7080113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7074009380 tx=0x7f7074009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 shutdown_connections 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f706806ce60 0x7f706806f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7080102c00 0x7f70801135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 --2- 172.21.15.38:0/10127520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70801035a0 0x7f7080113af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.576+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 >> 172.21.15.38:0/10127520 conn(0x7f70800f8790 msgr2=0x7f70800fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.577+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 shutdown_connections 2023-12-16T20:16:49.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.577+0000 7f7085779700 1 -- 172.21.15.38:0/10127520 wait complete. 2023-12-16T20:16:49.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 -- 172.21.15.38:0/3939742654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 msgr2=0x7f4bc00fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/3939742654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fb630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4004940 tx=0x7f4bb4009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 -- 172.21.15.38:0/3939742654 shutdown_connections 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/3939742654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fb630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/3939742654 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 0x7f4bc0103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 -- 172.21.15.38:0/3939742654 >> 172.21.15.38:0/3939742654 conn(0x7f4bc00711a0 msgr2=0x7f4bc00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 -- 172.21.15.38:0/3939742654 shutdown_connections 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.680+0000 7f4bc4eda700 1 -- 172.21.15.38:0/3939742654 wait complete. 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 Processor -- start 2023-12-16T20:16:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 -- start start 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 0x7f4bc00fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00fcf00 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bc4eda700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00fd070 con 0x7f4bc0102c70 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42800/0 (socket says 172.21.15.38:42800) 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 -- 172.21.15.38:0/2473789628 learned_addr learned my addr 172.21.15.38:0/2473789628 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbdd9b700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 0x7f4bc00fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 -- 172.21.15.38:0/2473789628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 msgr2=0x7f4bc00fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 0x7f4bc00fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 -- 172.21.15.38:0/2473789628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4005040 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.681+0000 7f4bbe59c700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0002a50 tx=0x7f4bb00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.682+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb0007cc0 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.682+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bb000f040 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.682+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc0119870 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.682+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb0009540 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.682+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc0119d50 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.683+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc0105050 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.683+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f4bb00096c0 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.684+0000 7f4baeffd700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 0x7f4ba806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.684+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4bb008bfe0 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.684+0000 7f4bbdd9b700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 0x7f4ba806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.684+0000 7f4bbdd9b700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 0x7f4ba806f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b3b0 tx=0x7f4bb4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.688+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f4bb0055f40 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.976+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4bc00fd230 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.977+0000 7f4baeffd700 1 -- 172.21.15.38:0/2473789628 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f4bc00fd230 con 0x7f4bc00fb1e0 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 3, 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 3 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:49.980 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 7, 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 7 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:16:49.981 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 msgr2=0x7f4ba806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 0x7f4ba806f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b3b0 tx=0x7f4bb4009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 msgr2=0x7f4bc00fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0002a50 tx=0x7f4bb00046b0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 shutdown_connections 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f4ba806ce60 0x7f4ba806f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc00fb1e0 0x7f4bc00fc3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 --2- 172.21.15.38:0/2473789628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc0102c70 0x7f4bc00fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 >> 172.21.15.38:0/2473789628 conn(0x7f4bc00711a0 msgr2=0x7f4bc00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 shutdown_connections 2023-12-16T20:16:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:49.979+0000 7f4bc4eda700 1 -- 172.21.15.38:0/2473789628 wait complete. 2023-12-16T20:16:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 -- 172.21.15.38:0/677158415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548101af0 msgr2=0x7fb548101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 --2- 172.21.15.38:0/677158415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548101af0 0x7fb548101ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb538004940 tx=0x7fb538009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 -- 172.21.15.38:0/677158415 shutdown_connections 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 --2- 172.21.15.38:0/677158415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5480fbb30 0x7fb5480fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 --2- 172.21.15.38:0/677158415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548101af0 0x7fb548101ec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 -- 172.21.15.38:0/677158415 >> 172.21.15.38:0/677158415 conn(0x7fb5480f7690 msgr2=0x7fb5480f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 -- 172.21.15.38:0/677158415 shutdown_connections 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.084+0000 7fb54deaa700 1 -- 172.21.15.38:0/677158415 wait complete. 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 Processor -- start 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 -- start start 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb548101af0 0x7fb548113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54810d4f0 con 0x7fb5480fbb30 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb54deaa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54810d660 con 0x7fb548101af0 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb5477fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb5477fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42828/0 (socket says 172.21.15.38:42828) 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.085+0000 7fb5477fe700 1 -- 172.21.15.38:0/95381530 learned_addr learned my addr 172.21.15.38:0/95381530 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb53effd700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb548101af0 0x7fb548113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb5477fe700 1 -- 172.21.15.38:0/95381530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb548101af0 msgr2=0x7fb548113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb5477fe700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb548101af0 0x7fb548113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb5477fe700 1 -- 172.21.15.38:0/95381530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538005040 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb5477fe700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb538009360 tx=0x7fb538009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53800e040 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb53800bc50 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53801c630 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54810d8e0 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.086+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54810de20 con 0x7fb5480fbb30 2023-12-16T20:16:50.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.087+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5480647b0 con 0x7fb5480fbb30 2023-12-16T20:16:50.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.088+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb538013420 con 0x7fb5480fbb30 2023-12-16T20:16:50.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.088+0000 7fb544ff9700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 0x7fb53406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.088+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb53808d5d0 con 0x7fb5480fbb30 2023-12-16T20:16:50.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.088+0000 7fb53effd700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 0x7fb53406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.089+0000 7fb53effd700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 0x7fb53406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb530006fd0 tx=0x7fb530008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.093+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb53805afc0 con 0x7fb5480fbb30 2023-12-16T20:16:50.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:49 smithi038 ceph-mon[163993]: pgmap v77: 65 pgs: 11 active+undersized+degraded, 13 active+undersized, 41 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/360 objects degraded (11.389%) 2023-12-16T20:16:50.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:49 smithi038 ceph-mon[163993]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:50.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:49 smithi141 ceph-mon[137587]: pgmap v77: 65 pgs: 11 active+undersized+degraded, 13 active+undersized, 41 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/360 objects degraded (11.389%) 2023-12-16T20:16:50.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:49 smithi141 ceph-mon[137587]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:50.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.345+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb54810ec10 con 0x7fb5480fbb30 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.346+0000 7fb544ff9700 1 -- 172.21.15.38:0/95381530 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1864 (secure 0 0 0) 0x7fb53805ab50 con 0x7fb5480fbb30 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:e23 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:16:50.348 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 23 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:16:12.868692+0000 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:16:50.349 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:50.350 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 msgr2=0x7fb53406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 0x7fb53406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb530006fd0 tx=0x7fb530008040 comp rx=0 tx=0).stop 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 msgr2=0x7fb548113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb538009360 tx=0x7fb538009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 shutdown_connections 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb53406ce70 0x7fb53406f320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5480fbb30 0x7fb548113630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 --2- 172.21.15.38:0/95381530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb548101af0 0x7fb548113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 >> 172.21.15.38:0/95381530 conn(0x7fb5480f7690 msgr2=0x7fb548065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 shutdown_connections 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.349+0000 7fb54deaa700 1 -- 172.21.15.38:0/95381530 wait complete. 2023-12-16T20:16:50.352 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 -- 172.21.15.38:0/3163077683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fdc40 msgr2=0x7fb9180fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 --2- 172.21.15.38:0/3163077683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fdc40 0x7fb9180fe010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb908004940 tx=0x7fb908009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 -- 172.21.15.38:0/3163077683 shutdown_connections 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 --2- 172.21.15.38:0/3163077683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fe5e0 0x7fb918106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 --2- 172.21.15.38:0/3163077683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fdc40 0x7fb9180fe010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 -- 172.21.15.38:0/3163077683 >> 172.21.15.38:0/3163077683 conn(0x7fb9180f76c0 msgr2=0x7fb9180f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 -- 172.21.15.38:0/3163077683 shutdown_connections 2023-12-16T20:16:50.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.455+0000 7fb91d828700 1 -- 172.21.15.38:0/3163077683 wait complete. 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 Processor -- start 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 -- start start 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fdc40 0x7fb9180fbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180fc640 con 0x7fb9180fe5e0 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.456+0000 7fb91d828700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180fc7b0 con 0x7fb9180fdc40 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42848/0 (socket says 172.21.15.38:42848) 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 -- 172.21.15.38:0/2700465507 learned_addr learned my addr 172.21.15.38:0/2700465507 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb916ffd700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fdc40 0x7fb9180fbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 -- 172.21.15.38:0/2700465507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fdc40 msgr2=0x7fb9180fbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fdc40 0x7fb9180fbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 -- 172.21.15.38:0/2700465507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb908005040 con 0x7fb9180fe5e0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb9167fc700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb900002a80 tx=0x7fb9000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb900007cc0 con 0x7fb9180fe5e0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb90000f040 con 0x7fb9180fe5e0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918119890 con 0x7fb9180fe5e0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb900009640 con 0x7fb9180fe5e0 2023-12-16T20:16:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.457+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918119d70 con 0x7fb9180fe5e0 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.458+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918104370 con 0x7fb9180fe5e0 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.459+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb9000097a0 con 0x7fb9180fe5e0 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.459+0000 7fb90f7fe700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 0x7fb90406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.459+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb90008ba90 con 0x7fb9180fe5e0 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.459+0000 7fb916ffd700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 0x7fb90406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.460+0000 7fb916ffd700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 0x7fb90406f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb90800b3b0 tx=0x7fb908009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.464+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb900055970 con 0x7fb9180fe5e0 2023-12-16T20:16:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.687+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb91804bbd0 con 0x7fb90406ce60 2023-12-16T20:16:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.688+0000 7fb90f7fe700 1 -- 172.21.15.38:0/2700465507 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb91804bbd0 con 0x7fb90406ce60 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:16:50.691 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:16:50.692 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "9/21 daemons upgraded", 2023-12-16T20:16:50.692 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T20:16:50.692 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:16:50.692 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.690+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 msgr2=0x7fb90406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.690+0000 7fb91d828700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 0x7fb90406f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb90800b3b0 tx=0x7fb908009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.690+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 msgr2=0x7fb9180fc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.690+0000 7fb91d828700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb900002a80 tx=0x7fb9000046b0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.690+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 shutdown_connections 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fb90406ce60 0x7fb90406f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9180fdc40 0x7fb9180fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 --2- 172.21.15.38:0/2700465507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180fe5e0 0x7fb9180fc040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 >> 172.21.15.38:0/2700465507 conn(0x7fb9180f76c0 msgr2=0x7fb9181014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:50.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 shutdown_connections 2023-12-16T20:16:50.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.691+0000 7fb91d828700 1 -- 172.21.15.38:0/2700465507 wait complete. 2023-12-16T20:16:50.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 -- 172.21.15.38:0/620965412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 msgr2=0x7f6e1c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 --2- 172.21.15.38:0/620965412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c106c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e04004940 tx=0x7f6e04009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:50.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 -- 172.21.15.38:0/620965412 shutdown_connections 2023-12-16T20:16:50.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 --2- 172.21.15.38:0/620965412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c106c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 --2- 172.21.15.38:0/620965412 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 0x7f6e1c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 -- 172.21.15.38:0/620965412 >> 172.21.15.38:0/620965412 conn(0x7f6e1c0f76c0 msgr2=0x7f6e1c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:50.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 -- 172.21.15.38:0/620965412 shutdown_connections 2023-12-16T20:16:50.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 -- 172.21.15.38:0/620965412 wait complete. 2023-12-16T20:16:50.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.795+0000 7f6e217ca700 1 Processor -- start 2023-12-16T20:16:50.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e217ca700 1 -- start start 2023-12-16T20:16:50.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e217ca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 0x7f6e1c0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e217ca700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e217ca700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0fc5e0 con 0x7f6e1c0fe610 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e217ca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0fc750 con 0x7f6e1c0fdc70 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39234/0 (socket says 172.21.15.38:39234) 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 -- 172.21.15.38:0/2477713779 learned_addr learned my addr 172.21.15.38:0/2477713779 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1affd700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 0x7f6e1c0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 -- 172.21.15.38:0/2477713779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 msgr2=0x7f6e1c0fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 0x7f6e1c0fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 -- 172.21.15.38:0/2477713779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04005040 con 0x7f6e1c0fe610 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.796+0000 7f6e1a7fc700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400b3b0 tx=0x7f6e04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.797+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0400e040 con 0x7f6e1c0fe610 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.797+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e04004290 con 0x7f6e1c0fe610 2023-12-16T20:16:50.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.797+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c1198e0 con 0x7f6e1c0fe610 2023-12-16T20:16:50.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.797+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0401c3f0 con 0x7f6e1c0fe610 2023-12-16T20:16:50.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.797+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c119dc0 con 0x7f6e1c0fe610 2023-12-16T20:16:50.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.798+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c104260 con 0x7f6e1c0fe610 2023-12-16T20:16:50.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.798+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6e04013820 con 0x7f6e1c0fe610 2023-12-16T20:16:50.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.799+0000 7f6e137fe700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 0x7f6e0806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:16:50.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.799+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6e0408d620 con 0x7f6e1c0fe610 2023-12-16T20:16:50.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.799+0000 7f6e1affd700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 0x7f6e0806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:16:50.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.799+0000 7f6e1affd700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 0x7f6e0806f310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c004550 tx=0x7f6e0c007ed0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:16:50.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:50.803+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6e04057580 con 0x7f6e1c0fe610 2023-12-16T20:16:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.088+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6e1c0fb2c0 con 0x7f6e1c0fe610 2023-12-16T20:16:51.093 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2473789628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:51.094 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:50 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/95381530' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:16:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.089+0000 7f6e137fe700 1 -- 172.21.15.38:0/2477713779 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+681 (secure 0 0 0) 0x7f6e0405aba0 con 0x7f6e1c0fe610 2023-12-16T20:16:51.094 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_WARN Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2023-12-16T20:16:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 msgr2=0x7f6e0806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 0x7f6e0806f310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c004550 tx=0x7f6e0c007ed0 comp rx=0 tx=0).stop 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 msgr2=0x7f6e1c0fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400b3b0 tx=0x7f6e04009e30 comp rx=0 tx=0).stop 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 shutdown_connections 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f6e0806ce60 0x7f6e0806f310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:51.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e1c0fdc70 0x7f6e1c0fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:51.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 --2- 172.21.15.38:0/2477713779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c0fe610 0x7f6e1c0fbfe0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:16:51.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 >> 172.21.15.38:0/2477713779 conn(0x7f6e1c0f76c0 msgr2=0x7f6e1c1013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:16:51.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 shutdown_connections 2023-12-16T20:16:51.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:16:51.092+0000 7f6e217ca700 1 -- 172.21.15.38:0/2477713779 wait complete. 2023-12-16T20:16:51.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2473789628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:16:51.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:50 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/95381530' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:16:52.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:51 smithi141 ceph-mon[137587]: pgmap v78: 65 pgs: 9 active+undersized+degraded, 10 active+undersized, 46 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 31/360 objects degraded (8.611%) 2023-12-16T20:16:52.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:51 smithi141 ceph-mon[137587]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:52.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:51 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2477713779' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:16:52.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:51 smithi038 ceph-mon[163993]: pgmap v78: 65 pgs: 9 active+undersized+degraded, 10 active+undersized, 46 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 31/360 objects degraded (8.611%) 2023-12-16T20:16:52.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:51 smithi038 ceph-mon[163993]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:16:52.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:51 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2477713779' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:16:53.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:52 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:53.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:52 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T20:16:54.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:53 smithi141 ceph-mon[137587]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 6 op/s 2023-12-16T20:16:54.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:53 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded) 2023-12-16T20:16:54.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:53 smithi141 ceph-mon[137587]: Cluster is now healthy 2023-12-16T20:16:54.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:53 smithi038 ceph-mon[163993]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 6 op/s 2023-12-16T20:16:54.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:53 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/360 objects degraded (8.611%), 9 pgs degraded) 2023-12-16T20:16:54.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:53 smithi038 ceph-mon[163993]: Cluster is now healthy 2023-12-16T20:16:56.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:55 smithi141 ceph-mon[137587]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T20:16:56.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:55 smithi038 ceph-mon[163993]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T20:16:58.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:57 smithi141 ceph-mon[137587]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T20:16:58.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:57 smithi038 ceph-mon[163993]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T20:17:00.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:16:59 smithi038 ceph-mon[163993]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:17:00.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:16:59 smithi141 ceph-mon[137587]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T20:17:01.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:01 smithi038 ceph-mon[163993]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:01.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:01 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:01.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:01 smithi141 ceph-mon[137587]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:01.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:01 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:03.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:03 smithi038 ceph-mon[163993]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:17:03.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:03 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:17:03.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:03 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:17:03.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:03 smithi038 ceph-mon[163993]: Upgrade: osd.3 is safe to restart 2023-12-16T20:17:03.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:03 smithi141 ceph-mon[137587]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:17:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:03 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:17:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:03 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T20:17:03.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:03 smithi141 ceph-mon[137587]: Upgrade: osd.3 is safe to restart 2023-12-16T20:17:04.400 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:04 smithi141 ceph-mon[137587]: Upgrade: Updating osd.3 2023-12-16T20:17:04.400 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:04 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:04.400 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:04 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:17:04.400 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:04 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:04.400 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:04 smithi141 ceph-mon[137587]: Deploying daemon osd.3 on smithi141 2023-12-16T20:17:04.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:04 smithi038 ceph-mon[163993]: Upgrade: Updating osd.3 2023-12-16T20:17:04.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:04 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:04.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:04 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T20:17:04.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:04 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:04.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:04 smithi038 ceph-mon[163993]: Deploying daemon osd.3 on smithi141 2023-12-16T20:17:05.486 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:05 smithi141 systemd[1]: Stopping Ceph osd.3 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:17:05.486 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-mon[137587]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:05.486 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:05.486 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:05.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:05 smithi038 ceph-mon[163993]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:05.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:05.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:05.745 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:17:05.484+0000 7f2aaa552700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:17:05.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:17:05.484+0000 7f2aaa552700 -1 osd.3 63 *** Got signal Terminated *** 2023-12-16T20:17:05.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[93656]: 2023-12-16T20:17:05.484+0000 7f2aaa552700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:17:06.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:06 smithi038 ceph-mon[163993]: osd.3 marked itself down and dead 2023-12-16T20:17:06.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:06 smithi141 ceph-mon[137587]: osd.3 marked itself down and dead 2023-12-16T20:17:07.116 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:06 smithi141 podman[146180]: 2023-12-16 20:17:06.864836635 +0000 UTC m=+1.438873503 container died 689a0c453e682c54212ba0c18b0e823d4d2f65e9034a3effa1552d1938afbf25 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=quincy-1f2f551, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:17:07.116 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:06 smithi141 podman[146180]: 2023-12-16 20:17:06.990620114 +0000 UTC m=+1.564656957 container cleanup 689a0c453e682c54212ba0c18b0e823d4d2f65e9034a3effa1552d1938afbf25 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-1f2f551, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2023-12-16T20:17:07.116 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:06 smithi141 bash[146180]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3 2023-12-16T20:17:07.116 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146198]: 2023-12-16 20:17:07.115550189 +0000 UTC m=+0.245031069 container remove 689a0c453e682c54212ba0c18b0e823d4d2f65e9034a3effa1552d1938afbf25 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, org.label-schema.license=GPLv2, RELEASE=quincy-1f2f551, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:17:07.416 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:07 smithi141 ceph-mon[137587]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:17:07.416 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:07 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:17:07.416 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:07 smithi141 ceph-mon[137587]: failed to encode map e64 with expected crc 2023-12-16T20:17:07.416 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:07 smithi141 ceph-mon[137587]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T20:17:07.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:07 smithi038 ceph-mon[163993]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:17:07.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:07 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:17:07.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:07 smithi038 ceph-mon[163993]: failed to encode map e64 with expected crc 2023-12-16T20:17:07.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:07 smithi038 ceph-mon[163993]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T20:17:07.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.415501204 +0000 UTC m=+0.064461249 container create 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20231212) 2023-12-16T20:17:07.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.370639014 +0000 UTC m=+0.019599041 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:07.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.490856008 +0000 UTC m=+0.139816019 container init 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=) 2023-12-16T20:17:07.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.494185394 +0000 UTC m=+0.143145389 container start 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:17:07.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.548777322 +0000 UTC m=+0.197737338 container attach 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:07 smithi141 podman[146287]: 2023-12-16 20:17:07.793697044 +0000 UTC m=+0.442657056 container died 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146313]: 2023-12-16 20:17:08.00709387 +0000 UTC m=+0.208395364 container remove 1bd7c48c81ea21951786d0c99218a55a3441503297b2268f50e06f3cd3643c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3) 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.3.service: Deactivated successfully. 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 systemd[1]: Stopped Ceph osd.3 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.3.service: Consumed 1min 9.287s CPU time. 2023-12-16T20:17:08.198 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 systemd[1]: Starting Ceph osd.3 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:17:08.467 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.365322824 +0000 UTC m=+0.065907698 container create 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2023-12-16T20:17:08.467 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.317139289 +0000 UTC m=+0.017724137 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:08.467 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.432337686 +0000 UTC m=+0.132922532 container init 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2023-12-16T20:17:08.467 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.437174577 +0000 UTC m=+0.137759411 container start 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2023-12-16T20:17:08.467 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-mon[137587]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.467 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-mon[137587]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T20:17:08.468 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-mon[137587]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.468 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-mon[137587]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.468 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-mon[137587]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:08 smithi038 ceph-mon[163993]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:08 smithi038 ceph-mon[163993]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T20:17:08.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:08 smithi038 ceph-mon[163993]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:08 smithi038 ceph-mon[163993]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:08 smithi038 ceph-mon[163993]: failed to encode map e65 with expected crc 2023-12-16T20:17:08.745 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.465234344 +0000 UTC m=+0.165819183 container attach 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 bash[146415]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T20:17:09.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T20:17:09.247 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-16T20:17:09.247 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T20:17:09.247 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate[146430]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-16T20:17:09.247 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:08 smithi141 podman[146415]: 2023-12-16 20:17:08.902705909 +0000 UTC m=+0.603290757 container died 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2023-12-16T20:17:09.247 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 podman[146565]: 2023-12-16 20:17:09.123522771 +0000 UTC m=+0.211781339 container remove 8613abe6302d3b3dd08861aabc00233630ca81ec0550266829614a76153689c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212) 2023-12-16T20:17:09.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:09 smithi038 ceph-mon[163993]: pgmap v89: 65 pgs: 6 active+undersized+degraded, 14 stale+active+clean, 3 active+undersized, 42 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/360 objects degraded (5.556%) 2023-12-16T20:17:09.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:09 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 20/360 objects degraded (5.556%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:09.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:09 smithi141 ceph-mon[137587]: pgmap v89: 65 pgs: 6 active+undersized+degraded, 14 stale+active+clean, 3 active+undersized, 42 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/360 objects degraded (5.556%) 2023-12-16T20:17:09.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:09 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 20/360 objects degraded (5.556%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 podman[146629]: 2023-12-16 20:17:09.291699598 +0000 UTC m=+0.074114215 container create f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 podman[146629]: 2023-12-16 20:17:09.235612637 +0000 UTC m=+0.018027264 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 podman[146629]: 2023-12-16 20:17:09.395815154 +0000 UTC m=+0.178229774 container init f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 podman[146629]: 2023-12-16 20:17:09.39893404 +0000 UTC m=+0.181348649 container start f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, ceph=True) 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 ceph-osd[146647]: -- 172.21.15.141:0/1339819557 <== mon.1 v2:172.21.15.141:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ddc07d6c0 con 0x564ddc04ec00 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 bash[146629]: f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc 2023-12-16T20:17:09.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 systemd[1]: Started Ceph osd.3 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:17:10.245 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:09 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:17:09.940+0000 7f05c8af2640 -1 Falling back to public interface 2023-12-16T20:17:10.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:10 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:10 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:10 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:10 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:10 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:10 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:10 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:10 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:10.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:10 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:10.787 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:10 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:11.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:11 smithi141 ceph-mon[137587]: pgmap v90: 65 pgs: 9 active+undersized+degraded, 11 stale+active+clean, 7 active+undersized, 38 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2023-12-16T20:17:11.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:11 smithi038 ceph-mon[163993]: pgmap v90: 65 pgs: 9 active+undersized+degraded, 11 stale+active+clean, 7 active+undersized, 38 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2023-12-16T20:17:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:13.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:13.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:13.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:13 smithi141 ceph-mon[137587]: pgmap v91: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:14.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:13 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:14.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:13 smithi038 ceph-mon[163993]: pgmap v91: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:14.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:14.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:13 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:14.995 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:14 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:17:14.532+0000 7f05c8af2640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-16T20:17:15.297 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:17:15.114+0000 7f05c8af2640 -1 osd.3 63 log_to_monitors true 2023-12-16T20:17:16.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:17:16 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:17:16.009+0000 7f05b8f61700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:17:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: pgmap v92: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:17:16.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.247 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:15 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: pgmap v92: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:16.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:15 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:17.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: from='osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: osdmap e66: 6 total, 5 up, 6 in 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: failed to encode map e66 with expected crc 2023-12-16T20:17:17.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:17 smithi038 ceph-mon[163993]: failed to encode map e66 with expected crc 2023-12-16T20:17:17.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: from='osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: osdmap e66: 6 total, 5 up, 6 in 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: failed to encode map e66 with expected crc 2023-12-16T20:17:17.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:17 smithi141 ceph-mon[137587]: failed to encode map e66 with expected crc 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: pgmap v94: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: failed to encode map e67 with expected crc 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003] boot 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:17:18.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:18 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 72/360 objects degraded (20.000%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:18.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: pgmap v94: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 72/360 objects degraded (20.000%) 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: failed to encode map e67 with expected crc 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: osd.3 [v2:172.21.15.141:6800/2635655003,v1:172.21.15.141:6801/2635655003] boot 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T20:17:18.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:18 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 72/360 objects degraded (20.000%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:19.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: osdmap e68: 6 total, 6 up, 6 in 2023-12-16T20:17:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:19 smithi038 ceph-mon[163993]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: osdmap e68: 6 total, 6 up, 6 in 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: failed to encode map e68 with expected crc 2023-12-16T20:17:19.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:19 smithi141 ceph-mon[137587]: failed to encode map e68 with expected crc 2023-12-16T20:17:20.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:20 smithi038 ceph-mon[163993]: pgmap v97: 65 pgs: 7 peering, 15 active+undersized+degraded, 16 active+undersized, 27 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/360 objects degraded (16.667%) 2023-12-16T20:17:20.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:20 smithi141 ceph-mon[137587]: pgmap v97: 65 pgs: 7 peering, 15 active+undersized+degraded, 16 active+undersized, 27 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/360 objects degraded (16.667%) 2023-12-16T20:17:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:21 smithi038 ceph-mon[163993]: pgmap v98: 65 pgs: 7 peering, 14 active+undersized+degraded, 13 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 57/360 objects degraded (15.833%) 2023-12-16T20:17:21.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:21.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:21 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.211+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2073012198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 msgr2=0x7f7f300fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.211+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2073012198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f300fb630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f24004940 tx=0x7f7f24009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.211+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2073012198 shutdown_connections 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.211+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2073012198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f300fb630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.211+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2073012198 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 0x7f7f30103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.212+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2073012198 >> 172.21.15.38:0/2073012198 conn(0x7f7f300711a0 msgr2=0x7f7f300715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.212+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2073012198 shutdown_connections 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.212+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2073012198 wait complete. 2023-12-16T20:17:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.212+0000 7f7f36bb0700 1 Processor -- start 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.212+0000 7f7f36bb0700 1 -- start start 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f36bb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f36bb0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 0x7f7f30113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f36bb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30114200 con 0x7f7f300fb1e0 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f36bb0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3010d4a0 con 0x7f7f30102c70 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55714/0 (socket says 172.21.15.38:55714) 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 -- 172.21.15.38:0/2588897852 learned_addr learned my addr 172.21.15.38:0/2588897852 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f2ffff700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 0x7f7f30113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 -- 172.21.15.38:0/2588897852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 msgr2=0x7f7f30113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 0x7f7f30113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 -- 172.21.15.38:0/2588897852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24005040 con 0x7f7f300fb1e0 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f3494c700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b790 tx=0x7f7f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f2000f6f0 con 0x7f7f300fb1e0 2023-12-16T20:17:21.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f2000fd00 con 0x7f7f300fb1e0 2023-12-16T20:17:21.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.213+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f200103a0 con 0x7f7f300fb1e0 2023-12-16T20:17:21.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.214+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3010d780 con 0x7f7f300fb1e0 2023-12-16T20:17:21.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.214+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3010dc40 con 0x7f7f300fb1e0 2023-12-16T20:17:21.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.215+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f30072cc0 con 0x7f7f300fb1e0 2023-12-16T20:17:21.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.215+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7f2000f850 con 0x7f7f300fb1e0 2023-12-16T20:17:21.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.216+0000 7f7f2d7fa700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 0x7f7f1806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.216+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7f2008c150 con 0x7f7f300fb1e0 2023-12-16T20:17:21.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.216+0000 7f7f2ffff700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 0x7f7f1806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.216+0000 7f7f2ffff700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 0x7f7f1806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f3010e7d0 tx=0x7f7f24009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.221+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7f20059b40 con 0x7f7f300fb1e0 2023-12-16T20:17:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.442+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f3010ecd0 con 0x7f7f1806ce60 2023-12-16T20:17:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.443+0000 7f7f2d7fa700 1 -- 172.21.15.38:0/2588897852 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7f3010ecd0 con 0x7f7f1806ce60 2023-12-16T20:17:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.445+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 msgr2=0x7f7f1806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.445+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 0x7f7f1806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f3010e7d0 tx=0x7f7f24009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.445+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 msgr2=0x7f7f301135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.445+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b790 tx=0x7f7f20009250 comp rx=0 tx=0).stop 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 shutdown_connections 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f7f1806ce60 0x7f7f1806f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f300fb1e0 0x7f7f301135e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 --2- 172.21.15.38:0/2588897852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f30102c70 0x7f7f30113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 >> 172.21.15.38:0/2588897852 conn(0x7f7f300711a0 msgr2=0x7f7f300fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:21.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 shutdown_connections 2023-12-16T20:17:21.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.446+0000 7f7f36bb0700 1 -- 172.21.15.38:0/2588897852 wait complete. 2023-12-16T20:17:21.458 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:17:21.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:21 smithi141 ceph-mon[137587]: pgmap v98: 65 pgs: 7 peering, 14 active+undersized+degraded, 13 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 57/360 objects degraded (15.833%) 2023-12-16T20:17:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:21.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:21 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:21.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.551+0000 7f071066c700 1 -- 172.21.15.38:0/1374654290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fdc00 msgr2=0x7f07080fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.551+0000 7f071066c700 1 --2- 172.21.15.38:0/1374654290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fdc00 0x7f07080fdfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0704004940 tx=0x7f0704009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- 172.21.15.38:0/1374654290 shutdown_connections 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 --2- 172.21.15.38:0/1374654290 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fe5a0 0x7f0708106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 --2- 172.21.15.38:0/1374654290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fdc00 0x7f07080fdfd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- 172.21.15.38:0/1374654290 >> 172.21.15.38:0/1374654290 conn(0x7f07080f76c0 msgr2=0x7f07080f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- 172.21.15.38:0/1374654290 shutdown_connections 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- 172.21.15.38:0/1374654290 wait complete. 2023-12-16T20:17:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 Processor -- start 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- start start 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fdc00 0x7f07080fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080fc690 con 0x7f07080fe5a0 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.552+0000 7f071066c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080fc800 con 0x7f07080fdc00 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55720/0 (socket says 172.21.15.38:55720) 2023-12-16T20:17:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 -- 172.21.15.38:0/410220917 learned_addr learned my addr 172.21.15.38:0/410220917 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070e408700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fdc00 0x7f07080fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 -- 172.21.15.38:0/410220917 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fdc00 msgr2=0x7f07080fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fdc00 0x7f07080fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 -- 172.21.15.38:0/410220917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704005040 con 0x7f07080fe5a0 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f070dc07700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06f800b790 tx=0x7f06f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f800f6f0 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06f800fd00 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708119910 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.553+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f80103a0 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.554+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0708119e00 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.554+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07081042d0 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.555+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f06f800f850 con 0x7f07080fe5a0 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.556+0000 7f06feffd700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 0x7f06f406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.556+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f06f808c0b0 con 0x7f07080fe5a0 2023-12-16T20:17:21.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.556+0000 7f070e408700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 0x7f06f406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.556+0000 7f070e408700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 0x7f06f406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0704004560 tx=0x7f0704009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.560+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f06f8056010 con 0x7f07080fe5a0 2023-12-16T20:17:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.780+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f070804bbf0 con 0x7f06f406ce60 2023-12-16T20:17:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.782+0000 7f06feffd700 1 -- 172.21.15.38:0/410220917 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f070804bbf0 con 0x7f06f406ce60 2023-12-16T20:17:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 msgr2=0x7f06f406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 0x7f06f406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0704004560 tx=0x7f0704009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 msgr2=0x7f07080fc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06f800b790 tx=0x7f06f8009250 comp rx=0 tx=0).stop 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 shutdown_connections 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f06f406ce60 0x7f06f406f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07080fdc00 0x7f07080fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 --2- 172.21.15.38:0/410220917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07080fe5a0 0x7f07080fc000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 >> 172.21.15.38:0/410220917 conn(0x7f07080f76c0 msgr2=0x7f0708101450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 shutdown_connections 2023-12-16T20:17:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.784+0000 7f071066c700 1 -- 172.21.15.38:0/410220917 wait complete. 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 -- 172.21.15.38:0/438000250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 msgr2=0x7f623c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 --2- 172.21.15.38:0/438000250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c0fbfb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6238004940 tx=0x7f6238009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 -- 172.21.15.38:0/438000250 shutdown_connections 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 --2- 172.21.15.38:0/438000250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c0fbfb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 --2- 172.21.15.38:0/438000250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f623c101b00 0x7f623c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.889+0000 7f62434d9700 1 -- 172.21.15.38:0/438000250 >> 172.21.15.38:0/438000250 conn(0x7f623c0f76c0 msgr2=0x7f623c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.890+0000 7f62434d9700 1 -- 172.21.15.38:0/438000250 shutdown_connections 2023-12-16T20:17:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.890+0000 7f62434d9700 1 -- 172.21.15.38:0/438000250 wait complete. 2023-12-16T20:17:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.890+0000 7f62434d9700 1 Processor -- start 2023-12-16T20:17:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.890+0000 7f62434d9700 1 -- start start 2023-12-16T20:17:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f62434d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f62434d9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f623c101b00 0x7f623c112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f62434d9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c113190 con 0x7f623c0fbb40 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f62434d9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c10c430 con 0x7f623c101b00 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55734/0 (socket says 172.21.15.38:55734) 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 -- 172.21.15.38:0/3246017020 learned_addr learned my addr 172.21.15.38:0/3246017020 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 -- 172.21.15.38:0/3246017020 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f623c101b00 msgr2=0x7f623c112ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f623c101b00 0x7f623c112ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 -- 172.21.15.38:0/3246017020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238005040 con 0x7f623c0fbb40 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f6241275700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f623000daf0 tx=0x7f623000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f623000ed80 con 0x7f623c0fbb40 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6230017920 con 0x7f623c0fbb40 2023-12-16T20:17:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c10c6b0 con 0x7f623c0fbb40 2023-12-16T20:17:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.891+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6230016950 con 0x7f623c0fbb40 2023-12-16T20:17:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.892+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c10cbf0 con 0x7f623c0fbb40 2023-12-16T20:17:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.893+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c0fb2c0 con 0x7f623c0fbb40 2023-12-16T20:17:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.893+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6230014070 con 0x7f623c0fbb40 2023-12-16T20:17:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.893+0000 7f622dffb700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 0x7f622806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.894+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f623008e3e0 con 0x7f623c0fbb40 2023-12-16T20:17:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.894+0000 7f6240a74700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 0x7f622806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.894+0000 7f6240a74700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 0x7f622806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f623800b3b0 tx=0x7f6238009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:21.898+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f623005be70 con 0x7f623c0fbb40 2023-12-16T20:17:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.110+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f623c10dca0 con 0x7f622806ce60 2023-12-16T20:17:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.122+0000 7f622dffb700 1 -- 172.21.15.38:0/3246017020 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f623c10dca0 con 0x7f622806ce60 2023-12-16T20:17:22.123 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:17:22.123 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (3m) 38s ago 11m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:17:22.123 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (116s) 38s ago 11m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:17:22.123 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (113s) 10s ago 10m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (3m) 38s ago 10m 78.6M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (7m) 38s ago 7m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (7m) 38s ago 7m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (7m) 10s ago 7m 67.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (7m) 10s ago 7m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (4m) 38s ago 12m 493M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (4m) 10s ago 10m 442M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (2m) 38s ago 12m 47.2M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (2m) 10s ago 10m 38.0M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (4m) 38s ago 11m 16.7M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (4m) 10s ago 10m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (99s) 38s ago 9m 85.8M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:17:22.124 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (70s) 38s ago 9m 93.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:17:22.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (41s) 38s ago 9m 12.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 2407bc0d39ec 2023-12-16T20:17:22.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (12s) 10s ago 9m 12.4M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 f3d2e940f234 2023-12-16T20:17:22.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (8m) 10s ago 8m 247M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 3c0d14ce2021 2023-12-16T20:17:22.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (8m) 10s ago 8m 232M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:17:22.125 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 38s ago 10m 59.0M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:17:22.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 msgr2=0x7f622806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 0x7f622806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f623800b3b0 tx=0x7f6238009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 msgr2=0x7f623c112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f623000daf0 tx=0x7f623000b4f0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 shutdown_connections 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f622806ce60 0x7f622806f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f623c0fbb40 0x7f623c112570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 --2- 172.21.15.38:0/3246017020 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f623c101b00 0x7f623c112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 >> 172.21.15.38:0/3246017020 conn(0x7f623c0f76c0 msgr2=0x7f623c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 shutdown_connections 2023-12-16T20:17:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.124+0000 7f62434d9700 1 -- 172.21.15.38:0/3246017020 wait complete. 2023-12-16T20:17:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:22 smithi038 ceph-mon[163993]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:22.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:22 smithi038 ceph-mon[163993]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/1301819303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 msgr2=0x7f1e740fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/1301819303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e740fbfb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e68004940 tx=0x7f1e68009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/1301819303 shutdown_connections 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/1301819303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e740fbfb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/1301819303 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 0x7f1e74101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/1301819303 >> 172.21.15.38:0/1301819303 conn(0x7f1e740719b0 msgr2=0x7f1e74071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/1301819303 shutdown_connections 2023-12-16T20:17:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.228+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/1301819303 wait complete. 2023-12-16T20:17:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 Processor -- start 2023-12-16T20:17:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 -- start start 2023-12-16T20:17:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 0x7f1e74112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74113120 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e7b1e6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7410c450 con 0x7f1e74101b00 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55754/0 (socket says 172.21.15.38:55754) 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 -- 172.21.15.38:0/2849657897 learned_addr learned my addr 172.21.15.38:0/2849657897 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e73fff700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 0x7f1e74112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 -- 172.21.15.38:0/2849657897 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 msgr2=0x7f1e74112ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 0x7f1e74112ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.229+0000 7f1e78f82700 1 -- 172.21.15.38:0/2849657897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68005040 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e78f82700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c810 tx=0x7f1e64004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e64012810 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e64012e20 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7410c730 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6400a370 con 0x7f1e740fbb40 2023-12-16T20:17:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.230+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7410cc70 con 0x7f1e740fbb40 2023-12-16T20:17:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.231+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74103fb0 con 0x7f1e740fbb40 2023-12-16T20:17:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.231+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1e64011780 con 0x7f1e740fbb40 2023-12-16T20:17:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.232+0000 7f1e717fa700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 0x7f1e5c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.232+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1e6408c6b0 con 0x7f1e740fbb40 2023-12-16T20:17:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.232+0000 7f1e73fff700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 0x7f1e5c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.232+0000 7f1e73fff700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 0x7f1e5c06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800b3b0 tx=0x7f1e68009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:22.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.236+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1e6405a0a0 con 0x7f1e740fbb40 2023-12-16T20:17:22.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:22 smithi141 ceph-mon[137587]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:22.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:22 smithi141 ceph-mon[137587]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.524+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e7404bbb0 con 0x7f1e740fbb40 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.525+0000 7f1e717fa700 1 -- 172.21.15.38:0/2849657897 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f1e64059c30 con 0x7f1e740fbb40 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:22.526 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2, 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 4 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6, 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 8 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:17:22.527 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 msgr2=0x7f1e5c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 0x7f1e5c06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800b3b0 tx=0x7f1e68009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 msgr2=0x7f1e74112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c810 tx=0x7f1e64004470 comp rx=0 tx=0).stop 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 shutdown_connections 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1e5c06ce60 0x7f1e5c06f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e740fbb40 0x7f1e74112590 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 --2- 172.21.15.38:0/2849657897 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e74101b00 0x7f1e74112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 >> 172.21.15.38:0/2849657897 conn(0x7f1e740719b0 msgr2=0x7f1e740faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 shutdown_connections 2023-12-16T20:17:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.527+0000 7f1e7b1e6700 1 -- 172.21.15.38:0/2849657897 wait complete. 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 -- 172.21.15.38:0/1984830641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 msgr2=0x7ff0f4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/1984830641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4101ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8004940 tx=0x7ff0e8009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 -- 172.21.15.38:0/1984830641 shutdown_connections 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/1984830641 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 0x7ff0f40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/1984830641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4101ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 -- 172.21.15.38:0/1984830641 >> 172.21.15.38:0/1984830641 conn(0x7ff0f40f76c0 msgr2=0x7ff0f40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 -- 172.21.15.38:0/1984830641 shutdown_connections 2023-12-16T20:17:22.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.631+0000 7ff0fb22e700 1 -- 172.21.15.38:0/1984830641 wait complete. 2023-12-16T20:17:22.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.632+0000 7ff0fb22e700 1 Processor -- start 2023-12-16T20:17:22.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.632+0000 7ff0fb22e700 1 -- start start 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.632+0000 7ff0fb22e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 0x7ff0f4115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0fb22e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0fb22e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f41164a0 con 0x7ff0f4101b00 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0fb22e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f410f7d0 con 0x7ff0f40fbb40 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55762/0 (socket says 172.21.15.38:55762) 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 -- 172.21.15.38:0/3712061562 learned_addr learned my addr 172.21.15.38:0/3712061562 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:22.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f8fca700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 0x7ff0f4115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 -- 172.21.15.38:0/3712061562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 msgr2=0x7ff0f4115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 0x7ff0f4115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 -- 172.21.15.38:0/3712061562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e8005040 con 0x7ff0f4101b00 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f3fff700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c830 tx=0x7ff0e0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e00106f0 con 0x7ff0f4101b00 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f410fab0 con 0x7ff0f4101b00 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0e0010d00 con 0x7ff0f4101b00 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e0012e90 con 0x7ff0f4101b00 2023-12-16T20:17:22.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.633+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f410fff0 con 0x7ff0f4101b00 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.634+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40fb2c0 con 0x7ff0f4101b00 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.635+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ff0e0010850 con 0x7ff0f4101b00 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.635+0000 7ff0f17fa700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 0x7ff0e406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.635+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff0e008c360 con 0x7ff0f4101b00 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.635+0000 7ff0f8fca700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 0x7ff0e406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.636+0000 7ff0f8fca700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 0x7ff0e406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800b3b0 tx=0x7ff0e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:22.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.640+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff0e0059cb0 con 0x7ff0f4101b00 2023-12-16T20:17:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.884+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff0f404bb80 con 0x7ff0f4101b00 2023-12-16T20:17:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.884+0000 7ff0f17fa700 1 -- 172.21.15.38:0/3712061562 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1864 (secure 0 0 0) 0x7ff0e0059840 con 0x7ff0f4101b00 2023-12-16T20:17:22.888 INFO:teuthology.orchestra.run.smithi038.stdout:e23 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 23 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:16:12.868692+0000 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:17:22.889 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:17:22.890 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:22.891 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.886+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 msgr2=0x7ff0e406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.886+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 0x7ff0e406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800b3b0 tx=0x7ff0e8009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.886+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 msgr2=0x7ff0f4115e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.886+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c830 tx=0x7ff0e0004470 comp rx=0 tx=0).stop 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 shutdown_connections 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff0e406ce70 0x7ff0e406f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f40fbb40 0x7ff0f4115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 --2- 172.21.15.38:0/3712061562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0f4101b00 0x7ff0f4115e50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 >> 172.21.15.38:0/3712061562 conn(0x7ff0f40f76c0 msgr2=0x7ff0f4065dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 shutdown_connections 2023-12-16T20:17:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.887+0000 7ff0fb22e700 1 -- 172.21.15.38:0/3712061562 wait complete. 2023-12-16T20:17:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-16T20:17:22.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.992+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/77142581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db4102c70 msgr2=0x7f0db4103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.992+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/77142581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db4102c70 0x7f0db4103040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0db0004940 tx=0x7f0db0009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.992+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/77142581 shutdown_connections 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.992+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/77142581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40fb1e0 0x7f0db40fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/77142581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db4102c70 0x7f0db4103040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/77142581 >> 172.21.15.38:0/77142581 conn(0x7f0db40711a0 msgr2=0x7f0db40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/77142581 shutdown_connections 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/77142581 wait complete. 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 Processor -- start 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- start start 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 0x7f0db4115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4116400 con 0x7f0db40fb1e0 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0dbc1f1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db410f730 con 0x7f0db4102c70 2023-12-16T20:17:22.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0db9f8d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0db9f8d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55782/0 (socket says 172.21.15.38:55782) 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.993+0000 7f0db9f8d700 1 -- 172.21.15.38:0/2561919946 learned_addr learned my addr 172.21.15.38:0/2561919946 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db978c700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 0x7f0db4115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db9f8d700 1 -- 172.21.15.38:0/2561919946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 msgr2=0x7f0db4115db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db9f8d700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 0x7f0db4115db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db9f8d700 1 -- 172.21.15.38:0/2561919946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0005040 con 0x7f0db40fb1e0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db978c700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 0x7f0db4115db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0db9f8d700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3b0 tx=0x7f0db0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db000e040 con 0x7f0db40fb1e0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0db000bc50 con 0x7f0db40fb1e0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db410f9b0 con 0x7f0db40fb1e0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db0013420 con 0x7f0db40fb1e0 2023-12-16T20:17:22.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.994+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db410fef0 con 0x7f0db40fb1e0 2023-12-16T20:17:22.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.995+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4072cc0 con 0x7f0db40fb1e0 2023-12-16T20:17:22.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.996+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0db001c430 con 0x7f0db40fb1e0 2023-12-16T20:17:22.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.996+0000 7f0daa7fc700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 0x7f0da006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:22.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.996+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0db008cfb0 con 0x7f0db40fb1e0 2023-12-16T20:17:22.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.996+0000 7f0db978c700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 0x7f0da006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:22.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:22.997+0000 7f0db978c700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 0x7f0da006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009fd0 tx=0x7f0da400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:23.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.001+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0db005aaf0 con 0x7f0db40fb1e0 2023-12-16T20:17:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: pgmap v99: 65 pgs: 7 peering, 58 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 3 op/s 2023-12-16T20:17:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/360 objects degraded (15.833%), 14 pgs degraded) 2023-12-16T20:17:23.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: Cluster is now healthy 2023-12-16T20:17:23.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:23.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2849657897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:23.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:23 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/3712061562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:17:23.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.221+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0db4110e50 con 0x7f0da006ce60 2023-12-16T20:17:23.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.222+0000 7f0daa7fc700 1 -- 172.21.15.38:0/2561919946 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0db4110e50 con 0x7f0da006ce60 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "10/21 daemons upgraded", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:17:23.224 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 msgr2=0x7f0da006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 0x7f0da006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009fd0 tx=0x7f0da400b040 comp rx=0 tx=0).stop 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 msgr2=0x7f0db4115870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3b0 tx=0x7f0db0009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 shutdown_connections 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f0da006ce60 0x7f0da006f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0db40fb1e0 0x7f0db4115870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 --2- 172.21.15.38:0/2561919946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db4102c70 0x7f0db4115db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 >> 172.21.15.38:0/2561919946 conn(0x7f0db40711a0 msgr2=0x7f0db40fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 shutdown_connections 2023-12-16T20:17:23.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.225+0000 7f0dbc1f1700 1 -- 172.21.15.38:0/2561919946 wait complete. 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1635840532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101c10 msgr2=0x7ff4f80fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1635840532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101c10 0x7ff4f80fb2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec004940 tx=0x7ff4ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1635840532 shutdown_connections 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1635840532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101c10 0x7ff4f80fb2d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1635840532 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101270 0x7ff4f8101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1635840532 >> 172.21.15.38:0/1635840532 conn(0x7ff4f80711a0 msgr2=0x7ff4f80715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1635840532 shutdown_connections 2023-12-16T20:17:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1635840532 wait complete. 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.330+0000 7ff4fd1cb700 1 Processor -- start 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4fd1cb700 1 -- start start 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4fd1cb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4fd1cb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101c10 0x7ff4f810ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4fd1cb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810f190 con 0x7ff4f8101270 2023-12-16T20:17:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4fd1cb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810f300 con 0x7ff4f8101c10 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55800/0 (socket says 172.21.15.38:55800) 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 -- 172.21.15.38:0/1423953580 learned_addr learned my addr 172.21.15.38:0/1423953580 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f659c700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101c10 0x7ff4f810ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 -- 172.21.15.38:0/1423953580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101c10 msgr2=0x7ff4f810ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101c10 0x7ff4f810ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 -- 172.21.15.38:0/1423953580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec005040 con 0x7ff4f8101270 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.331+0000 7ff4f6d9d700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8002a50 tx=0x7ff4e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.332+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e8007cc0 con 0x7ff4f8101270 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.332+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f8117690 con 0x7ff4f8101270 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.332+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4e800f040 con 0x7ff4f8101270 2023-12-16T20:17:23.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.332+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e8009540 con 0x7ff4f8101270 2023-12-16T20:17:23.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.332+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f8117b50 con 0x7ff4f8101270 2023-12-16T20:17:23.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.333+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8103740 con 0x7ff4f8101270 2023-12-16T20:17:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.333+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ff4e80096a0 con 0x7ff4f8101270 2023-12-16T20:17:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.334+0000 7ff4df7fe700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.334+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff4e808c110 con 0x7ff4f8101270 2023-12-16T20:17:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.334+0000 7ff4f659c700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:23.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.334+0000 7ff4f659c700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 0x7ff4e006f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b3b0 tx=0x7ff4ec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:23.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.338+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff4e8055f90 con 0x7ff4f8101270 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: pgmap v99: 65 pgs: 7 peering, 58 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 3 op/s 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/360 objects degraded (15.833%), 14 pgs degraded) 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: Cluster is now healthy 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2849657897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:23.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:23 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/3712061562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:17:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.628+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff4f8106860 con 0x7ff4f8101270 2023-12-16T20:17:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.628+0000 7ff4df7fe700 1 -- 172.21.15.38:0/1423953580 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff4e80595b0 con 0x7ff4f8101270 2023-12-16T20:17:23.629 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2023-12-16T20:17:23.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 msgr2=0x7ff4e006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 0x7ff4e006f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b3b0 tx=0x7ff4ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 msgr2=0x7ff4f810e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8002a50 tx=0x7ff4e80046b0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 shutdown_connections 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f8101270 0x7ff4f810e6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 --2- 172.21.15.38:0/1423953580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f8101c10 0x7ff4f810ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.630+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 >> 172.21.15.38:0/1423953580 conn(0x7ff4f80711a0 msgr2=0x7ff4f80fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.631+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 shutdown_connections 2023-12-16T20:17:23.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:23.631+0000 7ff4fd1cb700 1 -- 172.21.15.38:0/1423953580 wait complete. 2023-12-16T20:17:24.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:24 smithi038 ceph-mon[163993]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:24.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:24 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1423953580' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:17:24.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:24 smithi141 ceph-mon[137587]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:24.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:24 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1423953580' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:17:25.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:25 smithi038 ceph-mon[163993]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 0 op/s 2023-12-16T20:17:25.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:25 smithi141 ceph-mon[137587]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 0 op/s 2023-12-16T20:17:27.396 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:27 smithi038 ceph-mon[163993]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:27 smithi141 ceph-mon[137587]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:29.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:29 smithi038 ceph-mon[163993]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2023-12-16T20:17:29.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:29 smithi141 ceph-mon[137587]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2023-12-16T20:17:31.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:31 smithi141 ceph-mon[137587]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2023-12-16T20:17:31.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:31 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:31.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:31 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:31.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:31 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:31.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:31 smithi141 ceph-mon[137587]: Upgrade: osd.4 is safe to restart 2023-12-16T20:17:31.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:31 smithi038 ceph-mon[163993]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2023-12-16T20:17:31.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:31 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:31.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:31 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:31.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:31 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T20:17:31.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:31 smithi038 ceph-mon[163993]: Upgrade: osd.4 is safe to restart 2023-12-16T20:17:32.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:32 smithi141 ceph-mon[137587]: Upgrade: Updating osd.4 2023-12-16T20:17:32.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:32 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:32.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:32 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:17:32.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:32 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:32.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:32 smithi141 ceph-mon[137587]: Deploying daemon osd.4 on smithi141 2023-12-16T20:17:33.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:32 smithi038 ceph-mon[163993]: Upgrade: Updating osd.4 2023-12-16T20:17:33.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:32 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:33.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:32 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T20:17:33.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:32 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:33.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:32 smithi038 ceph-mon[163993]: Deploying daemon osd.4 on smithi141 2023-12-16T20:17:33.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:33 smithi141 ceph-mon[137587]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-16T20:17:33.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:33 smithi141 systemd[1]: Stopping Ceph osd.4 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:17:33.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:33 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:17:33.928+0000 7ff33fd8b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:17:33.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:33 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:17:33.928+0000 7ff33fd8b700 -1 osd.4 68 *** Got signal Terminated *** 2023-12-16T20:17:33.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:33 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[100059]: 2023-12-16T20:17:33.928+0000 7ff33fd8b700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:17:34.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:33 smithi038 ceph-mon[163993]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-16T20:17:34.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:34 smithi141 ceph-mon[137587]: osd.4 marked itself down and dead 2023-12-16T20:17:35.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:34 smithi038 ceph-mon[163993]: osd.4 marked itself down and dead 2023-12-16T20:17:35.377 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151156]: 2023-12-16 20:17:35.126224038 +0000 UTC m=+1.262826448 container died 3c0d14ce20219074842bf46743b64fc4bd28c5a67ac35e1e791841b216ea25bd (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, RELEASE=quincy-1f2f551, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2023-12-16T20:17:35.377 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151156]: 2023-12-16 20:17:35.252213679 +0000 UTC m=+1.388816056 container cleanup 3c0d14ce20219074842bf46743b64fc4bd28c5a67ac35e1e791841b216ea25bd (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, RELEASE=quincy-1f2f551, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2023-12-16T20:17:35.378 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 bash[151156]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4 2023-12-16T20:17:35.657 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151174]: 2023-12-16 20:17:35.377054403 +0000 UTC m=+0.247038090 container remove 3c0d14ce20219074842bf46743b64fc4bd28c5a67ac35e1e791841b216ea25bd (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, RELEASE=quincy-1f2f551, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2023-12-16T20:17:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:35 smithi141 ceph-mon[137587]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:35 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:17:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:35 smithi141 ceph-mon[137587]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T20:17:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:35.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:35.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151267]: 2023-12-16 20:17:35.710346987 +0000 UTC m=+0.081394367 container create 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2023-12-16T20:17:35.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151267]: 2023-12-16 20:17:35.648586569 +0000 UTC m=+0.019633959 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:35.997 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151267]: 2023-12-16 20:17:35.803086582 +0000 UTC m=+0.174133968 container init 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:17:35.997 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151267]: 2023-12-16 20:17:35.823138275 +0000 UTC m=+0.194185653 container start 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212) 2023-12-16T20:17:35.997 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:35 smithi141 podman[151267]: 2023-12-16 20:17:35.851989388 +0000 UTC m=+0.223036804 container attach 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:17:36.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:35 smithi038 ceph-mon[163993]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:17:36.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:35 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:17:36.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:35 smithi038 ceph-mon[163993]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T20:17:36.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:36.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:36.335 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151267]: 2023-12-16 20:17:36.119664079 +0000 UTC m=+0.490711481 container died 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:17:36.703 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151300]: 2023-12-16 20:17:36.335192122 +0000 UTC m=+0.208219864 container remove 902eecac89a8e62ecfc9177e366b95a60324178ff6b88ea3a430a25cd8e6df21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:17:36.703 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.4.service: Deactivated successfully. 2023-12-16T20:17:36.703 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 systemd[1]: Stopped Ceph osd.4 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:17:36.703 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.4.service: Consumed 59.972s CPU time. 2023-12-16T20:17:36.703 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 systemd[1]: Starting Ceph osd.4 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:17:36.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:36 smithi141 ceph-mon[137587]: failed to encode map e69 with expected crc 2023-12-16T20:17:36.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:36 smithi141 ceph-mon[137587]: failed to encode map e69 with expected crc 2023-12-16T20:17:36.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:36 smithi141 ceph-mon[137587]: failed to encode map e69 with expected crc 2023-12-16T20:17:36.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:36 smithi141 ceph-mon[137587]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T20:17:36.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151405]: 2023-12-16 20:17:36.701877818 +0000 UTC m=+0.066489132 container create c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20231212) 2023-12-16T20:17:36.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151405]: 2023-12-16 20:17:36.653280227 +0000 UTC m=+0.017891541 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:36.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151405]: 2023-12-16 20:17:36.810854731 +0000 UTC m=+0.175466054 container init c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux ) 2023-12-16T20:17:36.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151405]: 2023-12-16 20:17:36.81389462 +0000 UTC m=+0.178505933 container start c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, GIT_BRANCH=HEAD) 2023-12-16T20:17:36.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:36 smithi141 podman[151405]: 2023-12-16 20:17:36.843521272 +0000 UTC m=+0.208132588 container attach c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2023-12-16T20:17:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:36 smithi038 ceph-mon[163993]: failed to encode map e69 with expected crc 2023-12-16T20:17:37.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:36 smithi038 ceph-mon[163993]: failed to encode map e69 with expected crc 2023-12-16T20:17:37.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:36 smithi038 ceph-mon[163993]: failed to encode map e69 with expected crc 2023-12-16T20:17:37.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:36 smithi038 ceph-mon[163993]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T20:17:37.552 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151405]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate[151420]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151405]: 2023-12-16 20:17:37.271026232 +0000 UTC m=+0.635637557 container died c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:17:37.553 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151555]: 2023-12-16 20:17:37.551743268 +0000 UTC m=+0.275406906 container remove c48a745cea25ed54ba580e92eeb0b9a5a1d4b6f5318e39970309a684ce5493f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2023-12-16T20:17:37.810 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-mon[137587]: failed to encode map e70 with expected crc 2023-12-16T20:17:37.810 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-mon[137587]: failed to encode map e70 with expected crc 2023-12-16T20:17:37.810 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-mon[137587]: failed to encode map e70 with expected crc 2023-12-16T20:17:37.810 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-mon[137587]: pgmap v108: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 10 active+undersized, 44 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 33/360 objects degraded (9.167%) 2023-12-16T20:17:37.810 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 33/360 objects degraded (9.167%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151622]: 2023-12-16 20:17:37.701755016 +0000 UTC m=+0.052367836 container create 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151622]: 2023-12-16 20:17:37.760304591 +0000 UTC m=+0.110917369 container init 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151622]: 2023-12-16 20:17:37.666977954 +0000 UTC m=+0.017590745 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 podman[151622]: 2023-12-16 20:17:37.78043292 +0000 UTC m=+0.131045701 container start 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 ceph-osd[151640]: -- 172.21.15.141:0/2223076462 <== mon.1 v2:172.21.15.141:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bb355036c0 con 0x55bb354d4c00 2023-12-16T20:17:37.811 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 bash[151622]: 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 2023-12-16T20:17:38.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:37 smithi038 ceph-mon[163993]: failed to encode map e70 with expected crc 2023-12-16T20:17:38.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:37 smithi038 ceph-mon[163993]: failed to encode map e70 with expected crc 2023-12-16T20:17:38.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:37 smithi038 ceph-mon[163993]: failed to encode map e70 with expected crc 2023-12-16T20:17:38.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:37 smithi038 ceph-mon[163993]: pgmap v108: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 10 active+undersized, 44 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 33/360 objects degraded (9.167%) 2023-12-16T20:17:38.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:37 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 33/360 objects degraded (9.167%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:38.245 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:37 smithi141 systemd[1]: Started Ceph osd.4 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:17:38.627 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:38 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:17:38.330+0000 7fe9c9a10640 -1 Falling back to public interface 2023-12-16T20:17:38.923 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:38 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:38.923 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:38 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:38.923 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:38 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:38 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:38 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:39.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:38 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:40.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:39 smithi038 ceph-mon[163993]: pgmap v109: 65 pgs: 12 active+undersized+degraded, 2 stale+active+clean, 14 active+undersized, 37 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/360 objects degraded (12.778%) 2023-12-16T20:17:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:39 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:40.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:39 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:40.245 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:39 smithi141 ceph-mon[137587]: pgmap v109: 65 pgs: 12 active+undersized+degraded, 2 stale+active+clean, 14 active+undersized, 37 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 46/360 objects degraded (12.778%) 2023-12-16T20:17:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:39 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:40.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:39 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:42.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:41 smithi038 ceph-mon[163993]: pgmap v110: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:42.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:41 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:42.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:41 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:42.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:41 smithi141 ceph-mon[137587]: pgmap v110: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:42.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:41 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:42.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:41 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:43.085 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:42 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:43.085 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:42 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:17:42.939+0000 7fe9c9a10640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-16T20:17:43.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:42 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 62/360 objects degraded (17.222%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:43.745 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:17:43.460+0000 7fe9c9a10640 -1 osd.4 68 log_to_monitors true 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: pgmap v111: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:44.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:17:44.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:43 smithi038 ceph-mon[163993]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:17:44.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: pgmap v111: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:44.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:44.176 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:17:44.177 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:43 smithi141 ceph-mon[137587]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T20:17:44.495 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:17:44.174+0000 7fe9b6e79700 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: failed to encode map e71 with expected crc 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: from='osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: osdmap e71: 6 total, 5 up, 6 in 2023-12-16T20:17:45.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:44 smithi038 ceph-mon[163993]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: failed to encode map e71 with expected crc 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: from='osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: osdmap e71: 6 total, 5 up, 6 in 2023-12-16T20:17:45.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:44 smithi141 ceph-mon[137587]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:17:46.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: pgmap v112: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:17:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: failed to encode map e72 with expected crc 2023-12-16T20:17:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419] boot 2023-12-16T20:17:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T20:17:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:45 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: pgmap v112: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/360 objects degraded (17.222%) 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: failed to encode map e72 with expected crc 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: osd.4 [v2:172.21.15.141:6808/2242976419,v1:172.21.15.141:6809/2242976419] boot 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T20:17:46.246 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:45 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T20:17:47.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: pgmap v115: 65 pgs: 15 peering, 10 active+undersized+degraded, 9 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/360 objects degraded (9.444%) 2023-12-16T20:17:47.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: osdmap e73: 6 total, 6 up, 6 in 2023-12-16T20:17:47.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:47 smithi141 ceph-mon[137587]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: pgmap v115: 65 pgs: 15 peering, 10 active+undersized+degraded, 9 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/360 objects degraded (9.444%) 2023-12-16T20:17:47.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: osdmap e73: 6 total, 6 up, 6 in 2023-12-16T20:17:47.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: failed to encode map e73 with expected crc 2023-12-16T20:17:47.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:47 smithi038 ceph-mon[163993]: failed to encode map e73 with expected crc 2023-12-16T20:17:48.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:48 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 34/360 objects degraded (9.444%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:48.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:48 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 34/360 objects degraded (9.444%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T20:17:49.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:49 smithi038 ceph-mon[163993]: pgmap v117: 65 pgs: 15 peering, 6 active+undersized+degraded, 6 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 21/360 objects degraded (5.833%) 2023-12-16T20:17:49.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:49 smithi141 ceph-mon[137587]: pgmap v117: 65 pgs: 15 peering, 6 active+undersized+degraded, 6 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 21/360 objects degraded (5.833%) 2023-12-16T20:17:51.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:51 smithi038 ceph-mon[163993]: pgmap v118: 65 pgs: 15 peering, 50 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-12-16T20:17:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:51 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:51 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:51 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/360 objects degraded (5.833%), 6 pgs degraded) 2023-12-16T20:17:51.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:51 smithi038 ceph-mon[163993]: Cluster is now healthy 2023-12-16T20:17:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:51 smithi141 ceph-mon[137587]: pgmap v118: 65 pgs: 15 peering, 50 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-12-16T20:17:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:51 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:51 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:17:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:51 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/360 objects degraded (5.833%), 6 pgs degraded) 2023-12-16T20:17:51.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:51 smithi141 ceph-mon[137587]: Cluster is now healthy 2023-12-16T20:17:53.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:53 smithi038 ceph-mon[163993]: pgmap v119: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T20:17:53.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:53 smithi141 ceph-mon[137587]: pgmap v119: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- 172.21.15.38:0/696478089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 msgr2=0x7fca94103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 --2- 172.21.15.38:0/696478089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94103040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca84004940 tx=0x7fca84009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- 172.21.15.38:0/696478089 shutdown_connections 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 --2- 172.21.15.38:0/696478089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 0x7fca940fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 --2- 172.21.15.38:0/696478089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94103040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- 172.21.15.38:0/696478089 >> 172.21.15.38:0/696478089 conn(0x7fca940711a0 msgr2=0x7fca940715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- 172.21.15.38:0/696478089 shutdown_connections 2023-12-16T20:17:53.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- 172.21.15.38:0/696478089 wait complete. 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 Processor -- start 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.751+0000 7fca98c7e700 1 -- start start 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca98c7e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 0x7fca94113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca98c7e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca98c7e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94114200 con 0x7fca94102c70 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca98c7e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9410d4f0 con 0x7fca940fb1e0 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59488/0 (socket says 172.21.15.38:59488) 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 -- 172.21.15.38:0/1184098376 learned_addr learned my addr 172.21.15.38:0/1184098376 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca9259c700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 0x7fca94113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 -- 172.21.15.38:0/1184098376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 msgr2=0x7fca94113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 0x7fca94113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 -- 172.21.15.38:0/1184098376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84005040 con 0x7fca94102c70 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca91d9b700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca88002a50 tx=0x7fca880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.752+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca88007cc0 con 0x7fca94102c70 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.753+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca8800f040 con 0x7fca94102c70 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.753+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9410d780 con 0x7fca94102c70 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.753+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8800d9c0 con 0x7fca94102c70 2023-12-16T20:17:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.753+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9410dcc0 con 0x7fca94102c70 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.754+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca940fff10 con 0x7fca94102c70 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.754+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fca8800db20 con 0x7fca94102c70 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.755+0000 7fca82ffd700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 0x7fca7c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.755+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fca8808c000 con 0x7fca94102c70 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.755+0000 7fca9259c700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 0x7fca7c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:53.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.755+0000 7fca9259c700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 0x7fca7c06f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b3b0 tx=0x7fca84009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:53.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.759+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fca88059970 con 0x7fca94102c70 2023-12-16T20:17:53.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.978+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca9410ec10 con 0x7fca7c06ce60 2023-12-16T20:17:53.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.980+0000 7fca82ffd700 1 -- 172.21.15.38:0/1184098376 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fca9410ec10 con 0x7fca7c06ce60 2023-12-16T20:17:53.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 msgr2=0x7fca7c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 0x7fca7c06f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b3b0 tx=0x7fca84009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 msgr2=0x7fca94113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca88002a50 tx=0x7fca880046b0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 shutdown_connections 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca7c06ce60 0x7fca7c06f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca940fb1e0 0x7fca94113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 --2- 172.21.15.38:0/1184098376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca94102c70 0x7fca94113bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 >> 172.21.15.38:0/1184098376 conn(0x7fca940711a0 msgr2=0x7fca940fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:53.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 shutdown_connections 2023-12-16T20:17:53.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:53.982+0000 7fca98c7e700 1 -- 172.21.15.38:0/1184098376 wait complete. 2023-12-16T20:17:53.994 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:17:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 -- 172.21.15.38:0/3545475459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c90102c00 msgr2=0x7f3c90102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 --2- 172.21.15.38:0/3545475459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c90102c00 0x7f3c90102fd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c80004940 tx=0x7f3c80009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 -- 172.21.15.38:0/3545475459 shutdown_connections 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 --2- 172.21.15.38:0/3545475459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c901035a0 0x7f3c900fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 --2- 172.21.15.38:0/3545475459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c90102c00 0x7f3c90102fd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 -- 172.21.15.38:0/3545475459 >> 172.21.15.38:0/3545475459 conn(0x7f3c900f8790 msgr2=0x7f3c900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 -- 172.21.15.38:0/3545475459 shutdown_connections 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.090+0000 7f3c95374700 1 -- 172.21.15.38:0/3545475459 wait complete. 2023-12-16T20:17:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 Processor -- start 2023-12-16T20:17:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 -- start start 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 0x7f3c90113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90114200 con 0x7f3c901035a0 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c95374700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9010d4f0 con 0x7f3c90102c00 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c8e7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c8e7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59520/0 (socket says 172.21.15.38:59520) 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c8e7fc700 1 -- 172.21.15.38:0/2192726148 learned_addr learned my addr 172.21.15.38:0/2192726148 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c8effd700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 0x7f3c90113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.091+0000 7f3c8e7fc700 1 -- 172.21.15.38:0/2192726148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 msgr2=0x7f3c90113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c8e7fc700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 0x7f3c90113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c8e7fc700 1 -- 172.21.15.38:0/2192726148 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80005040 con 0x7f3c901035a0 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c8effd700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 0x7f3c90113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c8e7fc700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c890 tx=0x7f3c840044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8400a700 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c8400ad10 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9010d780 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c84012e70 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.092+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9010dcc0 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.093+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900fff10 con 0x7f3c901035a0 2023-12-16T20:17:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.094+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3c8400a860 con 0x7f3c901035a0 2023-12-16T20:17:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.094+0000 7f3c777fe700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 0x7f3c7806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.094+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3c8408c300 con 0x7f3c901035a0 2023-12-16T20:17:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.094+0000 7f3c8effd700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 0x7f3c7806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.095+0000 7f3c8effd700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 0x7f3c7806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c80004f90 tx=0x7f3c80009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.099+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3c84059cf0 con 0x7f3c901035a0 2023-12-16T20:17:54.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.322+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c9010ec10 con 0x7f3c7806ce60 2023-12-16T20:17:54.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.324+0000 7f3c777fe700 1 -- 172.21.15.38:0/2192726148 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3c9010ec10 con 0x7f3c7806ce60 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 msgr2=0x7f3c7806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 0x7f3c7806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c80004f90 tx=0x7f3c80009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 msgr2=0x7f3c90113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c890 tx=0x7f3c840044c0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 shutdown_connections 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3c7806ce60 0x7f3c7806f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c90102c00 0x7f3c90113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 --2- 172.21.15.38:0/2192726148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c901035a0 0x7f3c90113bb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 >> 172.21.15.38:0/2192726148 conn(0x7f3c900f8790 msgr2=0x7f3c900fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:54.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 shutdown_connections 2023-12-16T20:17:54.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.326+0000 7f3c95374700 1 -- 172.21.15.38:0/2192726148 wait complete. 2023-12-16T20:17:54.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.431+0000 7f1ae0024700 1 -- 172.21.15.38:0/4125569628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 msgr2=0x7f1ad80fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.431+0000 7f1ae0024700 1 --2- 172.21.15.38:0/4125569628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad80fdfc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4004940 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- 172.21.15.38:0/4125569628 shutdown_connections 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 --2- 172.21.15.38:0/4125569628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 0x7f1ad8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 --2- 172.21.15.38:0/4125569628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad80fdfc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- 172.21.15.38:0/4125569628 >> 172.21.15.38:0/4125569628 conn(0x7f1ad80f7680 msgr2=0x7f1ad80f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- 172.21.15.38:0/4125569628 shutdown_connections 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- 172.21.15.38:0/4125569628 wait complete. 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 Processor -- start 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- start start 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 0x7f1ad8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.432+0000 7f1ae0024700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8114220 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ae0024700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad810d510 con 0x7f1ad80fe590 2023-12-16T20:17:54.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59542/0 (socket says 172.21.15.38:59542) 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 -- 172.21.15.38:0/3155946465 learned_addr learned my addr 172.21.15.38:0/3155946465 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1add5bf700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 0x7f1ad8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 -- 172.21.15.38:0/3155946465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 msgr2=0x7f1ad8113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 0x7f1ad8113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 -- 172.21.15.38:0/3155946465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4005040 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1adddc0700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b3b0 tx=0x7f1ad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad400e040 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ad4009af0 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad810d740 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad401c3f0 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.433+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad810dc80 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.434+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad81041e0 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.435+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1ad4013800 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.435+0000 7f1ace7fc700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 0x7f1ac406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.436+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1ad408d650 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.436+0000 7f1add5bf700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 0x7f1ac406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.436+0000 7f1add5bf700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 0x7f1ac406f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ad810eef0 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.440+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1ad405b040 con 0x7f1ad80fdbf0 2023-12-16T20:17:54.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:54 smithi038 ceph-mon[163993]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:54.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.652+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad804bbf0 con 0x7f1ac406ce60 2023-12-16T20:17:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.662+0000 7f1ace7fc700 1 -- 172.21.15.38:0/3155946465 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1ad804bbf0 con 0x7f1ac406ce60 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (4m) 71s ago 11m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (2m) 71s ago 11m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (2m) 14s ago 11m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (4m) 71s ago 11m 78.6M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (8m) 71s ago 8m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (8m) 71s ago 8m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (8m) 14s ago 8m 67.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (8m) 14s ago 8m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:17:54.664 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (5m) 71s ago 12m 493M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (4m) 14s ago 10m 442M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (3m) 71s ago 12m 47.2M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (2m) 14s ago 10m 39.0M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (4m) 71s ago 11m 16.7M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (4m) 14s ago 11m 15.1M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (2m) 71s ago 10m 85.8M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (103s) 71s ago 10m 93.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (74s) 71s ago 9m 12.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 2407bc0d39ec 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (45s) 14s ago 9m 97.5M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 f3d2e940f234 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (16s) 14s ago 9m 10.5M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 86f170b7bf0e 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (9m) 14s ago 9m 233M 2581M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c56960481cab 2023-12-16T20:17:54.665 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 71s ago 11m 59.0M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 msgr2=0x7f1ac406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 0x7f1ac406f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ad810eef0 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 msgr2=0x7f1ad8113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b3b0 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 shutdown_connections 2023-12-16T20:17:54.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f1ac406ce60 0x7f1ac406f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80fdbf0 0x7f1ad8113650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 --2- 172.21.15.38:0/3155946465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ad80fe590 0x7f1ad8113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 >> 172.21.15.38:0/3155946465 conn(0x7f1ad80f7680 msgr2=0x7f1ad8101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 shutdown_connections 2023-12-16T20:17:54.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.665+0000 7f1ae0024700 1 -- 172.21.15.38:0/3155946465 wait complete. 2023-12-16T20:17:54.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:54 smithi141 ceph-mon[137587]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2067245507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 msgr2=0x7f3e080fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2067245507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e080fcc10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3df8004940 tx=0x7f3df8009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2067245507 shutdown_connections 2023-12-16T20:17:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2067245507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e080fcc10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2067245507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 0x7f3e08102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.768+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2067245507 >> 172.21.15.38:0/2067245507 conn(0x7f3e080f8790 msgr2=0x7f3e080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.769+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2067245507 shutdown_connections 2023-12-16T20:17:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.769+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2067245507 wait complete. 2023-12-16T20:17:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.769+0000 7f3e0eb71700 1 Processor -- start 2023-12-16T20:17:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.769+0000 7f3e0eb71700 1 -- start start 2023-12-16T20:17:54.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 0x7f3e081135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08114140 con 0x7f3e081035a0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0810d470 con 0x7f3e08102c00 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59564/0 (socket says 172.21.15.38:59564) 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 -- 172.21.15.38:0/2279148617 learned_addr learned my addr 172.21.15.38:0/2279148617 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0c90d700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 0x7f3e081135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 -- 172.21.15.38:0/2279148617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 msgr2=0x7f3e081135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 0x7f3e081135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 -- 172.21.15.38:0/2279148617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8005040 con 0x7f3e081035a0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e07fff700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3df8000c00 tx=0x7f3df8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df8021070 con 0x7f3e081035a0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3df80093b0 con 0x7f3e081035a0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0810d6f0 con 0x7f3e081035a0 2023-12-16T20:17:54.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df800e070 con 0x7f3e081035a0 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.770+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0810dbd0 con 0x7f3e081035a0 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.771+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e081050d0 con 0x7f3e081035a0 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.772+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3df801c670 con 0x7f3e081035a0 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.772+0000 7f3e057fa700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 0x7f3df406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.773+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3df808d300 con 0x7f3e081035a0 2023-12-16T20:17:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.773+0000 7f3e0c90d700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 0x7f3df406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.773+0000 7f3e0c90d700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 0x7f3df406f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009b80 tx=0x7f3df000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:54.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:54.777+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3df805ad90 con 0x7f3e081035a0 2023-12-16T20:17:55.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.064+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e080fc390 con 0x7f3e081035a0 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.065+0000 7f3e057fa700 1 -- 172.21.15.38:0/2279148617 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f3df805a920 con 0x7f3e081035a0 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:55.066 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 5 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 9 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:17:55.067 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:17:55.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 msgr2=0x7f3df406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 0x7f3df406f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009b80 tx=0x7f3df000b040 comp rx=0 tx=0).stop 2023-12-16T20:17:55.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 msgr2=0x7f3e08113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3df8000c00 tx=0x7f3df8009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 shutdown_connections 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f3df406ce60 0x7f3df406f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e08102c00 0x7f3e081135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 --2- 172.21.15.38:0/2279148617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e081035a0 0x7f3e08113af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 >> 172.21.15.38:0/2279148617 conn(0x7f3e080f8790 msgr2=0x7f3e080fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 shutdown_connections 2023-12-16T20:17:55.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.067+0000 7f3e0eb71700 1 -- 172.21.15.38:0/2279148617 wait complete. 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 -- 172.21.15.38:0/1029456378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 msgr2=0x7fe584109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/1029456378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584109040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe578004940 tx=0x7fe578009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 -- 172.21.15.38:0/1029456378 shutdown_connections 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/1029456378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584109040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/1029456378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5840fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 -- 172.21.15.38:0/1029456378 >> 172.21.15.38:0/1029456378 conn(0x7fe5840f76c0 msgr2=0x7fe5840f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 -- 172.21.15.38:0/1029456378 shutdown_connections 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.172+0000 7fe58a0c3700 1 -- 172.21.15.38:0/1029456378 wait complete. 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 Processor -- start 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 -- start start 2023-12-16T20:17:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5841157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe584116370 con 0x7fe5840fc2e0 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.173+0000 7fe58a0c3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58410f6a0 con 0x7fe5840fb9d0 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59574/0 (socket says 172.21.15.38:59574) 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 -- 172.21.15.38:0/2923912224 learned_addr learned my addr 172.21.15.38:0/2923912224 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 -- 172.21.15.38:0/2923912224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 msgr2=0x7fe5841157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe5837fe700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5841157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5841157e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 -- 172.21.15.38:0/2923912224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe578005040 con 0x7fe5840fc2e0 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe5837fe700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5841157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:17:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe582ffd700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe578009390 tx=0x7fe578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57800e040 con 0x7fe5840fc2e0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe578004290 con 0x7fe5840fc2e0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58410f980 con 0x7fe5840fc2e0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57801c3f0 con 0x7fe5840fc2e0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.174+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58410fec0 con 0x7fe5840fc2e0 2023-12-16T20:17:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.175+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe584106770 con 0x7fe5840fc2e0 2023-12-16T20:17:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.176+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe57800bc50 con 0x7fe5840fc2e0 2023-12-16T20:17:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.176+0000 7fe56bfff700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 0x7fe56c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.176+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe57808d5d0 con 0x7fe5840fc2e0 2023-12-16T20:17:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.176+0000 7fe5837fe700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 0x7fe56c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.177+0000 7fe5837fe700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 0x7fe56c06f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe574009fd0 tx=0x7fe57400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.181+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe57805b060 con 0x7fe5840fc2e0 2023-12-16T20:17:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.426+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe58410bce0 con 0x7fe5840fc2e0 2023-12-16T20:17:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.426+0000 7fe56bfff700 1 -- 172.21.15.38:0/2923912224 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1864 (secure 0 0 0) 0x7fe57805abf0 con 0x7fe5840fc2e0 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:e23 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 23 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-16T20:09:32.206228+0000 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2023-12-16T20:16:12.868692+0000 2023-12-16T20:17:55.428 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 44 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2023-12-16T20:17:55.429 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14498,1=24271} 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.aofkae{0:14498} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/798907765,v1:172.21.15.38:6829/798907765] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dbcjir{0:14510} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/64603490,v1:172.21.15.38:6827/64603490] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.xhutny{1:24271} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.141:6824/2182927496,v1:172.21.15.141:6825/2182927496] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi141.eyrunj{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.141:6826/246239581,v1:172.21.15.141:6827/246239581] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T20:17:55.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:55.431 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:17:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 msgr2=0x7fe56c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 0x7fe56c06f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe574009fd0 tx=0x7fe57400b040 comp rx=0 tx=0).stop 2023-12-16T20:17:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 msgr2=0x7fe584115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe578009390 tx=0x7fe578009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 shutdown_connections 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe56c06ce70 0x7fe56c06f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5840fb9d0 0x7fe5841157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 --2- 172.21.15.38:0/2923912224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5840fc2e0 0x7fe584115d20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.428+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 >> 172.21.15.38:0/2923912224 conn(0x7fe5840f76c0 msgr2=0x7fe5840f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.429+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 shutdown_connections 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.429+0000 7fe58a0c3700 1 -- 172.21.15.38:0/2923912224 wait complete. 2023-12-16T20:17:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 -- 172.21.15.38:0/747228651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e4101b00 msgr2=0x7f72e4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/747228651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e4101b00 0x7f72e4101ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72d4004940 tx=0x7f72d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 -- 172.21.15.38:0/747228651 shutdown_connections 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/747228651 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e40fbb40 0x7f72e40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/747228651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e4101b00 0x7f72e4101ed0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 -- 172.21.15.38:0/747228651 >> 172.21.15.38:0/747228651 conn(0x7f72e40719b0 msgr2=0x7f72e4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 -- 172.21.15.38:0/747228651 shutdown_connections 2023-12-16T20:17:55.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.534+0000 7f72e8ed3700 1 -- 172.21.15.38:0/747228651 wait complete. 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 Processor -- start 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 -- start start 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e4101b00 0x7f72e4113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e410d520 con 0x7f72e40fbb40 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e8ed3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e410d690 con 0x7f72e4101b00 2023-12-16T20:17:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59594/0 (socket says 172.21.15.38:59594) 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.535+0000 7f72e259c700 1 -- 172.21.15.38:0/2273289920 learned_addr learned my addr 172.21.15.38:0/2273289920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72d9d9b700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e4101b00 0x7f72e4113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e259c700 1 -- 172.21.15.38:0/2273289920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e4101b00 msgr2=0x7f72e4113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e259c700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e4101b00 0x7f72e4113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e259c700 1 -- 172.21.15.38:0/2273289920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4005040 con 0x7f72e40fbb40 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e259c700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72d400b3b0 tx=0x7f72d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72d400e040 con 0x7f72e40fbb40 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e410d910 con 0x7f72e40fbb40 2023-12-16T20:17:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72d400bc50 con 0x7f72e40fbb40 2023-12-16T20:17:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72d4013420 con 0x7f72e40fbb40 2023-12-16T20:17:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.536+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e410de50 con 0x7f72e40fbb40 2023-12-16T20:17:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.537+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e40734d0 con 0x7f72e40fbb40 2023-12-16T20:17:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.538+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f72d401c430 con 0x7f72e40fbb40 2023-12-16T20:17:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.538+0000 7f72db7fe700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 0x7f72d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.538+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f72d408d070 con 0x7f72e40fbb40 2023-12-16T20:17:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.538+0000 7f72d9d9b700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 0x7f72d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.539+0000 7f72d9d9b700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 0x7f72d006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72cc006fd0 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.543+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f72d405ab10 con 0x7f72e40fbb40 2023-12-16T20:17:55.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:55 smithi038 ceph-mon[163993]: pgmap v120: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:55.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:55 smithi038 ceph-mon[163993]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:55 smithi038 ceph-mon[163993]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:55.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:55 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2279148617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:55.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:55 smithi141 ceph-mon[137587]: pgmap v120: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:55.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:55 smithi141 ceph-mon[137587]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:55.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:55 smithi141 ceph-mon[137587]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:55.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:55 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2279148617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:17:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.762+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72e410ec40 con 0x7f72d006ce60 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.764+0000 7f72db7fe700 1 -- 172.21.15.38:0/2273289920 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f72e410ec40 con 0x7f72d006ce60 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:17:55.765 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "11/21 daemons upgraded", 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2023-12-16T20:17:55.766 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:17:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 msgr2=0x7f72d006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 0x7f72d006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72cc006fd0 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2023-12-16T20:17:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 msgr2=0x7f72e4113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72d400b3b0 tx=0x7f72d4009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 shutdown_connections 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f72d006ce60 0x7f72d006f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72e40fbb40 0x7f72e4113660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 --2- 172.21.15.38:0/2273289920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72e4101b00 0x7f72e4113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 >> 172.21.15.38:0/2273289920 conn(0x7f72e40719b0 msgr2=0x7f72e40653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 shutdown_connections 2023-12-16T20:17:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.766+0000 7f72e8ed3700 1 -- 172.21.15.38:0/2273289920 wait complete. 2023-12-16T20:17:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 -- 172.21.15.38:0/2270708806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 msgr2=0x7f4380108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 --2- 172.21.15.38:0/2270708806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380108f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4374004940 tx=0x7f4374009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 -- 172.21.15.38:0/2270708806 shutdown_connections 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 --2- 172.21.15.38:0/2270708806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380108f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 --2- 172.21.15.38:0/2270708806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 0x7f4380070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 -- 172.21.15.38:0/2270708806 >> 172.21.15.38:0/2270708806 conn(0x7f43800f8790 msgr2=0x7f43800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 -- 172.21.15.38:0/2270708806 shutdown_connections 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.870+0000 7f4385fb8700 1 -- 172.21.15.38:0/2270708806 wait complete. 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 Processor -- start 2023-12-16T20:17:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 -- start start 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 0x7f4380115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43801164b0 con 0x7f4380070870 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.871+0000 7f4385fb8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438010f7e0 con 0x7f438006ff60 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59610/0 (socket says 172.21.15.38:59610) 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 -- 172.21.15.38:0/3553010417 learned_addr learned my addr 172.21.15.38:0/3553010417 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:17:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437f7fe700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 0x7f4380115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 -- 172.21.15.38:0/3553010417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 msgr2=0x7f4380115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 0x7f4380115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 -- 172.21.15.38:0/3553010417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374005040 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f437effd700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4374009180 tx=0x7f4374009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f437400e040 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438010fa60 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4374004290 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.872+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f437401c3f0 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.873+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438010ffa0 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.874+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4380106650 con 0x7f4380070870 2023-12-16T20:17:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.874+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f437400bb80 con 0x7f4380070870 2023-12-16T20:17:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.874+0000 7f4367fff700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 0x7f436806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:17:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.875+0000 7f437f7fe700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 0x7f436806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:17:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.875+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f437408d640 con 0x7f4380070870 2023-12-16T20:17:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.875+0000 7f437f7fe700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 0x7f436806f310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43700041d0 tx=0x7f43700043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:17:55.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:55.879+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f437405b030 con 0x7f4380070870 2023-12-16T20:17:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.166+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f438010bdc0 con 0x7f4380070870 2023-12-16T20:17:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.166+0000 7f4367fff700 1 -- 172.21.15.38:0/3553010417 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f437405abc0 con 0x7f4380070870 2023-12-16T20:17:56.167 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2023-12-16T20:17:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 msgr2=0x7f436806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 0x7f436806f310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43700041d0 tx=0x7f43700043c0 comp rx=0 tx=0).stop 2023-12-16T20:17:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 msgr2=0x7f4380115e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4374009180 tx=0x7f4374009e30 comp rx=0 tx=0).stop 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 shutdown_connections 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f436806ce60 0x7f436806f310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f438006ff60 0x7f4380115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 --2- 172.21.15.38:0/3553010417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4380070870 0x7f4380115e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 >> 172.21.15.38:0/3553010417 conn(0x7f43800f8790 msgr2=0x7f43801037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 shutdown_connections 2023-12-16T20:17:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:17:56.168+0000 7f4385fb8700 1 -- 172.21.15.38:0/3553010417 wait complete. 2023-12-16T20:17:56.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:56 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2923912224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:17:56.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:56 smithi038 ceph-mon[163993]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:56.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:56 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/3553010417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:17:56.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:56 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2923912224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T20:17:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:56 smithi141 ceph-mon[137587]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:17:56.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:56 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/3553010417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:17:57.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:57 smithi038 ceph-mon[163993]: pgmap v121: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:57.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:57 smithi141 ceph-mon[137587]: pgmap v121: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T20:17:58.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:58 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:58.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:58 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:59.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: pgmap v122: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:17:59.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:59.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: Upgrade: osd.5 is safe to restart 2023-12-16T20:17:59.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:59.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:17:59.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:17:59 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:17:59.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: pgmap v122: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:17:59.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T20:17:59.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: Upgrade: osd.5 is safe to restart 2023-12-16T20:17:59.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:17:59.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T20:17:59.646 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:17:59 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:18:00.437 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:00 smithi141 ceph-mon[137587]: Upgrade: Updating osd.5 2023-12-16T20:18:00.437 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:00 smithi141 ceph-mon[137587]: Deploying daemon osd.5 on smithi141 2023-12-16T20:18:00.437 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:00 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:00.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:00 smithi038 ceph-mon[163993]: Upgrade: Updating osd.5 2023-12-16T20:18:00.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:00 smithi038 ceph-mon[163993]: Deploying daemon osd.5 on smithi141 2023-12-16T20:18:00.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:00 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:01.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:01 smithi038 ceph-mon[163993]: pgmap v123: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:18:01.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:01 smithi141 ceph-mon[137587]: pgmap v123: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:18:01.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:01 smithi141 systemd[1]: Stopping Ceph osd.5 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:18:01.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:01 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:18:01.500+0000 7fc3b7a1b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:18:01.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:01 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:18:01.500+0000 7fc3b7a1b700 -1 osd.5 73 *** Got signal Terminated *** 2023-12-16T20:18:01.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:01 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[106785]: 2023-12-16T20:18:01.500+0000 7fc3b7a1b700 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:18:02.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:02 smithi038 ceph-mon[163993]: osd.5 marked itself down and dead 2023-12-16T20:18:02.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:02 smithi141 ceph-mon[137587]: osd.5 marked itself down and dead 2023-12-16T20:18:03.139 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:02 smithi141 podman[156480]: 2023-12-16 20:18:02.881801375 +0000 UTC m=+1.428475845 container died c56960481cab8c4508a4ab16892200c55180ce87f3df2e00bb630b0e36c08d35 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=quincy-1f2f551, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2023-12-16T20:18:03.139 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156480]: 2023-12-16 20:18:03.047217538 +0000 UTC m=+1.593892010 container cleanup c56960481cab8c4508a4ab16892200c55180ce87f3df2e00bb630b0e36c08d35 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-1f2f551, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2023-12-16T20:18:03.139 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 bash[156480]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5 2023-12-16T20:18:03.400 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156497]: 2023-12-16 20:18:03.138780363 +0000 UTC m=+0.248309282 container remove c56960481cab8c4508a4ab16892200c55180ce87f3df2e00bb630b0e36c08d35 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, org.label-schema.build-date=20231212, ceph=True, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=quincy-1f2f551, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2023-12-16T20:18:03.656 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:03 smithi141 ceph-mon[137587]: pgmap v124: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-16T20:18:03.656 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:03 smithi141 ceph-mon[137587]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:18:03.656 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:03 smithi141 ceph-mon[137587]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T20:18:03.657 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.530416434 +0000 UTC m=+0.063420730 container create e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:18:03.657 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.484439634 +0000 UTC m=+0.017443896 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:18:03.657 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.656010247 +0000 UTC m=+0.189014498 container init e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2023-12-16T20:18:03.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:03 smithi038 ceph-mon[163993]: pgmap v124: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2023-12-16T20:18:03.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:03 smithi038 ceph-mon[163993]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T20:18:03.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:03 smithi038 ceph-mon[163993]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T20:18:03.944 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.659253161 +0000 UTC m=+0.192257406 container start e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2023-12-16T20:18:03.944 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.680332066 +0000 UTC m=+0.213336356 container attach e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:18:04.245 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:03 smithi141 podman[156586]: 2023-12-16 20:18:03.943630833 +0000 UTC m=+0.476635101 container died e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2023-12-16T20:18:04.246 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156612]: 2023-12-16 20:18:04.155314337 +0000 UTC m=+0.205172854 container remove e6d4a98f26bbee21c66a419b144db02ed74f29f4a60fbb682159ae65e4c25115 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:18:04.246 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.5.service: Deactivated successfully. 2023-12-16T20:18:04.246 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 systemd[1]: Stopped Ceph osd.5 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:18:04.246 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.5.service: Consumed 59.952s CPU time. 2023-12-16T20:18:04.615 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:04 smithi141 ceph-mon[137587]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T20:18:04.615 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 systemd[1]: Starting Ceph osd.5 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:18:04.615 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156715]: 2023-12-16 20:18:04.521835783 +0000 UTC m=+0.063463678 container create 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2023-12-16T20:18:04.615 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156715]: 2023-12-16 20:18:04.475824246 +0000 UTC m=+0.017452147 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:18:04.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:04 smithi038 ceph-mon[163993]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T20:18:04.995 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156715]: 2023-12-16 20:18:04.614495971 +0000 UTC m=+0.156123863 container init 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2023-12-16T20:18:04.996 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156715]: 2023-12-16 20:18:04.631213281 +0000 UTC m=+0.172841167 container start 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:18:04.996 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:04 smithi141 podman[156715]: 2023-12-16 20:18:04.663517701 +0000 UTC m=+0.205145585 container attach 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2023-12-16T20:18:05.413 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T20:18:05.413 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156715]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate[156732]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156715]: 2023-12-16 20:18:05.118550263 +0000 UTC m=+0.660178167 container died 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2023-12-16T20:18:05.414 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156874]: 2023-12-16 20:18:05.338349542 +0000 UTC m=+0.214731936 container remove 6d1db27a4f4ab09449ec6612ed158b60f794ccdaa1204797cb5e35b0d0c4ae70 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2023-12-16T20:18:05.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-mon[137587]: pgmap v127: 65 pgs: 3 peering, 10 stale+active+clean, 3 active+undersized, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T20:18:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-mon[137587]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T20:18:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:05.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156935]: 2023-12-16 20:18:05.505108333 +0000 UTC m=+0.058075402 container create 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156935]: 2023-12-16 20:18:05.464488711 +0000 UTC m=+0.017455695 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156935]: 2023-12-16 20:18:05.588611733 +0000 UTC m=+0.141578708 container init 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 podman[156935]: 2023-12-16 20:18:05.610081595 +0000 UTC m=+0.163048563 container start 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.31.3, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS) 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 ceph-osd[156954]: -- 172.21.15.141:0/3364615614 <== mon.1 v2:172.21.15.141:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574fc5236c0 con 0x5574fc4f4c00 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 bash[156935]: 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 2023-12-16T20:18:05.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:05 smithi141 systemd[1]: Started Ceph osd.5 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:18:05.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:05 smithi038 ceph-mon[163993]: pgmap v127: 65 pgs: 3 peering, 10 stale+active+clean, 3 active+undersized, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T20:18:05.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:05 smithi038 ceph-mon[163993]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T20:18:05.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:05.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:06.483 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:06 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:18:06.154+0000 7f64d9e17640 -1 Falling back to public interface 2023-12-16T20:18:06.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:06 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:06.817 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:06 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:06.817 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:06 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:07.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:06 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:07.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:06 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:07.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:06 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:07.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:07 smithi141 ceph-mon[137587]: pgmap v128: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-16T20:18:07.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:07 smithi141 ceph-mon[137587]: Health check failed: Degraded data redundancy: 48/360 objects degraded (13.333%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T20:18:07.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:07.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:07 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:08.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:07 smithi038 ceph-mon[163993]: pgmap v128: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-16T20:18:08.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:07 smithi038 ceph-mon[163993]: Health check failed: Degraded data redundancy: 48/360 objects degraded (13.333%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T20:18:08.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:08.046 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:07 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:09 smithi141 ceph-mon[137587]: pgmap v129: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:09 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:09.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:09 smithi141 ceph-mon[137587]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T20:18:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:09 smithi038 ceph-mon[163993]: pgmap v129: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:09 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:10.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:09 smithi038 ceph-mon[163993]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T20:18:10.495 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:10 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:18:10.079+0000 7f64d9e17640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-16T20:18:10.896 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:10 smithi141 ceph-mon[137587]: from='osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:18:10.896 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:10 smithi141 ceph-mon[137587]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:18:10.897 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:10 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:18:10.590+0000 7f64d9e17640 -1 osd.5 73 log_to_monitors true 2023-12-16T20:18:10.897 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:18:10 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:18:10.706+0000 7f64c8a83700 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:18:11.138 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:10 smithi038 ceph-mon[163993]: from='osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:18:11.138 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:10 smithi038 ceph-mon[163993]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: pgmap v130: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: osdmap e76: 6 total, 5 up, 6 in 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:11.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T20:18:11.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:18:11.998 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: pgmap v130: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: osdmap e76: 6 total, 5 up, 6 in 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi141", "root=default"]}]: dispatch 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:18:12.141 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T20:18:12.142 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:18:12.143 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:12.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[163988]: 2023-12-16T20:18:12.139+0000 7f609e5a2700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T20:18:12.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Upgrade: Setting container_image for all osd 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: pgmap v132: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344] boot 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: Health check update: Degraded data redundancy: 55/360 objects degraded (15.278%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T20:18:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:12 smithi141 ceph-mon[137587]: osdmap e78: 6 total, 6 up, 6 in 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Upgrade: Setting container_image for all osd 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: pgmap v132: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: osd.5 [v2:172.21.15.141:6816/3891441344,v1:172.21.15.141:6817/3891441344] boot 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T20:18:13.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: Health check update: Degraded data redundancy: 55/360 objects degraded (15.278%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T20:18:13.146 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:12 smithi038 ceph-mon[163993]: osdmap e78: 6 total, 6 up, 6 in 2023-12-16T20:18:14.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:14 smithi141 ceph-mon[137587]: pgmap v135: 65 pgs: 13 active+undersized+degraded, 13 active+undersized, 39 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 51/360 objects degraded (14.167%) 2023-12-16T20:18:15.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:14 smithi038 ceph-mon[163993]: pgmap v135: 65 pgs: 13 active+undersized+degraded, 13 active+undersized, 39 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 51/360 objects degraded (14.167%) 2023-12-16T20:18:16.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:16 smithi141 ceph-mon[137587]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 46/360 objects degraded (12.778%) 2023-12-16T20:18:16.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:16 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:16.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:16 smithi038 ceph-mon[163993]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 46/360 objects degraded (12.778%) 2023-12-16T20:18:16.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:16 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:17.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:17 smithi141 ceph-mon[137587]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/360 objects degraded (12.778%), 11 pgs degraded) 2023-12-16T20:18:17.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:17 smithi038 ceph-mon[163993]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/360 objects degraded (12.778%), 11 pgs degraded) 2023-12-16T20:18:18.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:18 smithi038 ceph-mon[163993]: pgmap v137: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2023-12-16T20:18:18.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:18 smithi141 ceph-mon[137587]: pgmap v137: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2023-12-16T20:18:20.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:20 smithi038 ceph-mon[163993]: pgmap v138: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T20:18:20.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:20.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:20.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:20 smithi141 ceph-mon[137587]: pgmap v138: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T20:18:20.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:20.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:22.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:22 smithi038 ceph-mon[163993]: pgmap v139: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 973 B/s rd, 2 op/s 2023-12-16T20:18:22.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:22 smithi141 ceph-mon[137587]: pgmap v139: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 973 B/s rd, 2 op/s 2023-12-16T20:18:24.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:24 smithi038 ceph-mon[163993]: pgmap v140: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 880 B/s rd, 2 op/s 2023-12-16T20:18:24.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:24 smithi141 ceph-mon[137587]: pgmap v140: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 880 B/s rd, 2 op/s 2023-12-16T20:18:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1519179958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 msgr2=0x7fa8f80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1519179958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f80fbfb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec004940 tx=0x7fa8ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1519179958 shutdown_connections 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1519179958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f80fbfb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1519179958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 0x7fa8f8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1519179958 >> 172.21.15.38:0/1519179958 conn(0x7fa8f80f76c0 msgr2=0x7fa8f80f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1519179958 shutdown_connections 2023-12-16T20:18:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.288+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1519179958 wait complete. 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 Processor -- start 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 -- start start 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 0x7fa8f810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f810f250 con 0x7fa8f80fbb40 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8fd1c4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f810f3c0 con 0x7fa8f8101b00 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52442/0 (socket says 172.21.15.38:52442) 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.289+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1796110549 learned_addr learned my addr 172.21.15.38:0/1796110549 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 0x7fa8f810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1796110549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 msgr2=0x7fa8f810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 0x7fa8f810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1796110549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec005040 con 0x7fa8f80fbb40 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800b7c0 tx=0x7fa8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e800f6f0 con 0x7fa8f80fbb40 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8117710 con 0x7fa8f80fbb40 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8e800fd00 con 0x7fa8f80fbb40 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e8011e90 con 0x7fa8f80fbb40 2023-12-16T20:18:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.290+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f8117c20 con 0x7fa8f80fbb40 2023-12-16T20:18:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.291+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f8103fb0 con 0x7fa8f80fbb40 2023-12-16T20:18:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.292+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa8e800f850 con 0x7fa8f80fbb40 2023-12-16T20:18:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.292+0000 7fa8df7fe700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 0x7fa8e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.292+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa8e808c0f0 con 0x7fa8f80fbb40 2023-12-16T20:18:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.293+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 0x7fa8e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.293+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 0x7fa8e006f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80666e0 tx=0x7fa8ec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:26.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.297+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa8e8056050 con 0x7fa8f80fbb40 2023-12-16T20:18:26.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:26 smithi141 ceph-mon[137587]: pgmap v141: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2023-12-16T20:18:26.496 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:26 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:26.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.521+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8f8066420 con 0x7fa8e006ce70 2023-12-16T20:18:26.522 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:26 smithi038 ceph-mon[163993]: pgmap v141: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2023-12-16T20:18:26.522 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:26 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:18:26.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.522+0000 7fa8df7fe700 1 -- 172.21.15.38:0/1796110549 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fa8f8066420 con 0x7fa8e006ce70 2023-12-16T20:18:26.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 msgr2=0x7fa8e006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 0x7fa8e006f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80666e0 tx=0x7fa8ec009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:26.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 msgr2=0x7fa8f810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800b7c0 tx=0x7fa8e8009250 comp rx=0 tx=0).stop 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 shutdown_connections 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa8e006ce70 0x7fa8e006f320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f80fbb40 0x7fa8f810e6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1796110549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8f8101b00 0x7fa8f810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 >> 172.21.15.38:0/1796110549 conn(0x7fa8f80f76c0 msgr2=0x7fa8f80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 shutdown_connections 2023-12-16T20:18:26.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.524+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1796110549 wait complete. 2023-12-16T20:18:26.536 INFO:teuthology.orchestra.run.smithi038.stdout:true 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 -- 172.21.15.38:0/723899318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 msgr2=0x7f2dc00fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 --2- 172.21.15.38:0/723899318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc00fee30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004940 tx=0x7f2db4009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 -- 172.21.15.38:0/723899318 shutdown_connections 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 --2- 172.21.15.38:0/723899318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc00fee30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 --2- 172.21.15.38:0/723899318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 0x7f2dc01051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 -- 172.21.15.38:0/723899318 >> 172.21.15.38:0/723899318 conn(0x7f2dc00fa990 msgr2=0x7f2dc00fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 -- 172.21.15.38:0/723899318 shutdown_connections 2023-12-16T20:18:26.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.630+0000 7f2dc6752700 1 -- 172.21.15.38:0/723899318 wait complete. 2023-12-16T20:18:26.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 Processor -- start 2023-12-16T20:18:26.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 -- start start 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 0x7f2dc01158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0116440 con 0x7f2dc01057c0 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dc6752700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc010f770 con 0x7f2dc0104e20 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dbf7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dbf7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52456/0 (socket says 172.21.15.38:52456) 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dbf7fe700 1 -- 172.21.15.38:0/3990242796 learned_addr learned my addr 172.21.15.38:0/3990242796 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.631+0000 7f2dbffff700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 0x7f2dc01158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbf7fe700 1 -- 172.21.15.38:0/3990242796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 msgr2=0x7f2dc01158b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbf7fe700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 0x7f2dc01158b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbf7fe700 1 -- 172.21.15.38:0/3990242796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4005040 con 0x7f2dc01057c0 2023-12-16T20:18:26.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbf7fe700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009fd0 tx=0x7f2db4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db400e040 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc010f9f0 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2db4013420 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db401c630 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.632+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc010ff30 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.633+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc01072f0 con 0x7f2dc01057c0 2023-12-16T20:18:26.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.634+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2db4013a00 con 0x7f2dc01057c0 2023-12-16T20:18:26.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.634+0000 7f2dbcff9700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 0x7f2da806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:26.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.634+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2db408d520 con 0x7f2dc01057c0 2023-12-16T20:18:26.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.634+0000 7f2dbffff700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 0x7f2da806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:26.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.635+0000 7f2dbffff700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 0x7f2da806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2db0004f40 tx=0x7f2db000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:26.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.639+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2db405af10 con 0x7f2dc01057c0 2023-12-16T20:18:26.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.858+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc010bdc0 con 0x7f2da806ce60 2023-12-16T20:18:26.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.859+0000 7f2dbcff9700 1 -- 172.21.15.38:0/3990242796 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f2dc010bdc0 con 0x7f2da806ce60 2023-12-16T20:18:26.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 msgr2=0x7f2da806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 0x7f2da806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2db0004f40 tx=0x7f2db000b040 comp rx=0 tx=0).stop 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 msgr2=0x7f2dc0115df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009fd0 tx=0x7f2db4009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 shutdown_connections 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2da806ce60 0x7f2da806f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2dc0104e20 0x7f2dc01158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 --2- 172.21.15.38:0/3990242796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2dc01057c0 0x7f2dc0115df0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.861+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 >> 172.21.15.38:0/3990242796 conn(0x7f2dc00fa990 msgr2=0x7f2dc00fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.862+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 shutdown_connections 2023-12-16T20:18:26.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:26.862+0000 7f2dc6752700 1 -- 172.21.15.38:0/3990242796 wait complete. 2023-12-16T20:18:26.874 INFO:teuthology.orchestra.run.smithi038.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-16T20:18:27.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch ps' 2023-12-16T20:18:27.394 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:27 smithi038 ceph-mon[163993]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:27.395 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:27 smithi038 ceph-mon[163993]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:27.435 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:27 smithi141 ceph-mon[137587]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:27.495 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:27 smithi141 ceph-mon[137587]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 -- 172.21.15.38:0/636574021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 msgr2=0x7fc354101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 --2- 172.21.15.38:0/636574021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354101640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc344009ce0 tx=0x7fc344004d10 comp rx=0 tx=0).stop 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 -- 172.21.15.38:0/636574021 shutdown_connections 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 --2- 172.21.15.38:0/636574021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 0x7fc3540fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 --2- 172.21.15.38:0/636574021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354101640 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 -- 172.21.15.38:0/636574021 >> 172.21.15.38:0/636574021 conn(0x7fc3540711a0 msgr2=0x7fc3540715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 -- 172.21.15.38:0/636574021 shutdown_connections 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.230+0000 7fc359a5a700 1 -- 172.21.15.38:0/636574021 wait complete. 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 Processor -- start 2023-12-16T20:18:28.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 -- start start 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 0x7fc354113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354114490 con 0x7fc354101270 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc359a5a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35410d730 con 0x7fc354101c10 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc352ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc352ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52466/0 (socket says 172.21.15.38:52466) 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc352ffd700 1 -- 172.21.15.38:0/3826002092 learned_addr learned my addr 172.21.15.38:0/3826002092 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.231+0000 7fc3527fc700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 0x7fc354113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc352ffd700 1 -- 172.21.15.38:0/3826002092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 msgr2=0x7fc354113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc352ffd700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 0x7fc354113db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc352ffd700 1 -- 172.21.15.38:0/3826002092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009940 con 0x7fc354101270 2023-12-16T20:18:28.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc352ffd700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc34400bee0 tx=0x7fc344004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34400e040 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc344008ea0 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34401c750 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35410d9b0 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.232+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35410def0 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.233+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354100590 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.234+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc344012b50 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.234+0000 7fc33b7fe700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 0x7fc33c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.234+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc34408de40 con 0x7fc354101270 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.234+0000 7fc3527fc700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 0x7fc33c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:28.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.235+0000 7fc3527fc700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 0x7fc33c06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc35410f0a0 tx=0x7fc3480091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.239+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc34405b830 con 0x7fc354101270 2023-12-16T20:18:28.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.453+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc354108340 con 0x7fc33c06ce60 2023-12-16T20:18:28.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.463+0000 7fc33b7fe700 1 -- 172.21.15.38:0/3826002092 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc34800e6b0 con 0x7fc33c06ce60 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (4m) 104s ago 12m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (3m) 104s ago 12m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (2m) 20s ago 11m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (4m) 104s ago 12m 78.6M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (8m) 104s ago 8m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (8m) 104s ago 8m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (8m) 20s ago 8m 67.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (8m) 20s ago 8m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (5m) 104s ago 13m 493M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (5m) 20s ago 11m 442M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:18:28.465 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (3m) 104s ago 13m 47.2M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (3m) 20s ago 11m 34.5M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (5m) 104s ago 12m 16.7M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (5m) 20s ago 11m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (2m) 104s ago 11m 85.8M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (2m) 104s ago 10m 93.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (107s) 104s ago 10m 12.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 2407bc0d39ec 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (79s) 20s ago 10m 99.0M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 f3d2e940f234 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (50s) 20s ago 9m 93.9M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 86f170b7bf0e 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (22s) 20s ago 9m 11.6M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 8e6cb8119501 2023-12-16T20:18:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 104s ago 11m 59.0M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 msgr2=0x7fc33c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 0x7fc33c06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc35410f0a0 tx=0x7fc3480091a0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 msgr2=0x7fc354113870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc34400bee0 tx=0x7fc344004d10 comp rx=0 tx=0).stop 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 shutdown_connections 2023-12-16T20:18:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc33c06ce60 0x7fc33c06f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc354101270 0x7fc354113870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 --2- 172.21.15.38:0/3826002092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc354101c10 0x7fc354113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 >> 172.21.15.38:0/3826002092 conn(0x7fc3540711a0 msgr2=0x7fc354104210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 shutdown_connections 2023-12-16T20:18:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:28.466+0000 7fc359a5a700 1 -- 172.21.15.38:0/3826002092 wait complete. 2023-12-16T20:18:28.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:28 smithi038 ceph-mon[163993]: pgmap v142: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:18:28.726 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch upgrade status' 2023-12-16T20:18:28.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:28 smithi141 ceph-mon[137587]: pgmap v142: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T20:18:28.995 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:29.626 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:29 smithi038 ceph-mon[163993]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 -- 172.21.15.38:0/949256931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3944102c70 msgr2=0x7f3944103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 --2- 172.21.15.38:0/949256931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3944102c70 0x7f3944103040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3934004940 tx=0x7f3934009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 -- 172.21.15.38:0/949256931 shutdown_connections 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 --2- 172.21.15.38:0/949256931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39440fb1e0 0x7f39440fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 --2- 172.21.15.38:0/949256931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3944102c70 0x7f3944103040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 -- 172.21.15.38:0/949256931 >> 172.21.15.38:0/949256931 conn(0x7f39440711a0 msgr2=0x7f39440715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 -- 172.21.15.38:0/949256931 shutdown_connections 2023-12-16T20:18:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.698+0000 7f3949f0b700 1 -- 172.21.15.38:0/949256931 wait complete. 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 Processor -- start 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 -- start start 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 0x7f3944113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394410d4b0 con 0x7f39440fb1e0 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f3949f0b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394410d620 con 0x7f3944102c70 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f39437fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f39437fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52474/0 (socket says 172.21.15.38:52474) 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.699+0000 7f39437fe700 1 -- 172.21.15.38:0/3517728980 learned_addr learned my addr 172.21.15.38:0/3517728980 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f3942ffd700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 0x7f3944113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f39437fe700 1 -- 172.21.15.38:0/3517728980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 msgr2=0x7f3944113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:29.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f39437fe700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 0x7f3944113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f39437fe700 1 -- 172.21.15.38:0/3517728980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934005040 con 0x7f39440fb1e0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f3942ffd700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 0x7f3944113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f39437fe700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f393400b3b0 tx=0x7f3934009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393400e040 con 0x7f39440fb1e0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394410d8a0 con 0x7f39440fb1e0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f393400bc50 con 0x7f39440fb1e0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3934013420 con 0x7f39440fb1e0 2023-12-16T20:18:29.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.700+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394410dde0 con 0x7f39440fb1e0 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.701+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3944072cc0 con 0x7f39440fb1e0 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.702+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f393401c430 con 0x7f39440fb1e0 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.702+0000 7f392bfff700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 0x7f392c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.702+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f393408d070 con 0x7f39440fb1e0 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.702+0000 7f3942ffd700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 0x7f392c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.703+0000 7f3942ffd700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 0x7f392c06f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3938006fd0 tx=0x7f3938008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:29.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.711+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f393405ab10 con 0x7f39440fb1e0 2023-12-16T20:18:29.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:29 smithi141 ceph-mon[137587]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:29.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.938+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f394410ec40 con 0x7f392c06ce60 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.939+0000 7f392bfff700 1 -- 172.21.15.38:0/3517728980 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f394410ec40 con 0x7f392c06ce60 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5", 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T20:18:29.940 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "12/21 daemons upgraded", 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": true 2023-12-16T20:18:29.941 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 msgr2=0x7f392c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 0x7f392c06f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3938006fd0 tx=0x7f3938008040 comp rx=0 tx=0).stop 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 msgr2=0x7f39441135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f393400b3b0 tx=0x7f3934009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 shutdown_connections 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f392c06ce60 0x7f392c06f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39440fb1e0 0x7f39441135f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 --2- 172.21.15.38:0/3517728980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3944102c70 0x7f3944113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:29.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 >> 172.21.15.38:0/3517728980 conn(0x7f39440711a0 msgr2=0x7f39440f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:29.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 shutdown_connections 2023-12-16T20:18:29.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:29.941+0000 7f3949f0b700 1 -- 172.21.15.38:0/3517728980 wait complete. 2023-12-16T20:18:30.220 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph health detail' 2023-12-16T20:18:30.496 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:30.567 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:30 smithi038 ceph-mon[163993]: pgmap v143: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:30.568 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:30 smithi038 ceph-mon[163993]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:30.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:30 smithi141 ceph-mon[137587]: pgmap v143: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:30.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:30 smithi141 ceph-mon[137587]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:18:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 -- 172.21.15.38:0/1976945872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58700fb1e0 msgr2=0x7f58700fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 --2- 172.21.15.38:0/1976945872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58700fb1e0 0x7f58700fb630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5864004940 tx=0x7f5864009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 -- 172.21.15.38:0/1976945872 shutdown_connections 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 --2- 172.21.15.38:0/1976945872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58700fb1e0 0x7f58700fb630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 --2- 172.21.15.38:0/1976945872 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5870102c70 0x7f5870103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 -- 172.21.15.38:0/1976945872 >> 172.21.15.38:0/1976945872 conn(0x7f58700711a0 msgr2=0x7f58700715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 -- 172.21.15.38:0/1976945872 shutdown_connections 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 -- 172.21.15.38:0/1976945872 wait complete. 2023-12-16T20:18:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.325+0000 7f58767da700 1 Processor -- start 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f58767da700 1 -- start start 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f58767da700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58700fb1e0 0x7f58700fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f58767da700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f58767da700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700fd000 con 0x7f5870102c70 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f58767da700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700fd170 con 0x7f58700fb1e0 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55892/0 (socket says 172.21.15.38:55892) 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 -- 172.21.15.38:0/2712362856 learned_addr learned my addr 172.21.15.38:0/2712362856 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586ffff700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58700fb1e0 0x7f58700fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 -- 172.21.15.38:0/2712362856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58700fb1e0 msgr2=0x7f58700fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58700fb1e0 0x7f58700fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 -- 172.21.15.38:0/2712362856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864005040 con 0x7f5870102c70 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.326+0000 7f586f7fe700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5864009fd0 tx=0x7f5864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.327+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586400e040 con 0x7f5870102c70 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.327+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f586400bc50 con 0x7f5870102c70 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.327+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870119890 con 0x7f5870102c70 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.327+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5864013ea0 con 0x7f5870102c70 2023-12-16T20:18:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.327+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5870119da0 con 0x7f5870102c70 2023-12-16T20:18:31.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.328+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5870072cc0 con 0x7f5870102c70 2023-12-16T20:18:31.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.328+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5864013420 con 0x7f5870102c70 2023-12-16T20:18:31.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.329+0000 7f586cff9700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 0x7f585806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.329+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f586408d750 con 0x7f5870102c70 2023-12-16T20:18:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.329+0000 7f586ffff700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 0x7f585806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.329+0000 7f586ffff700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 0x7f585806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5860006fd0 tx=0x7f5860008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:31.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.333+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f58640576b0 con 0x7f5870102c70 2023-12-16T20:18:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.619+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f58700fdb00 con 0x7f5870102c70 2023-12-16T20:18:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.620+0000 7f586cff9700 1 -- 172.21.15.38:0/2712362856 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7f586405acd0 con 0x7f5870102c70 2023-12-16T20:18:31.621 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-16T20:18:31.621 INFO:teuthology.orchestra.run.smithi038.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T20:18:31.621 INFO:teuthology.orchestra.run.smithi038.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-16T20:18:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 msgr2=0x7f585806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 0x7f585806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5860006fd0 tx=0x7f5860008040 comp rx=0 tx=0).stop 2023-12-16T20:18:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 msgr2=0x7f58700fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5864009fd0 tx=0x7f5864009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 shutdown_connections 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f585806ce70 0x7f585806f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58700fb1e0 0x7f58700fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 --2- 172.21.15.38:0/2712362856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5870102c70 0x7f58700fc920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 >> 172.21.15.38:0/2712362856 conn(0x7f58700711a0 msgr2=0x7f58700fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 shutdown_connections 2023-12-16T20:18:31.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:31.622+0000 7f58767da700 1 -- 172.21.15.38:0/2712362856 wait complete. 2023-12-16T20:18:32.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions' 2023-12-16T20:18:32.277 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:32.634 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:32 smithi038 ceph-mon[163993]: pgmap v144: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:32.634 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:32 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2712362856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:18:32.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:32 smithi141 ceph-mon[137587]: pgmap v144: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:32.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:32 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2712362856' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T20:18:33.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.124+0000 7fa794633700 1 -- 172.21.15.38:0/2537694028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 msgr2=0x7fa78c103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:33.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.124+0000 7fa794633700 1 --2- 172.21.15.38:0/2537694028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c103040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa788004940 tx=0x7fa788009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:33.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 -- 172.21.15.38:0/2537694028 shutdown_connections 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 --2- 172.21.15.38:0/2537694028 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 0x7fa78c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 --2- 172.21.15.38:0/2537694028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c103040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 -- 172.21.15.38:0/2537694028 >> 172.21.15.38:0/2537694028 conn(0x7fa78c0711a0 msgr2=0x7fa78c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 -- 172.21.15.38:0/2537694028 shutdown_connections 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 -- 172.21.15.38:0/2537694028 wait complete. 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 Processor -- start 2023-12-16T20:18:33.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.125+0000 7fa794633700 1 -- start start 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa794633700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 0x7fa78c113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa794633700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa794633700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c114200 con 0x7fa78c102c70 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa794633700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c10d4f0 con 0x7fa78c0fb1e0 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55902/0 (socket says 172.21.15.38:55902) 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 -- 172.21.15.38:0/1271498882 learned_addr learned my addr 172.21.15.38:0/1271498882 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa7923cf700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 0x7fa78c113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 -- 172.21.15.38:0/1271498882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 msgr2=0x7fa78c113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 0x7fa78c113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 -- 172.21.15.38:0/1271498882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788005040 con 0x7fa78c102c70 2023-12-16T20:18:33.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.126+0000 7fa791bce700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa77c002a50 tx=0x7fa77c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.127+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77c007cc0 con 0x7fa78c102c70 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.127+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa77c00f040 con 0x7fa78c102c70 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.127+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77c00d9c0 con 0x7fa78c102c70 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.127+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c10d780 con 0x7fa78c102c70 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.127+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c10dcc0 con 0x7fa78c102c70 2023-12-16T20:18:33.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.128+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c0fff10 con 0x7fa78c102c70 2023-12-16T20:18:33.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.128+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa77c00db20 con 0x7fa78c102c70 2023-12-16T20:18:33.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.129+0000 7fa782ffd700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 0x7fa77806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:18:33.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.129+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa77c08bf10 con 0x7fa78c102c70 2023-12-16T20:18:33.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.129+0000 7fa7923cf700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 0x7fa77806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:18:33.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.129+0000 7fa7923cf700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 0x7fa77806f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b840 tx=0x7fa788009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:18:33.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.133+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa77c059900 con 0x7fa78c102c70 2023-12-16T20:18:33.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.420+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa78c10ec10 con 0x7fa78c102c70 2023-12-16T20:18:33.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.420+0000 7fa782ffd700 1 -- 172.21.15.38:0/1271498882 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7fa77c059490 con 0x7fa78c102c70 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 6 2023-12-16T20:18:33.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 10 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:18:33.423 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 msgr2=0x7fa77806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 0x7fa77806f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b840 tx=0x7fa788009e30 comp rx=0 tx=0).stop 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 msgr2=0x7fa78c113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa77c002a50 tx=0x7fa77c0046b0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 shutdown_connections 2023-12-16T20:18:33.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa77806ce70 0x7fa77806f320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa78c0fb1e0 0x7fa78c113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 --2- 172.21.15.38:0/1271498882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa78c102c70 0x7fa78c113bb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:18:33.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 >> 172.21.15.38:0/1271498882 conn(0x7fa78c0711a0 msgr2=0x7fa78c0fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:18:33.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 shutdown_connections 2023-12-16T20:18:33.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:18:33.423+0000 7fa794633700 1 -- 172.21.15.38:0/1271498882 wait complete. 2023-12-16T20:18:33.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-16T20:18:33.932 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:34.591 INFO:teuthology.orchestra.run.smithi038.stdout:wait for servicemap items w/ changing names to refresh 2023-12-16T20:18:34.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:34 smithi038 ceph-mon[163993]: pgmap v145: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:34.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:34 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1271498882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:34.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:34 smithi141 ceph-mon[137587]: pgmap v145: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:34.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:34 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1271498882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:18:34.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'sleep 60' 2023-12-16T20:18:35.240 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:18:35.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:35.720 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:36.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:36 smithi141 ceph-mon[137587]: pgmap v146: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:36.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:36 smithi038 ceph-mon[163993]: pgmap v146: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:38.697 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:38 smithi038 ceph-mon[163993]: pgmap v147: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:38.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:38 smithi141 ceph-mon[137587]: pgmap v147: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:40.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:40 smithi141 ceph-mon[137587]: pgmap v148: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:40.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:40 smithi038 ceph-mon[163993]: pgmap v148: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:42.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:42 smithi141 ceph-mon[137587]: pgmap v149: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:42.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:42 smithi038 ceph-mon[163993]: pgmap v149: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:44.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:44 smithi141 ceph-mon[137587]: pgmap v150: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:44.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:44 smithi038 ceph-mon[163993]: pgmap v150: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:46 smithi141 ceph-mon[137587]: pgmap v151: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:46.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:46 smithi038 ceph-mon[163993]: pgmap v151: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:48.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:48 smithi141 ceph-mon[137587]: pgmap v152: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:48.751 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:48 smithi038 ceph-mon[163993]: pgmap v152: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:50.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:50 smithi141 ceph-mon[137587]: pgmap v153: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:50.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:50 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:50.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:50 smithi038 ceph-mon[163993]: pgmap v153: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:50.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:50 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:18:52.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:52 smithi141 ceph-mon[137587]: pgmap v154: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:52.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:52 smithi038 ceph-mon[163993]: pgmap v154: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:54.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:54 smithi141 ceph-mon[137587]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:54.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:54 smithi038 ceph-mon[163993]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:56.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:56 smithi141 ceph-mon[137587]: pgmap v156: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:56.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:56 smithi038 ceph-mon[163993]: pgmap v156: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:18:58.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:18:58 smithi141 ceph-mon[137587]: pgmap v157: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:18:58.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:18:58 smithi038 ceph-mon[163993]: pgmap v157: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:00.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:00 smithi141 ceph-mon[137587]: pgmap v158: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:00.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:00 smithi038 ceph-mon[163993]: pgmap v158: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:02.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:02 smithi141 ceph-mon[137587]: pgmap v159: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:02.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:02 smithi038 ceph-mon[163993]: pgmap v159: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:04.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:04 smithi141 ceph-mon[137587]: pgmap v160: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:04.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:04 smithi038 ceph-mon[163993]: pgmap v160: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:05.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:05 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:05.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:05 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:06.745 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:06 smithi141 ceph-mon[137587]: pgmap v161: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:06.896 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:06 smithi038 ceph-mon[163993]: pgmap v161: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:08.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:08 smithi038 ceph-mon[163993]: pgmap v162: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:08.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:08 smithi141 ceph-mon[137587]: pgmap v162: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:10.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:10 smithi038 ceph-mon[163993]: pgmap v163: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:10.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:10 smithi141 ceph-mon[137587]: pgmap v163: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:11.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:11 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:19:11.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:11 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T20:19:12.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:12 smithi038 ceph-mon[163993]: pgmap v164: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:19:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:19:12.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:12 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:19:12.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:12 smithi141 ceph-mon[137587]: pgmap v164: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T20:19:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T20:19:12.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:12 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' 2023-12-16T20:19:14.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:14 smithi038 ceph-mon[163993]: pgmap v165: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:14.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:14 smithi141 ceph-mon[137587]: pgmap v165: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:16.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:16 smithi038 ceph-mon[163993]: pgmap v166: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:16.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:16 smithi141 ceph-mon[137587]: pgmap v166: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:18.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:18 smithi038 ceph-mon[163993]: pgmap v167: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:18.997 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:18 smithi141 ceph-mon[137587]: pgmap v167: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:20 smithi038 ceph-mon[163993]: pgmap v168: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:20.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:20 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:20.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:20 smithi141 ceph-mon[137587]: pgmap v168: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:20.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:20 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:22.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:22 smithi038 ceph-mon[163993]: pgmap v169: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:22.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:22 smithi141 ceph-mon[137587]: pgmap v169: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:24.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:24 smithi038 ceph-mon[163993]: pgmap v170: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:24.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:24 smithi141 ceph-mon[137587]: pgmap v170: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:26.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:26 smithi038 ceph-mon[163993]: pgmap v171: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:26.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:26 smithi141 ceph-mon[137587]: pgmap v171: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:28.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:28 smithi038 ceph-mon[163993]: pgmap v172: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:28.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:28 smithi141 ceph-mon[137587]: pgmap v172: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:30.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:30 smithi038 ceph-mon[163993]: pgmap v173: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:30.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:30 smithi141 ceph-mon[137587]: pgmap v173: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:32.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:32 smithi038 ceph-mon[163993]: pgmap v174: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:32.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:32 smithi141 ceph-mon[137587]: pgmap v174: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:34.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:34 smithi038 ceph-mon[163993]: pgmap v175: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:34.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:34 smithi141 ceph-mon[137587]: pgmap v175: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:35.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:35 smithi038 ceph-mon[163993]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:35.970 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:35 smithi141 ceph-mon[137587]: from='mgr.34102 172.21.15.38:0/957222244' entity='mgr.smithi038.gdlrfj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T20:19:36.280 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph orch ps' 2023-12-16T20:19:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:19:36.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:36 smithi038 ceph-mon[163993]: pgmap v176: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:36.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:36 smithi141 ceph-mon[137587]: pgmap v176: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 -- 172.21.15.38:0/3344369781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0101b00 msgr2=0x7fc5b0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3344369781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0101b00 0x7fc5b0101ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac004940 tx=0x7fc5ac009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 -- 172.21.15.38:0/3344369781 shutdown_connections 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3344369781 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5b00fbb40 0x7fc5b00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3344369781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0101b00 0x7fc5b0101ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 -- 172.21.15.38:0/3344369781 >> 172.21.15.38:0/3344369781 conn(0x7fc5b00719b0 msgr2=0x7fc5b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 -- 172.21.15.38:0/3344369781 shutdown_connections 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.344+0000 7fc5b861a700 1 -- 172.21.15.38:0/3344369781 wait complete. 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 Processor -- start 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 -- start start 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5b0101b00 0x7fc5b0113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b010d500 con 0x7fc5b00fbb40 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b861a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b010d670 con 0x7fc5b0101b00 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b63b6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b63b6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53868/0 (socket says 172.21.15.38:53868) 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.345+0000 7fc5b63b6700 1 -- 172.21.15.38:0/3388209249 learned_addr learned my addr 172.21.15.38:0/3388209249 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b63b6700 1 -- 172.21.15.38:0/3388209249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5b0101b00 msgr2=0x7fc5b0113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b63b6700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5b0101b00 0x7fc5b0113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b63b6700 1 -- 172.21.15.38:0/3388209249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac005040 con 0x7fc5b00fbb40 2023-12-16T20:19:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b63b6700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009fd0 tx=0x7fc5ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac00e040 con 0x7fc5b00fbb40 2023-12-16T20:19:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5ac00bc50 con 0x7fc5b00fbb40 2023-12-16T20:19:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b010d8f0 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac013ea0 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.346+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b010de30 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.347+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00734d0 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.348+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc5ac013420 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.348+0000 7fc5a6ffd700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 0x7fc59c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.348+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc5ac08d770 con 0x7fc5b00fbb40 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.348+0000 7fc5b5bb5700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 0x7fc59c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.349+0000 7fc5b5bb5700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 0x7fc59c06f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0006fd0 tx=0x7fc5a0006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.353+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc5ac05b160 con 0x7fc5b00fbb40 2023-12-16T20:19:37.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.568+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 --> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b010ec20 con 0x7fc59c06ce70 2023-12-16T20:19:37.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.578+0000 7fc5a6ffd700 1 -- 172.21.15.38:0/3388209249 <== mgr.34102 v2:172.21.15.38:6800/3824811739 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc5b010ec20 con 0x7fc59c06ce70 2023-12-16T20:19:37.580 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T20:19:37.580 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (5m) 2m ago 13m 27.7M - 0.25.0 c8568f914cd2 0fc6b11c9220 2023-12-16T20:19:37.580 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (4m) 2m ago 13m 6665k - 19.0.0-202-gc7586e95 e538bb48aa15 9431965ca8a5 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi141 smithi141 running (4m) 90s ago 12m 6660k - 19.0.0-202-gc7586e95 e538bb48aa15 3d646cc67a37 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (5m) 2m ago 13m 78.6M - 9.4.12 a0ea5e3c46d9 394f7b8905d1 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.aofkae smithi038 running (10m) 2m ago 9m 127M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4cd96cd0d829 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dbcjir smithi038 running (10m) 2m ago 10m 62.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9e92e9487e44 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.eyrunj smithi141 running (9m) 90s ago 9m 67.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd867748a371 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi141.xhutny smithi141 running (10m) 90s ago 10m 118M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4179e4b6df81 2023-12-16T20:19:37.581 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.gdlrfj smithi038 *:8443,9283,8765 running (7m) 2m ago 14m 493M - 19.0.0-202-gc7586e95 e538bb48aa15 24a7c39eb282 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi141.cycgjd smithi141 *:8443,9283,8765 running (6m) 90s ago 12m 442M - 19.0.0-202-gc7586e95 e538bb48aa15 853ddb871bf5 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (4m) 2m ago 14m 47.2M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 437ac35e3b7f 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi141 smithi141 running (4m) 90s ago 12m 34.5M 2048M 19.0.0-202-gc7586e95 e538bb48aa15 6b6a7721fefe 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (6m) 2m ago 13m 16.7M - 1.5.0 0da6a335fe13 dac393c929dd 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi141 smithi141 *:9100 running (6m) 90s ago 12m 15.0M - 1.5.0 0da6a335fe13 e6fa8fad8391 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 2m ago 12m 85.8M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 893b19acd14a 2023-12-16T20:19:37.582 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (3m) 2m ago 11m 93.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 8ac075df9f9e 2023-12-16T20:19:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (2m) 2m ago 11m 12.0M 1559M 19.0.0-202-gc7586e95 e538bb48aa15 2407bc0d39ec 2023-12-16T20:19:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi141 running (2m) 90s ago 11m 99.0M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 f3d2e940f234 2023-12-16T20:19:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi141 running (119s) 90s ago 11m 93.9M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 86f170b7bf0e 2023-12-16T20:19:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi141 running (92s) 90s ago 10m 11.6M 2581M 19.0.0-202-gc7586e95 e538bb48aa15 8e6cb8119501 2023-12-16T20:19:37.583 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (6m) 2m ago 13m 59.0M - 2.43.0 a07b618ecd1d 842a5656a07a 2023-12-16T20:19:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 msgr2=0x7fc59c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 0x7fc59c06f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0006fd0 tx=0x7fc5a0006db0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 msgr2=0x7fc5b0113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009fd0 tx=0x7fc5ac009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 shutdown_connections 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fc59c06ce70 0x7fc59c06f320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b00fbb40 0x7fc5b0113640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 --2- 172.21.15.38:0/3388209249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5b0101b00 0x7fc5b0113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 >> 172.21.15.38:0/3388209249 conn(0x7fc5b00719b0 msgr2=0x7fc5b00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 shutdown_connections 2023-12-16T20:19:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:37.581+0000 7fc5b861a700 1 -- 172.21.15.38:0/3388209249 wait complete. 2023-12-16T20:19:37.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions' 2023-12-16T20:19:38.114 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:19:38.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:38 smithi038 ceph-mon[163993]: pgmap v177: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:38.645 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:38 smithi038 ceph-mon[163993]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:19:38.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 -- 172.21.15.38:0/3896891904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea44102c70 msgr2=0x7fea44103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 --2- 172.21.15.38:0/3896891904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea44102c70 0x7fea44103040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea38004940 tx=0x7fea38009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 -- 172.21.15.38:0/3896891904 shutdown_connections 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 --2- 172.21.15.38:0/3896891904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea440fb1e0 0x7fea440fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 --2- 172.21.15.38:0/3896891904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea44102c70 0x7fea44103040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 -- 172.21.15.38:0/3896891904 >> 172.21.15.38:0/3896891904 conn(0x7fea440711a0 msgr2=0x7fea440715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 -- 172.21.15.38:0/3896891904 shutdown_connections 2023-12-16T20:19:38.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.861+0000 7fea4abec700 1 -- 172.21.15.38:0/3896891904 wait complete. 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 Processor -- start 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 -- start start 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea44102c70 0x7fea440fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440fcf00 con 0x7fea440fb1e0 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea4abec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440fd070 con 0x7fea44102c70 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea48988700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea48988700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53884/0 (socket says 172.21.15.38:53884) 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.862+0000 7fea48988700 1 -- 172.21.15.38:0/1706650993 learned_addr learned my addr 172.21.15.38:0/1706650993 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea43fff700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea44102c70 0x7fea440fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:38.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea48988700 1 -- 172.21.15.38:0/1706650993 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea44102c70 msgr2=0x7fea440fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea48988700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea44102c70 0x7fea440fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea48988700 1 -- 172.21.15.38:0/1706650993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38005040 con 0x7fea440fb1e0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea48988700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b3b0 tx=0x7fea38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3800e040 con 0x7fea440fb1e0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea3800bc50 con 0x7fea440fb1e0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea38013420 con 0x7fea440fb1e0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea44119840 con 0x7fea440fb1e0 2023-12-16T20:19:38.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.863+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea44119c50 con 0x7fea440fb1e0 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.864+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea440fff10 con 0x7fea440fb1e0 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.865+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fea3801c430 con 0x7fea440fb1e0 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.865+0000 7fea417fa700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 0x7fea3406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.865+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fea3808d070 con 0x7fea440fb1e0 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.865+0000 7fea43fff700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 0x7fea3406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:38.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.866+0000 7fea43fff700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 0x7fea3406f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea440fddc0 tx=0x7fea30009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:38.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:38.870+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fea38057080 con 0x7fea440fb1e0 2023-12-16T20:19:38.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:38 smithi141 ceph-mon[137587]: pgmap v177: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:38.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:38 smithi141 ceph-mon[137587]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T20:19:39.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.191+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fea4404bbb0 con 0x7fea440fb1e0 2023-12-16T20:19:39.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.192+0000 7fea417fa700 1 -- 172.21.15.38:0/1706650993 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7fea3805a6a0 con 0x7fea440fb1e0 2023-12-16T20:19:39.193 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 2 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 6 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2023-12-16T20:19:39.194 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)": 10 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 msgr2=0x7fea3406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 0x7fea3406f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea440fddc0 tx=0x7fea30009ee0 comp rx=0 tx=0).stop 2023-12-16T20:19:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 msgr2=0x7fea440fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b3b0 tx=0x7fea38009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 shutdown_connections 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fea3406ce60 0x7fea3406f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea440fb1e0 0x7fea440fc3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 --2- 172.21.15.38:0/1706650993 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea44102c70 0x7fea440fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 >> 172.21.15.38:0/1706650993 conn(0x7fea440711a0 msgr2=0x7fea440fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 shutdown_connections 2023-12-16T20:19:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:39.194+0000 7fea4abec700 1 -- 172.21.15.38:0/1706650993 wait complete. 2023-12-16T20:19:39.484 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-16T20:19:39.644 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:39 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1706650993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:19:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/mon.smithi038/config 2023-12-16T20:19:39.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:39 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1706650993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 -- 172.21.15.38:0/2932480008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c0fb1e0 msgr2=0x7f2e7c0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 --2- 172.21.15.38:0/2932480008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fb630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e70004940 tx=0x7f2e70009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 -- 172.21.15.38:0/2932480008 shutdown_connections 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 --2- 172.21.15.38:0/2932480008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fb630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 --2- 172.21.15.38:0/2932480008 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c102c70 0x7f2e7c103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 -- 172.21.15.38:0/2932480008 >> 172.21.15.38:0/2932480008 conn(0x7f2e7c0711a0 msgr2=0x7f2e7c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:40.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 -- 172.21.15.38:0/2932480008 shutdown_connections 2023-12-16T20:19:40.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.422+0000 7f2e812b2700 1 -- 172.21.15.38:0/2932480008 wait complete. 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 Processor -- start 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 -- start start 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0fcf00 con 0x7f2e7c102c70 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.423+0000 7f2e812b2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0fd070 con 0x7f2e7c0fb1e0 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53904/0 (socket says 172.21.15.38:53904) 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 -- 172.21.15.38:0/4265109466 learned_addr learned my addr 172.21.15.38:0/4265109466 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7affd700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 -- 172.21.15.38:0/4265109466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c0fb1e0 msgr2=0x7f2e7c0fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 -- 172.21.15.38:0/4265109466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70005040 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e7a7fc700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009fd0 tx=0x7f2e70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7000e040 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e70013420 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7001c630 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c119840 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.424+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c119ca0 con 0x7f2e7c102c70 2023-12-16T20:19:40.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.425+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c105050 con 0x7f2e7c102c70 2023-12-16T20:19:40.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.426+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2e70013590 con 0x7f2e7c102c70 2023-12-16T20:19:40.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.426+0000 7f2e637fe700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 0x7f2e6406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:40.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.426+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2e7008d480 con 0x7f2e7c102c70 2023-12-16T20:19:40.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.426+0000 7f2e7affd700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 0x7f2e6406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:40.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.427+0000 7f2e7affd700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 0x7f2e6406f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c004f40 tx=0x7f2e6c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:40.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.431+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2e70057480 con 0x7f2e7c102c70 2023-12-16T20:19:40.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.719+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e7c072cc0 con 0x7f2e7c102c70 2023-12-16T20:19:40.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.720+0000 7f2e637fe700 1 -- 172.21.15.38:0/4265109466 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f2e7005aaa0 con 0x7f2e7c102c70 2023-12-16T20:19:40.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 msgr2=0x7f2e6406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:40.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 0x7f2e6406f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c004f40 tx=0x7f2e6c00b040 comp rx=0 tx=0).stop 2023-12-16T20:19:40.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 msgr2=0x7f2e7c0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009fd0 tx=0x7f2e70009e30 comp rx=0 tx=0).stop 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 shutdown_connections 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f2e6406ce70 0x7f2e6406f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e7c0fb1e0 0x7f2e7c0fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 --2- 172.21.15.38:0/4265109466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e7c102c70 0x7f2e7c0fc900 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 >> 172.21.15.38:0/4265109466 conn(0x7f2e7c0711a0 msgr2=0x7f2e7c0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 shutdown_connections 2023-12-16T20:19:40.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:40.722+0000 7f2e812b2700 1 -- 172.21.15.38:0/4265109466 wait complete. 2023-12-16T20:19:40.734 INFO:teuthology.orchestra.run.smithi038.stdout:false 2023-12-16T20:19:40.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:40 smithi038 ceph-mon[163993]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:40.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:19:40.984 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T20:19:41.061 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7d88989a8dec406daafb94668b5dc45f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T20:19:41.064 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-16T20:19:41.074 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-16T20:19:41.075 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:19:41.075 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:19:41.090 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:40 smithi141 ceph-mon[137587]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:41.106 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-16T20:19:41.106 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:19:41.162 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:19:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 -- 172.21.15.38:0/471798708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 msgr2=0x7fca480fb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 --2- 172.21.15.38:0/471798708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca480fb330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca380048d0 tx=0x7fca38009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 -- 172.21.15.38:0/471798708 shutdown_connections 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 --2- 172.21.15.38:0/471798708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca480fb330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 --2- 172.21.15.38:0/471798708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 0x7fca48101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 -- 172.21.15.38:0/471798708 >> 172.21.15.38:0/471798708 conn(0x7fca48071dc0 msgr2=0x7fca480721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 -- 172.21.15.38:0/471798708 shutdown_connections 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 -- 172.21.15.38:0/471798708 wait complete. 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.308+0000 7fca4f907640 1 Processor -- start 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4f907640 1 -- start start 2023-12-16T20:19:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4f907640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4f907640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 0x7fca48111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4f907640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca48112160 con 0x7fca480faee0 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4f907640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4810b6d0 con 0x7fca48100ea0 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59484/0 (socket says 172.21.15.38:59484) 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 -- 172.21.15.38:0/1031443165 learned_addr learned my addr 172.21.15.38:0/1031443165 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4cea2640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 0x7fca48111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 -- 172.21.15.38:0/1031443165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 msgr2=0x7fca48111b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 0x7fca48111b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 -- 172.21.15.38:0/1031443165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38005040 con 0x7fca480faee0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca4d6a3640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca4400fce0 tx=0x7fca44004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.309+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4400de30 con 0x7fca480faee0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.310+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca440090d0 con 0x7fca480faee0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.310+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca440126a0 con 0x7fca480faee0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.310+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4810b950 con 0x7fca480faee0 2023-12-16T20:19:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.310+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4810bec0 con 0x7fca480faee0 2023-12-16T20:19:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.311+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca481112f0 con 0x7fca480faee0 2023-12-16T20:19:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.311+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fca44009240 con 0x7fca480faee0 2023-12-16T20:19:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.311+0000 7fca3dffb640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 0x7fca3406f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.311+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fca4408e820 con 0x7fca480faee0 2023-12-16T20:19:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.312+0000 7fca4cea2640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 0x7fca3406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.312+0000 7fca4cea2640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 0x7fca3406f290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca38034040 tx=0x7fca38009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.316+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fca440587b0 con 0x7fca480faee0 2023-12-16T20:19:41.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.494+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca48063ce0 con 0x7fca480faee0 2023-12-16T20:19:41.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.495+0000 7fca3dffb640 1 -- 172.21.15.38:0/1031443165 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16443 (secure 0 0 0) 0x7fca4405bdd0 con 0x7fca480faee0 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:18:12.673807+0000","last_up_change":"2023-12-16T20:18:11.670604+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T20:09:31.147492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T20:09:31.639182+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6803","nonce":3568061758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6805","nonce":3568061758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6809","nonce":3568061758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6807","nonce":3568061758}]},"public_addr":"172.21.15.38:6803/3568061758","cluster_addr":"172.21.15.38:6805/3568061758","heartbeat_back_addr":"172.21.15.38:6809/3568061758","heartbeat_front_addr":"172.21.15.38:6807/3568061758","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6811","nonce":3130410261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6813","nonce":3130410261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6817","nonce":3130410261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6815","nonce":3130410261}]},"public_addr":"172.21.15.38:6811/3130410261","cluster_addr":"172.21.15.38:6813/3130410261","heartbeat_back_addr":"172.21.15.38:6817/3130410261","heartbeat_front_addr":"172.21.15.38:6815/3130410261","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6819","nonce":2661634231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6821","nonce":2661634231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6825","nonce":2661634231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6823","nonce":2661634231}]},"public_addr":"172.21.15.38:6819/2661634231","cluster_addr":"172.21.15.38:6821/2661634231","heartbeat_back_addr":"172.21.15.38:6825/2661634231","heartbeat_front_addr":"172.21.15.38:6823/2661634231","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6801","nonce":2635655003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6803","nonce":2635655003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6807","nonce":2635655003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6805","nonce":2635655003}]},"public_addr":"172.21.15.141:6801/2635655003","cluster_addr":"172.21.15.141:6803/2635655003","heartbeat_back_addr":"172.21.15.141:6807/2635655003","heartbeat_front_addr":"172.21.15.141:6805/2635655003","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6809","nonce":2242976419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6811","nonce":2242976419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6815","nonce":2242976419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6813","nonce":2242976419}]},"public_addr":"172.21.15.141:6809/2242976419","cluster_addr":"172.21.15.141:6811/2242976419","heartbeat_back_addr":"172.21.15.141:6815/2242976419","heartbeat_front_addr":"172.21.15.141:6813/2242976419","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6817","nonce":3891441344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6819","nonce":3891441344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6823","nonce":3891441344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6821","nonce":3891441344}]},"public_addr":"172.21.15.141:6817/3891441344","cluster_addr":"172.21.15.141:6819/3891441344","heartbeat_back_addr":"172.21.15.141:6823/3891441344","heartbeat_front_addr":"172.21.15.141:6821/3891441344","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/3787041257":"2023-12-17T20:14:50.024450+0000","172.21.15.38:0/4137995363":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6801/3097077380":"2023-12-17T20:11:28.170588+0000","172.21.15.38:0/4145377918":"2023-12-17T20:11:28.170588+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/3571172552":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6800/3097077380":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.141:0/246578244":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6827/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:0/1425692992":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6800/4126814688":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000","172.21.15.141:6828/1534563216":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6826/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:0/3535750768":"2023-12-17T20:14:50.024450+0000","172.21.15.141:6829/1534563216":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.141:0/650036288":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000","172.21.15.141:0/1813051126":"2023-12-17T20:12:38.199399+0000","172.21.15.141:0/1610209447":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3835823800":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/3890487682":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.141:0/2050386671":"2023-12-17T20:12:38.199399+0000","172.21.15.141:0/3799344375":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6801/4126814688":"2023-12-17T20:14:50.024450+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 msgr2=0x7fca3406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 0x7fca3406f290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca38034040 tx=0x7fca38009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 msgr2=0x7fca48111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca4400fce0 tx=0x7fca44004600 comp rx=0 tx=0).stop 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 shutdown_connections 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca48100ea0 0x7fca48111b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fca3406cde0 0x7fca3406f290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 --2- 172.21.15.38:0/1031443165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca480faee0 0x7fca48111620 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 >> 172.21.15.38:0/1031443165 conn(0x7fca48071dc0 msgr2=0x7fca480f9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 shutdown_connections 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.497+0000 7fca4f907640 1 -- 172.21.15.38:0/1031443165 wait complete. 2023-12-16T20:19:41.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:08:07.208300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T20:09:31.147492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T20:09:31.639182+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T20:19:41.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 -- 172.21.15.38:0/1937644451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc01020b0 msgr2=0x7fadc0102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/1937644451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc01020b0 0x7fadc0102480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fadb00048d0 tx=0x7fadb0009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 -- 172.21.15.38:0/1937644451 shutdown_connections 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/1937644451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc0064150 0x7fadc00645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/1937644451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc01020b0 0x7fadc0102480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 -- 172.21.15.38:0/1937644451 >> 172.21.15.38:0/1937644451 conn(0x7fadc0070f50 msgr2=0x7fadc0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:41.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 -- 172.21.15.38:0/1937644451 shutdown_connections 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 -- 172.21.15.38:0/1937644451 wait complete. 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.616+0000 7fadc5b9d640 1 Processor -- start 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadc5b9d640 1 -- start start 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadc5b9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadc5b9d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc01020b0 0x7fadc0112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadc5b9d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0113380 con 0x7fadc0064150 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadc5b9d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc010c8e0 con 0x7fadc01020b0 2023-12-16T20:19:41.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59500/0 (socket says 172.21.15.38:59500) 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 -- 172.21.15.38:0/2547050100 learned_addr learned my addr 172.21.15.38:0/2547050100 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbeffd640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc01020b0 0x7fadc0112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 -- 172.21.15.38:0/2547050100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc01020b0 msgr2=0x7fadc0112d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc01020b0 0x7fadc0112d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.617+0000 7fadbf7fe640 1 -- 172.21.15.38:0/2547050100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0005040 con 0x7fadc0064150 2023-12-16T20:19:41.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.618+0000 7fadbf7fe640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fadb002bda0 tx=0x7fadb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.619+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadb00092e0 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.619+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fadb00098f0 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.619+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc010cb60 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.619+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadb003b400 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.619+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc010d080 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.620+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0063ce0 con 0x7fadc0064150 2023-12-16T20:19:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.620+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fadb002f070 con 0x7fadc0064150 2023-12-16T20:19:41.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.621+0000 7fada7fff640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 0x7fada806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.621+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fadb00ae760 con 0x7fadc0064150 2023-12-16T20:19:41.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.621+0000 7fadbeffd640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 0x7fada806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.621+0000 7fadbeffd640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 0x7fada806f280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fadc010dc10 tx=0x7fadb400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.625+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fadb0078640 con 0x7fadc0064150 2023-12-16T20:19:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.803+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadc00ff2f0 con 0x7fadc0064150 2023-12-16T20:19:41.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.803+0000 7fada7fff640 1 -- 172.21.15.38:0/2547050100 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadb007bc60 con 0x7fadc0064150 2023-12-16T20:19:41.805 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 msgr2=0x7fada806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 0x7fada806f280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fadc010dc10 tx=0x7fadb400b040 comp rx=0 tx=0).stop 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 msgr2=0x7fadc01127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fadb002bda0 tx=0x7fadb0009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 shutdown_connections 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadc01020b0 0x7fadc0112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fada806cdd0 0x7fada806f280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 --2- 172.21.15.38:0/2547050100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadc0064150 0x7fadc01127f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.805+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 >> 172.21.15.38:0/2547050100 conn(0x7fadc0070f50 msgr2=0x7fadc00fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.806+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 shutdown_connections 2023-12-16T20:19:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.806+0000 7fadc5b9d640 1 -- 172.21.15.38:0/2547050100 wait complete. 2023-12-16T20:19:41.816 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:41 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/4265109466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:19:41.817 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:41 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1031443165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:19:41.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T20:19:41.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 -- 172.21.15.38:0/1805246600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fd090 msgr2=0x7f58500fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 --2- 172.21.15.38:0/1805246600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fd090 0x7f58500fd460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c50 tx=0x7f584c004d10 comp rx=0 tx=0).stop 2023-12-16T20:19:41.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 -- 172.21.15.38:0/1805246600 shutdown_connections 2023-12-16T20:19:41.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 --2- 172.21.15.38:0/1805246600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fda30 0x7f5850106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 --2- 172.21.15.38:0/1805246600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fd090 0x7f58500fd460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 -- 172.21.15.38:0/1805246600 >> 172.21.15.38:0/1805246600 conn(0x7f58500f6b10 msgr2=0x7f58500f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 -- 172.21.15.38:0/1805246600 shutdown_connections 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.923+0000 7f585806e640 1 -- 172.21.15.38:0/1805246600 wait complete. 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 Processor -- start 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 -- start start 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fd090 0x7f5850112840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501133d0 con 0x7f58500fda30 2023-12-16T20:19:41.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f585806e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585010c930 con 0x7f58500fd090 2023-12-16T20:19:41.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59512/0 (socket says 172.21.15.38:59512) 2023-12-16T20:19:41.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855e0a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fd090 0x7f5850112840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 -- 172.21.15.38:0/694233417 learned_addr learned my addr 172.21.15.38:0/694233417 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 -- 172.21.15.38:0/694233417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fd090 msgr2=0x7f5850112840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fd090 0x7f5850112840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.924+0000 7f5855609640 1 -- 172.21.15.38:0/694233417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0098b0 con 0x7f58500fda30 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f5855609640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f584000c810 tx=0x7f58400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f584000a820 con 0x7f58500fda30 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585010cc10 con 0x7f58500fda30 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f584000ae30 con 0x7f58500fda30 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58400115c0 con 0x7f58500fda30 2023-12-16T20:19:41.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.925+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585010d130 con 0x7f58500fda30 2023-12-16T20:19:41.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.926+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5850064130 con 0x7f58500fda30 2023-12-16T20:19:41.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.926+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5840012420 con 0x7f58500fda30 2023-12-16T20:19:41.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.927+0000 7f58467fc640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 0x7f583c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:41.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.927+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f584008c860 con 0x7f58500fda30 2023-12-16T20:19:41.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.927+0000 7f5855e0a640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 0x7f583c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:41.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.927+0000 7f5855e0a640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 0x7f583c06f280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f584c0048c0 tx=0x7f584c037040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:41.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:41.931+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f58400566e0 con 0x7f58500fda30 2023-12-16T20:19:41.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:41 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/4265109466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T20:19:41.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:41 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1031443165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:19:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.108+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f585010de40 con 0x7f58500fda30 2023-12-16T20:19:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.109+0000 7f58467fc640 1 -- 172.21.15.38:0/694233417 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7f58400126d0 con 0x7f58500fda30 2023-12-16T20:19:42.110 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:19:42.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.110+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 msgr2=0x7f583c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 0x7f583c06f280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f584c0048c0 tx=0x7f584c037040 comp rx=0 tx=0).stop 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 msgr2=0x7f5850112d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f584000c810 tx=0x7f58400043c0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 shutdown_connections 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f583c06cdd0 0x7f583c06f280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58500fda30 0x7f5850112d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 --2- 172.21.15.38:0/694233417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58500fd090 0x7f5850112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 >> 172.21.15.38:0/694233417 conn(0x7f58500f6b10 msgr2=0x7f5850100920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:42.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 shutdown_connections 2023-12-16T20:19:42.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.111+0000 7f585806e640 1 -- 172.21.15.38:0/694233417 wait complete. 2023-12-16T20:19:42.123 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T20:19:42.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 -- 172.21.15.38:0/1490434801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e81018c0 msgr2=0x7f43e80faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1490434801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e81018c0 0x7f43e80faf50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43d00048d0 tx=0x7f43d0009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 -- 172.21.15.38:0/1490434801 shutdown_connections 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1490434801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e81018c0 0x7f43e80faf50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1490434801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e8100f20 0x7f43e81012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 -- 172.21.15.38:0/1490434801 >> 172.21.15.38:0/1490434801 conn(0x7f43e80f6a90 msgr2=0x7f43e80f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 -- 172.21.15.38:0/1490434801 shutdown_connections 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.228+0000 7f43ed66e640 1 -- 172.21.15.38:0/1490434801 wait complete. 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 Processor -- start 2023-12-16T20:19:42.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 -- start start 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e81018c0 0x7f43e8111bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81121d0 con 0x7f43e8100f20 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43ed66e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8112340 con 0x7f43e81018c0 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59522/0 (socket says 172.21.15.38:59522) 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 -- 172.21.15.38:0/1521785700 learned_addr learned my addr 172.21.15.38:0/1521785700 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43dffff640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e81018c0 0x7f43e8111bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 -- 172.21.15.38:0/1521785700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e81018c0 msgr2=0x7f43e8111bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e81018c0 0x7f43e8111bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.229+0000 7f43e6ffd640 1 -- 172.21.15.38:0/1521785700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0005040 con 0x7f43e8100f20 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43e6ffd640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f43d8002a50 tx=0x7f43d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d8007c30 con 0x7f43e8100f20 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43d800f040 con 0x7f43e8100f20 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d800da90 con 0x7f43e8100f20 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e810b910 con 0x7f43e8100f20 2023-12-16T20:19:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.230+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e810be80 con 0x7f43e8100f20 2023-12-16T20:19:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.231+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e8064130 con 0x7f43e8100f20 2023-12-16T20:19:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.231+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f43d800dd10 con 0x7f43e8100f20 2023-12-16T20:19:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.232+0000 7f43df7fe640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 0x7f43d406f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.232+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f43d808c230 con 0x7f43e8100f20 2023-12-16T20:19:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.232+0000 7f43dffff640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 0x7f43d406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.232+0000 7f43dffff640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 0x7f43d406f280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43e810c8e0 tx=0x7f43d0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.236+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f43d8056110 con 0x7f43e8100f20 2023-12-16T20:19:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.413+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f43e810ce00 con 0x7f43e8100f20 2023-12-16T20:19:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.414+0000 7f43df7fe640 1 -- 172.21.15.38:0/1521785700 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7f43d8059730 con 0x7f43e8100f20 2023-12-16T20:19:42.415 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.415+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 msgr2=0x7f43d406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.415+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 0x7f43d406f280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43e810c8e0 tx=0x7f43d0009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.415+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 msgr2=0x7f43e8111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.415+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f43d8002a50 tx=0x7f43d8004600 comp rx=0 tx=0).stop 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 shutdown_connections 2023-12-16T20:19:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e81018c0 0x7f43e8111bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f43d406cdd0 0x7f43d406f280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 --2- 172.21.15.38:0/1521785700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43e8100f20 0x7f43e8111690 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 >> 172.21.15.38:0/1521785700 conn(0x7f43e80f6a90 msgr2=0x7f43e80f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 shutdown_connections 2023-12-16T20:19:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.416+0000 7f43ed66e640 1 -- 172.21.15.38:0/1521785700 wait complete. 2023-12-16T20:19:42.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:19:42.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 -- 172.21.15.38:0/2296752155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102930 msgr2=0x7f45940fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 --2- 172.21.15.38:0/2296752155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102930 0x7f45940fa670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45840048d0 tx=0x7f4584009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 -- 172.21.15.38:0/2296752155 shutdown_connections 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 --2- 172.21.15.38:0/2296752155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102930 0x7f45940fa670 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 --2- 172.21.15.38:0/2296752155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102020 0x7f45941023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 -- 172.21.15.38:0/2296752155 >> 172.21.15.38:0/2296752155 conn(0x7f4594071590 msgr2=0x7f4594071990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.532+0000 7f459b31d640 1 -- 172.21.15.38:0/2296752155 shutdown_connections 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 -- 172.21.15.38:0/2296752155 wait complete. 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 Processor -- start 2023-12-16T20:19:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 -- start start 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102930 0x7f4594112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941131d0 con 0x7f4594102020 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f459b31d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4594113340 con 0x7f4594102930 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f45990b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f45990b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59528/0 (socket says 172.21.15.38:59528) 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f45990b9640 1 -- 172.21.15.38:0/3370907776 learned_addr learned my addr 172.21.15.38:0/3370907776 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.533+0000 7f45988b8640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102930 0x7f4594112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f45990b9640 1 -- 172.21.15.38:0/3370907776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102930 msgr2=0x7f4594112bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f45990b9640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102930 0x7f4594112bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f45990b9640 1 -- 172.21.15.38:0/3370907776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584005040 con 0x7f4594102020 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f45990b9640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f459000eb70 tx=0x7f459000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4590007c30 con 0x7f4594102020 2023-12-16T20:19:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f459000f040 con 0x7f4594102020 2023-12-16T20:19:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459410c8b0 con 0x7f4594102020 2023-12-16T20:19:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45900094b0 con 0x7f4594102020 2023-12-16T20:19:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.534+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459410ce20 con 0x7f4594102020 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.535+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4594064130 con 0x7f4594102020 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.535+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f4590009630 con 0x7f4594102020 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.536+0000 7f4589ffb640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 0x7f458006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.536+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f459008bf30 con 0x7f4594102020 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.536+0000 7f45988b8640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 0x7f458006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.536+0000 7f45988b8640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 0x7f458006f280 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f459410d8e0 tx=0x7f4584009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:42.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.541+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f45900bf300 con 0x7f4594102020 2023-12-16T20:19:42.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.732+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4594108fd0 con 0x7f4594102020 2023-12-16T20:19:42.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.733+0000 7f4589ffb640 1 -- 172.21.15.38:0/3370907776 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v78) v1 ==== 81+0+2193 (secure 0 0 0) 0x7f45900198b0 con 0x7f4594102020 2023-12-16T20:19:42.734 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3787041257 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4137995363 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3097077380 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4145377918 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2059469158 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2180116293 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3571172552 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2626729029 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3097077380 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/4128185288 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/246578244 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6827/1754224692 2023-12-17T20:09:42.440174+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1425692992 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/4126814688 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2626729029 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1787286082 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1848758830 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2878914856 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:42.736 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:6828/1534563216 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3045147274 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6826/1754224692 2023-12-17T20:09:42.440174+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3535750768 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:6829/1534563216 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3688359566 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/650036288 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3927288525 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/640446867 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:42.737 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2497608596 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/1813051126 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/1610209447 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3835823800 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3045147274 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3890487682 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/4128185288 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/2050386671 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/3799344375 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:42.738 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/4126814688 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:listed 37 entries 2023-12-16T20:19:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 msgr2=0x7f458006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 0x7f458006f280 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f459410d8e0 tx=0x7f4584009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 msgr2=0x7f4594112690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f459000eb70 tx=0x7f459000b040 comp rx=0 tx=0).stop 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 shutdown_connections 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4594102930 0x7f4594112bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f458006cdd0 0x7f458006f280 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 --2- 172.21.15.38:0/3370907776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4594102020 0x7f4594112690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 >> 172.21.15.38:0/3370907776 conn(0x7f4594071590 msgr2=0x7f45940f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 shutdown_connections 2023-12-16T20:19:42.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:42.735+0000 7f459b31d640 1 -- 172.21.15.38:0/3370907776 wait complete. 2023-12-16T20:19:42.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:42 smithi038 ceph-mon[163993]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:42.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:42 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2547050100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:19:42.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:42 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/694233417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:19:42.746 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:42 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1521785700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:19:42.747 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T20:19:42.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:42.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T20:19:42.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:19:42.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:42.779 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T20:19:42.858 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:19:42.858 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:19:42.895 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-12-16T20:19:42.895 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:19:42.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:19:42.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:42 smithi141 ceph-mon[137587]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T20:19:42.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:42 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2547050100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:19:42.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:42 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/694233417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:19:42.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:42 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1521785700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:19:43.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 -- 172.21.15.38:0/850819844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3854101a80 msgr2=0x7f38540fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 --2- 172.21.15.38:0/850819844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3854101a80 0x7f38540fb110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f38440048d0 tx=0x7f3844009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 -- 172.21.15.38:0/850819844 shutdown_connections 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 --2- 172.21.15.38:0/850819844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3854101a80 0x7f38540fb110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 --2- 172.21.15.38:0/850819844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38541010e0 0x7f38541014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 -- 172.21.15.38:0/850819844 >> 172.21.15.38:0/850819844 conn(0x7f38540f6c90 msgr2=0x7f38540f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 -- 172.21.15.38:0/850819844 shutdown_connections 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.095+0000 7f385c31d640 1 -- 172.21.15.38:0/850819844 wait complete. 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 Processor -- start 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 -- start start 2023-12-16T20:19:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3854101a80 0x7f3854112f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854113550 con 0x7f38541010e0 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385c31d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385410cab0 con 0x7f3854101a80 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59540/0 (socket says 172.21.15.38:59540) 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 -- 172.21.15.38:0/1602841554 learned_addr learned my addr 172.21.15.38:0/1602841554 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f38598b8640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3854101a80 0x7f3854112f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 -- 172.21.15.38:0/1602841554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3854101a80 msgr2=0x7f3854112f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3854101a80 0x7f3854112f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.096+0000 7f385a0b9640 1 -- 172.21.15.38:0/1602841554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844005040 con 0x7f38541010e0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f385a0b9640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3850002a50 tx=0x7f3850004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3850007c30 con 0x7f38541010e0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f385000f040 con 0x7f38541010e0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385410cd90 con 0x7f38541010e0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385000daf0 con 0x7f38541010e0 2023-12-16T20:19:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.097+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385410d280 con 0x7f38541010e0 2023-12-16T20:19:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.098+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854064130 con 0x7f38541010e0 2023-12-16T20:19:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.098+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f385000dc90 con 0x7f38541010e0 2023-12-16T20:19:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.099+0000 7f384affd640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 0x7f384006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.099+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f385008bae0 con 0x7f38541010e0 2023-12-16T20:19:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.099+0000 7f38598b8640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 0x7f384006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.099+0000 7f38598b8640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 0x7f384006f280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f385410df20 tx=0x7f3844009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.103+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3850055af0 con 0x7f38541010e0 2023-12-16T20:19:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.283+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f385410dfc0 con 0x7f38541010e0 2023-12-16T20:19:43.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.284+0000 7f384affd640 1 -- 172.21.15.38:0/1602841554 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16443 (secure 0 0 0) 0x7f3850007d90 con 0x7f38541010e0 2023-12-16T20:19:43.286 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-16T20:19:43.286 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"fsid":"56b1cbe2-9c4e-11ee-95a5-87774f69a715","created":"2023-12-16T20:05:09.981037+0000","modified":"2023-12-16T20:18:12.673807+0000","last_up_change":"2023-12-16T20:18:11.670604+0000","last_in_change":"2023-12-16T20:08:37.818201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:08:07.208300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T20:09:31.147492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T20:09:31.639182+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"823fcdc8-23a7-4401-b145-dfd40acfbe5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6803","nonce":3568061758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6805","nonce":3568061758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6809","nonce":3568061758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3568061758},{"type":"v1","addr":"172.21.15.38:6807","nonce":3568061758}]},"public_addr":"172.21.15.38:6803/3568061758","cluster_addr":"172.21.15.38:6805/3568061758","heartbeat_back_addr":"172.21.15.38:6809/3568061758","heartbeat_front_addr":"172.21.15.38:6807/3568061758","state":["exists","up"]},{"osd":1,"uuid":"3c07c7f4-3599-494b-bec2-721ece56613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6811","nonce":3130410261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6813","nonce":3130410261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6817","nonce":3130410261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3130410261},{"type":"v1","addr":"172.21.15.38:6815","nonce":3130410261}]},"public_addr":"172.21.15.38:6811/3130410261","cluster_addr":"172.21.15.38:6813/3130410261","heartbeat_back_addr":"172.21.15.38:6817/3130410261","heartbeat_front_addr":"172.21.15.38:6815/3130410261","state":["exists","up"]},{"osd":2,"uuid":"9ee3a174-4f43-493d-99fc-9e66d34b747e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6819","nonce":2661634231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6821","nonce":2661634231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6825","nonce":2661634231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2661634231},{"type":"v1","addr":"172.21.15.38:6823","nonce":2661634231}]},"public_addr":"172.21.15.38:6819/2661634231","cluster_addr":"172.21.15.38:6821/2661634231","heartbeat_back_addr":"172.21.15.38:6825/2661634231","heartbeat_front_addr":"172.21.15.38:6823/2661634231","state":["exists","up"]},{"osd":3,"uuid":"f43cc52b-2a8e-442d-8acb-b61c2d5d4803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6801","nonce":2635655003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6803","nonce":2635655003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6807","nonce":2635655003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":2635655003},{"type":"v1","addr":"172.21.15.141:6805","nonce":2635655003}]},"public_addr":"172.21.15.141:6801/2635655003","cluster_addr":"172.21.15.141:6803/2635655003","heartbeat_back_addr":"172.21.15.141:6807/2635655003","heartbeat_front_addr":"172.21.15.141:6805/2635655003","state":["exists","up"]},{"osd":4,"uuid":"3f8086c7-2036-4bd7-9922-3c2e84a75a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6809","nonce":2242976419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6811","nonce":2242976419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6815","nonce":2242976419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":2242976419},{"type":"v1","addr":"172.21.15.141:6813","nonce":2242976419}]},"public_addr":"172.21.15.141:6809/2242976419","cluster_addr":"172.21.15.141:6811/2242976419","heartbeat_back_addr":"172.21.15.141:6815/2242976419","heartbeat_front_addr":"172.21.15.141:6813/2242976419","state":["exists","up"]},{"osd":5,"uuid":"dd3a52a7-e6e7-4ad9-b2fa-6afea9ec3c71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6817","nonce":3891441344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6819","nonce":3891441344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6823","nonce":3891441344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":3891441344},{"type":"v1","addr":"172.21.15.141:6821","nonce":3891441344}]},"public_addr":"172.21.15.141:6817/3891441344","cluster_addr":"172.21.15.141:6819/3891441344","heartbeat_back_addr":"172.21.15.141:6823/3891441344","heartbeat_front_addr":"172.21.15.141:6821/3891441344","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:29.844327+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:07:47.611644+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:04.371112+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:19.530612+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:35.468929+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:08:51.600542+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/3787041257":"2023-12-17T20:14:50.024450+0000","172.21.15.38:0/4137995363":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6801/3097077380":"2023-12-17T20:11:28.170588+0000","172.21.15.38:0/4145377918":"2023-12-17T20:11:28.170588+0000","172.21.15.38:0/2059469158":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/2180116293":"2023-12-17T20:05:55.519024+0000","172.21.15.38:0/3571172552":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:6800/3097077380":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.141:0/246578244":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6827/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:0/1425692992":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6800/4126814688":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6800/2626729029":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1787286082":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/1848758830":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2878914856":"2023-12-17T20:05:55.519024+0000","172.21.15.141:6828/1534563216":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6800/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:6826/1754224692":"2023-12-17T20:09:42.440174+0000","172.21.15.38:0/3535750768":"2023-12-17T20:14:50.024450+0000","172.21.15.141:6829/1534563216":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3688359566":"2023-12-17T20:05:33.868918+0000","172.21.15.141:0/650036288":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3927288525":"2023-12-17T20:05:33.868918+0000","172.21.15.38:0/640446867":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/2497608596":"2023-12-17T20:06:42.696878+0000","172.21.15.141:0/1813051126":"2023-12-17T20:12:38.199399+0000","172.21.15.141:0/1610209447":"2023-12-17T20:12:38.199399+0000","172.21.15.38:0/3835823800":"2023-12-17T20:11:28.170588+0000","172.21.15.38:6801/3045147274":"2023-12-17T20:06:42.696878+0000","172.21.15.38:0/3890487682":"2023-12-17T20:14:50.024450+0000","172.21.15.38:6800/4128185288":"2023-12-17T20:05:55.519024+0000","172.21.15.141:0/2050386671":"2023-12-17T20:12:38.199399+0000","172.21.15.141:0/3799344375":"2023-12-17T20:12:38.199399+0000","172.21.15.38:6801/4126814688":"2023-12-17T20:14:50.024450+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 msgr2=0x7f384006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 0x7f384006f280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f385410df20 tx=0x7f3844009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 msgr2=0x7f38541129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3850002a50 tx=0x7f3850004600 comp rx=0 tx=0).stop 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 shutdown_connections 2023-12-16T20:19:43.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3854101a80 0x7f3854112f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7f384006cdd0 0x7f384006f280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 --2- 172.21.15.38:0/1602841554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38541010e0 0x7f38541129c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.286+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 >> 172.21.15.38:0/1602841554 conn(0x7f38540f6c90 msgr2=0x7f3854065440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.287+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 shutdown_connections 2023-12-16T20:19:43.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.287+0000 7f385c31d640 1 -- 172.21.15.38:0/1602841554 wait complete. 2023-12-16T20:19:43.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:08:07.208300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T20:09:31.147492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T20:09:31.639182+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T20:19:43.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- 172.21.15.38:0/1618384010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 msgr2=0x7fdddc102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/1618384010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc102490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fddd80048d0 tx=0x7fddd8009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- 172.21.15.38:0/1618384010 shutdown_connections 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/1618384010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc0faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/1618384010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc102490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- 172.21.15.38:0/1618384010 >> 172.21.15.38:0/1618384010 conn(0x7fdddc071570 msgr2=0x7fdddc071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- 172.21.15.38:0/1618384010 shutdown_connections 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- 172.21.15.38:0/1618384010 wait complete. 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 Processor -- start 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- start start 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc1149e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc115520 con 0x7fdddc1020c0 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.405+0000 7fdde3b1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc115690 con 0x7fdddc0fa730 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59560/0 (socket says 172.21.15.38:59560) 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 -- 172.21.15.38:0/3292765179 learned_addr learned my addr 172.21.15.38:0/3292765179 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde18b9640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc1149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 -- 172.21.15.38:0/3292765179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 msgr2=0x7fdddc1149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc1149e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 -- 172.21.15.38:0/3292765179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8005040 con 0x7fdddc1020c0 2023-12-16T20:19:43.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde18b9640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc1149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde10b8640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fddcc002a50 tx=0x7fddcc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc007c30 con 0x7fdddc1020c0 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddcc00f040 con 0x7fdddc1020c0 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc10ec60 con 0x7fdddc1020c0 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc00daf0 con 0x7fdddc1020c0 2023-12-16T20:19:43.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.406+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc10f180 con 0x7fdddc1020c0 2023-12-16T20:19:43.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.407+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc064130 con 0x7fdddc1020c0 2023-12-16T20:19:43.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.408+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fddcc00dc90 con 0x7fdddc1020c0 2023-12-16T20:19:43.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.408+0000 7fddd27fc640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 0x7fddc806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.408+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fddcc08bbf0 con 0x7fdddc1020c0 2023-12-16T20:19:43.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.408+0000 7fdde18b9640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 0x7fddc806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.409+0000 7fdde18b9640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 0x7fddc806f280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddd80316b0 tx=0x7fddd8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.413+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fddcc055ad0 con 0x7fdddc1020c0 2023-12-16T20:19:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.592+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdddc10f3a0 con 0x7fdddc1020c0 2023-12-16T20:19:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.592+0000 7fddd27fc640 1 -- 172.21.15.38:0/3292765179 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddcc0590f0 con 0x7fdddc1020c0 2023-12-16T20:19:43.594 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-16T20:19:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.594+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 msgr2=0x7fddc806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.594+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 0x7fddc806f280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddd80316b0 tx=0x7fddd8009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.594+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 msgr2=0x7fdddc114f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.594+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fddcc002a50 tx=0x7fddcc004600 comp rx=0 tx=0).stop 2023-12-16T20:19:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 shutdown_connections 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fddc806cdd0 0x7fddc806f280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdddc1020c0 0x7fdddc114f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 --2- 172.21.15.38:0/3292765179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdddc0fa730 0x7fdddc1149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 >> 172.21.15.38:0/3292765179 conn(0x7fdddc071570 msgr2=0x7fdddc0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 shutdown_connections 2023-12-16T20:19:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.595+0000 7fdde3b1d640 1 -- 172.21.15.38:0/3292765179 wait complete. 2023-12-16T20:19:43.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T20:19:43.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- 172.21.15.38:0/2004590377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 msgr2=0x7fa938102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 --2- 172.21.15.38:0/2004590377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa938102490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9340048d0 tx=0x7fa934009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- 172.21.15.38:0/2004590377 shutdown_connections 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 --2- 172.21.15.38:0/2004590377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 --2- 172.21.15.38:0/2004590377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa938102490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- 172.21.15.38:0/2004590377 >> 172.21.15.38:0/2004590377 conn(0x7fa938071570 msgr2=0x7fa938071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- 172.21.15.38:0/2004590377 shutdown_connections 2023-12-16T20:19:43.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- 172.21.15.38:0/2004590377 wait complete. 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 Processor -- start 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.712+0000 7fa94079d640 1 -- start start 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa94079d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380fb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa94079d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa94079d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380fc390 con 0x7fa9381020c0 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa94079d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380fc500 con 0x7fa9380fa730 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59572/0 (socket says 172.21.15.38:59572) 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 -- 172.21.15.38:0/843769673 learned_addr learned my addr 172.21.15.38:0/843769673 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93e539640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 -- 172.21.15.38:0/843769673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 msgr2=0x7fa9380fb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380fb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 -- 172.21.15.38:0/843769673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934005040 con 0x7fa9381020c0 2023-12-16T20:19:43.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93e539640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa93dd38640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa92800b790 tx=0x7fa9280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa92800c700 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa92800cd10 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa938118ce0 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.713+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa928013370 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.714+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa938119010 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.714+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa938064130 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.715+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa928012070 con 0x7fa9381020c0 2023-12-16T20:19:43.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.715+0000 7fa92effd640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 0x7fa92406f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:43.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.715+0000 7fa93e539640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 0x7fa92406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:43.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.715+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa92808bea0 con 0x7fa9381020c0 2023-12-16T20:19:43.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.716+0000 7fa93e539640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 0x7fa92406f280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa93402bda0 tx=0x7fa934009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:43.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.720+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa928055e00 con 0x7fa9381020c0 2023-12-16T20:19:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:43 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/3370907776' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T20:19:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:43 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/1602841554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:19:43.895 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:43 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/3292765179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:19:43.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.898+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa9380fc6c0 con 0x7fa9381020c0 2023-12-16T20:19:43.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.898+0000 7fa92effd640 1 -- 172.21.15.38:0/843769673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa928059420 con 0x7fa9381020c0 2023-12-16T20:19:43.900 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:19:43.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 msgr2=0x7fa92406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 0x7fa92406f280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa93402bda0 tx=0x7fa934009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 msgr2=0x7fa9380fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:43.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa92800b790 tx=0x7fa9280091d0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 shutdown_connections 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fa92406cdd0 0x7fa92406f280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9381020c0 0x7fa9380fbe50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 --2- 172.21.15.38:0/843769673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9380fa730 0x7fa9380fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 >> 172.21.15.38:0/843769673 conn(0x7fa938071570 msgr2=0x7fa9380f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 shutdown_connections 2023-12-16T20:19:43.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:43.901+0000 7fa94079d640 1 -- 172.21.15.38:0/843769673 wait complete. 2023-12-16T20:19:43.913 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T20:19:43.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:43 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/3370907776' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T20:19:43.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:43 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/1602841554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T20:19:43.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:43 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/3292765179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T20:19:44.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- 172.21.15.38:0/229998267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 msgr2=0x7fe600101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 --2- 172.21.15.38:0/229998267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe600101310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40048d0 tx=0x7fe5f4009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- 172.21.15.38:0/229998267 shutdown_connections 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 --2- 172.21.15.38:0/229998267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 0x7fe6000faf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 --2- 172.21.15.38:0/229998267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe600101310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- 172.21.15.38:0/229998267 >> 172.21.15.38:0/229998267 conn(0x7fe6000f6ab0 msgr2=0x7fe6000f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- 172.21.15.38:0/229998267 shutdown_connections 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- 172.21.15.38:0/229998267 wait complete. 2023-12-16T20:19:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 Processor -- start 2023-12-16T20:19:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.019+0000 7fe60706e640 1 -- start start 2023-12-16T20:19:44.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 0x7fe60010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60010e3f0 con 0x7fe600100f40 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60010e560 con 0x7fe6001018e0 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59582/0 (socket says 172.21.15.38:59582) 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 -- 172.21.15.38:0/2425848283 learned_addr learned my addr 172.21.15.38:0/2425848283 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 -- 172.21.15.38:0/2425848283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 msgr2=0x7fe60010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe5fffff640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 0x7fe60010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 0x7fe60010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 -- 172.21.15.38:0/2425848283 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4005040 con 0x7fe600100f40 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe604e0a640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f402bda0 tx=0x7fe5f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f40092e0 con 0x7fe600100f40 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60010e7e0 con 0x7fe600100f40 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5f40098f0 con 0x7fe600100f40 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f403b400 con 0x7fe600100f40 2023-12-16T20:19:44.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.020+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600116cc0 con 0x7fe600100f40 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.021+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600064130 con 0x7fe600100f40 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.022+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe5f402f070 con 0x7fe600100f40 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.022+0000 7fe5fd7fa640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 0x7fe5f006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.022+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe5f40ae650 con 0x7fe600100f40 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.022+0000 7fe5fffff640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 0x7fe5f006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.023+0000 7fe5fffff640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 0x7fe5f006f280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009af0 tx=0x7fe5ec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:44.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.027+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe5f4078490 con 0x7fe600100f40 2023-12-16T20:19:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.204+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe600107f40 con 0x7fe600100f40 2023-12-16T20:19:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.204+0000 7fe5fd7fa640 1 -- 172.21.15.38:0/2425848283 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe5f407bab0 con 0x7fe600100f40 2023-12-16T20:19:44.206 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-16T20:19:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 msgr2=0x7fe5f006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 0x7fe5f006f280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009af0 tx=0x7fe5ec00b040 comp rx=0 tx=0).stop 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 msgr2=0x7fe60010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f402bda0 tx=0x7fe5f4009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 shutdown_connections 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6001018e0 0x7fe60010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fe5f006cdd0 0x7fe5f006f280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 --2- 172.21.15.38:0/2425848283 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe600100f40 0x7fe60010d970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 >> 172.21.15.38:0/2425848283 conn(0x7fe6000f6ab0 msgr2=0x7fe6000f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 shutdown_connections 2023-12-16T20:19:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.207+0000 7fe60706e640 1 -- 172.21.15.38:0/2425848283 wait complete. 2023-12-16T20:19:44.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:19:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/2549612366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf281021a0 msgr2=0x7fbf28102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/2549612366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf281021a0 0x7fbf28102570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf200048d0 tx=0x7fbf20009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/2549612366 shutdown_connections 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/2549612366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf28102b40 0x7fbf280fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/2549612366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf281021a0 0x7fbf28102570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/2549612366 >> 172.21.15.38:0/2549612366 conn(0x7fbf280f7d50 msgr2=0x7fbf280fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/2549612366 shutdown_connections 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/2549612366 wait complete. 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 Processor -- start 2023-12-16T20:19:44.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- start start 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf281021a0 0x7fbf28112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28113500 con 0x7fbf28102b40 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.323+0000 7fbf2fb1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2810ca60 con 0x7fbf281021a0 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59598/0 (socket says 172.21.15.38:59598) 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 -- 172.21.15.38:0/3681250664 learned_addr learned my addr 172.21.15.38:0/3681250664 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-16T20:19:44.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d8b9640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf281021a0 0x7fbf28112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 -- 172.21.15.38:0/3681250664 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf281021a0 msgr2=0x7fbf28112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf281021a0 0x7fbf28112970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 -- 172.21.15.38:0/3681250664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20005040 con 0x7fbf28102b40 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2d0b8640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c002a50 tx=0x7fbf1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c007c30 con 0x7fbf28102b40 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf1c00f040 con 0x7fbf28102b40 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2810cd40 con 0x7fbf28102b40 2023-12-16T20:19:44.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c00daf0 con 0x7fbf28102b40 2023-12-16T20:19:44.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.324+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2810d260 con 0x7fbf28102b40 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.325+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf28064130 con 0x7fbf28102b40 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.326+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fbf1c00dc90 con 0x7fbf28102b40 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.326+0000 7fbf267fc640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 0x7fbf1006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.326+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbf1c08bb40 con 0x7fbf28102b40 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.326+0000 7fbf2d8b9640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 0x7fbf1006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:19:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.327+0000 7fbf2d8b9640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 0x7fbf1006f280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf20003080 tx=0x7fbf20009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:19:44.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.331+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbf1c055ad0 con 0x7fbf28102b40 2023-12-16T20:19:44.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.521+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbf2810df70 con 0x7fbf28102b40 2023-12-16T20:19:44.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.522+0000 7fbf267fc640 1 -- 172.21.15.38:0/3681250664 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v78) v1 ==== 81+0+2193 (secure 0 0 0) 0x7fbf1c0590f0 con 0x7fbf28102b40 2023-12-16T20:19:44.523 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3787041257 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4137995363 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3097077380 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4145377918 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2059469158 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2180116293 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3571172552 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2626729029 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3097077380 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/4128185288 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/246578244 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6827/1754224692 2023-12-17T20:09:42.440174+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1425692992 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/4126814688 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2626729029 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1787286082 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1848758830 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:44.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2878914856 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:6828/1534563216 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3045147274 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6826/1754224692 2023-12-17T20:09:42.440174+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3535750768 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:6829/1534563216 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3688359566 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/650036288 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3927288525 2023-12-17T20:05:33.868918+0000 2023-12-16T20:19:44.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/640446867 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2497608596 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/1813051126 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/1610209447 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3835823800 2023-12-17T20:11:28.170588+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3045147274 2023-12-17T20:06:42.696878+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3890487682 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/4128185288 2023-12-17T20:05:55.519024+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/2050386671 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141:0/3799344375 2023-12-17T20:12:38.199399+0000 2023-12-16T20:19:44.527 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/4126814688 2023-12-17T20:14:50.024450+0000 2023-12-16T20:19:44.528 INFO:teuthology.orchestra.run.smithi038.stderr:listed 37 entries 2023-12-16T20:19:44.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 msgr2=0x7fbf1006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 0x7fbf1006f280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf20003080 tx=0x7fbf20009da0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 msgr2=0x7fbf28112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c002a50 tx=0x7fbf1c004600 comp rx=0 tx=0).stop 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 shutdown_connections 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:6800/3824811739,v1:172.21.15.38:6801/3824811739] conn(0x7fbf1006cdd0 0x7fbf1006f280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf28102b40 0x7fbf28112eb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 --2- 172.21.15.38:0/3681250664 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf281021a0 0x7fbf28112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 >> 172.21.15.38:0/3681250664 conn(0x7fbf280f7d50 msgr2=0x7fbf280f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:19:44.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 shutdown_connections 2023-12-16T20:19:44.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-16T20:19:44.524+0000 7fbf2fb1d640 1 -- 172.21.15.38:0/3681250664 wait complete. 2023-12-16T20:19:44.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T20:19:44.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.537 DEBUG:teuthology.orchestra.run.smithi141:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T20:19:44.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-12-16T20:19:44.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.574 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T20:19:44.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.720 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-16T20:19:44.752 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T20:19:44.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:19:44.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:44 smithi038 ceph-mon[163993]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:44.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:44 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/843769673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:19:44.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:44 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/2425848283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:19:44.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:44 smithi038 ceph-mon[163993]: from='client.? 172.21.15.38:0/3681250664' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T20:19:44.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.829 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-16T20:19:44.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.922 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-12-16T20:19:44.938 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T20:19:44.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:44.938 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T20:19:44.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:44 smithi141 ceph-mon[137587]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T20:19:44.995 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:44 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/843769673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T20:19:44.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:44 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/2425848283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T20:19:44.996 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:44 smithi141 ceph-mon[137587]: from='client.? 172.21.15.38:0/3681250664' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T20:19:45.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:19:45.007 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-12-16T20:19:45.110 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-16T20:19:45.121 INFO:tasks.cephadm:Teardown begin 2023-12-16T20:19:45.122 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:19:45.156 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:19:45.185 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-16T20:19:45.185 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T20:19:45.212 DEBUG:teuthology.orchestra.run.smithi141:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T20:19:45.240 INFO:tasks.cephadm:Stopping all daemons... 2023-12-16T20:19:45.240 INFO:tasks.cephadm.mon.smithi038:Stopping mon.smithi038... 2023-12-16T20:19:45.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038 2023-12-16T20:19:45.611 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 systemd[1]: Stopping Ceph mon.smithi038 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:19:45.865 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[163988]: 2023-12-16T20:19:45.609+0000 7f60a15a8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi038 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:19:45.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038[163988]: 2023-12-16T20:19:45.609+0000 7f60a15a8700 -1 mon.smithi038@0(leader) e3 *** Got Signal Terminated *** 2023-12-16T20:19:45.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 podman[194393]: 2023-12-16 20:19:45.701636458 +0000 UTC m=+0.268779019 container died 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, ceph=True, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2023-12-16T20:19:45.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 podman[194393]: 2023-12-16 20:19:45.865265476 +0000 UTC m=+0.432408035 container cleanup 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.31.3) 2023-12-16T20:19:46.144 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 bash[194393]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038 2023-12-16T20:19:46.145 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Dec 16 20:19:45 smithi038 podman[194419]: 2023-12-16 20:19:45.940274818 +0000 UTC m=+0.237899942 container remove 437ac35e3b7f22334e160b51c1d77b09263e53f7d8cac12032f932a10fdfb612 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi038, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.31.3) 2023-12-16T20:19:46.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi038.service' 2023-12-16T20:19:46.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:19:46.245 INFO:tasks.cephadm.mon.smithi038:Stopped mon.smithi038 2023-12-16T20:19:46.246 INFO:tasks.cephadm.mon.smithi141:Stopping mon.smithi141... 2023-12-16T20:19:46.246 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi141 2023-12-16T20:19:46.474 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 systemd[1]: Stopping Ceph mon.smithi141 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:19:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141[137583]: 2023-12-16T20:19:46.473+0000 7f4aa80fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi141 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:19:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141[137583]: 2023-12-16T20:19:46.473+0000 7f4aa80fb700 -1 mon.smithi141@1(peon) e3 *** Got Signal Terminated *** 2023-12-16T20:19:46.746 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 podman[161788]: 2023-12-16 20:19:46.697739006 +0000 UTC m=+0.276749348 container died 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:19:47.137 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 podman[161788]: 2023-12-16 20:19:46.878604557 +0000 UTC m=+0.457614929 container cleanup 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2023-12-16T20:19:47.138 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 bash[161788]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141 2023-12-16T20:19:47.138 INFO:journalctl@ceph.mon.smithi141.smithi141.stdout:Dec 16 20:19:46 smithi141 podman[161803]: 2023-12-16 20:19:46.995303692 +0000 UTC m=+0.294708147 container remove 6b6a7721fefe0580cecc5c958ee066358d88f3ba8018cba5870718d6f24fb5a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-mon-smithi141, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2) 2023-12-16T20:19:47.143 DEBUG:teuthology.orchestra.run.smithi141:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@mon.smithi141.service' 2023-12-16T20:19:47.194 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:19:47.195 INFO:tasks.cephadm.mon.smithi141:Stopped mon.smithi141 2023-12-16T20:19:47.195 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-16T20:19:47.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0 2023-12-16T20:19:47.644 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:47 smithi038 systemd[1]: Stopping Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:19:47.645 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:19:47.433+0000 7ff7a49c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:19:47.645 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:19:47.433+0000 7ff7a49c6700 -1 osd.0 78 *** Got signal Terminated *** 2023-12-16T20:19:47.645 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:47 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0[175205]: 2023-12-16T20:19:47.433+0000 7ff7a49c6700 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:19:53.395 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:52 smithi038 podman[194526]: 2023-12-16 20:19:52.927175549 +0000 UTC m=+5.544564271 container died 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:19:53.396 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194526]: 2023-12-16 20:19:53.023115874 +0000 UTC m=+5.640504606 container cleanup 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2023-12-16T20:19:53.396 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 bash[194526]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0 2023-12-16T20:19:53.396 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194545]: 2023-12-16 20:19:53.172676534 +0000 UTC m=+0.240885275 container remove 893b19acd14a0179d26d146335e16acdb7dfc53390a75b990367f1551c01a774 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True) 2023-12-16T20:19:53.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.439243597 +0000 UTC m=+0.051455611 container create 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, GIT_BRANCH=HEAD) 2023-12-16T20:19:53.834 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.406311271 +0000 UTC m=+0.018523297 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:19:53.834 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.523077662 +0000 UTC m=+0.135289692 container init 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=) 2023-12-16T20:19:53.834 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.540819302 +0000 UTC m=+0.153031308 container start 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212) 2023-12-16T20:19:53.834 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.56427601 +0000 UTC m=+0.176488040 container attach 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2023-12-16T20:19:53.834 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:53 smithi038 podman[194637]: 2023-12-16 20:19:53.832948027 +0000 UTC m=+0.445160042 container died 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:19:54.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service' 2023-12-16T20:19:54.086 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:54 smithi038 podman[194663]: 2023-12-16 20:19:54.047497352 +0000 UTC m=+0.206466089 container remove 98322f547b5e87d5500d4b4265074a9633dee287109cde809ede973a252c7aaa (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:19:54.087 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:54 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service: Deactivated successfully. 2023-12-16T20:19:54.087 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:54 smithi038 systemd[1]: Stopped Ceph osd.0 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715. 2023-12-16T20:19:54.087 INFO:journalctl@ceph.osd.0.smithi038.stdout:Dec 16 20:19:54 smithi038 systemd[1]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.0.service: Consumed 7.142s CPU time. 2023-12-16T20:19:54.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:19:54.104 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-16T20:19:54.104 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-16T20:19:54.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.1 2023-12-16T20:19:54.368 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:54 smithi038 systemd[1]: Stopping Ceph osd.1 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:19:54.644 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:54 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:19:54.366+0000 7fbca292e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:19:54.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:54 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:19:54.366+0000 7fbca292e700 -1 osd.1 78 *** Got signal Terminated *** 2023-12-16T20:19:54.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:54 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1[181077]: 2023-12-16T20:19:54.366+0000 7fbca292e700 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:20:00.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:59 smithi038 podman[194743]: 2023-12-16 20:19:59.785820187 +0000 UTC m=+5.461300492 container died 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:20:00.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:59 smithi038 podman[194743]: 2023-12-16 20:19:59.896694402 +0000 UTC m=+5.572174707 container cleanup 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2023-12-16T20:20:00.145 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:59 smithi038 bash[194743]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1 2023-12-16T20:20:00.146 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:19:59 smithi038 podman[194761]: 2023-12-16 20:19:59.980039579 +0000 UTC m=+0.195233225 container remove 8ac075df9f9ecc2ee7489b580a003e00a1bda48416b3d6e166c261f6b15b8281 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:20:00.644 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.371668388 +0000 UTC m=+0.061158365 container create 74e53ce8c659d3dcc09b73b960376aba59efb76a69b4585b925f8a391e822360 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2023-12-16T20:20:00.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.32985498 +0000 UTC m=+0.019344958 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:20:00.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.447284723 +0000 UTC m=+0.136774710 container init 74e53ce8c659d3dcc09b73b960376aba59efb76a69b4585b925f8a391e822360 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2023-12-16T20:20:00.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.464767852 +0000 UTC m=+0.154257829 container start 74e53ce8c659d3dcc09b73b960376aba59efb76a69b4585b925f8a391e822360 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux ) 2023-12-16T20:20:00.645 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.479978291 +0000 UTC m=+0.169468283 container attach 74e53ce8c659d3dcc09b73b960376aba59efb76a69b4585b925f8a391e822360 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True) 2023-12-16T20:20:01.080 INFO:journalctl@ceph.osd.1.smithi038.stdout:Dec 16 20:20:00 smithi038 podman[194850]: 2023-12-16 20:20:00.759653788 +0000 UTC m=+0.449143774 container died 74e53ce8c659d3dcc09b73b960376aba59efb76a69b4585b925f8a391e822360 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2023-12-16T20:20:01.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.1.service' 2023-12-16T20:20:01.134 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:20:01.135 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-16T20:20:01.135 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-16T20:20:01.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.2 2023-12-16T20:20:01.358 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:01 smithi038 systemd[1]: Stopping Ceph osd.2 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:20:01.644 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:01 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:20:01.357+0000 7f3ef478e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:20:01.645 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:01 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:20:01.357+0000 7f3ef478e700 -1 osd.2 78 *** Got signal Terminated *** 2023-12-16T20:20:01.645 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:01 smithi038 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2[186604]: 2023-12-16T20:20:01.357+0000 7f3ef478e700 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:20:07.105 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:06 smithi038 podman[194956]: 2023-12-16 20:20:06.85164839 +0000 UTC m=+5.537416093 container died 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2023-12-16T20:20:07.105 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[194956]: 2023-12-16 20:20:07.104348164 +0000 UTC m=+5.790115890 container cleanup 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.schema-version=1.0) 2023-12-16T20:20:07.394 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 bash[194956]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2 2023-12-16T20:20:07.395 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[194974]: 2023-12-16 20:20:07.20418327 +0000 UTC m=+0.344593700 container remove 2407bc0d39ecc68ec657065299de27237190a11bfddc0b17ad1fe378204d11d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2023-12-16T20:20:07.894 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.579075568 +0000 UTC m=+0.059125997 container create be1495bb145e996ba89db778b25ed1eb388fa7578f1657104b22620a5004d24d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212) 2023-12-16T20:20:07.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.537761617 +0000 UTC m=+0.017812057 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:20:07.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.654506025 +0000 UTC m=+0.134556460 container init be1495bb145e996ba89db778b25ed1eb388fa7578f1657104b22620a5004d24d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212) 2023-12-16T20:20:07.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.660148316 +0000 UTC m=+0.140198741 container start be1495bb145e996ba89db778b25ed1eb388fa7578f1657104b22620a5004d24d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2023-12-16T20:20:07.895 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.687356343 +0000 UTC m=+0.167406779 container attach be1495bb145e996ba89db778b25ed1eb388fa7578f1657104b22620a5004d24d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2023-12-16T20:20:08.179 INFO:journalctl@ceph.osd.2.smithi038.stdout:Dec 16 20:20:07 smithi038 podman[195063]: 2023-12-16 20:20:07.956211282 +0000 UTC m=+0.436261718 container died be1495bb145e996ba89db778b25ed1eb388fa7578f1657104b22620a5004d24d (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212) 2023-12-16T20:20:08.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.2.service' 2023-12-16T20:20:08.234 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:20:08.234 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-16T20:20:08.235 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-16T20:20:08.235 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.3 2023-12-16T20:20:08.745 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:08 smithi141 systemd[1]: Stopping Ceph osd.3 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:20:08.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:20:08.484+0000 7f05be96a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:20:08.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:20:08.484+0000 7f05be96a700 -1 osd.3 78 *** Got signal Terminated *** 2023-12-16T20:20:08.746 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:08 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3[146643]: 2023-12-16T20:20:08.484+0000 7f05be96a700 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:20:13.966 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:13 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:13.703+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:13.967 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:13 smithi141 podman[161922]: 2023-12-16 20:20:13.815011517 +0000 UTC m=+5.397250723 container died f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, org.label-schema.build-date=20231212) 2023-12-16T20:20:13.967 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:13 smithi141 podman[161922]: 2023-12-16 20:20:13.965467661 +0000 UTC m=+5.547706905 container cleanup f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:20:14.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:13 smithi141 bash[161922]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3 2023-12-16T20:20:14.246 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[161939]: 2023-12-16 20:20:14.073822971 +0000 UTC m=+0.253351190 container remove f3d2e940f23475e06238384698c7764b3548eb63432fd99375272ba3a916f8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2023-12-16T20:20:14.714 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.42365093 +0000 UTC m=+0.056727355 container create af0506f6662d668a1d6d415fd9a04399cccdc0eeb77c1328d47b81c0a8c50b4e (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, ceph=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2023-12-16T20:20:14.714 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.384653366 +0000 UTC m=+0.017729755 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:20:14.714 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.507458539 +0000 UTC m=+0.140534926 container init af0506f6662d668a1d6d415fd9a04399cccdc0eeb77c1328d47b81c0a8c50b4e (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:20:14.715 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.525020877 +0000 UTC m=+0.158097258 container start af0506f6662d668a1d6d415fd9a04399cccdc0eeb77c1328d47b81c0a8c50b4e (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2023-12-16T20:20:14.715 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.548616709 +0000 UTC m=+0.181693108 container attach af0506f6662d668a1d6d415fd9a04399cccdc0eeb77c1328d47b81c0a8c50b4e (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2023-12-16T20:20:14.995 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:14 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:14.712+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:14.996 INFO:journalctl@ceph.osd.3.smithi141.stdout:Dec 16 20:20:14 smithi141 podman[162026]: 2023-12-16 20:20:14.812340446 +0000 UTC m=+0.445416842 container died af0506f6662d668a1d6d415fd9a04399cccdc0eeb77c1328d47b81c0a8c50b4e (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9) 2023-12-16T20:20:15.042 DEBUG:teuthology.orchestra.run.smithi141:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.3.service' 2023-12-16T20:20:15.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:20:15.083 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-16T20:20:15.083 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-16T20:20:15.083 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.4 2023-12-16T20:20:15.352 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:15 smithi141 systemd[1]: Stopping Ceph osd.4 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:20:15.352 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:15 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:15.350+0000 7fe9bf888700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:20:15.352 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:15 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:15.350+0000 7fe9bf888700 -1 osd.4 78 *** Got signal Terminated *** 2023-12-16T20:20:15.352 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:15 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:15.350+0000 7fe9bf888700 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:20:15.995 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:15 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:15.702+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:16.982 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:16 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:16.664+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:17.995 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:17 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:17.674+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:17.996 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:17 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:17.601+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:18.996 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:18 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:18.571+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:18.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:18 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:18.672+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:19.996 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:19 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4[151636]: 2023-12-16T20:20:19.695+0000 7fe9b867c700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:49.984845+0000 front 2023-12-16T20:19:49.984892+0000 (oldest deadline 2023-12-16T20:20:13.484687+0000) 2023-12-16T20:20:19.996 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:19 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:19.598+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:20.841 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:20 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:20.553+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:21.114 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:20 smithi141 podman[162131]: 2023-12-16 20:20:20.840663518 +0000 UTC m=+5.548727575 container died 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:20:21.115 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162131]: 2023-12-16 20:20:21.030918666 +0000 UTC m=+5.738982761 container cleanup 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:20:21.115 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 bash[162131]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4 2023-12-16T20:20:21.497 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162148]: 2023-12-16 20:20:21.114182193 +0000 UTC m=+0.272701743 container remove 86f170b7bf0e5cdb25bed134e5d89bff2b7d453680e6d3781fc179c5678ec9c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.build-date=20231212) 2023-12-16T20:20:21.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:21 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:21.543+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:21.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:21 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:21.543+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:21.888 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.505750412 +0000 UTC m=+0.072417464 container create a5f2c63c9c081cc0013e9b194e95f45a75976e875baa5428eaad9ba2f1138dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2023-12-16T20:20:21.888 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.451676834 +0000 UTC m=+0.018343886 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:20:21.888 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.597772244 +0000 UTC m=+0.164439298 container init a5f2c63c9c081cc0013e9b194e95f45a75976e875baa5428eaad9ba2f1138dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2023-12-16T20:20:21.888 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.607069092 +0000 UTC m=+0.173736148 container start a5f2c63c9c081cc0013e9b194e95f45a75976e875baa5428eaad9ba2f1138dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.31.3) 2023-12-16T20:20:21.888 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.630683618 +0000 UTC m=+0.197350672 container attach a5f2c63c9c081cc0013e9b194e95f45a75976e875baa5428eaad9ba2f1138dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2023-12-16T20:20:22.189 INFO:journalctl@ceph.osd.4.smithi141.stdout:Dec 16 20:20:21 smithi141 podman[162238]: 2023-12-16 20:20:21.887160509 +0000 UTC m=+0.453827572 container died a5f2c63c9c081cc0013e9b194e95f45a75976e875baa5428eaad9ba2f1138dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2023-12-16T20:20:22.199 DEBUG:teuthology.orchestra.run.smithi141:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.4.service' 2023-12-16T20:20:22.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:20:22.240 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-16T20:20:22.240 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-16T20:20:22.241 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.5 2023-12-16T20:20:22.477 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 systemd[1]: Stopping Ceph osd.5 for 56b1cbe2-9c4e-11ee-95a5-87774f69a715... 2023-12-16T20:20:22.745 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:22.524+0000 7f64cfc8f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T20:20:22.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:22.524+0000 7f64cfc8f700 -1 osd.5 78 *** Got signal Terminated *** 2023-12-16T20:20:22.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:22.524+0000 7f64cfc8f700 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T20:20:22.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:22.564+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:22.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:22 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:22.564+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:23.745 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:23 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:23.515+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:23.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:23 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:23.515+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:24.745 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:24 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:24.483+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:24.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:24 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:24.483+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:25.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:25 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:25.449+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:25.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:25 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:25.449+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:26.745 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:26 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:26.462+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:26.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:26 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:26.462+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:27.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:27 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:27.482+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2023-12-16T20:19:52.107202+0000 front 2023-12-16T20:19:52.107144+0000 (oldest deadline 2023-12-16T20:20:16.806913+0000) 2023-12-16T20:20:27.746 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:27 smithi141 ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5[156950]: 2023-12-16T20:20:27.483+0000 7f64ca286700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2023-12-16T20:19:56.807349+0000 front 2023-12-16T20:19:56.807362+0000 (oldest deadline 2023-12-16T20:20:21.507287+0000) 2023-12-16T20:20:28.164 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:27 smithi141 podman[162344]: 2023-12-16 20:20:27.912362471 +0000 UTC m=+5.438368478 container died 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, ceph=True) 2023-12-16T20:20:28.165 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162344]: 2023-12-16 20:20:28.054551209 +0000 UTC m=+5.580557223 container cleanup 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, org.label-schema.build-date=20231212, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2023-12-16T20:20:28.165 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 bash[162344]: ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5 2023-12-16T20:20:28.496 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162372]: 2023-12-16 20:20:28.162982514 +0000 UTC m=+0.247406893 container remove 8e6cb81195012a7edb5e7d782823801cb97ce5b1620c223052a7cf7c8cf803f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2023-12-16T20:20:28.886 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.521162455 +0000 UTC m=+0.062846828 container create 05d16f2bd5d4b1a9958818e710afbc73d15ee08499ab15aedef0914800170f25 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, io.buildah.version=1.31.3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2023-12-16T20:20:28.886 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.476032919 +0000 UTC m=+0.017717250 image pull e538bb48aa152d6b7faf38ac1e3989c9cce30a65d5a29d9af1a8b43a8f5cdf25 quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5 2023-12-16T20:20:28.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.596634218 +0000 UTC m=+0.138318551 container init 05d16f2bd5d4b1a9958818e710afbc73d15ee08499ab15aedef0914800170f25 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, ceph=True) 2023-12-16T20:20:28.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.603437417 +0000 UTC m=+0.145121737 container start 05d16f2bd5d4b1a9958818e710afbc73d15ee08499ab15aedef0914800170f25 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2023-12-16T20:20:28.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.629410578 +0000 UTC m=+0.171094923 container attach 05d16f2bd5d4b1a9958818e710afbc73d15ee08499ab15aedef0914800170f25 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2023-12-16T20:20:28.887 INFO:journalctl@ceph.osd.5.smithi141.stdout:Dec 16 20:20:28 smithi141 podman[162464]: 2023-12-16 20:20:28.881984773 +0000 UTC m=+0.423669109 container died 05d16f2bd5d4b1a9958818e710afbc73d15ee08499ab15aedef0914800170f25 (image=quay.ceph.io/ceph-ci/ceph@sha256:45cdc87ca300414c8899f73cd28f3b099dc14234a3689c0162531020ce800bc5, name=ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, RELEASE=wip-yuri8-testing-2023-12-15-0911-c7586e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.build-date=20231212) 2023-12-16T20:20:29.222 DEBUG:teuthology.orchestra.run.smithi141:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56b1cbe2-9c4e-11ee-95a5-87774f69a715@osd.5.service' 2023-12-16T20:20:29.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T20:20:29.262 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-16T20:20:29.263 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T20:20:50.457 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T20:21:00.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:21:00.563 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T20:21:00.592 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-16T20:21:00.594 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi038/crash 2023-12-16T20:21:00.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash -- . 2023-12-16T20:21:00.636 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T20:21:00.636 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now 2023-12-16T20:21:00.638 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi141/crash 2023-12-16T20:21:00.639 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash -- . 2023-12-16T20:21:00.664 INFO:teuthology.orchestra.run.smithi141.stderr:tar: /var/lib/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T20:21:00.665 INFO:teuthology.orchestra.run.smithi141.stderr:tar: Error is not recoverable: exiting now 2023-12-16T20:21:00.666 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-16T20:21:00.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-16T20:21:00.715 INFO:teuthology.orchestra.run.smithi038.stderr:grep: /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-16T20:21:00.717 INFO:tasks.cephadm:Compressing logs... 2023-12-16T20:21:00.717 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T20:21:00.759 DEBUG:teuthology.orchestra.run.smithi141:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T20:21:00.788 INFO:teuthology.orchestra.run.smithi141.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:: No such file or directory 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.eyrunj.log 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi141.log 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.eyrunj.log: /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T20:21:00.789 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.xhutny.log 2023-12-16T20:21:00.790 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi141.log: /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T20:21:00.790 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.xhutny.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T20:21:00.790 INFO:teuthology.orchestra.run.smithi141.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T20:21:00.790 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi141.cycgjd.log 2023-12-16T20:21:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-16T20:21:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T20:21:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T20:21:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.aofkae.log 2023-12-16T20:21:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi038.log 2023-12-16T20:21:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.aofkae.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T20:21:00.795 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi038.gdlrfj.log 2023-12-16T20:21:00.795 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi038.log: /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T20:21:00.795 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi038.gdlrfj.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T20:21:00.795 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.dbcjir.log 2023-12-16T20:21:00.804 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log: /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi141.cycgjd.log: 90.9% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T20:21:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T20:21:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.dbcjir.log: 90.9% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T20:21:00.828 INFO:teuthology.orchestra.run.smithi141.stderr: 88.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi141.cycgjd.log.gz 2023-12-16T20:21:01.000 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mgr.smithi038.gdlrfj.log.gz 2023-12-16T20:21:01.093 INFO:teuthology.orchestra.run.smithi141.stderr: 92.5% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi141.log.gz 2023-12-16T20:21:01.636 INFO:teuthology.orchestra.run.smithi038.stderr: 90.7% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mon.smithi038.log.gz 2023-12-16T20:21:05.080 INFO:teuthology.orchestra.run.smithi038.stderr: 94.9% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.dbcjir.log.gz 2023-12-16T20:21:05.380 INFO:teuthology.orchestra.run.smithi141.stderr: 95.0% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.eyrunj.log.gz 2023-12-16T20:21:05.543 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T20:21:06.079 INFO:teuthology.orchestra.run.smithi141.stderr: 93.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T20:21:06.091 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T20:21:06.157 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T20:21:06.380 INFO:teuthology.orchestra.run.smithi141.stderr: 93.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T20:21:08.074 INFO:teuthology.orchestra.run.smithi141.stderr: 93.3% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T20:21:47.198 INFO:teuthology.orchestra.run.smithi038.stderr: 92.9% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi038.aofkae.log.gz 2023-12-16T20:21:47.199 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-12-16T20:21:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m46.426s 2023-12-16T20:21:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:user 1m5.187s 2023-12-16T20:21:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m1.920s 2023-12-16T20:21:47.332 INFO:teuthology.orchestra.run.smithi141.stderr: 93.1% -- replaced with /var/log/ceph/56b1cbe2-9c4e-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi141.xhutny.log.gz 2023-12-16T20:21:47.333 INFO:teuthology.orchestra.run.smithi141.stderr: 2023-12-16T20:21:47.333 INFO:teuthology.orchestra.run.smithi141.stderr:real 0m46.560s 2023-12-16T20:21:47.334 INFO:teuthology.orchestra.run.smithi141.stderr:user 1m7.336s 2023-12-16T20:21:47.334 INFO:teuthology.orchestra.run.smithi141.stderr:sys 0m2.226s 2023-12-16T20:21:47.334 INFO:tasks.cephadm:Archiving logs... 2023-12-16T20:21:47.334 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi038/log 2023-12-16T20:21:47.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T20:21:56.365 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi141/log 2023-12-16T20:21:56.366 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T20:22:05.954 INFO:tasks.cephadm:Removing cluster... 2023-12-16T20:22:05.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 --force 2023-12-16T20:22:06.536 DEBUG:teuthology.orchestra.run.smithi141:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 --force 2023-12-16T20:22:07.135 INFO:tasks.cephadm:Removing cephadm ... 2023-12-16T20:22:07.136 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T20:22:07.154 DEBUG:teuthology.orchestra.run.smithi141:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T20:22:07.170 INFO:tasks.cephadm:Teardown complete 2023-12-16T20:22:07.171 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T20:22:07.182 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T20:22:07.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T20:22:07.198 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T20:22:07.292 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T20:22:07.303 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T20:22:07.304 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:22:07.307 DEBUG:teuthology.orchestra.run.smithi141:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:22:07.319 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:22:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 -240us[ -240us] +/- 71ms 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 +281us[ +302us] +/- 60ms 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -46us[ -46us] +/- 75ms 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:22:07.327 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:22:07.327 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-12-16T20:22:07.327 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 -223us[ -205us] +/- 71ms 2023-12-16T20:22:07.328 INFO:teuthology.orchestra.run.smithi141.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 +277us[ +296us] +/- 60ms 2023-12-16T20:22:07.328 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -36us[ -36us] +/- 75ms 2023-12-16T20:22:07.328 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:22:07.328 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T20:22:07.380 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T20:22:07.381 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T20:22:07.468 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T20:22:07.592 DEBUG:teuthology.orchestra.run.smithi141:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T20:22:07.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:22:07.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:22:07.731 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:22:07.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:22:07.765 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T20:22:07.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T20:22:07.788 INFO:teuthology.task.internal:Duration was 1525.598807 seconds 2023-12-16T20:22:07.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T20:22:07.799 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T20:22:07.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T20:22:07.802 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T20:22:07.849 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:22:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:22:08.175 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T20:22:08.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2023-12-16T20:22:08.176 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T20:22:08.196 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi141.front.sepia.ceph.com 2023-12-16T20:22:08.196 DEBUG:teuthology.orchestra.run.smithi141:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T20:22:08.222 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T20:22:08.223 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T20:22:08.238 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T20:22:08.292 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T20:22:08.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T20:22:08.311 DEBUG:teuthology.orchestra.run.smithi141:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T20:22:08.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T20:22:08.873 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T20:22:08.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T20:22:08.905 DEBUG:teuthology.orchestra.run.smithi141:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T20:22:08.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T20:22:08.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:22:08.947 DEBUG:teuthology.orchestra.run.smithi141:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:22:08.974 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2023-12-16T20:22:08.998 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = core 2023-12-16T20:22:09.014 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:22:09.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:22:09.049 DEBUG:teuthology.orchestra.run.smithi141:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:22:09.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:22:09.068 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T20:22:09.094 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T20:22:09.095 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi038 2023-12-16T20:22:09.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T20:22:09.149 DEBUG:teuthology.misc:Transferring archived files from smithi141:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733/remote/smithi141 2023-12-16T20:22:09.149 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T20:22:09.189 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T20:22:09.189 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T20:22:09.192 DEBUG:teuthology.orchestra.run.smithi141:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T20:22:09.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T20:22:09.252 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T20:22:09.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T20:22:09.264 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T20:22:09.264 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T20:22:09.267 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T20:22:09.279 INFO:teuthology.orchestra.run.smithi038.stdout: 265402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 20:22 /home/ubuntu/cephtest 2023-12-16T20:22:09.291 INFO:teuthology.orchestra.run.smithi141.stdout: 265883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 20:22 /home/ubuntu/cephtest 2023-12-16T20:22:09.292 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T20:22:09.304 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T20:22:09.395 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T20:22:09.423 DEBUG:teuthology.nuke:shortname: smithi038 2023-12-16T20:22:09.423 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:22:09.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:48:44.654635', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8v1Jgn/nZVH/N5Qz9KuKdh34aRS5qOo9LGdTBj0EwZ6eJgxWCJwIRWEFKEh2W+FDyukpTHxc0eSn8X7QZa1Sw='} 2023-12-16T20:22:09.454 DEBUG:teuthology.nuke:shortname: smithi141 2023-12-16T20:22:09.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:22:09.480 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:48:44.652601', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLiKQTDHBYEzKcxypmORXCjwT2fuHh1L/8O+SG5MMQZC5GJMddrFWo9/G2oTfLKMMzTXxOurIl/wZ+ABfXw5nS0='} 2023-12-16T20:22:09.506 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-16T20:22:09.507 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:22:09.530 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-16T20:22:09.530 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:09.548 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-16T20:22:09.548 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:22:09.568 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T20:22:09.572 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-16T20:22:09.572 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:09.596 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T20:22:13.569 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:13.598 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:13.679 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T20:22:13.709 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T20:22:17.681 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:17.710 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:17.792 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T20:22:17.821 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-16T20:22:17.922 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-16T20:22:21.796 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:22:21.907 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-16T20:22:22.007 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-16T20:22:22.113 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1525.5988073349 failure_reason: 'Command failed on smithi038 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56b1cbe2-9c4e-11ee-95a5-87774f69a715 -e sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7d88989a8dec406daafb94668b5dc45f status: fail success: false 2023-12-16T20:22:22.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:22:22.206 INFO:teuthology.run:FAIL